Addis PulseStudio

Inclusion AI Ships Ling-3.1-Flash: 560B MoE, 25B Active, MIT-Licensed, 1M Context

A 48-hour dual release drops a base and an instruct checkpoint of a hybrid-linear MoE model whose 7:1 KDA-to-MLA ratio is the actual engineering story behind the 1M context window.

4 min read907 words

What happened

Inclusion AI published two checkpoints of Ling-3.1-flash to Hugging Face within 48 hours: a BF16 base model on 25 October and an instruct checkpoint with a 1M-token context window on 27 October 2026. Both are 560B-parameter Mixture-of-Experts models with 25B active parameters per token, both MIT-licensed.

Context

Inclusion AI, an Ant Group spin-off, flagged Ling-3.1-flash as "coming soon" roughly five days before the weights appeared, per r/LocalLLaMA reports. The model follows the sparse-MoE pattern set by DeepSeek, Mixtral, and Qwen: large total parameters, small active subset per token. The departure is architectural. Instead of full-softmax attention in every layer, 63 of 72 use a linear-attention variant (KDA), interleaved with 9 Gated Multi-head Latent Attention layers. That 7:1 ratio is the design choice the rest of the model is built around.

How it works

560B total parameters, 25B active per token via 512 routed experts (8 activated plus 1 shared per token). The transformer stack is 63 KDA layers and 9 Gated MLA layers in a 7:1 ratio, plus 4 dense layers, 64 attention heads, hidden size 4096.

KDA is a linear-attention mechanism: per-token cost scales linearly with sequence length rather than quadratically as in standard softmax attention. That is the engineering reason the -1019 instruct checkpoint carries a 1M-token context window without a KV-cache footprint that dwarfs the model weights.

The base checkpoint is BF16, produced after a Warmup-Stable-and-Merge pass, intended for continued pretraining. The -1019 adds the 1M context window and post-training optimisation, and carries an FP8 tag on the model card.

Serving requires at minimum 4×GB300 (TP4, EP4) or 8×H200 (TP8, EP8). SGLang with MTP speculative decoding and vLLM are the documented engines. Two Hopper-specific environment flags deliver roughly 10% faster batch-1 decode on H100/H200-class hardware.

Our read

The architectural bet is buried under the spec tables. Sixty-three of seventy-two layers use linear attention instead of full softmax. A 560B full-attention model at 1M tokens would need a KV cache that dwarfs the weights. By making 87.5% of the stack linear, Inclusion AI trades per-token recall fidelity — the 9 Gated MLA layers preserve full attention where it matters — for a context window standard MoE designs cannot reach at this parameter count. The 7:1 ratio is not aesthetic; it is the minimum Gated MLA coverage that keeps retrieval acceptable while KDA layers carry the long-range workload.

The 48-hour release gap between base and instruct tells you where the product is. Most labs space these weeks apart because post-training is the long pole. A two-day gap means -1019 was already baked before the base hit the hub. The base is the research artifact; the instruct model is the product.

Benchmark movement: AA Intelligence Index 41 to 44, AutomationBench-AA 62% to 68%, CritPt 18% to 26%. The CritPt gain is the most significant — 8 absolute points on a critical-thinking benchmark at 25B active parameters is the kind of result that changes which model you route a reasoning step to. The story is not new SOTA. It is 25B active parameters doing work that previously needed a larger active set, and for an API caller paying per token, that efficiency gap is where the cost curve bends.

For a studio on one or two RTX 4090s, this changes nothing locally. The MIT licence removes contractual friction from API-generated text in shipped product, but it does not make a 560B MoE model runnable on a workstation.

What this changes

Nothing changes in the local inference stack on Monday. The minimum documented deployment is 4×GB300 or 8×H200 with expert parallelism — datacentre-class, not a studio rack.

What does change for a studio already paying for a general-purpose LLM API for script drafting or prompt generation: the OpenRouter endpoint linked on the model card (inclusionai/ling-3.1-flash) is a new option to benchmark. The 1M context window means a full feature script plus its storyboard fits in one call without chunking. The MIT licence means that generated text can ship in a client deliverable without a separate commercial-use negotiation.

The tradeoff is integration. The 'custom_code' and 'bailing_hybrid' tags mean no off-the-shelf ComfyUI text-node exists. Any local path requires building a SGLang or vLLM microservice behind an OpenAI-compatible endpoint and wiring it into ComfyUI's API-node layer. For most small studios, the API route is the realistic one.

License

Both checkpoints list MIT on their Hugging Face model cards. MIT is permissive: commercial use, modification, and redistribution are permitted with attribution. There is no revenue ceiling, no enterprise-gating clause, no research-only restriction. The sources do not include a separate licence-file excerpt, so if your legal review requires the full text, pull it from the model repository directly.

Key takeaways

  • 560B total / 25B active MoE, 512 experts (8+1 activated), 63 KDA + 9 Gated MLA layers at a 7:1 ratio.
  • 1M-token context window on the -1019 instruct checkpoint, enabled by linear attention in 63 of 72 layers.
  • MIT licence on both checkpoints: commercial use permitted, no stated ceiling or restriction.
  • Minimum inference: 4×GB300 or 8×H200 with expert parallelism; not a local-workstation model.
  • Benchmark gains over predecessor: AA Intelligence Index 41→44, AutomationBench-AA 62%→68%, CritPt 18%→26%.

Sources

  1. inclusionAI/Ling-3.1-flash-base — text-generation on Hugging Face — tier 1
  2. inclusionAI/Ling-3.1-flash-1019 — text-generation on Hugging Face — tier 1
  3. inclusionAI/Ling-3.1-flash-1019 · Hugging Face — tier 3
  4. Ling-3.1-flash-1019 weights are out, and they released the base model too — tier 3
moellminferencearchitecture

How this post was made

Drafted from clustered primary sources by the models below, then read, edited and approved by a human before it was published. The sources are listed in full at the end of the article.

Drafted
Independent sources
4
cluster pair
clef:27b
cluster label
gemma4:12b
radar brief
gemma4:12b
research brief
qwen3.8:27b
draft article
qwen3.8:27b
short script
qwen3.8:27b
seo pack
gemma4:12b
Run
editorial-20261027T160538Z