The Information Machine
Concluded·Day 2·in the edition since 27 Aug 2026·5 sources·updated 28 Aug 2026

Qwen3.8-Flash and Qwen4 architecture preview

The gist

Alibaba releases Qwen3.8-Flash, 125B open-weight MoE previewing Qwen4

The release makes a 125B-parameter multimodal MoE model available as open weights with broad same-day inference framework support. The offloadable N-gram embedding table and sparse activation pattern allow the model to run locally on hardware with 75GB of RAM, and Qwen frames it as a preview of the Qwen4 architecture design.

The full picture

Qwen3.8-Flash and Qwen3.8-Flash-Next launched August 26, 2026 as open-weight models and early previews of the forthcoming Qwen4 architecture. Both are available via API on QwenCloud; Qwen3.8-Flash became available on OpenRouter on August 27. Alibaba also released an FP8 variant of Qwen3.8-Flash-Next alongside the main weights.

The models carry 125B total parameters plus a 51B N-gram embedding table, with only 6B parameters activating per token. The architecture uses GDN and QSA as a hybrid attention mechanism, gated residual connections providing four information-passing lanes between layers instead of one, and the Muon optimizer for training. The N-gram table is designed to sit in host memory with async prefetch rather than GPU memory, and only a quarter of the model's layers maintain a growing KV cache. The model supports a 262K native context window extensible to 1M tokens via YaRN.

Qwen states the model was trained at 1/9 the cost of Qwen3.7-Plus while outperforming it, with particular gains in coding and office tasks. Cited benchmarks include 62.5 on SWE-bench Pro, 84.5 on AndroidWorld, 58.7 on DeepSWE 1.1, and 95.7 on MathVision. UnslothAI stated the model outperforms Claude Opus 4.6 (Max). The QwenCloud API is priced at $0.16/1M input tokens and $0.47/1M output tokens.

SGLang, vLLM, UnslothAI, and TokenSpeed all provided day-0 infrastructure support. UnslothAI's GGUF quantizations enable local execution on 75GB of RAM. The release reached the top of Hacker News with 272 points.

How it developed
27 August 2026

Alibaba's Qwen team released Qwen3.8-Flash and Qwen3.8-Flash-Next on August 26 as open-weight previews of the Qwen4 architecture, with an FP8 variant also open-sourced at launch.

The 125B-parameter models activate only 6B per token, add Qwen Sparse Attention, gated residual connections, and a 51B N-gram embedding table that offloads to host RAM; Qwen reports training cost one-ninth that of Qwen3.7-Plus. Same-day support arrived from SGLang, vLLM, UnslothAI, and TokenSpeed; the QwenCloud API starts at $0.16 per million input tokens, and the release topped Hacker News with 272 points.

Qwen3.8-Flash became available on OpenRouter on August 27, adding a second API platform beyond QwenCloud for Alibaba's 125B mixture-of-experts model, released August 26 as an early Qwen4 architecture preview.

OpenRouter describes it as supporting coding assistants, agentic workflows, long-video understanding, visual understanding, document analysis, and chart reading. Simon Willison also tested quantized versions on a DGX Spark using Unsloth quantizations, finding the UD-Q2_K_XL quantization at xhigh reasoning effort his preferred output.

First citedQwen Twitter
Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free