The Information Machine
Following·since 26 Aug 2026·Day 3·9 sources·updated 28 Aug 2026

Qwen3.8-Flash and Qwen4 architecture preview

The gist

Alibaba releases Qwen3.8-Flash, 125B open-weight MoE previewing Qwen4

The release makes a 125B-parameter multimodal MoE model available as open weights with broad same-day inference framework support. The offloadable N-gram embedding table and sparse activation pattern allow the model to run locally on hardware with 75GB of RAM, and Qwen frames it as a preview of the Qwen4 architecture design.

The full picture

Qwen3.8-Flash and Qwen3.8-Flash-Next launched August 26, 2026 as open-weight models and early previews of the forthcoming Qwen4 architecture. Both are available via API on QwenCloud; Qwen3.8-Flash became available on OpenRouter on August 27. Alibaba also released an FP8 variant of Qwen3.8-Flash-Next alongside the main weights.

The models carry 125B total parameters plus a 51B N-gram embedding table, with only 6B parameters activating per token. The architecture uses GDN and QSA as a hybrid attention mechanism, gated residual connections providing four information-passing lanes between layers instead of one, and the Muon optimizer for training. The N-gram table is designed to sit in host memory with async prefetch rather than GPU memory, and only a quarter of the model's layers maintain a growing KV cache. The model supports a 262K native context window extensible to 1M tokens via YaRN.

Qwen states the model was trained at 1/9 the cost of Qwen3.7-Plus while outperforming it, with particular gains in coding and office tasks. Cited benchmarks include 62.5 on SWE-bench Pro, 84.5 on AndroidWorld, 58.7 on DeepSWE 1.1, and 95.7 on MathVision. UnslothAI stated the model outperforms Claude Opus 4.6 (Max). The QwenCloud API is priced at $0.16/1M input tokens and $0.47/1M output tokens.

SGLang, vLLM, UnslothAI, and TokenSpeed all provided day-0 infrastructure support. UnslothAI's GGUF quantizations enable local execution on 75GB of RAM. The release reached the top of Hacker News with 272 points.

How it developed
28 August 2026

Qwen3.8-Flash became available on OpenRouter on August 27, adding a second API platform beyond QwenCloud for Alibaba's 125B mixture-of-experts model, released August 26 as an early Qwen4 architecture preview.

OpenRouter describes it as supporting coding assistants, agentic workflows, long-video understanding, visual understanding, document analysis, and chart reading. Simon Willison also tested quantized versions on a DGX Spark using Unsloth quantizations, finding the UD-Q2_K_XL quantization at xhigh reasoning effort his preferred output.

27 August 2026

Qwen3.8-Flash becomes available on OpenRouter

Alibaba's Qwen team released Qwen3.8-Flash and Qwen3.8-Flash-Next on August 26 as open-weight previews of the Qwen4 architecture, with an FP8 variant also open-sourced at launch. The 125B-parameter models activate only 6B per token, add Qwen Sparse Attention, gated residual connections, and a 51B N-gram embedding table that offloads to host RAM; Qwen reports training cost one-ninth that of Qwen3.7-Plus. Same-day support arrived from SGLang, vLLM, UnslothAI, and TokenSpeed; the QwenCloud API starts at $0.16 per million input tokens, and the release topped Hacker News with 272 points.

26 August 2026

Simon Willison tests quantized versions on a DGX Spark; UnslothAI GGUF quantizations enable 75GB-RAM local execution

Sources
4 more sources
The daily email

Want this in your inbox?

I send a short email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free