The Information Machine
Concluded·Day 7·in the edition since 2 Oct 2026·2 sources·updated 8 Oct 2026

Open-weight models approaching frontier performance

The gist

Kimi K3 and Local Models Score Near Closed-Model Leaders on Benchmarks

Open-weight models running on consumer hardware are reaching capability levels previously associated only with top commercial APIs. The largest open-weight release to date scored within half a point of the leading closed model on Terminal-Bench 2.1.

The full picture

Moonshot AI released Kimi K3 on July 27, 2026, a 2.8 trillion parameter mixture-of-experts open-weight model with a 1 million token context window and native vision support, scoring 88.3 on Terminal-Bench 2.1, placing it near GPT-5.6 Sol (88.8) and above Claude Fable 5 (84.6). On local hardware, Qwen3.8-27B succeeded on 167 of 169 arithmetic attempts with reasoning enabled, with reasoning traces showing explicit column-by-column addition with carry operations. Writing in September 2026, Simon Willison described Qwen3.6-35B running on a personal laptop as producing better SVG art than Claude Opus 4.7, and wrote of Qwen 3.8 27B: 'I thought I'd have to wait five years and spend ten thousand dollars on hardware to get results even half as good as this one.'

How it developed
9 October 2026

Analysis found Qwen-Image-2.1-Turbo model card contains no evaluation scores or benchmark results

7 October 2026

Microsoft demonstrated DeepSeek V4 Flash, a 284-billion-parameter open-weight model, running locally on a Windows PC on October 7.

Quantizing to 1.6 bits reduced the memory requirement to roughly 60GB, within reach of the Surface Laptop Ultra's up to 128GB of unified memory on Nvidia's RTX Spark chip. Microsoft published a full demo video on the Windows YouTube channel.

6 October 2026

NVIDIA reported 89% of telecom operators consider open source models important and launched a 30B telecom-tuned Nemotron model; SoftBank, AT&T, and Indosat cited building on open foundations

5 October 2026

Together AI released Together Link, integrating open models GLM 5.3 and Kimi K3 into coding agent workflows with claimed 50%+ cost reduction

4 October 2026

Willison found Qwen3.8-27B correct on 167 of 169 arithmetic attempts with reasoning enabled on October 5, where GPT-4o failed many in its original experiment.

On October 6, Fastino.ai reported GLM-5.2 and Kimi K3 reach 85-95% of a frontier model's intelligence score at 17-35% of the cost, the quality gap roughly three benchmark points and the price gap 3x to 6x; MindStudio put open-weight inference at 10-15x cheaper than frontier APIs.

First citedSimon Willison
3 October 2026

On October 4, Friedberg cited Stanford data showing the closed-to-open performance gap at about 3.3%, with open-weight downloads growing from 339 million in March 2025 to over 2 billion by March 2026, Qwen alone near 1 billion.

Simon Willison separately assessed Qwen 3.8 27B, a 17 GB download, as the first local model he found nearly competitive with frontier models, and Qwen3.6-35B on a laptop as producing SVG art better than Claude Opus 4.7. Friedberg argued that weights distributed across thousands of computers are now beyond the reach of export controls.

2 October 2026

Local Qwen models and GLM-5.3 attack risks

Alibaba released Qwen-Image-2.1 on October 2, extending open-weight local models from text reasoning into image generation and editing on consumer NVIDIA hardware.

That same day, webAI's TwIL-LM3-Pro, a 3.66B model that runs as a 2.09 GiB llama.cpp file on CPU or local GPU, outscored VibeThinker-3B by approximately 35% on formal logic and reached 95.4% on BIG-Bench Hard's logic subset, pushing competitive on-device performance into the sub-4B parameter range.

First in the edition · 2 October 2026
1 October 2026

Simon Willison reported on October 1 that Qwen3.6-35B, run on a laptop, outperformed Claude Opus 4.7 on SVG image generation, and that Qwen 3.8 27B, a 17 GB download, was the first local model he felt was nearly competitive with frontier systems, though its default high-reasoning mode can take 21 minutes per query.

Separately, Anthropic reported that Z.ai's open-weight GLM-5.3 can produce functional cyberattacks and that simple jailbreak techniques were sufficient to bypass its safety guardrails.

First citedSimon Willison
27 September 2026

Willison described Qwen3.6-35B on a laptop outperforming Claude Opus 4.7 on SVG art generation, and called Qwen 3.8 27B years ahead of expectations.

26 September 2026

Milk Road AI argued that open-weight model proliferation has made AI containment debate largely moot, citing PrismML compression and a 280-fold drop in inference costs.

16 September 2026

Dario Amodei published a governance proposal including embedded third-party evaluators, industry coordination mechanisms, and eventual international limits.

4 August 2026

Cline reported V4 Pro at 80.6% on SWE-bench Verified and DeepSeek's updated model at 82.7 on Terminal-Bench 2.1

20 July 2026

Fastino.ai reported GLM-5.2 at 85% and Kimi K3 at 95% of Fable 5's intelligence score at 17% and 35% of the cost respectively

2 July 2026

MindStudio wrote that open-weight models Qwen 2.5, DeepSeek R1, and GLM-4 have made the choice between open and closed models genuinely hard for agent developers

29 June 2026

FLUX.2 model family coverage published, noting 32B FLUX.2 [dev] runs on single consumer high-VRAM GPU

27 June 2026

OpenRouter reported open-weight models have maintained a 3-6 month capability gap behind frontier labs for over 18 months

Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free