Analysis of agent inference workloads: long repeated prefixes and short outputs make KV-cache reuse more critical than raw token throughput
OpenAI Pro plan pricing overhaul
OpenAI Halves $200 Pro Plan Limits, Adds $500 Tier
The restructuring directly cuts what $200/month Pro subscribers receive, and the compute cost data suggests the economics of flat-rate AI subscriptions are under pressure. The SemiAnalysis comparison quantifies a gap in value between OpenAI and Anthropic plans for heavy agent users.
The full picture
OpenAI paused new Pro plan sign-ups on September 10 due to demand for GPT-6 Astra straining compute capacity, then reopened the plan at DevDay on September 29 with usage cut from 20x to 10x the Plus plan baseline. The restructured $200 plan caps chat users at 100 Pro messages per week and permanently removes the five-hour usage limit; affected subscribers received a one-time $2,500 in API credits expiring at year-end. A new $500 Pro 500 plan offers 25x base usage and Ultrafast access. OpenAI attributed the cuts to more efficient models, though some users are skeptical and see it as benefiting Anthropic ahead of its IPO.
The pricing changes coincide with data on rapidly growing internal compute costs. An Epoch AI report found that the median OpenAI researcher consumed $601 of coding-agent inference per day at API list prices by mid-August 2026, up from under $1 per day in January 2026, with usage doubling roughly every month. At that growth rate, per-researcher spend would reach approximately $185 million per year within another year; list-price figures do not reflect what OpenAI actually pays for inference internally. OpenAI agents log 3.1 agent-workdays for every human workday.
A SemiAnalysis comparison cited by The Neuron estimates that Claude Max at $200 per month provides over 5x the API-equivalent usage value of ChatGPT Pro at the same price for heavy agent users, measuring raw model usage value at API rates rather than model intelligence or benchmark scores.
How it developed
Analysis published October 11 citing a16z data argues that flat-rate and per-seat subscriptions are becoming structurally unsustainable because AI agents consume nearly 5x the tokens humans do, a ratio that grew 14x in six months.
Agents working around the clock remove the natural usage cap that human prompting speed provided, pointing vendors toward consumption-based metering. The data frames OpenAI's September 29 decision to halve Pro plan usage and add a $500 tier as part of a broader breakdown in subscription economics.
On October 10, Pine released a cloud computing environment designed for AI agent workloads, claiming roughly 1/20th the model-token cost of GPT-5.6 Sol with Codex on SaaS-Bench v1.1 and a 78.3% checkpoint score on that benchmark, with preliminary internal tests showing 2 to 5 times faster execution than alternatives.
The release adds an infrastructure option to the compute-cost pressure that drove OpenAI to halve Pro plan usage and add a $500 tier at DevDay on September 29.
Broadcom reported to be arranging $50B+ in financing for OpenAI custom chips under the Nexus program, targeting close before end of 2026
Internal OpenAI data published October 6 shows its median researcher consuming more than $600 in tokens daily and AI agents logging 3.1 workdays per human workday, adding concrete figures to the cost pressures behind OpenAI's September 29 decision to halve Pro plan limits and add a $500 tier.
NVIDIA separately published that GPT-6 Astra Ultrafast, which powers that tier, delivers up to 8x faster token generation than standard Astra mode on Blackwell GPUs, available now via the OpenAI API.
Epoch AI report: median OpenAI researcher consumed $601 of coding-agent inference per day by mid-August, up from under $1 in January, doubling roughly every month
Simon Willison published argument for hard budget caps as default on pay-by-usage services
Goldman Sachs projected on October 2 that monthly AI agent token use could reach 120 quadrillion by 2030, with per-token costs expected to fall 60-70% per year, adding analyst scale to the compute cost pressure around OpenAI's October 1 decision to halve Pro plan usage limits and add a $500/month tier.
Meta, Microsoft, and Uber reversed AI adoption mandates after agentic workflows drove per-user costs to roughly $1,000 per day, and Epoch AI found AI access costs fell about 47% per quarter over three years.
Analysis frames the pricing changes as evidence of a compute bottleneck, citing OpenAI's $10 million weekend spend on Navier-Stokes equations
On October 7, Qualcomm CEO Cristiano Amon projected that global token demand will grow 40x by 2030, from 31.7 billion to 1.27 trillion tokens every 10 seconds, as AI shifts from human-paced to agent-paced activity, adding industry-scale context to the compute pressure behind OpenAI's September 29 decision to halve Pro plan limits and add a $500 tier.
A separate analysis the same day found that agentic workloads push demand beyond GPU inference toward CPUs, memory, networking, and broader data-center infrastructure, making always-on agents structurally costlier than chatbot use.
Analysis published noting enterprise tokenmaxxing mandates reversed at Meta, Microsoft, and Uber as agent costs hit $1,000/day
Jensen Huang told CNBC a 1-gigawatt NVIDIA AI factory costs $50-60B but can generate ~$50B in annual rental revenue.
Morningstar noted multiple potential revenue streams for Muse including transaction fees, subscriptions, advertising, and enterprise revenue
Satya Nadella said the value creation opportunity in the agent world is 10X greater than prior software eras
Sources
- OpenAI pricing hikes signal AI industry compute bottleneck
Want this in your inbox?
I send one email each morning with the stories that moved. If you would rather just read here, that works too.
Subscribe free