Analysis
Analysis
The Token Burn Economy: Why AI Usage Limits Are Really Workflow Limits
Everyone blames the rate limits. The real bill is being run up by bad session architecture — and businesses are about to discover the same problem at ten thousand times the scale.
By The Memo · Saturday, June 20, 2026 · 11 min read
Every few weeks a new thread surfaces on Reddit and Hacker News: someone has hit their Claude or ChatGPT usage cap by lunchtime and they are, understandably, annoyed. The replies fall into two camps. One blames the lab — the limits are too tight, the pricing is greedy, the model is being deliberately throttled. The other camp, smaller and quieter, says something more interesting: you're not hitting a usage limit. You're hitting a workflow limit.
After watching hundreds of these sessions — our own, our readers', and the increasingly detailed write-ups people post when they get frustrated enough — the second camp is right. The single largest source of wasted tokens in 2026 is not the model, the prompt, or the context window. It is the correction chain: the long, accreting tail of "actually, make it shorter," "no, more formal," "undo that last part," that quietly reloads the entire prior conversation on every turn.
Here is the part that surprises almost everyone the first time they see it written down. When you send a follow-up message in a chat interface, the model does not remember the prior turns. The client does. Each new message replays the entire conversation — every prior user prompt, every prior assistant response, every system instruction — and bills you for the whole thing. The cost of a correction is not the cost of the correction. It is the cost of everything that came before it, plus the correction, plus the new response.
Subscribers only
Keep reading — it's free.
The Model Memo is a free daily newsletter. Drop your email to unlock the rest of this essay and get tomorrow's in your inbox. Always free, unsubscribe anytime.
Free daily newsletter. Unsubscribe anytime. No spam — ever.
Keep Reading