top of page

Simon Willison Spots the Tokenpocalypse as Enterprise AI Costs Break the Unlimited-Use Dream

Aug 12
12 min read

Simon Willison highlighted a telling enterprise AI conflict on August 7: employees can burn costly tokens while performing work that simpler software already handles. The example involved turning PDFs into images, markdown files, and presentation material. It sounds trivial, yet it exposes a serious budget problem.

According to audio obtained by 404 Media, Accenture leaders discussed rapidly increasing token consumption and the difficulty of connecting that usage to business value. One executive reportedly joked about PDF conversion being a major “token chewer.” The exchange captured the gap between encouraging employees to use AI and controlling what that encouragement costs.

The pressure now extends beyond Accenture. Companies adopted Claude, ChatGPT, Copilot, Codex, and AI agents as broadly useful productivity systems. They are discovering that unlimited experimentation creates a variable operating expense with no natural ceiling. The new contest is not AI adoption versus rejection. It is maximum usage versus measurable value.

Simon Willison Found the Perfect Token-Waste Story

A mundane PDF task became an unusually clear example of how enterprise AI spending escapes financial control.

Willison’s PDF warning drew attention to an anecdote from a June 24 investigation by 404 Media. The publication said it obtained audio from an internal Accenture discussion about rising AI consumption.

Justice Kwak, Accenture’s agentic AI strategy lead, reportedly said engineers were not the main drivers of some costly usage patterns. Non-engineers were responsible for many of the behaviors under discussion.

Stuart Henderson, an Accenture client group lead, then asked whether Kwak had converted a PDF into images before turning those images into markdown. Henderson reportedly called that process a major token chewer.

The exchange is funny because it describes an elaborate solution to an ordinary document problem. It is important because that solution can multiply work at every stage.

A PDF may contain selectable text, page images, charts, tables, headers, and layout instructions. An AI workflow can extract each page, inspect the images, reconstruct the text, interpret the layout, and produce a new format. Every model request adds input and output tokens.

If an agent repeats a failed extraction, checks its own answer, or calls another model, consumption rises again. A worker may only see a polished slide deck. The company sees a chain of metered inference requests.

Tokens are small units of data processed by a generative model. They represent portions of text and, depending on the system, information derived from images or other media. Organizations often pay according to how many tokens a model reads and generates.

This metering model differs from a conventional office-software license. Opening another document in a word processor usually does not create a new usage charge. Asking an AI agent to interpret that document can trigger several paid operations.

The employee does not need to understand that chain. Modern AI interfaces deliberately hide much of it. A request such as “turn this report into slides” can initiate extraction, planning, summarization, formatting, revision, and validation.

The result is a visibility problem. Workers judge the workflow by convenience and output quality. Technology leaders must judge it by cost, accuracy, security, and whether the output was worth producing.

The original investigation framed Accenture’s experience as part of a broader spending correction. Companies had pushed employees toward AI experimentation. Some were now considering controls because consumption was becoming unpredictable.

Accenture did not publicly authenticate every detail attributed to the private meeting. The leaked-audio account should therefore remain clearly attributed to 404 Media. However, the company’s later actions support the wider conclusion that token management has become a formal enterprise concern.

On July 29, Accenture announced a tokenomics offering designed to connect consumption with teams, workflows, products, decisions, and business outcomes. That timing turned the PDF anecdote into more than office comedy. It showed how quickly an internal cost problem can become a consulting category.

Falling Token Prices Are Not Lowering the Total Bill

AI becomes more expensive when usage grows faster than the unit cost falls.

The early enterprise pitch treated generative AI like another software rollout. A company would buy access, train employees, and spread usage across the organization. Greater adoption appeared to mean greater productivity.

Agentic AI changes that calculation. An agentic workflow is a system that plans steps, invokes tools, and revises its work with limited human direction. One employee request can become dozens of model interactions.

Gartner expects inference on extremely large language models to become much more efficient by 2030. Yet its inference forecast includes a crucial warning. Falling provider costs will not necessarily pass fully to enterprise customers.

Gartner also estimates that agentic models require five to 30 times more tokens per task than a standard chatbot. More capable systems can perform more actions, use longer contexts, and create more demand.

That creates the central reversal. Cheaper intelligence encourages companies to apply AI to more work. Each workflow then expands from one response into a sequence of searches, tool calls, evaluations, and corrections.

The same pattern has appeared in cloud computing. Lower prices for individual computing or storage units did not guarantee lower corporate bills. Easier access encouraged teams to deploy more services, retain more data, and automate more activity.

AI adds another complication because consumption can be nondeterministic. The same task does not always follow the same path. One agent might finish after three steps, while another retries tools or explores several alternatives.

McKinsey says token usage can vary by as much as 30 times for the same agentic coding task. Its enterprise spending analysis also describes AI costs scattered across cloud providers, model vendors, software platforms, experiments, and business units.

That fragmentation delays detection. A company may approve several reasonable purchases without seeing their combined effect. Cost overruns become visible after the tokens have already been consumed.

The bill also extends beyond tokens. Companies pay for data pipelines, retrieval infrastructure, evaluations, security reviews, monitoring, and employees who supervise unreliable outputs. A cheap model response can sit inside an expensive workflow.

Long context windows make the problem harder. A context window is the information a model receives during one interaction. Sending full documents, long chat histories, tool descriptions, and repeated reference material increases consumption before the model produces anything.

Document work illustrates this clearly. A system might resend the same report during extraction, analysis, drafting, and revision. Without caching or careful context selection, every stage processes overlapping information.

This is why Simon Willison’s example matters beyond PDFs. It turns an abstract discussion about AI token costs into a recognizable workflow. The user requests one result, but the infrastructure performs far more work.

Companies cannot solve this problem by watching the model vendor’s invoice alone. They need to identify the team, task, model, agent, and business result behind each unit of consumption.

That requirement makes AI cost management an operational discipline. It belongs beside security, reliability, and data governance, not inside an annual software-renewal meeting.

The People Under Pressure Are Not Just Engineers

Enterprise AI budgets now depend on thousands of employees making technical cost decisions through ordinary prompts.

Engineers understand that a model call consumes resources. They can inspect logs, shorten prompts, cache repeated content, and choose smaller models. Most knowledge workers were never expected to make those choices.

They see a chat box attached to familiar office work. The interface encourages natural language, iteration, and experimentation. It rarely explains the cost difference between rewriting a sentence and analyzing a collection of scanned documents.

That design creates a new kind of shadow spending. Employees do not need to enter payment details or deploy cloud infrastructure. They can increase corporate consumption simply by choosing a stronger model or repeating a request.

The Accenture anecdote suggests that non-engineers can drive substantial usage through document conversion and presentation work. That does not make those employees irresponsible. Their employers told them to use AI, while vendors designed the products to make usage effortless.

The conflict begins when companies reverse direction. Workers first hear that AI proficiency is essential. Later, they receive token limits, model restrictions, or warnings about unnecessary requests.

This can produce the wrong behavior. Employees may avoid valuable workflows because the rules are unclear. Others may keep using expensive models because nobody has defined what “valuable” means.

A better policy distinguishes tasks by expected outcome. Drafting a routine email does not need the same model as reviewing a complex engineering proposal. Extracting selectable text from a PDF does not always need visual reasoning.

Model routing can make that distinction automatically. A routing system sends simple requests to smaller, less costly models while reserving advanced systems for difficult tasks. It can also reject requests that traditional software handles better.

The Associated Press reported that companies are increasingly exploring such routing as tokenmaxxing loses favor. Its workplace cost report described businesses examining the returns from AI use and discouraging advanced models for routine work.

Routing still requires judgment. A short prompt can hide a high-risk task, while a long document may only need basic extraction. Companies need policies based on sensitivity, complexity, accuracy requirements, and expected value.

Procurement teams also face pressure. They must compare subscriptions, usage contracts, cloud services, and embedded AI features that meter activity differently. A predictable seat license can still contain usage caps or restrictions.

CIOs inherit the technical problem, but CFOs determine whether the expense deserves continued support. Business-unit leaders must explain what the tools produce. Security teams must track what information workers send to external models.

That shared accountability is new. Traditional software budgeting often assigns a license to a department. Enterprise AI requires organizations to connect each workflow to both consumption and an outcome.

The outcome cannot be “employees used more AI.” It must describe something the organization values, such as faster resolution, fewer defects, additional revenue, or less repetitive work.

Knowledge workers also need alternatives. A searchable knowledge base can reduce repeated document uploads when information already exists locally. Better retrieval can send only relevant passages instead of entire files.

The shift therefore affects workflow design as much as spending policy. Companies that simply impose token caps will reduce consumption. They will not necessarily identify which work should continue.

Maximum AI Usage Is Colliding With Measurable Value

The unlimited-use dream fails when activity becomes a substitute for evidence of productivity.

For several years, executives worried that employees were not adopting AI quickly enough. Companies funded pilots, distributed assistants, created training programs, and encouraged teams to find use cases.

That strategy made sense when adoption was the bottleneck. Few organizations knew where generative AI would work. Broad experimentation helped expose useful patterns.

The bottleneck has moved. Once thousands of workers can invoke advanced models, experimentation becomes a recurring operating expense. The question changes from “Are people using AI?” to “Which uses deserve to scale?”

Accenture’s response makes this transition explicit. Its tokenomics program promotes real-time monitoring, accountability, model matching, and cost per transaction.

The company describes a three-stage approach: see consumption, fix inefficient designs, and maintain controls as workloads change. That structure resembles cloud financial operations, but AI introduces more uncertainty around task quality and agent behavior.

The primary opponent is therefore not Accenture against a model vendor. It is the promise of frictionless AI abundance against the reality of accountable enterprise spending.

Maximum usage produces visible excitement. It creates prompt counts, generated documents, agent runs, and adoption dashboards. None of those metrics confirms that the organization gained corresponding value.

Measurable value is slower and less flattering. It requires comparison with a baseline. Teams must ask how long work took before AI, whether quality changed, and how much human checking remains necessary.

PDF conversion again provides the right test. If an AI workflow turns a report into slides, the company should compare it with conventional extraction and presentation tools. It should include correction time, factual errors, formatting repairs, and review.

The AI path can still win. A model may interpret an irregular report, identify themes, and draft a useful narrative faster than rigid software. The point is not that AI should never touch a PDF.

The point is that model use must earn its place. An agent that consumes more resources can be worthwhile when it completes more valuable work. A cheap workflow remains wasteful if nobody needs its output.

This distinction also challenges model vendors. Their products benefit when customers send longer contexts, perform more reasoning, and delegate more steps. Enterprise buyers benefit only when those steps improve an outcome.

Vendors are adding caching, batch processing, smaller models, and routing features. Those tools reduce waste, but they do not resolve the incentive mismatch. Providers still earn from consumption or broader adoption.

Companies need their own measurement layer. It should record requests, model selection, token volume, latency, failure rates, human intervention, and the business process involved.

They also need a stopping rule. An agent should not continue revising a low-value document because it can. Budgets, step limits, confidence thresholds, and approval gates can constrain open-ended work.

The same discipline applies to personal AI workflows. Repeatedly uploading the same sources wastes time and context. Systems that support knowledge blending can retrieve selected information without rebuilding the full context for every request.

Simon Willison has long focused on the practical behavior of language models, including their limits, costs, and security implications. His PDF observation fits that approach. The revealing details often appear in everyday implementation choices, not grand model announcements.

Token Controls Can Create Their Own Failure

A blunt spending crackdown can destroy useful experimentation while preserving the least visible forms of waste.

The case for cost control is strong, but the available evidence does not prove that non-engineers are the central cause of enterprise AI overspending. The Accenture comments came from a reported private discussion, not a published consumption audit.

A memorable PDF story can distort attention. Document conversion is easy to mock because the workflow sounds excessive. Expensive engineering agents can also consume large contexts, run tests, inspect repositories, and retry failed changes.

Those engineering tasks may produce more value, but companies still need evidence. A technical label does not make consumption efficient. Likewise, a nontechnical request can support important legal, sales, or research work.

Organizations should avoid turning token management into employee surveillance. Prompt logs can contain confidential work, personnel information, customer records, and preliminary ideas. Detailed monitoring creates security and privacy obligations.

Cost allocation can also discourage collaboration. If every department receives a strict token budget, teams may hide experiments or shift spending into tools that remain outside the central dashboard.

Hard limits create another risk. An agent might stop before completing a valuable task, leaving employees with partial work that still requires manual recovery. The organization saves tokens but loses the expected benefit.

Cheap-model routing can reduce spending while lowering quality. Smaller models may miss document details, mishandle tool instructions, or generate plausible errors. A workflow that needs repeated correction can cost more overall.

EY argues that tokens are only the most visible portion of agent economics. Its agent cost analysis includes infrastructure, governance, organizational change, failure recovery, and regulatory exposure.

That broader view matters because local optimization can move expenses elsewhere. Reducing model consumption might increase employee review time. Cutting evaluation runs can allow costly errors into production.

Companies should measure total workflow cost instead of celebrating lower token totals. They should also compare quality, speed, and risk before and after any intervention.

This is where the “tokenpocalypse” label can mislead. The problem is not that tokens suddenly became unaffordable everywhere. The problem is that rapid adoption exposed weak measurement and unclear ownership.

Some organizations will find that their AI programs remain economically attractive. Others will discover that employees automated work with little strategic value. Most will find both patterns inside the same company.

Unit costs will continue falling, and models will keep improving. Those trends weaken predictions of a permanent spending wall. They strengthen the case for governance because lower costs invite even greater consumption.

The skeptical conclusion is therefore narrower. Enterprises are not necessarily abandoning AI. They are moving from adoption targets toward allocation decisions, and those decisions remain difficult to evaluate.

The Next Three Signals Will Show Whether Tokenomics Works

The next phase will be judged by workflow-level returns, automatic model routing, and changes in enterprise purchasing behavior.

The first signal is whether companies report cost per completed business process instead of total token reduction. A useful metric might track one resolved support case, reviewed contract, completed software change, or finished research task.

This would strengthen the tokenomics argument because it connects spending with output. If companies only publish lower consumption, they may be suppressing use without improving productivity.

Watch how Accenture develops its own offering. Its approach promises visibility across workflows, owners, models, and agents. Evidence of repeatable customer outcomes would show that the internal concern identified by 404 Media became a workable management discipline.

The second signal is widespread automatic routing. Employees currently make many model choices through product menus or defaults. That places a technical cost decision in front of users who lack the information to evaluate it.

Effective routing would reserve advanced reasoning for tasks that require it. It would send simple extraction, classification, and rewriting work to smaller systems or conventional software.

The crucial measure is not routing frequency. It is whether routing preserves quality while lowering total workflow cost. High correction rates would weaken the case for aggressive model downgrades.

The third signal is a change in enterprise purchasing. Buyers may demand shared usage pools, detailed telemetry, enforceable budgets, caching controls, and contracts tied more closely to outcomes.

They may also favor products that process local information without repeatedly sending entire documents to frontier models. That would reward efficient context management rather than maximum token throughput.

If vendors respond with clearer controls and predictable consumption, the current backlash will look like a normal maturation cycle. Enterprise AI will continue expanding under stricter financial rules.

If costs remain opaque, companies will impose broader restrictions. That outcome would slow experimentation and increase demand for smaller, open-weight, or locally operated models.

Simon Willison’s observation gives readers a practical question for evaluating any AI workflow: what work is the model actually performing, and why does that work require this model?

Apply that question before sending another large document into an agent. Check whether text extraction, search, local processing, or a smaller model can complete the first stage. Reserve expensive reasoning for the parts that require judgment.

The tokenpocalypse is not the end of enterprise AI. It is the end of treating every generated output as evidence of progress. The companies that measure outcomes, control context, and route tasks deliberately will keep experimenting. Those that only count adoption will keep discovering the bill afterward.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page