top of page

Schools Spend Billions on AI Without Measurable Learning Gains

Sep 2
14 min read

Google News surfaced a blunt conflict on August 30: schools are buying AI tools, yet many cannot show measurable improvements in student learning.

The headline came through a MarketScale briefing, which summarized reporting about education technology procurement. Its message was sharper than the familiar debate about cheating or screen time. Schools are committing limited resources before vendors, districts, or researchers can reliably explain which products improve learning.

That creates a demanding test for AI in education. Districts must distinguish tools that save teachers time from tools that help students learn. Vendors must support their promises with independent evidence. Google News readers are seeing the purchasing boom collide with an accountability system that was never designed for software changing this quickly.

What the Google News Headline Actually Reveals

The important development is not simply that schools are buying AI. It is that procurement has moved faster than meaningful evaluation.

The MarketScale item summarized an education procurement report published in August 2026. District officials described a market crowded with products that promise personalization, faster planning, tutoring, assessment, and administrative relief.

Those functions do not produce the same kind of value. A system that drafts a parent email addresses teacher workload. A tutoring product makes a stronger claim because it seeks to change student knowledge or skills.

Districts often purchase both categories under the broad label of AI. That can blur the distinction between operational convenience and educational effectiveness. A teacher saving preparation time is valuable, but it does not establish that students understand fractions, write better arguments, or retain new concepts.

The phrase “spend billions” also requires context. It describes a wider education technology economy rather than a verified national total devoted only to generative AI subscriptions. Public reporting rarely separates AI features from larger software contracts, device programs, learning platforms, or cloud services.

That accounting problem matters. Many established products now include AI functions inside existing contracts. A district can therefore increase its exposure to AI without approving a clearly labeled AI purchase.

The reverse can also happen. A product marketed as an AI tutor might function mainly as a conversational interface over conventional instructional material. The label says little about instructional quality.

This makes school AI spending difficult to measure and even harder to evaluate. District leaders need to know what was purchased, who used it, how often they used it, and which outcome was expected to change.

Those questions sound basic. Yet software contracts frequently emphasize access, licenses, implementation, uptime, and support. They are less likely to define a credible learning target or specify how the district will measure it.

A usage dashboard cannot close that gap. Logins, prompts, generated lessons, and completed sessions are activity measures. They do not demonstrate that a student learned more than a comparable student without the product.

The Google News framing therefore exposes an evidence problem, not a verdict that every school AI tool has failed. Some tools have not been studied long enough. Others were deployed without a usable baseline or comparison group.

Still, missing evidence cannot be treated as positive evidence. When districts cannot name the outcome attached to a purchase, they also cannot determine whether renewal represents success, inertia, or fear of falling behind.

The market is moving in the opposite direction. Generative AI features are becoming easier to add, demonstrations look convincing, and product cycles are getting shorter. Evidence production remains slow because meaningful research requires careful implementation and enough time to observe learning.

That mismatch is the central event. Schools are being asked to make long-term educational judgments about products that can change between one semester and the next.

School AI Spending Is Pressuring Buyers and Vendors

District technology leaders now face pressure from both directions: adopt AI quickly, but prove that every classroom use deserves scarce instructional time.

The pressure to adopt comes from students, teachers, government initiatives, and workplace expectations. Students already encounter generative AI outside school. Teachers use it to create examples, revise materials, draft communications, and reduce repetitive work.

Federal policy has also encouraged responsible adoption. A 2025 education AI guidance document said existing grant funds could support instructional materials, tutoring, advising, and AI literacy.

That guidance did not tell districts to buy every available product. It connected allowable AI uses to improved outcomes, responsible deployment, privacy, and stakeholder engagement.

The distinction is essential. Permission to use public funds is not evidence that a particular product works. Federal encouragement can accelerate experimentation, but districts still carry responsibility for selecting, monitoring, and retiring tools.

Parents and teachers create pressure in the other direction. They want schools to explain why students need another digital system and what data it collects. They also want to know whether the system develops student thinking or replaces it.

That tension has become more visible after the pandemic-era expansion of classroom technology. Schools added devices, platforms, digital curricula, and remote learning services at exceptional speed. Many communities are now reassessing how much screen-based instruction students receive.

AI enters that environment with larger claims and more complex risks. A conventional worksheet application serves predetermined content. A generative system creates new responses, which can be inaccurate, inappropriate, or unexpectedly persuasive.

The product can also behave differently across prompts and users. That variability makes a one-time approval insufficient. Districts need ongoing monitoring, clear escalation paths, and rules for material model changes.

Procurement teams are not always staffed for that work. A district might have capable curriculum, legal, privacy, security, and technology specialists, yet lack a common review process across those functions.

Curriculum officials might ask whether a product reflects learning science. Security teams focus on account access and data handling. Lawyers examine contract language, while teachers judge classroom usefulness.

Every question matters, but passing one review does not compensate for failing another. A secure tool can be instructionally weak. An engaging tutor can mishandle student data. A time-saving assistant can produce biased or inaccurate material.

Vendors face a corresponding challenge. Fast adoption once rewarded broad claims, polished demonstrations, and easy onboarding. The next stage will reward companies that define narrower use cases and permit serious evaluation.

That means identifying the product’s intended user and expected effect. It also means separating claims about teacher efficiency from claims about student achievement.

A company can measure teacher time with structured diaries, task comparisons, and user studies. Learning claims require stronger designs, including appropriate assessments and meaningful comparison conditions.

Implementation data also matters. A product can show promising results in a controlled pilot and still disappoint across a district. Training, schedules, device access, student attendance, and teacher confidence influence what reaches the classroom.

The purchasing decision therefore extends beyond choosing a model. Districts are buying an intervention that includes software, professional development, curriculum alignment, support, safeguards, and local implementation.

Google News may package this conflict as a striking headline. For district leaders, however, the practical question is less dramatic: what evidence must exist before expansion or renewal?

The Promise Versus Reality Gap Is Widening

AI promises individualized support at software scale, but schools often receive generalized access without the instructional structure needed to improve learning.

Personalization is one of the market’s strongest promises. A system can respond immediately, adjust explanations, generate examples, and remain available after class. Those capabilities can help when they support a sound teaching strategy.

They can also create the appearance of learning. A student might finish an assignment faster because the system supplies an answer, rewrites a paragraph, or suggests the next calculation.

Completion and learning are not interchangeable. Learning requires students to build knowledge they can retrieve and apply without the same support. An effective tool must preserve enough productive effort for that process to occur.

A major experiment involving high school mathematics illustrates the problem. The researchers compared access to a general GPT interface with a more constrained tutoring design.

Students using AI performed better while assistance remained available. However, students with unrestricted access performed worse on an unassisted assessment than students who never received that access.

The published mathematics study reported a 17 percent reduction in unassisted performance for the general GPT condition. The constrained tutor reduced that harm by guiding students rather than simply supplying answers.

One experiment cannot settle the entire question of AI in education. It covered a defined subject, population, implementation, and assessment design. It does establish why product design matters.

The underlying model was not the only variable. The instructional guardrails determined whether assistance encouraged reasoning or bypassed it.

That distinction is uncomfortable for procurement. A district cannot evaluate a product only by asking which foundation model it uses. It must examine the learning experience built around that model.

Useful questions include whether the system asks students to explain their reasoning. Reviewers should also test whether it reveals answers too quickly, adapts to misconceptions, and checks understanding without relying on self-reported confidence.

The product should disclose what teachers can observe. If educators receive only aggregate usage statistics, they cannot tell whether students struggled productively or delegated the work.

A promising tutor also needs a defined curriculum relationship. It should know the instructional objective, expected prerequisite knowledge, and boundaries of the task. Generic conversation is not a substitute for that alignment.

Evidence can support carefully designed uses. The OECD education outlook concluded that generative AI can support learning when guided by clear teaching principles. It also described administrative applications that can reduce routine work.

That is a more precise claim than saying AI improves education. The benefit depends on who uses the system, for which task, under what conditions, and against which alternative.

The promise versus reality gap grows when marketing removes those conditions. A demo can show an AI tutor giving a polished explanation. It cannot show whether the student remembers the concept next month.

The same issue applies to teacher-facing products. Generated lesson plans can save time, but teachers still need to check accuracy, accessibility, standards alignment, and age appropriateness.

If review takes longer than creating the material directly, the efficiency claim weakens. If teachers skip review because they trust the interface, errors can reach students.

This does not make AI assistance useless. It means buyers must demand evidence for the exact claim being sold.

A product that reduces drafting time should be judged on workload, quality, and correction costs. A product that promises learning gains should be judged through assessments that measure independent performance.

School AI spending becomes wasteful when districts buy one kind of benefit and later defend it using another. High usage cannot rescue weak learning outcomes. Positive teacher sentiment cannot establish academic improvement.

The primary conflict is therefore not technology against education. It is broad AI promises against the narrower evidence required for responsible classroom decisions.

What the Numbers Still Cannot Prove

The current evidence base contains both promising results and serious warnings, but it does not justify a single verdict across every AI product.

Research on classroom AI remains uneven. Products differ in subject, age group, instructional design, model behavior, and teacher involvement. Studies also use different measures and time horizons.

A short pilot might measure engagement or immediate task performance. A stronger evaluation tests whether students retain knowledge and transfer it to unfamiliar problems.

The difference can change the apparent result. An assistant that improves answers during use might weaken independent performance later. Another tool might produce modest gains because it gives students more guided practice.

The lack of a universal answer is not a reason to stop evaluation. It is a reason to make claims narrower and studies more specific.

A nationally representative teacher survey from RAND documented early K-12 adoption patterns. It found that educators often focused on teacher-facing uses and workload support.

That evidence helps explain demand. It does not prove that the same tools improve student outcomes. Surveys describe behavior and perceptions, while causal studies estimate what changed because of an intervention.

Districts need both forms of information. Usage research shows whether a product fits daily work. Outcome research shows whether that fit produces the intended educational result.

Local evaluation can fill part of the gap, but weak evaluation can create false confidence. Comparing this year’s users with last year’s students might confuse product effects with changes in teachers, curriculum, attendance, or assessment difficulty.

Voluntary participation creates another challenge. Teachers who choose an AI pilot may have more technical confidence, stronger support, or different students than nonparticipants.

Even randomized studies require interpretation. Results from one setting do not automatically transfer to another district with different staffing, schedules, policies, or student needs.

The responsible response is not paralysis. Districts can use staged adoption, beginning with a defined problem and a limited group. They can establish a baseline before the product enters the classroom.

The evaluation should include the outcome promised by the vendor. It should also track unintended effects, such as reduced independent practice, increased teacher review, unequal access, or student confusion.

Privacy and security outcomes belong in the same process. A system that improves one academic measure while exposing sensitive student information is not a successful deployment.

Accessibility also requires direct testing. Products should work for students with disabilities, multilingual learners, and users relying on assistive technology. A broad claim about personalization does not demonstrate accessible design.

Cost analysis should include implementation time. Training, account management, troubleshooting, content review, policy development, and parent communication consume staff capacity.

These costs remain hidden when districts count only a contract. They also explain why a promising pilot can struggle during expansion.

The biggest uncertainty concerns long-term behavior. Students and teachers adapt to tools, while vendors update underlying models. Early results may change as novelty fades or features evolve.

This creates a moving-target problem. The evaluated product can differ from the deployed product months later. Contracts should therefore address material updates and renewed review.

Schools also need exit plans. Data export, record retention, account deletion, and curriculum continuity matter when a district ends a product.

Without those provisions, switching costs can sustain a weak tool. Teachers build workflows around it, students store work inside it, and administrators hesitate to disrupt operations.

That dynamic turns early experimentation into default infrastructure. Renewal can then occur without anyone proving the original premise.

The MarketScale headline captures a real accountability gap, but “no measurable impact” should not become a claim that no impact exists. In many cases, districts have not measured the right outcome well enough to know.

That uncertainty still places the burden on vendors and buyers. Public institutions should not infer educational value from the absence of disconfirming evidence.

Better Contracts Can Change the AI in Education Market

Schools can narrow the evidence gap by writing contracts around outcomes, implementation, transparency, and the right to stop.

Traditional software procurement often centers on access. The vendor provides accounts and support, while the district pays for an agreed period.

That structure works poorly when the product is sold as an educational intervention. Access is only the beginning. The district needs usable implementation and an observable result.

An outcome-oriented contract should first define the problem. “Use AI” is not a problem statement. Reducing teacher planning time or improving algebra mastery is specific enough to measure.

The contract should identify the target population and setting. A literacy tutor for elementary students needs different evidence and safeguards from an administrative assistant used by district employees.

Success measures must follow the claim. Workload tools can track task time, corrections, and user retention. Student-facing tools need independent assessments that do not depend on continued AI assistance.

Districts should also define minimum implementation conditions. An evaluation becomes misleading when a product receives too little training, inadequate usage, or inconsistent teacher support.

That does not mean vendors should be paid for logins. It means both parties must know whether a disappointing result reflects the product, implementation, or both.

Contracts can require evidence disclosures. Vendors should identify completed studies, study sponsors, relevant populations, limitations, and whether researchers evaluated the current product version.

Independent evidence deserves more weight than a vendor case study. However, even independent studies need scrutiny for design quality and relevance.

The agreement should cover model changes. A vendor might switch models, modify safeguards, add data processing, or alter response behavior during the contract.

Districts need notice, documentation, and review rights when those changes affect risk or instructional function. Otherwise, approval applies to a product that no longer exists in the same form.

Audit access is another important provision. Districts should receive enough data to evaluate use and outcomes without exposing unnecessary student information.

The data should distinguish active educational use from passive account availability. It should also help teachers understand how students interact with the system.

Transparency does not require exposing proprietary model weights. It requires enough information to judge intended use, known limitations, data handling, and material updates.

Renewal criteria should be established before deployment. Districts can specify which measures will inform continuation, modification, expansion, or termination.

That reduces the influence of sunk costs. It also protects staff from being asked to defend a tool simply because implementation required substantial effort.

Contracts cannot solve every instructional problem. They cannot turn a generic chatbot into a well-designed tutor. They can make unsupported promises harder to sell.

They can also reshape competition. Vendors with credible evidence, focused use cases, and transparent limitations gain a clearer route to trust.

Products built mainly around novelty face a harder market. That is healthy pressure because school systems cannot treat students as permanent beta testers.

Procurement reform can benefit smaller vendors, too. Clear requirements reduce the value of vague branding and large sales operations. A focused product can compete by demonstrating a defined result.

District collaboration would strengthen that effect. Shared evaluation frameworks and evidence repositories can prevent every school system from repeating the same review.

Schools should still account for local context. Yet common standards for privacy, accessibility, transparency, and evidence can reduce duplicated work.

Knowledge management also matters during evaluation. District teams need a searchable record of contracts, studies, classroom observations, policy decisions, and model changes.

A well-maintained AI knowledge base can help reviewers preserve that evidence across departments. The tool used for this record should follow the district’s own security and governance requirements.

The goal is institutional memory. When staff roles change, the district should retain the reasons behind an approval, limitation, or rejection.

Without that record, each renewal cycle can restart the debate. Vendors retain detailed product knowledge, while buyers lose the context needed to challenge their claims.

The next phase of school AI spending will therefore depend as much on procurement design as model capability. Better contracts can translate educational goals into evidence requirements.

Three Signals to Watch After This Google News Moment

The next few months will show whether schools turn skepticism into measurable purchasing rules or continue renewing AI tools through momentum alone.

The first signal is the quality of district renewal criteria. Buyers should publish or clearly document the outcomes that determine whether a pilot expands.

A stronger process will separate teacher efficiency, student achievement, engagement, accessibility, and safety. Each benefit needs its own evidence.

If districts begin requiring baselines and independent assessments, the MarketScale critique will have changed procurement behavior. If renewals still depend mainly on usage, the accountability gap will remain.

The second signal is the evidence vendors release. Companies should move beyond testimonials and selected examples toward studies that describe participants, comparison groups, assessments, and limitations.

Partnerships with independent researchers can improve credibility. Disclosure of unfavorable or mixed results would also indicate a more mature market.

The key is relevance. A study involving university volunteers does not automatically support a purchase for elementary classrooms. Evidence should match the proposed users and instructional setting.

Watch how vendors describe teacher time savings. They should account for verification and correction work rather than counting only faster first drafts.

For student-facing systems, watch for tests conducted without AI access. That is where researchers can determine whether students learned or merely completed supported tasks.

The third signal is the spread of screen-time and AI governance rules. States and large districts are already reviewing how digital tools fit inside classroom instruction.

Those policies can weaken indiscriminate adoption, but blunt restrictions also carry risks. A daily time cap does not distinguish a passive video from an accessible tutoring session.

Effective governance will ask whether technology serves a defined educational purpose. It will also preserve teacher judgment within clear safety and evidence boundaries.

A policy that simply bans AI can push student use outside supervised environments. A policy that permits every approved product can confuse administrative clearance with instructional value.

The more useful path combines age-appropriate boundaries, transparent review, teacher training, student AI literacy, and measurable goals.

Google News will keep surfacing both success stories and warnings because the underlying evidence remains mixed. Readers should examine what each story actually measures.

Was the result a faster task, a better assisted answer, stronger independent learning, or a positive survey response? Those outcomes are related, but they are not equivalent.

School leaders should ask vendors to state one primary claim and provide evidence that directly supports it. Teachers should report both saved time and new review burdens.

Parents can ask what student information enters a system, what problem the product addresses, and how the district will decide whether to renew it.

Researchers should prioritize realistic classroom conditions and longer follow-up periods. They should also document implementation because a tool’s instructional setting often shapes its effect.

Vendors have the clearest immediate action. Narrow the promise, disclose the limitations, and help customers measure the result that justified the purchase.

The headline’s central warning is not that schools must avoid AI. It is that enthusiasm cannot substitute for educational evidence.

A defensible deployment starts with a learning or workload problem, not a product category. It ends with a decision rule established before the results arrive.

That standard will feel slower than chasing each model release. It is still faster than spending years maintaining systems that nobody can show are helping.

The next Google News headline should not celebrate the largest deployment or the newest classroom assistant. The meaningful milestone will be a district showing what changed, for whom, and under which conditions.

Until then, school AI spending remains an experiment with unusually high stakes. The question for every buyer is simple: what evidence would make you expand, revise, or stop?

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page