top of page

ACM Open Source AI Report Warns Faster Coding Is Overloading Human Review

21 hours ago
13 min read

The ACM open source AI report identifies a costly reversal: AI can produce patches quickly, but humans must still decide which changes deserve trust. That imbalance is adding work for maintainers who already operate with limited time, funding, and review capacity.

Released by the Association for Computing Machinery’s Technology Policy Council, the report examines AI’s effects on open-source software. Its central concern is not whether AI can write useful code. It is whether human-led projects can safely absorb a much larger stream of machine-assisted contributions.

The distinction matters because open-source software supports phones, vehicles, cloud services, and AI systems. Yet many important projects depend on volunteers or small teams. Godot, curl, and other projects have already tightened contribution rules after encountering low-quality AI submissions. The promise of abundant code is meeting the reality of scarce human attention.

The ACM Open Source AI Report Shifts Attention to Review

The report argues that faster code production does not remove the human bottleneck. It moves that bottleneck into review, governance, and maintenance.

The ACM TechBrief was published in 2026 by six authors working through ACM’s Technology Policy Council. They include Arunachalam Balasubramanian Shrinivass, Simson Garfinkel, Josiah Dykstra, Andy Oram, Nina Shamsi, and Jonathan M. Smith.

The brief addresses four connected pressures: cybersecurity, software maintenance, financial sustainability, and organizations’ limited knowledge about their open-source dependencies. AI affects each area, but it does not affect them in the same way.

AI systems can find vulnerabilities, propose patches, write tests, and automate routine development work. These capabilities can help a well-managed project resolve defined problems faster. They can also help a contributor prepare documentation or explore an unfamiliar codebase.

However, a pull request is only a proposal to change the project. A trusted maintainer must determine whether it solves the stated problem, preserves compatibility, meets project standards, and avoids new security risks.

That decision often requires more than reading the modified lines. Reviewers may need to reproduce the issue, inspect related modules, evaluate architectural consequences, and test behavior across supported environments.

AI reduces the cost of creating a plausible submission. It does not reduce the cost of understanding every consequence at the same rate.

This asymmetry changes the economics of participation. A contributor can generate several patches while a maintainer is still reviewing the first one. The submitter can also leave after opening the request, while the project inherits every unresolved question.

The original reporting describes this as more code for humans to check. That wording captures the immediate problem, but the wider consequence is more serious.

Open-source releases depend on delegated trust. Maintainers decide which contributors, processes, and artifacts are reliable enough to enter an official build. An increase in unverified output therefore creates governance work, not just coding work.

The report does not claim that every AI-assisted contribution is poor. It acknowledges that model quality can improve. The unresolved problem is that each additional submission still requires some level of human judgment.

That judgment is especially expensive when generated code looks convincing. A patch can compile and pass visible tests while misunderstanding an undocumented assumption. It can also add complexity that appears harmless until later changes expose it.

The ACM open source AI report therefore changes the central question. The issue is no longer simply whether AI makes individual developers faster. It is whether project-level review capacity grows with their output.

That reframing creates the article’s main conflict: machine-generated abundance versus human-controlled trust.

Open-Source Maintainers Face a Review Capacity Gap

The projects under the most pressure are not necessarily those with the worst code. They are those with high adoption and too few qualified reviewers.

A qualified reviewer needs more than general programming ability. The reviewer must understand the project’s architecture, compatibility promises, release process, and community expectations.

That knowledge develops slowly. A mature project may have thousands of users but only a small group capable of approving consequential changes. Adding another code generator does not automatically create another trusted reviewer.

The problem becomes sharper when AI attracts first-time contributors. New participation can strengthen an open-source community when contributors learn its norms and eventually assume maintenance responsibilities.

Traditional review has partly served that mentoring function. A maintainer explains why a change needs revision, and the contributor carries that knowledge into future work.

Machine-mediated participation can break this exchange. The maintainer still spends time explaining the project’s requirements, but the person submitting the code may not understand or retain the lesson.

Godot made this concern explicit when it announced stricter contribution rules on June 30, 2026. The open-source game engine said its qualified reviewer pool was small and its pull-request backlog was already difficult to manage.

Godot said AI had lowered the effort needed to create a pull request without reducing the work needed to review one. The foundation also questioned the value of feedback that trains neither the contributor nor a future maintainer.

Its planned rules prohibit autonomous AI agents and substantial AI-authored code. They also require human accountability and disclosure when contributors use limited AI assistance.

The policy is not simply an ideological rejection of AI. It is an attempt to protect a scarce resource: informed reviewer time.

The risk extends beyond code submissions. Projects can receive generated bug reports, feature proposals, security findings, and discussion comments. Each item competes for the same maintainers’ attention.

A seemingly detailed vulnerability report can be particularly expensive. Reviewers must determine whether the claimed flaw exists before they can dismiss it safely. A fabricated report may consume hours even when it produces no fix.

A July 2026 preprint described this pattern as an AI contribution flood. The researchers analyzed 294 repositories containing more than two million pull requests and issues.

They reported that pull-request volume increased during 2025 while merge rates declined. One-time contributors experienced an 18.18 percent decline in merge rates relative to the study’s modeled counterfactual.

The researchers also interviewed practitioners and surveyed 229 open-source participants. They identified defensive strategies ranging from stricter contribution templates to broader restrictions on outside submissions.

These findings do not establish that AI caused every rejected request. Repository studies also face classification and comparison limits. They do show why maintainers perceive the new volume as a capacity problem.

Another 2026 study examined 11,097 GitHub repositories between January 2023 and May 2026. It reported a 5.3 percent increase in review depth after projects adopted AI coding agents.

Review depth measures the intensity of review interaction, not the quality of the final software. Still, the increase supports a consistent mechanism: faster generation transfers work toward validation.

The result is a review capacity gap. Contribution volume can expand through cheap automation, while trusted review remains tied to scarce human expertise.

Faster AI Coding Creates a Trust and Security Tradeoff

AI can help repair open-source software, yet the same speed can increase attack opportunities and overwhelm the people responsible for safe releases.

The ACM open source AI report presents AI as a dual-use capability. Models can locate vulnerabilities and propose fixes. Similar techniques can help attackers search for weaknesses or generate persuasive malicious submissions.

Google’s CodeMender illustrates the defensive promise. According to Google, the agent contributed 72 security fixes to open-source projects between April and October 2025.

Some targeted projects contained as many as 4.5 million lines of code. Automation can be valuable at that scale because human teams cannot inspect every path manually.

However, an automated fix still enters a project’s trust process. Maintainers must verify the diagnosis, review the patch, evaluate tests, and coordinate release timing.

That process becomes harder when an application depends on many separate packages. Each component has its own maintainers, release schedule, and downstream users.

An AI system might find related weaknesses across several libraries quickly. The ecosystem cannot necessarily patch, release, and deploy every affected component at the same speed.

Attackers do not face the same responsibilities. They can generate many hypotheses, abandon failures, and exploit the first useful result. Defenders must investigate credible findings without breaking existing systems.

Open repositories also create a supply-chain risk. A malicious actor can submit a package, patch, or dependency update that appears useful while hiding unwanted behavior.

AI can make such submissions more polished. It can generate tests, documentation, and detailed explanations that create an appearance of care. Presentation quality does not establish provenance or safety.

This is why a passing test suite cannot serve as the only gate. Tests represent known expectations. They rarely cover every security boundary, unusual environment, or long-term maintenance cost.

Reviewers must ask who understands the change and who will repair it later. They also need to determine whether added dependencies, generated files, or unfamiliar patterns expand the project’s attack surface.

That accountability question separates assistance from delegation. A developer may use AI while remaining capable of defending every design choice. A contributor who cannot explain the patch transfers that responsibility to the project.

Organizations using open source inherit the consequences. Many teams maintain a technical knowledge base, yet still lack a current map of their software dependencies.

A software bill of materials, or SBOM, provides a machine-readable inventory of an application’s components. It can help a security team locate an affected library after a vulnerability disclosure.

An SBOM cannot show whether the component has enough maintainers. It cannot reveal whether unresolved pull requests are accumulating or whether a project’s governance has weakened.

It also cannot determine whether an AI-generated fix received adequate review. Inventory is necessary, but organizational awareness must include project health and maintenance practices.

The tradeoff is therefore not AI versus security. It is speed without accountability versus speed supported by review, traceability, and responsible ownership.

AI can shorten the path from discovery to a candidate patch. It cannot eliminate the need to establish that the patch belongs in a trusted release.

The Funding Model Does Not Match Open Source’s Value

AI is increasing demands on maintainers inside an ecosystem whose economic value greatly exceeds the funding reaching many individual projects.

The ACM brief cites research estimating that firms would spend 3.5 times more on software if open source did not exist. The same economic value study estimated its worldwide demand-side value to firms at $8.8 trillion.

Those figures describe the cost organizations avoid by using shared software. They do not represent revenue received by maintainers.

This gap matters because open-source maintenance includes much more than writing code. Projects need release management, documentation, user support, packaging, testing, fundraising, and community moderation.

AI can assist with parts of that work. It cannot decide a project’s priorities or reconcile disagreements among users, contributors, and sponsors.

The ACM open source AI report highlights a striking institutional comparison. The Linux Foundation reported $292,217,236 in 2024 revenue. The Apache Software Foundation reported $2,379,402.

These organizations differ in scope and operating model, so their revenue should not be treated as a direct performance comparison. The contrast still demonstrates how unevenly resources can flow through open source.

The more important inequality exists at the project level. A widely used component may have no dedicated organization, support contract, or full-time maintainer.

Companies can build profitable services on that component without knowing who approves releases. They may only investigate its governance after a vulnerability, abandonment, or breaking change appears.

This is the free-rider problem: users receive value from a shared resource without contributing proportionately to its upkeep. AI does not create that problem, but it can intensify it.

A company may use AI coding tools to produce changes against an external dependency. If its engineers submit those changes upstream, the receiving project assumes the review cost.

The company gains cheaper code generation. The volunteer maintainer receives another proposal to validate.

Even a useful patch imposes coordination work. Maintainers must ensure it supports the broader user community, not only the contributor’s private requirements.

Poor submissions impose a larger external cost. The submitting organization can abandon the request, while the project must close it, explain the decision, or manage the resulting conflict.

Funding can add reviewer capacity, but money alone does not instantly create expertise. A new maintainer still needs time to learn the project and earn community trust.

That means support should extend beyond short-term bug bounties. Projects need sustained funding for documentation, onboarding, testing infrastructure, packaging, and succession planning.

The ACM brief’s recommendations reflect this broader need. It calls for greater attention to financial sustainability and the organizational work that keeps projects usable.

Corporate buyers should treat this as supply-chain management. If a critical dependency is maintained by one exhausted volunteer, that condition represents operational risk.

Procurement teams routinely evaluate the stability of commercial vendors. They rarely apply equivalent scrutiny to open-source packages because no invoice triggers the review.

AI contribution pressure makes that omission harder to defend. More automated output can reach a project, while the project’s human capacity remains invisible to downstream users.

The funding question is therefore inseparable from the review question. A system that generates more proposals without financing judgment will deepen the bottleneck.

Blanket AI Bans Protect Attention but Can Narrow Participation

Stricter gates can preserve short-term review capacity, but poorly designed restrictions can also block legitimate contributors and weaken future maintainer pipelines.

A project facing a flood of low-value submissions has several options. It can require disclosure, limit contribution size, demand reproducible tests, restrict new features, or ban certain forms of AI use.

Each rule changes who bears the cost. A detailed submission template forces contributors to explain their work before a maintainer begins reviewing it.

Permission requirements reduce speculative feature requests. Automated checks can reject formatting errors or missing tests before human review.

A blanket ban offers a clearer boundary, but enforcement is difficult. AI-generated code does not carry a reliable technical marker, and human-authored work can also be poor.

Detection tools can produce false positives. Contributors who write in a second language or use accessibility aids may be questioned unfairly if polished text becomes evidence of AI use.

Strict rules can also make entry harder for genuine newcomers. Open source depends on converting some first-time contributors into long-term participants.

If projects close every accessible pathway, they can protect today’s reviewers while reducing tomorrow’s maintainer pool. That is the sustainability trap identified by recent research.

The ACM open source AI report does not provide a universal contribution policy. Open-source governance remains decentralized, and projects differ widely in risk, scale, and reviewer capacity.

A small command-line utility cannot copy the process of a large foundation. A cryptographic library should apply different assurance requirements from an experimental design tool.

Evidence from maintainers nevertheless shows broad skepticism. Tidelift’s maintainer survey asked how known AI use would affect willingness to review contributions.

Among 344 respondents, 64 percent said they would be less willing to review or accept AI-produced contributions. Nine percent said they would be more willing, while 27 percent were unsure.

The survey predates the newest coding agents, and attitudes may change as tools improve. It still shows that contributor trust cannot be assumed from technical capability.

The fairest policy target is accountability, not writing style. Contributors should understand their changes, disclose relevant automation, provide evidence, and remain available for revisions.

Projects can also separate low-risk assistance from substantial delegation. Code completion, mechanical replacement, and translation may create different burdens from autonomous feature development.

Contribution size matters as well. A focused patch with a reproduced bug and targeted tests is easier to evaluate than a broad refactor generated without prior discussion.

Maintainers need authority to close submissions that create disproportionate review work. They also need policies that explain this boundary before contributors invest time.

Platforms such as GitHub can help by giving projects stronger intake controls. Useful features might include contribution permissions, structured declarations, rate limits, and repository-specific checks.

Platform support cannot replace local governance. It can reduce the administrative effort required to enforce the choices each community makes.

The skeptical point remains important: current evidence cannot measure all AI-assisted work. Contributors do not always disclose tool use, and researchers must infer adoption from incomplete signals.

An increase in review activity might reflect larger projects or changing contributor populations. It does not prove that every additional review comment represents harmful machine output.

The available evidence supports a narrower conclusion. Generation capacity is rising faster than many projects’ ability to validate contributions, and maintainers are responding with stronger gates.

Three Signals Will Show Whether the Pressure Is Easing

The next test is whether projects gain review capacity, whether platforms improve contribution controls, and whether major users fund the dependencies they rely upon.

The first signal is measurable change in repository queues. Researchers and project leaders should track review time, closure reasons, merge rates, and repeat contributions.

A healthy intervention should reduce low-value intake without eliminating successful newcomers. Shorter queues alone are not enough if projects achieve them by closing outside participation.

The strongest evidence would combine volume with quality. Projects should report whether accepted changes require fewer revisions, create fewer regressions, and attract contributors who remain involved.

The second signal is platform-level support for accountability. Repository hosts can make disclosure and verification easier without trying to identify AI authorship through unreliable detection.

Structured submission fields could require contributors to describe testing, explain design choices, and confirm their ability to maintain the change.

Projects also need tools for limiting high-cost contribution types. A maintainer should be able to require prior discussion for large refactors or autonomous-agent submissions.

If platforms introduce these controls, the ACM open source AI report’s diagnosis gains an operational response. If they focus only on increasing agent output, the imbalance grows.

The third signal is sustained funding from organizations that depend on open source. One-time grants help, but maintenance requires recurring support and paid reviewer time.

Companies should identify which dependencies affect production, security, and compliance. They should then examine maintainer concentration, release activity, documentation quality, and response capacity.

An SBOM can start that process by identifying components. The harder step is connecting the inventory to ownership, governance, and investment decisions.

Security teams should also distinguish patch availability from patch deployment. AI can find a flaw quickly, yet downstream products may remain exposed until every dependency updates.

That delay is partly technical and partly organizational. A thinly staffed project can become the slowest link across many commercial systems.

Developers have responsibilities as well. Anyone using an AI coding tool for open-source work should verify the output and understand the surrounding code.

A submission should include a clear problem statement, focused scope, relevant tests, and an explanation the contributor can defend without consulting the model.

Organizations can reduce external review costs by assigning experienced engineers to support their upstream changes. They should not treat community maintainers as unpaid quality assurance.

Maintainers, meanwhile, need permission to design contribution processes around their actual capacity. Openness does not require accepting unlimited, unverified output.

The longer-term opportunity is not to eliminate AI from open source. It is to use automation where it reduces repetitive work without separating code from human responsibility.

AI-assisted review may eventually help with this balance. Research involving 587 patch reviews found that only a minority of generated comments were accepted directly, though additional comments were rated useful as guidance.

That mixed result suggests review tools can assist human judgment without replacing it. Projects will need evidence from their own workflows before relying on such systems.

The central reversal will remain until those systems mature. Code generation is becoming abundant, while contextual judgment stays scarce.

Readers who build products on open source should ask three practical questions. Which dependencies would stop receiving safe updates if one maintainer left? Who funds their review work? How would your team respond if automated submissions consumed their remaining capacity?

The ACM open source AI report makes those questions urgent because the pressure is already visible. Watch repository backlogs, platform controls, and recurring maintenance funding during the coming months.

If all three improve, AI can become a net addition to open-source capacity. If submission volume rises without them, faster coding will keep producing slower trust.

Give every agent the context to do better work

Connect your agents to the knowledge, decisions, and history already organized in remio.

remio currently supports Windows 10+ (x64) and Macs with Apple silicon.

Your AI Partner at Work
Get more done with remio

Plan. Create. Deliver.
All in one place.

bottom of page