3296 words
16 minutes
When AI Builds AI: What Anthropic's Own Data Says About Recursive Self-Improvement

Most claims about AI building the next generation of AI come from people with something to sell and no numbers to show. On June 4, 2026, a frontier lab put its own operational data on the table. Anthropic’s Institute published “When AI builds itself,” written by Marina Favaro and Jack Clark with editorial support from Santi Ruiz [1]. It is not a research paper making theoretical claims. It is an internal report on what is already happening inside the company, and it carries five numbers that are hard to read calmly: more than 80% of the code merged into Anthropic’s codebase is now authored by Claude, the typical engineer merges 8x as much code per day as in 2024, an internal model called Mythos Preview hit roughly a 52x speedup on a training-optimization task, that same model now beats a human researcher’s next-step choice 64% of the time, and one project shipped 800-plus fixes that cut a class of API errors by 1000x [1].

We are going to read those five numbers straight, because they deserve it. Then we are going to put them next to a number from a completely different source that says the best AI agents complete real professional work to a client-ready standard less than 5% of the time [3]. Both numbers are true at the same time. The thing that explains the gap is not the model. It is the structure the model is handed.

Figure 1 - Diagram of a recursive loop showing Claude authoring code that improves the harness and training pipeline, which in turn produces a more capable Claude.

Figure 1 - The Recursive Loop, Stated Plainly: Anthropic’s disclosure describes a closed loop. Claude authors most of the code merged into Anthropic’s codebase, including the infrastructure that trains the next model, which is then more capable at authoring code and improving its own training. The loop is real and measured. Whether it is fast, safe, or generalizable is the rest of the article [1].


The Five Numbers, Read Straight#

The headline figure is the cleanest. As of May 2026, Anthropic states that more than 80% of the code it merges into its own codebase was authored by Claude [1]. Before Claude Code shipped as a research preview in February 2025, that figure sat in the low single digits. The move from low single digits to past 80% took roughly fifteen months. That is the first thing worth sitting with: this is not a projection or a roadmap. It is a measured present-tense number about a working codebase that ships a commercial product.

The second figure is about the humans. Anthropic reports that in the second quarter of 2026, the typical engineer was merging 8x as much code per day as they were in 2024 [1]. The phrase “roughly 8x more productive” is doing some lifting here, and we want to be precise about it. The measured quantity is merged code per engineer per day, not features shipped, not bugs avoided, and not value delivered. Eight times the merged code is a real and large change in throughput. It is not the same claim as eight times the value, and Anthropic does not make the stronger claim. We will not either.

The third and fourth numbers are about Claude improving the thing that makes Claude. Anthropic measured how well the model can speed up its own training code. In May 2025, Claude Opus 4 averaged about a 3x speedup over the starting code on training-optimization tasks [1]. In April 2026, an internal model named Mythos Preview reached roughly a 52x speedup over the same baseline [1]. That is approximately a 17x jump in eleven months on the narrow task of making training faster. On a parallel vector, research judgment, Anthropic asked how often the model picks a better next experiment than a human researcher would. In November 2025, Opus 4.5 beat the human choice 51% of the time, barely above a coin flip [1]. By April 2026, Mythos Preview beat it 64% of the time [1]. The model moved from “marginally useful” to “clearly useful” on research direction in about five months.

KEY INSIGHT: When you read a productivity multiplier, find the unit. “8x more productive” measured as merged code per day is a real throughput change, not a claim about eight times the delivered value. The most defensible reading of any AI metric is the one that names exactly what was counted.

The fifth number is the one that lands hardest because it is concrete. In April 2026, Anthropic reports that Claude shipped more than 800 fixes that cut a class of API errors by 1000x [1]. The engineer overseeing the work estimated that a human would have needed four years to do the same [1]. Strip the framing and what remains is an AI system repairing the infrastructure that trains future AI systems, at a cadence no human team could sustain. That is the recursive loop made specific. Mythos Preview is a real named internal model, not a hypothetical, which is what makes the 52x and 64x figures more than thought experiments.

Figure 2 - Two paired charts on a dark background: the left bar rising from roughly 3x in May 2025 to 52x in April 2026, the right bar rising from 51% in November 2025 to 64% in April 2026.

Figure 2 - Two Capability Vectors Over Roughly One Year: The left panel shows training-optimization speedup climbing from about 3x with Opus 4 in May 2025 to roughly 52x with Mythos Preview in April 2026. The right panel shows research-judgment win rate against a human moving from 51% with Opus 4.5 in November 2025 to 64% with Mythos Preview in April 2026. Both vectors point at the same thing: the model is getting measurably better at improving the model [1].


Why a Lab Publishes Its Own Capability Ceiling#

A reasonable first reaction is suspicion. Why would a company publish the strongest possible statement of its own product’s power, in this much detail, with named internal models? The honest answer is that the paper carries two purposes at once, and both are legitimate.

Read as a safety disclosure, the paper argues that the world should retain the option to verifiably slow or pause frontier development, and that the public cannot make sensible decisions about that option without seeing real operational data [1]. Publishing the numbers rather than keeping them internal is consistent with that argument. You cannot ask society to weigh a risk you refuse to quantify.

Read as a capability statement, the same numbers are the strongest public claim about Claude’s abilities that any lab has made, and no competitor has publicly matched them. The timing matters here and it is worth stating carefully. Anthropic confidentially filed a draft S-1 registration statement with the SEC on June 1, 2026, following a funding round that valued the company at roughly $965 billion [4][5][6]. The disclosure landed three days later. We are not going to dress that sequence up as a scandal. A confidential S-1 is not a priced offering and not a dated public listing, and Anthropic’s own framing keeps the door open rather than committing: the offering “will depend on market conditions and other factors” [4]. The defensible reading is that the commercial timing is real context, not a debunking. A safety disclosure and a capability statement can be the same document. Both readings are true, and dismissing either one costs you accuracy.

Figure 3 - A level balance-scale diagram weighing a safety-disclosure pan against a capability-statement pan, both fed by the same set of figures, with a hedged S-1 timing note below.

Figure 3 - One Document, Two Legitimate Readings: The same five figures support a safety argument (the public should be able to weigh whether to slow frontier development) and a capability argument (this is the strongest public statement of Claude’s power). The confidential S-1 filing on June 1, 2026 at a roughly $965 billion valuation is real timing context, hedged by Anthropic’s own “will depend on market conditions” language, not a completed offering [1][4][5].


The Number That Refuses to Cooperate#

Now the counterweight. If Claude can author 80% of a frontier lab’s code and beat human researchers on next-step judgment, you would expect AI agents to be quietly automating professional work everywhere. They are not.

The Remote Labor Index, built by Scale AI and the Center for AI Safety and published in October 2025, measures something the productivity benchmarks do not [2]. It asks a blunt question about real freelance projects: would a reasonable client accept this deliverable as at least as good as the human standard? The unit of measurement is client-ready work, not model capability in isolation. Across a corpus of real remote-work tasks, the best agent reached a maximum automation rate of 2.5% [2]. The best agents clear the client-ready bar less than 5% of the time [2]. The paper’s own phrasing puts the floor at less than 3% [2].

Hold those two facts side by side. AI is authoring more than 80% of the code at Anthropic [1] and clearing under 5% of arbitrary professional tasks in the wild [2][3]. The same underlying technology produces both numbers. The contradiction is only apparent, and resolving it is the whole point of this article.

KEY INSIGHT: The variable that moves the outcome is not the model. It is the structure the model is handed. Anthropic’s 80% and the Remote Labor Index’s 2.5% are measurements of the same class of system operating in two radically different environments.

Figure 4 - A bar comparison: a tall cyan bar at 80% code authorship inside Anthropic next to a tiny amber bar at 2.5% maximum automation on the Remote Labor Index.

Figure 4 - The Same Technology, Two Environments: On the left, Claude authors more than 80% of merged code inside Anthropic [1]. On the right, the best agent on the Remote Labor Index reaches a 2.5% maximum automation rate on arbitrary professional tasks [2]. The gap is not a measurement error. It is the difference between a structured environment built for the agent and an unstructured one that was not.


What the Structure Actually Does#

Anthropic’s own paper gives the explanation, and it is not a flattering one for anyone hoping to drop an agent into a legacy codebase and walk away. The 80% figure works because Anthropic’s codebase is structured for it. The clean-codebase argument stops being a hypothesis the moment it explains a real operational number. The reason the figure is 80% at Anthropic and closer to 8% in many other shops is that Anthropic built the harness, the structured codebase, the tests, and the review gates that let an agent do genuinely good work without constant correction.

This is the same fundamentals argument we have made before, now confirmed from inside a frontier lab rather than argued from the outside. A clean, well-tested, well-documented codebase is what lets an agent’s output land as mergeable code instead of plausible-looking slop. The harness Anthropic constructed, Claude Code plus a codebase organized for machine authorship, is the operational explanation for the 80%. Take the same model and point it at the open distribution of real freelance briefs, with their ambiguous requirements and missing context and no enforcing structure, and you get the Remote Labor Index’s 2.5% [2].

The failure mode is specific. The Remote Labor Index found that 45.6% of failed submissions were quality failures, meaning the work simply was not at a professional standard, with the rest split across task misunderstandings, format errors, and incomplete work [2]. Agents do best on create-from-scratch prompts and degrade on complex multi-step briefs, precise editing, and tasks that need domain judgment to interpret ambiguous requirements [2]. Every one of those weaknesses is something a good harness compensates for. Anthropic’s environment supplies the constraints, the tests, and the review that the open freelance market does not.

Figure 7 - Stacked-bar breakdown of Remote Labor Index failures: quality failures are the largest amber segment, the rest split across misunderstandings, format, and incomplete work.

Figure 7 - Where Agents Fail on Real Work: Of failed submissions on the Remote Labor Index, 45.6% were quality failures, work that was simply not at a professional standard, with the rest spread across task misunderstandings, format errors, and incomplete submissions [2]. Each of these is exactly the kind of error that a structured environment’s tests, specs, and review gates catch before the work ships. The open freelance market has none of those gates, which is why the floor sits so low.

Figure 5 - A two-environment diagram: a cyan structured side with tests, lints, specs, and review gates feeding high success, beside an amber side with ambiguous briefs and low success.

Figure 5 - Structure Is the Multiplier: The left side shows the structured environment Anthropic built: tests, lints, specs, and review gates that catch and correct agent output before it merges. The right side shows the open freelance distribution: ambiguous briefs, missing context, no enforcing structure. Same model, two outcomes. The harness is what converts capability into mergeable work [1][2].


What Every Engineering Team Should Take From This#

The instinct after reading Anthropic’s numbers is to ask which model they are using and whether you can get it. That is the wrong question. The model is available. The 80% is a property of the environment the model works in, not the model itself.

The practical program is unglamorous and it is the same one good engineers have always followed. Make the codebase clean enough that an agent can do good work in it. Write the tests that catch bad output. Maintain the specs and the documentation that tell the agent what acceptable work looks like. Build the review gates, automated and human, that reject substandard output before it merges. Those are the components that turn raw capability into the 80% figure, and they are portable across every model that will ever ship. A team that does this work will see its own authorship percentage climb. A team that points the same model at an untested, undocumented, sprawling codebase will get output much closer to the Remote Labor Index floor, and will conclude, wrongly, that the technology is not ready.

The recursive loop Anthropic disclosed is real, and it is worth taking seriously on both the capability and the safety dimension. But the lesson for a team that is not a frontier lab is not “the singularity is near.” It is older and more useful than that. The fundamentals you were told to care about, clean code, tests, clear specs, honest review, are now the difference between an agent that writes 80% of your code and one that writes 8% of it. The structure is the lever. Anthropic just published the proof.

KEY INSIGHT: You do not get Anthropic’s 80% by buying Anthropic’s model. You get it by building the environment that lets the model succeed. The clean codebase you were always supposed to maintain is the thing that converts model capability into merged code.

Figure 6 - A checklist diagram of four structural investments, clean code, tests, specs, and review gates, with cyan arrows showing each one raising a model-independent agent authorship gauge.

Figure 6 - The Portable Program: The four structural investments that produce a high agent-authorship rate are clean code, tests that catch bad output, specs that define acceptable work, and review gates that reject the rest. None of them depend on a specific model. Each one raises how much of your codebase an agent can author well, which is the lever Anthropic’s data actually demonstrates [1].


Reading Recursive Self-Improvement Without Flinching or Hyping#

It is tempting to file this disclosure under one of two headings: proof that runaway AI is imminent, or marketing dressed as transparency. Neither heading survives contact with the numbers.

The case for taking it seriously is genuine. A model that improves its own training code 52x over a baseline [1], beats human research judgment 64% of the time [1], and ships work a human would have needed four years to do [1] is participating materially in building its successor. That is the literal definition of recursive self-improvement, and a frontier lab measured it in production rather than speculating about it. Dismissing it as hype means ignoring the first primary-source operational data anyone has published on the question.

The case for restraint is equally genuine. Every one of these figures is narrow. The 52x is on training-optimization tasks, not on general capability. The 64% is on next-step research judgment within Anthropic’s own workflow, not on independent science. The 80% is merged code inside a codebase engineered for exactly this, not value delivered across the economy. And the Remote Labor Index’s 2.5% [2] is a standing reminder that the same technology, removed from that engineered environment, struggles with the kind of ambiguous, multi-step work that fills most professional jobs. The loop is real and it is bounded. Both halves of that sentence are load-bearing.

The honest synthesis is that AI is now a serious contributor to building AI inside the labs that have structured their environments for it, and is still a long way from autonomously doing arbitrary professional work in the environments that have not. The distance between those two states is measured in structure, not in model weights.

Figure 8 - A diagram of a cyan recursive loop enclosed by a dashed gray boundary ring, with general professional work sitting outside the ring at a low level near the Remote Labor Index floor.

Figure 8 - Real, Measured, and Bounded: The recursive loop is genuine inside the structured environment, shown as the cyan cycle. The dashed gray ring is its current boundary: the gains are narrow (training-optimization speedup, next-step research judgment, code authorship inside an engineered codebase) rather than general. Outside the ring, arbitrary professional work still sits near the Remote Labor Index floor [1][2]. Taking the disclosure seriously means holding both the loop and its boundary in view at once.


Conclusion#

Anthropic published five numbers that describe an AI system materially building its own successor: 80% code authorship, 8x engineer throughput, a 52x training speedup, a 64% research-judgment win rate, and an 800-fix project that compressed four years of human work into a 1000x error reduction [1]. Read straight, those numbers are the strongest public evidence yet that recursive self-improvement is operational, not theoretical, inside a frontier lab.

The disclosure is simultaneously a safety argument and a capability statement, published three days after a confidential S-1 filing at a roughly $965 billion valuation [4][5][6]. Both readings are true, and the commercial timing is context rather than a debunking, hedged by Anthropic’s own “will depend on market conditions” language [4].

The sharpest finding sits in the gap between two numbers. The same technology that authors 80% of Anthropic’s code clears under 5% of arbitrary professional tasks on the Remote Labor Index [1][2][3]. The variable that explains the gap is structure. Anthropic’s 80% works because Anthropic built the clean codebase, the tests, the specs, and the review gates that let an agent do good work. The lesson for every other engineering team is not to chase the model. It is to build the environment. The fundamentals you were always supposed to maintain are now the difference between an agent that writes most of your code and one that writes almost none of it. The structure is the lever, and the data finally proves it.


References#

[1] M. Favaro and J. Clark (editorial support by S. Ruiz), “When AI builds itself,” Anthropic Institute, June 4, 2026. https://www.anthropic.com/institute/recursive-self-improvement

[2] Scale AI and the Center for AI Safety, “Remote Labor Index (RLI),” Scale AI Labs, October 2025. https://labs.scale.com/papers/rli

[3] “Remote Labor Index: Measuring AI Automation of Remote Work,” arXiv:2510.26787, October 2025. https://arxiv.org/abs/2510.26787

[4] “Anthropic confidentially files for IPO after raising $65 billion in a funding round at a $965 billion valuation,” Fortune, June 1, 2026. https://fortune.com/2026/06/01/anthropic-confidentially-files-ipo-965-billion-valuation/

[5] “Anthropic confidentially files IPO prospectus with SEC, prepping Wall Street for landmark AI deal,” CNBC, June 1, 2026. https://www.cnbc.com/2026/06/01/anthropic-ipo-s1-prospectus.html

[6] “Anthropic files to go public,” TechCrunch, June 1, 2026. https://techcrunch.com/2026/06/01/anthropic-files-to-go-public/

When AI Builds AI: What Anthropic's Own Data Says About Recursive Self-Improvement
https://dotzlaw.com/insights/ai-11-when-ai-builds-ai/
Author
Gary Dotzlaw, Katrina Dotzlaw, Ryan Dotzlaw
Published at
2026-07-13
License
CC BY-NC-SA 4.0

Building production AI, or modernizing a legacy system?

That is the kind of work we do at Dotzlaw Consulting. Book a free 20-minute intro call and tell us what you are trying to build, or what is slowing you down.

← Back to Insights