AI R&D progress multiplier reaches 3×

What AI 2027 Predicted

The scenario describes a progression of AI R&D multipliers: 1.5× by early 2026, 2× with the mature Agent-1 system, and then 3× with Agent-2 by January 2027. The 3× multiplier means AI tools triple the pace of algorithmic progress at the leading lab compared to what the same researchers could achieve without AI assistance. Agent-2, with its continuous online learning capability, is depicted as qualitatively more capable at research tasks than its predecessor.

How We Track This

We monitor:

• METR’s developer productivity studies (RCTs measuring AI coding uplift)
• Internal reports from frontier labs on AI-assisted research productivity
• Academic studies on AI’s impact on scientific research output
• Surveys of AI researchers on tool usage and perceived productivity
• Qualitative shifts: from coding assistance to research ideation and experiment design

The key challenge is distinguishing “coding productivity” from “R&D progress.” The scenario’s multiplier covers the full R&D pipeline — including experiment design, hypothesis generation, and research taste — not just code output.

Current Evidence

Developer productivity as supporting evidence:

• METR’s July 2025 RCT found that experienced open-source developers were actually 19% slower when using early-2025 AI tools on familiar codebases — a striking counterresult (METR, July 2025)
• However, METR acknowledged this was “a snapshot of early-2025 AI capabilities in one relevant setting” and that results would change as tools improve
• METR’s February 2026 update notes they are redesigning their experiment methodology and believe “developers are more sped up from AI tools now — in early 2026 — compared to our estimates from early 2025” (METR, February 2026)

Broader productivity evidence:

• Individual coding-productivity results vary by task and population; they do not provide a general research multiplier.
• Claude Code generating $500M+ run-rate revenue suggests significant real-world value, though this doesn’t directly measure R&D multiplier
• Frontier labs report using AI extensively for internal coding, but published evidence of AI accelerating algorithmic research (as opposed to implementation) is limited

AI Futures self-grading:

• The self-grading assessed AI R&D uplift as “behind pace” relative to AI 2027’s predictions
• Updated early-2025 estimates downward; end-2025 estimates were “similar to original start-of-scenario estimates”
• The predicted 1.5× by early 2026 already appears behind schedule — making 3× by January 2027 very ambitious

Current assessment: No qualifying threefold whole-research multiplier was identified. The evidence does not justify the earlier precise 1.1-1.3× range.

Sources:

• METR: Early-2025 AI developer productivity study
• METR: Experiment redesign update (Feb 2026)
• Grading AI 2027’s 2025 Predictions — AI Futures Project

Counterevidence & Limitations

• METR’s developer trial concerns its population and tool generation; it does not directly resolve a laboratory multiplier.
• The January 2027 target requires comparable research-progress evidence, not extrapolation from an unsupported current estimate.
• Coding speed and overall research progress are distinct quantities and should remain separate.
• Measuring “R&D multiplier” precisely is methodologically difficult — there’s no standard metric
• Most productivity gains may accrue to less experienced developers or routine tasks, not frontier research
• Individual forecasts are dated judgments with differing milestone definitions, not measurements of the current multiplier.

What Would Change Our Assessment

• Strengthen the assessment: Verified whole-project measurements approach the original threefold quantity.
• Confirm: Comparable evidence establishes a threefold multiplier with a credible no-AI counterfactual and uncertainty.
• Remain unresolved: Coding throughput or self-reported gains lack the necessary research-progress comparison.
• Reassess timing after January 2027: Evaluate the original window without moving the date.

Update History

Date	Update
2026-09-06	Current evidence and assessment explanation reviewed. Clarified measurement scope, source interpretation and limitations.
2026-03-13	Prediction timeframe not yet reached. Current estimated AI R&D multiplier at ~1.1-1.3×. Reaching 3× by January 2027 would require dramatic and unprecedented acceleration. METR redesigning measurement approaches for R&D impact.