AI R&D progress multiplier reaches 3×
While the latest Agent-1 could double the pace of OpenBrain's algorithmic progress, Agent-2 can now triple it.
What AI 2027 Predicted
The scenario describes a progression of AI R&D multipliers: 1.5× by early 2026, 2× with the mature Agent-1 system, and then 3× with Agent-2 by January 2027. The 3× multiplier means AI tools triple the pace of algorithmic progress at the leading lab compared to what the same researchers could achieve without AI assistance. Agent-2, with its continuous online learning capability, is depicted as qualitatively more capable at research tasks than its predecessor.
How We Track This
We monitor:
- METR’s developer productivity studies (RCTs measuring AI coding uplift)
- Internal reports from frontier labs on AI-assisted research productivity
- Academic studies on AI’s impact on scientific research output
- Surveys of AI researchers on tool usage and perceived productivity
- Qualitative shifts: from coding assistance to research ideation and experiment design
The key challenge is distinguishing “coding productivity” from “R&D progress.” The scenario’s multiplier covers the full R&D pipeline — including experiment design, hypothesis generation, and research taste — not just code output.
Current Evidence
METR’s developer productivity research (the best available proxy):
- METR’s July 2025 RCT found that experienced open-source developers were actually 19% slower when using early-2025 AI tools on familiar codebases — a striking counterresult (METR, July 2025)
- However, METR acknowledged this was “a snapshot of early-2025 AI capabilities in one relevant setting” and that results would change as tools improve
- METR’s February 2026 update notes they are redesigning their experiment methodology and believe “developers are more sped up from AI tools now — in early 2026 — compared to our estimates from early 2025” (METR, February 2026)
Broader productivity evidence:
- AI coding assistants increase individual developer output by an estimated 20-40% in favorable settings (greenfield code, well-defined tasks)
- Claude Code generating $500M+ run-rate revenue suggests significant real-world value, though this doesn’t directly measure R&D multiplier
- Frontier labs report using AI extensively for internal coding, but published evidence of AI accelerating algorithmic research (as opposed to implementation) is limited
AI Futures self-grading:
- The self-grading assessed AI R&D uplift as “behind pace” relative to AI 2027’s predictions
- Updated early-2025 estimates downward; end-2025 estimates were “similar to original start-of-scenario estimates”
- The predicted 1.5× by early 2026 already appears behind schedule — making 3× by January 2027 very ambitious
Current estimated multiplier: Probably in the range of 1.1-1.3× for full R&D (coding + research), depending heavily on task type and team. Coding-only productivity gains are higher but don’t translate directly to overall R&D speed.
Sources:
- METR: Early-2025 AI developer productivity study
- METR: Experiment redesign update (Feb 2026)
- Grading AI 2027’s 2025 Predictions — AI Futures Project
Counterevidence & Limitations
- The METR RCT result (AI making experienced devs slower) directly contradicts the predicted trajectory, though tool capabilities have improved since
- A 3× R&D multiplier by January 2027 requires going from ~1.1-1.3× today to 3× in 10 months — an enormous jump
- The scenario conflates coding automation with full R&D acceleration; coding may be 3× faster while overall research progress lags
- Measuring “R&D multiplier” precisely is methodologically difficult — there’s no standard metric
- Most productivity gains may accrue to less experienced developers or routine tasks, not frontier research
- The AI Futures authors themselves now place the timeline for full coding automation at 2029-early 2030s (Daniel Kokotajlo: 2029; Eli Lifland: early 2030s)
What Would Change Our Assessment
- Upgrade to “emerging”: Credible reports of 2×+ R&D multiplier at any frontier lab, or METR’s updated study showing 50%+ productivity gains
- Upgrade to “on-track”: Internal lab reports or leaked documents showing AI tripling research output pace
- Maintain “not-yet-testable”: Prediction date is January 2027, ~10 months away; status will be evaluated closer to that date
- Preemptive downgrade to “behind”: If multiplier remains below 1.5× through mid-2026
Update History
| Date | Update |
|---|---|
| 2026-03 | Prediction timeframe not yet reached. Current estimated AI R&D multiplier at ~1.1-1.3×. Reaching 3× by January 2027 would require dramatic and unprecedented acceleration. METR redesigning measurement approaches for R&D impact. |