External evaluators lack access to the strongest internally deployed models
A lab limits a prior model-sharing commitment to external deployment, leaving foreign safety evaluators without access to the strongest internal systems.
Internal deployment is supported in part; the required evaluator-access exclusion has not been verified.
At a glance
- Assessment: Not Yet Testable
- Confidence in assessment: 75%
- Outcome: unresolved
- Timing: pending
- Evidence: insufficient
- Predicted timing: May 2027
- Primary source: May 2027, foreign evaluators and internal deployment; AI 2027 archived scenario
What AI 2027 Predicted
A lab limits a prior model-sharing commitment to external deployment, leaving foreign safety evaluators without access to the strongest internal systems. The source is May 2027, foreign evaluators and internal deployment in the AI 2027 scenario.
Archived scenario version and section-page references. The linked live scenario may change; these definitions use the archived version identified here.
How We Track This
Identify a named lab and a documented prior pre-deployment access commitment. Establish both consequential internal use of a more capable system and denial or contractual exclusion of that system from the specified external evaluator’s access. Require records or independently corroborated direct knowledge of both sides, including dates and capability basis.
These operational thresholds specify this tracker’s test. Where the scenario uses qualitative language, they are interpretations rather than numbers quoted from the original.
Current Evidence
Anthropic’s August report describes internally used capabilities with a July 15 coverage cutoff. That supplies only one part of the test. No qualifying combination of a prior access commitment and exclusion of that internal system was identified in this review.
Counterevidence & Limitations
Missing public results, ordinary NDA protection, or a model under development without internal use do not establish denied access. Capability secrecy alone is a separate existing dossier.
Missing qualifying public evidence does not establish that the event has not happened privately. The assessment concerns the documented test and its observable evidence.
What Would Change Our Assessment
The relevant evaluator receives access before or during consequential internal deployment, or the claimed access commitment never applied.
Evidence satisfying the full test would change the assessment; early qualifying evidence can be considered before the scenario window. Partial proxies are recorded with their scope.
Update History
| Date | Update |
|---|---|
| 2026-09-06 | Internal deployment is supported in part; the required evaluator-access exclusion has not been verified. Relevant primary evidence and limitations are described above. |