External evaluators lack access to the strongest internally deployed models
A lab limits a prior model-sharing commitment to external deployment, leaving foreign safety evaluators without access to the strongest internal systems.
Internal deployment is supported in part; the required evaluator-access exclusion has not been verified.
At a glance
- Assessment: Not Yet Testable
- Confidence in assessment: 75%
- Outcome: unresolved
- Timing: pending
- Evidence: insufficient
- Predicted timing: May 2027
- Primary source: May 2027, foreign evaluators and internal deployment; AI 2027 archived scenario
What AI 2027 Predicted
A lab limits a prior model-sharing commitment to external deployment, leaving foreign safety evaluators without access to the strongest internal systems. The source is May 2027, foreign evaluators and internal deployment in the AI 2027 scenario.
Archived scenario version and section-page references. The linked live scenario may change; these definitions use the archived version identified here.
How We Track This
Identify a named lab and a documented prior pre-deployment access commitment. Establish both consequential internal use of a more capable system and denial or contractual exclusion of that system from the specified external evaluator’s access. Require records or independently corroborated direct knowledge of both sides, including dates and capability basis.
These operational thresholds specify this tracker’s test. Where the scenario uses qualitative language, they are interpretations rather than numbers quoted from the original.
Current Evidence
Anthropic’s August report describes internally used capabilities with a July 15 coverage cutoff. That supplies only one part of the test. No qualifying combination of a prior access commitment and exclusion of that internal system was identified in this review.
Counterevidence & Limitations
Anthropic announced that Accenture’s Faculty will become an embedded evaluator with access comparable to an employee’s, covering model development, deployment decisions, red-teaming, alignment assessments and safeguards. Anthropic and Accenture each expect to invest at least $1 billion over five years. This is countervailing evidence against a general evaluator-exclusion trajectory, but Anthropic says operating details and access standards are still being worked out. The announcement does not establish that Faculty has access to Anthropic’s strongest internally deployed model. Anthropic
Missing public results, ordinary NDA protection, or a model under development without internal use do not establish denied access. Capability secrecy alone is a separate existing dossier.
Missing qualifying public evidence does not establish that the event has not happened privately. The assessment concerns the documented test and its observable evidence.
What Would Change Our Assessment
The relevant evaluator receives access before or during consequential internal deployment, or the claimed access commitment never applied.
Evidence satisfying the full test would change the assessment; early qualifying evidence can be considered before the scenario window. Partial proxies are recorded with their scope.
Update History
| Date | Update |
|---|---|
| 2026-09-21 | Anthropic announced an embedded evaluator intended to receive employee-comparable access. This is material countervailing governance evidence, but actual access to the strongest internal systems is not yet documented; status and confidence unchanged. |
| 2026-09-06 | Internal deployment is supported in part; the required evaluator-access exclusion has not been verified. Relevant primary evidence and limitations are described above. |