← Field Notes
AUG 26 · Clipped · via X · @ajeya_cotra Off-Brief Alert

Ajeya Cotra says do not take a lab's word on what its agents did

Independent review is the eval-comparison pattern applied to safety: the judge is checked by humans who did not build it. The same logic should sit inside the product that ships the agent.

Machine summary of the source

Ajeya Cotra (@ajeya_cotra) on X: "It is reasonable to be skeptical of taking a lab's word for what its own agents did." Cotra worked on the independent investigation. She explained why outside reviewers needed to read the transcripts. Those reviewers did not build the system. They formed their own view.

The summary above is generated; the note at the top is the editorial judgment. Primary source ↗