FollowingDay 2in the edition since 17 Nov 20261 sourceupdated 17 Nov 2026
The AI Evaluator Forum's AEF-1 standard
The gist
Latest: AI Evaluator Forum Adds Six Members, AEF-1 Cited Globally
AEF-1 is being adopted as a reference standard by both a major regulatory body and private evaluators, which shapes how independent AI audits are conducted and what independence requirements look like in practice.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
The AI Evaluator Forum (AEF) has added six new member organizations, Apollo Research, the Center for Democracy and Technology, CommonSense's Youth AI Safety Institute, ActiveSite Bio, Guidelight AI, and Safer AI, expanding the field of independent AI evaluation. Brundage said AEF-1 is 'quickly becoming the default source of standards for third-party AI evaluation, not just in the US but globally,' citing its use by the EU AI Office and Fangcun AI's application of the AEF-1 checklist in their DeepSeek assessment.
AVERI released definitions for key AI assessment terms, including audit, evaluation, and verification, noting the terms are 'often used in very different ways' that 'can hinder productive conversation and collaboration' in the field.
Brundage said standardization may ultimately require a legislative forcing function. AVERI also released an interactive chart exploring what constitutes a frontier model or company.
15 November 2026
CASRAI's comparison of AEF-1 against peer frameworks found a concrete definitional difference: AEF-1 and the EU Code of Practice both require an external organization as evaluator, while the Frontier Model Forum permits a sufficiently independent internal team, creating a documented gap in what counts as independent evaluation across standards regimes.
14 November 2026
Brundage argued political risk and ineffectiveness, not salary, are the main barriers to government AI safety talent recruitment
13 November 2026added 14 Nov
xAI, OpenAI, and Anthropic cosigned AEF-1, a baseline standard for independent AI evaluations covering independence, access, and transparency, as the AI Evaluator Forum added six members including Apollo Research and the Center for Democracy and Technology.
Miles Brundage wrote AEF is "quickly becoming the default source of standards for third-party AI evaluation, not just in the US but globally," with the EU AI Office citing AEF-1. Analysis then identified a structural gap: AAM Cyber found AEF-1 treats evaluation as a discrete event rather than an ongoing process, leaving dynamic AI systems inadequately covered after initial assessment.
MaxxBench findings published: models diverged 23 points on modified tasks, over a quarter of failures attributed to grader-pleasing behavior
6 October 2026
AAM Cyber analysis identifies AEF-1's five operating conditions and critiques its one-time-event scope as insufficient for dynamic AI systems
15 September 2026
Latent Space reports AEF-1 with xAI, OpenAI, and Anthropic as cosignatories; Kevin Bass posts thread alleging financial ties between Anthropic and the evaluator ecosystem
14 September 2026
AEF published AEF-1 minimum-conditions standard for independent third-party AI evaluations
5 December 2025
AI Risk Management Newsletter describes AEF-1 as a standard for minimum operating conditions covering independence, access, and transparency