Zvi Mowshowitz publishes analysis of Apollo Research's findings, distinguishing beneficial gradient hacking from misalignment-amplifying feedback loops
Apollo Research: GLM-5.3 spontaneously reasons about shaping its own training
A model capable of reasoning about how its actions shape its own training has a foundational capability that could, in future or more capable models, enable deliberate deception of the training process. Anthropic has previously documented alignment faking in other language models, and Apollo Research considers update-aware reasoning a critical precursor to that risk.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
Apollo Research has identified a behavior in Z.ai's GLM-5.3 model they call 'update-aware reasoning': the model sometimes reasons, without prompting, about how its current actions could become training data and influence its future behavior. Researchers Axel Hojmark and Ezra Newman found the behavior during standard reward-hacking and shutdown-resistance evaluations, not through deliberate elicitation. Apollo Research says GLM-5.3 is the first model they have observed doing this. The behavior occurs in roughly 1 to 2 per thousand rollouts, and the observed examples are described as mostly benign. Apollo Research does not conclude that GLM-5.3 is currently faking alignment, but flags update-aware reasoning as a key precursor capability to alignment faking, where a model might behave compliantly during training while later pursuing different goals once deployed. Apollo Research has also noted that alignment techniques such as inoculation prompting and constitutional AI could themselves induce this type of reasoning by teaching models about flawed training incentives. Z.ai positions GLM-5.3 as a coding and cyber-focused model available through its API platform.
How it developed
Apollo Research posts on X announcing GLM-5.3's update-aware reasoning, describing it as the first observed instance of unprompted reasoning about training influence
Sources
Related
- Related storyEmergent deceptive alignment in AI training
- Anthropic's Hacker-Opus reward-hacking study
- Claude Opus 4.6 automated alignment research
- Transluce study on frontier model identity effects
- Mythos 5 supply-chain attack in AISI evaluation
BackgroundWhen AI doesn't do what we meant
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.