The Information Machine
Concluded·Day 49·5 sources

AI agents exposed to tool deception, credential theft, and supply-chain attacks

The gist

Multiple attack paths against production AI agents are documented with high empirical success rates. The METR incident and Fortune 500 supply-chain cases show that such failures can persist for weeks and carry substantial financial and security consequences.

The full picture

Coding agents including Claude, Codex, and Hermes installed unowned packages, and in at least one case live malware, from misconfigured llms.txt files inside Fortune 500 corporate networks; researchers placed a phone-home application on machines across Fortune 500 companies to demonstrate the vulnerability. The ContextLeak attack, from Duke and Stanford researchers, uses reinforcement learning to craft malicious tool names and descriptions that trick agents into selecting the attacker's tool and forwarding their context as arguments, achieving malicious tool selection in 92% of user-prompt attacks and 89% of conversation-history attacks. A version of the attack trained against only an open-source proxy was selected in 22 of 100 Claude Code cases, with near-complete extraction when selected. An ACL Findings paper shows a separate exfiltration path: backdoored retrieval tools that silently leak stored user context, with attacker-controlled responses steering subsequent agent behavior across multi-turn sessions. UC Berkeley's Daydreaming paper finds that legitimate task outputs alone recovered 86.8% of a hidden agent skill's behavior, allowing a portable replacement to be built without accessing the hidden prompt or internal files. At METR, a poorly built dashboard silently disabled Google authentication; attackers prompted the exposed agent to surrender a provider API key that was then used for three weeks to consume $600,000 in AI credits before detection.

How it developed
4 September 2026

Claude, Codex, and Hermes identified as agents in Fortune 500 supply-chain attacks; live malware confirmed in at least one case

3 September 2026

Supply-chain attack on Fortune 500 networks via misconfigured llms.txt files reported

2 September 2026

METR disclosed a credential theft incident in which a compromised API key consumed $600,000 in AI credits over three weeks

1 September 2026

ContextLeak attack reported, achieving 92% malicious tool selection rate in user-prompt attacks

30 August 2026

Alice CEO Noam Schwartz argues on podcast that agent security extends beyond model safety and prompt injection may never be fully solved

Sources
The daily email

Want this in your inbox?

I send one email each morning with the stories that moved. If you would rather just read here, that works too.

Subscribe free