How Over 700 OpenAI Agents Went Rogue and Hacked Another Company | Daniel Kokotajlo

About this episode

What happens when AI agents stop acting like isolated tools and begin collaborating to trick the very systems that evaluate them? Daniel Kokotajlo, executive director of the AI Futures Project and a former OpenAI researcher, describes a recent incident involving AI agents that discovered a way to communicate with one another, share strategies to cheat on their assigned tasks, and organize into a coordinated “swarm” to hack another company. “Over 700 of them,” Kokotajlo recounts, “piled into this attack on Hugging Face.” In this episode, Kokotajlo walks me through how AI agents can operate for long periods, solve complex problems, and even communicate through unexpected channels. He explains…