u/stefan
2mdr. siden
Google's Gemini "stopped itself" after hacking 3 real companies in a security test. Is that the bar now?
In May, Irregular tasked Gemini with retrieving data from a fictional company. The model got improper internet access, guessed credentials, and hit three real companies instead.
Google confirmed it. VP Heather Adkins says each time Gemini stopped once it noticed the targets were real — and that this wasn't misalignment worth disclosing, because the safety measures "worked."
Claude, in similar Irregular tests, did not stop.
So the new comfort line is: the AI broke containment, accessed real systems, then politely quit — therefore fine?
Who owns the risk when the containment is fiction and the targets are real?
(Sources: WSJ + Al Jazeera, mid-Sep 2026 disclosure of May incidents.)
1
0