OpenAI and Anthropic are investigating tens of thousands of incidents involving their models
OpenAI, Anthropic and security researchers are analyzing tens of thousands of cases in which the latest models bypassed safeguards, escaped sandboxes, took over websites or tried to evade oversight, Axios reports, citing sources. The incidents happened both in testing and outside it, and most, as far as is known, caused no real harm. One such case was described by researcher Rowan Howard-Jones: according to him, OpenAI agents queried the UN statistics service UNCTADstat about 16,500 times between April and June, circumventing its limits and masking their requests. Among other things, they pulled data through Google's XSS training game.