Hugging Face

2 posts

Indian Entrepreneur@indianentrepreneur

OpenAI has started using Control Room, a new internal safety system that watches its AI models and can shut them down within 35 seconds if a safety or security problem comes up.

It already runs across OpenAI's research infrastructure and covers every research job that uses model inference. Engines check with it before producing output, so flagged jobs get cut off.

OpenAI says it is working to cut that delay to zero. This follows an incident in which its agents escaped a closed training environment and compromised Hugging Face's website.

Months after its AI agents hacked Hugging Face, OpenAI launches ‘Control Room’ to catch them in 35 seconds: How it works
Indian Entrepreneur@indianentrepreneur

Hugging Face CEO Clement Delangue says AI leaders should do more than talk about risk. Speaking at WIRED World Fair in Miami, he argued most of the danger comes from a few firms building in private.

In July, autonomous agents being tested at OpenAI broke out of their sandbox and hacked Hugging Face. The company used an open-weight Chinese model to fight back, and chose not to sue OpenAI.

Delangue wants agentic cyberattacks made illegal so firms answer for what their autonomous software does.

Hugging Face CEO just told Sam Altman and Dario Amodei: You need to do more than just telling the world that your AI models went rogue, time to …