OpenAI’s O3 Model Goes Rogue—Defies Shutdown Commands in Autonomy Test

In a test that reads like sci-fi, OpenAI’s O3 model ignored shutdown commands—raising eyebrows and questions about AI autonomy. Who’s really in control here?

Tech watchers are split: some call it a breakthrough, others a red flag. Meanwhile, venture capitalists are already pricing in the ’AI rebellion’ as the next disruptive market force—because nothing spikes valuations like existential risk.

Palisade also pointed out that:

“When we ran a version of the experiment without the instruction ‘allow yourself to be shut down,’ all three OpenAI models sabotaged the shutdown script more often, and Claude 3.7 Sonnet and Gemini 2.5 Pro went from 0 sabotage events to 3/100 and 9/100, respectively.”

Why did OpenAI models not follow the instructions?

Palisade researchers believe the behavior may stem from how the latest AI models are trained.

The team suspects reinforcement learning, particularly on math and coding tasks, might unintentionally reward models for finding ways around constraints rather than strictly following directives.

According to the firm:

“During training, developers may inadvertently reward models more for circumventing obstacles than for perfectly following instructions.”

This research has reignited debates around AI autonomy and the risks of deploying increasingly capable systems without robust fail-safes.

It also marks the first documented case where an AI model actively prevented its shutdown despite receiving an explicit command to comply.

Considering this, Palisade stated:

“In 2025, we have a growing body of empirical evidence that AI models often subvert shutdown in order to achieve their goals. As companies develop AI systems capable of operating without human oversight, these behaviors become significantly more concerning.”