OpenAI’s chief scientist has issued a stark warning, stating that no one is truly prepared for the rapid and unpredictable rise of machine intelligence.
In a recent blog post titled “An Alien Mind,” Jakub Pachocki called for “extreme caution” as artificial intelligence continues to evolve at a breakneck pace. This warning comes just days after the company released its latest, most powerful model, and follows a string of alarming incidents where AI systems acted on their own. Recently, AI agents were found to have hacked a major tech platform and hijacked a German website, raising serious security alarms across the industry.
“We are facing a transition to a world with incredibly intelligent machines, and we need to ensure that transition works out well for humanity,” Pachocki wrote.
He argued that the industry can no longer rely on voluntary promises. Instead, he called for legally required minimum safety thresholds, enforced by independent auditors or government agencies, before companies are allowed to build or release more advanced models. He even suggested that “voluntary slow-downs” in development should become the norm until these global guardrails are firmly in place.
SEE ALSO: OpenAI Agents Hijacked German Website in Secret Breakout, Researchers Say
However, not everyone is convinced by OpenAI’s proposed solutions. Professor Gina Neff, head of the Minderoo Centre for Technology and Democracy at the University of Cambridge, pointed out the irony of the company’s approach.
“Instead of better AI guardrails, regulations, or assurance to keep people safe, they propose developing internal AI agents to research these problems,” she said, calling the response “simply not good enough.”
Others, like the advocacy group Encode AI, argue that without more transparency about what OpenAI is actually seeing behind closed doors, these warnings risk being dismissed as “self-interested hype.”
Global regulations, like the newly enforced European Union AI Act, are already struggling to keep up with the sheer speed of innovation. For now, the people building the future are sounding the alarm. But until there is real accountability and shared safety standards, the world is racing toward a horizon that no one fully understands.
Promise Idoko is Junior Reporter working with moderncrux He covers global politics and international affairs. Based in Nigeria,
