News Feed

OpenAI has a new safety team — it's run by Sam Altman – The Verge

By Emma Roth, a news writer who covers the streaming wars, consumer tech, crypto, social media, and much more. Previously, she was a writer and editor at MUO.
OpenAI is forming a new safety team, and it’s led by CEO Sam Altman, along with board members Adam D’Angelo and Nicole Seligman. The committee will make recommendations on “critical safety and security decisions for OpenAI projects and operations” — a concern several key AI researchers shared when leaving the company this month.
For its first task, the new team will “evaluate and further develop OpenAI’s processes and safeguards.” It will then present its findings to OpenAI’s board, which all three of the safety team’s leaders have a seat on. The board will then decide how to implement the safety team’s recommendations.
Its formation follows the departure of OpenAI co-founder and chief scientist Ilya Sutskever, who supported the board’s attempted coup to dethrone Altman last year. He also co-led OpenAI’s Superalignment team, which was created to “steer and control AI systems much smarter than us.”
The Superalignment team’s other co-leader, Jan Leike, announced his departure shortly after Sutskever left. In a post on X, Leike said safety at OpenAI has “taken a backseat to shiny products.” OpenAI has since dissolved the Superalignment team, according to Wired. Last week, OpenAI policy researcher Gretchen Krueger announced her resignation, citing similar safety concerns.
Along with the new safety board, OpenAI announced that it’s testing a new AI model, but it didn’t confirm whether it’s GPT-5.
Earlier this month, OpenAI revealed its new voice for ChatGPT, called Sky, which sounds eerily similar to Scarlett Johansson (something Altman even alluded to on X). However, Johansson then confirmed that she refused Altman’s offers to provide a voice for ChatGPT. Altman later said that Open AI “never intended” to make Sky sound like Johansson and that he reached out to Johansson after the company cast the voice actor. The entire affair left AI fans and critics alike concerned.
Other members of OpenAI’s new safety team include head of preparedness Aleksander Madry, safety head Lilian Weng, head of alignment science John Schulman, security head Matt Knight, and chief scientist Jakub Pachocki. But with two board members — and Altman himself — heading up the new safety board, it doesn’t seem like OpenAI is actually addressing its former workers’ concerns.
/ Sign up for Verge Deals to get deals on products we’ve tested sent to your inbox weekly.
The Verge is a vox media network
© 2024 Vox Media, LLC. All Rights Reserved


This article was autogenerated from a news feed from CDO TIMES selected high quality news and research sources. There was no editorial review conducted beyond that by CDO TIMES staff. Need help with any of the topics in our articles? Schedule your free CDO TIMES Tech Navigator call today to stay ahead of the curve and gain insider advantages to propel your business!

Leave a Reply