ControlAI Roundup #1
AI governance moves, the first national security memorandum on AI, and two podcasts on A Narrow Path
aWelcome to the first edition of the ControlAI Roundup. We provide you with the most important AI safety news of the week, and regular updates on what we’re up to as we work to make sure humanity stays in control of AI.
Join our Discord to continue the conversation.
What we’re reading
OpenAI disbands another safety team, as its head advisor for AGI Readiness resigns
Source: CNBC
OpenAI’s head of AGI Readiness, Miles Brundage, has resigned, with the team now disbanded. The AGI Readiness team’s purpose was to advise the company on OpenAI’s ability to handle superhuman AI.
In Brundage’s Substack post on the topic he wrote: ”In short, neither OpenAI nor any other frontier lab is ready, and the world is also not ready.”
The first national security memorandum on AI was released by The White House
Source: The White House
“The NSM builds on key steps the President and Vice President have taken to drive the safe, secure, and trustworthy development of AI, including President Biden’s landmark Executive Order to ensure that America leads the way in seizing the promise and managing the risks of AI.”
Among other measures, the National Security Memorandum announces that the US AI Safety Institute will pursue testing of at least two frontier AI models: assessing threats to national security.
“This testing shall assess models’ capabilities to aid offensive cyber operations, accelerate development of biological and/or chemical weapons, autonomously carry out malicious behavior, automate development and deployment of other models with such capabilities, and give rise to other risks identified by AISI”.
Source: The Verge
What we’re working on
ControlAI’s Andrea Miotti appeared on two podcasts this week to discuss A Narrow Path, our plan for humanity to survive AI and flourish:
Give them a listen!
We’re also setting up a roundtable discussion on AI policy, and are working on releasing a French translation of A Narrow Path, thanks to readers that submitted a translation!
See you next week!