ControlAI Weekly Roundup #4
Elon Musk could help Trump understand that an AGI race is a “suicide race”, AI poses risks to financial stability, and Amazon mulls a new multi-billion dollar investment round in Anthropic.
Welcome to the ControlAI Weekly Roundup! Each week we provide you with the most important AI safety news, and regular updates on what we’re up to as we work to make sure humanity stays in control of AI.
Join our Discord to continue the conversation.
What we’re reading
Musk’s influence on Trump could lead to tougher AI standards, says scientist
Source: The Guardian
At the Guardian Web Summit in Lisbon, Max Tegmark said that Elon Musk, who strongly backed President-elect Trump in the US election, and who Trump has said will lead a new Department of Government Efficiency (DOGE), could persuade Trump to introduce safety standards for AI and prevent AGI.
Tegmark added “He might help Trump understand that an AGI race is a suicide race”.
We previously wrote about the possibility of an AGI suicide race in our newsletter here: A Race We All LoseAI use poses risks to global financial system, standard-setters warn
Source: Euronews
The Financial Stability Board, an international body that monitors and makes recommendations about the global financial system, has said that AI could lead to herding, fraud, and disinformation.
The board wrote that AI may “potentially amplify certain financial sector vulnerabilities and thereby pose risks to financial stability”.Amazon mulls new multi-billion dollar investment in Anthropic, the Information reports
Source: Reuters
Amazon is reportedly in talks for a second multi-billion dollar investment in AGI company Anthropic.
According to a report in The Information, Amazon has asked Anthropic to use a large number of servers powered by chips developed by Amazon, although Anthropic reportedly prefers to use Nvidia chips.
What we’re watching
We’ve published three clips of ControlAI’s Andrea Miotti on the Future of Life Institute’s podcast, discussing A Narrow Path, our plan for humanity to survive AI and flourish:
What we’re working on
This week our policy team has been hard at work meeting with parliamentarians in the UK’s House of Commons and House of Lords. Our Policy Analyst Leticia Garcia is also a panellist at Newspeak House’s AI Safety Talk this evening.
We recently updated our site and added an overview of our work on superintelligence — check it out at www.controlai.com/superintelligence
If you want to continue the conversation, join our Discord where we also post a daily version of the Roundup.
See you next week!