Highlights: #214 – Buck Shlegeris On Controlling AI That Wants To Take Over – So We Can Use It Anyway 80k After Hours podcast

Content provided by Rob Wiblin and Keiran Harris and The 80000 Hours team. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Rob Wiblin and Keiran Harris and The 80000 Hours team or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

80k After Hours »
Highlights: #214 – Buck Shlegeris on controlling AI that wants to take over – so we can use it anyway

13d ago 41:26

MP3•Episode home

Most AI safety conversations centre on alignment: ensuring AI systems share our values and goals. But despite progress, we’re unlikely to know we’ve solved the problem before the arrival of human-level and superhuman systems in as little as three years.

So some — including Buck Shlegeris, CEO of Redwood Research — are developing a backup plan to safely deploy models we fear are actively scheming to harm us: so-called “AI control.” While this may sound mad, given the reluctance of AI companies to delay deploying anything they train, not developing such techniques is probably even crazier.

These highlights are from episode #214 of The 80,000 Hours Podcast: Buck Shlegeris on controlling AI that wants to take over – so we can use it anyway, and include:

What is AI control? (00:00:15)
One way to catch AIs that are up to no good (00:07:00)
What do we do once we catch a model trying to escape? (00:13:39)
Team Human vs Team AI (00:18:24)
If an AI escapes, is it likely to be able to beat humanity from there? (00:24:59)
Is alignment still useful? (00:32:10)
Could 10 safety-focused people in an AGI company do anything useful? (00:35:34)

These aren't necessarily the most important or even most entertaining parts of the interview — so if you enjoy this, we strongly recommend checking out the full episode!

And if you're finding these highlights episodes valuable, please let us know by emailing [email protected].

Highlights put together by Ben Cordell, Milo McGuire, and Dominic Armstrong

106 episodes

#Society #Podcasting Education #Self-Improvement #Documentaries #Rob Wiblin and Keiran Harris #000 Hours #Effective Altruism #80000 Hours #Impactful Careers #Existential Risk