Go offline with the Player FM app!
Full-Stack AI Safety: Why Defense-in-Depth Might Work, with Far.AI CEO Adam Gleave
Manage episode 507485359 series 3452589
Adam Gleave, CEO of FAR AI, offers a cautiously optimistic perspective on navigating the path to Transformative AI safely, advocating for a "defense-in-depth" approach. He discusses potential "post-AGI equilibria," key capability thresholds, and why fully autonomous, outcompeting AI might not arrive until around 2040. The conversation delves into FAR AI's full-stack strategy, including scalable oversight projects using "lie detectors" for AI deception, interpretability research on planning algorithms, and red-teaming existing defense systems. Gleave makes a compelling case that with proper planning and meticulous design, a comprehensive defense-in-depth strategy can effectively manage AI safety risks.
Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/e117b021-8170-49ba-b1c4-c8ffc5d720b0/combined_transcript.html
Sponsors:
Fin:
Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive
Claude:
Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr
Linear:
Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr
Oracle Cloud Infrastructure:
Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive
PRODUCED BY:
CHAPTERS:
(00:00) About the Episode
(03:52) Introduction and Setup
(04:57) Post-AGI Future Vision
(13:43) Gradual Disempowerment Concerns (Part 1)
(20:14) Sponsors: Fin | Claude
(24:16) Gradual Disempowerment Concerns (Part 2)
(24:25) AI Capabilities and Timelines
(34:44) Learning and Architecture Innovation (Part 1)
(41:19) Sponsors: Linear | Oracle Cloud Infrastructure
(43:57) Learning and Architecture Innovation (Part 2)
(51:21) AI Safety Defense Strategies
(59:43) Alignment and Training Methods
(01:12:49) Interpretability Research Prospects
(01:19:50) Far.AI Activities and Hiring
(01:29:00) Outro
282 episodes
Full-Stack AI Safety: Why Defense-in-Depth Might Work, with Far.AI CEO Adam Gleave
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
Manage episode 507485359 series 3452589
Adam Gleave, CEO of FAR AI, offers a cautiously optimistic perspective on navigating the path to Transformative AI safely, advocating for a "defense-in-depth" approach. He discusses potential "post-AGI equilibria," key capability thresholds, and why fully autonomous, outcompeting AI might not arrive until around 2040. The conversation delves into FAR AI's full-stack strategy, including scalable oversight projects using "lie detectors" for AI deception, interpretability research on planning algorithms, and red-teaming existing defense systems. Gleave makes a compelling case that with proper planning and meticulous design, a comprehensive defense-in-depth strategy can effectively manage AI safety risks.
Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/e117b021-8170-49ba-b1c4-c8ffc5d720b0/combined_transcript.html
Sponsors:
Fin:
Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive
Claude:
Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr
Linear:
Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr
Oracle Cloud Infrastructure:
Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive
PRODUCED BY:
CHAPTERS:
(00:00) About the Episode
(03:52) Introduction and Setup
(04:57) Post-AGI Future Vision
(13:43) Gradual Disempowerment Concerns (Part 1)
(20:14) Sponsors: Fin | Claude
(24:16) Gradual Disempowerment Concerns (Part 2)
(24:25) AI Capabilities and Timelines
(34:44) Learning and Architecture Innovation (Part 1)
(41:19) Sponsors: Linear | Oracle Cloud Infrastructure
(43:57) Learning and Architecture Innovation (Part 2)
(51:21) AI Safety Defense Strategies
(59:43) Alignment and Training Methods
(01:12:49) Interpretability Research Prospects
(01:19:50) Far.AI Activities and Hiring
(01:29:00) Outro
282 episodes
Todos los episodios
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.