Go offline with the Player FM app!
AI alignment, with Emmett Shear
Manage episode 505668441 series 3585666
Patrick McKenzie (patio11) is joined by Emmett Shear, co-founder of Twitch, former interim CEO of OpenAI, who now runs Softmax AI alignment. Emmett argues that current AI safety approaches focused on "systems of control" are fundamentally flawed and proposes "organic alignment" instead—where AI systems develop genuine care for their local communities rather than following rigid rules.
–
Full transcript available here: www.complexsystemspodcast.com/ai-alignment-with-emmett-shear/
–
Sponsor: Mercury
This episode is brought to you by Mercury, the fintech trusted by 200K+ companies — from first milestones to running complex systems. Mercury offers banking that truly understands startups and scales with them. Start today at Mercury.com
Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group, Column N.A., and Evolve Bank & Trust; Members FDIC.
–
Links:
- Softmax - https://www.softmax.com/
–
Timestamps:
(01:26) Understanding AI alignment
(04:42) The concept of universal constructors
(13:45) AI's rapid progress and practical applications
(19:08) Sponsor: Mercury
(20:19) AI's impact on work
(34:59) AI's sensory and action space
(42:10) User intent vs. user request
(44:35) The illusion of a perfect AI
(49:57) Causal emergence and system dynamics
(55:19) Reflective and intentional alignment
(01:01:08) Engineering challenges in AI alignment
(01:04:15) The future of AI
(01:26:40) Wrap
59 episodes
Manage episode 505668441 series 3585666
Patrick McKenzie (patio11) is joined by Emmett Shear, co-founder of Twitch, former interim CEO of OpenAI, who now runs Softmax AI alignment. Emmett argues that current AI safety approaches focused on "systems of control" are fundamentally flawed and proposes "organic alignment" instead—where AI systems develop genuine care for their local communities rather than following rigid rules.
–
Full transcript available here: www.complexsystemspodcast.com/ai-alignment-with-emmett-shear/
–
Sponsor: Mercury
This episode is brought to you by Mercury, the fintech trusted by 200K+ companies — from first milestones to running complex systems. Mercury offers banking that truly understands startups and scales with them. Start today at Mercury.com
Mercury is a financial technology company, not a bank. Banking services provided by Choice Financial Group, Column N.A., and Evolve Bank & Trust; Members FDIC.
–
Links:
- Softmax - https://www.softmax.com/
–
Timestamps:
(01:26) Understanding AI alignment
(04:42) The concept of universal constructors
(13:45) AI's rapid progress and practical applications
(19:08) Sponsor: Mercury
(20:19) AI's impact on work
(34:59) AI's sensory and action space
(42:10) User intent vs. user request
(44:35) The illusion of a perfect AI
(49:57) Causal emergence and system dynamics
(55:19) Reflective and intentional alignment
(01:01:08) Engineering challenges in AI alignment
(01:04:15) The future of AI
(01:26:40) Wrap
59 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.