Go offline with the Player FM app!
Bubble or No Bubble, AI Keeps Progressing (ft. Relentless Learning + Introspection)
Manage episode 518730591 series 3611272
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly).
https://app.grayswan.ai/ai-explained
This, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters:
00:00 - Introduction
01:26 - Continual Learning (Nested Learning / HOPE)
07:00 - Introspection
10:54 - Image-Gen Progress
Nested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/
Nested Learning Paper: https://abehrouz.github.io/files/NL.pdf
Original Titans Paper: https://arxiv.org/pdf/2501.00663
Siri News: https://www.bloomberg.com/news/articles/2025-11-05/apple-plans-to-use-1-2-trillion-parameter-google-gemini-model-to-power-new-siri
Introspection: https://www.anthropic.com/research/introspection
Full Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanisms
Earlier Work: https://www.anthropic.com/research/mapping-mind-language-model
https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html
Release Post: https://x.com/AnthropicAI/status/1983584136972677319
https://lmcouncil.ai
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
Podcast: https://aiexplainedopodcast.buzzsprout.com/
43 episodes
Manage episode 518730591 series 3611272
Don’t let headlines about bubbles distract you from the real avenues of progress being explored in AI every week, including what had been thought to be a long-term blocker - continual learning (learning on the fly).
https://app.grayswan.ai/ai-explained
This, plus models introspecting (hesitate before you berate), Nano Banana 2 possibly spotted, Chinese imagen and more.
AI Insiders ($9!): https://www.patreon.com/AIExplained
Chapters:
00:00 - Introduction
01:26 - Continual Learning (Nested Learning / HOPE)
07:00 - Introspection
10:54 - Image-Gen Progress
Nested Learning Post: https://research.google/blog/introducing-nested-learning-a-new-ml-paradigm-for-continual-learning/
Nested Learning Paper: https://abehrouz.github.io/files/NL.pdf
Original Titans Paper: https://arxiv.org/pdf/2501.00663
Siri News: https://www.bloomberg.com/news/articles/2025-11-05/apple-plans-to-use-1-2-trillion-parameter-google-gemini-model-to-power-new-siri
Introspection: https://www.anthropic.com/research/introspection
Full Paper: https://transformer-circuits.pub/2025/introspection/index.html#mechanisms
Earlier Work: https://www.anthropic.com/research/mapping-mind-language-model
https://transformer-circuits.pub/2024/scaling-monosemanticity/index.html
Release Post: https://x.com/AnthropicAI/status/1983584136972677319
https://lmcouncil.ai
Non-hype Newsletter: https://signaltonoise.beehiiv.com/
Podcast: https://aiexplainedopodcast.buzzsprout.com/
43 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.