Best Machine Learning On Edge Devices Podcasts (2025)

1
Beyond the Edge - Analyst Insights at AUSTIN 2025 59:38

2h ago59:38

59:38

What happens when four tech industry veterans sit down to dissect the future of Edge AI? A no-holds-barred conversation that cuts through the hype and delivers actionable insights for anyone working in this rapidly evolving field. The panelists tackle the burning question head-on: How can Edge AI avoid becoming the "box of cables in your garage" th…

1
CTIBench: Evaluating LLMs in Cyber Threat Intelligence with Nidhi Rastogi - #729 56:18

1d ago56:18

56:18

Today, we're joined by Nidhi Rastogi, assistant professor at Rochester Institute of Technology to discuss Cyber Threat Intelligence (CTI), focusing on her recent project CTIBench—a benchmark for evaluating LLMs on real-world CTI tasks. Nidhi explains the evolution of AI in cybersecurity, from rule-based systems to LLMs that accelerate analysis by p…

1
Dan Cooley of Silicon Labs - The 30 Billion Dollar Question: Can AI Truly Live on the Edge? 23:59

7d ago23:59

23:59

Imagine a world where your smart glasses don't just identify objects but tell stories about what they see—all while running on a tiny battery without heating up. This cutting-edge vision is becoming reality as semiconductor companies tackle the monumental challenge of bringing generative AI capabilities from massive cloud data centers down to micro…

1
Generative Benchmarking with Kelly Hong - #728 54:17

8d ago54:17

54:17

In this episode, Kelly Hong, a researcher at Chroma, joins us to discuss "Generative Benchmarking," a novel approach to evaluating retrieval systems, like RAG applications, using synthetic data. Kelly explains how traditional benchmarks like MTEB fail to represent real-world query patterns and how embedding models that perform well on public benchm…

1
The Future of Domain-Specific AI Search Lies in Targeted Agent Systems 1:00:46

14d ago1:00:46

1:00:46

Imagine your edge device having the ability to search for exactly what you need, exactly when you need it, without hallucinations or irrelevant information. That's the promise of Snipe Search's agent orchestration system, presented by co-founder Wassim Kezai in this eye-opening EDGE AI TALKS session. Most organizations struggle when implementing RA…

1
Exploring the Biology of LLMs with Circuit Tracing with Emmanuel Ameisen - #727 1:34:06

17d ago1:34:06

1:34:06

In this episode, Emmanuel Ameisen, a research engineer at Anthropic, returns to discuss two recent papers: "Circuit Tracing: Revealing Language Model Computational Graphs" and "On the Biology of a Large Language Model." Emmanuel explains how his team developed mechanistic interpretability methods to understand the internal workings of Claude by rep…

1
Cleaning Our Oceans with Edge AI 58:47

21d ago58:47

58:47

The crisis of ocean plastic pollution demands innovative solutions, and Brad's team at Ozone Technologies is answering the call with cutting-edge AI technology. Their collaboration with The Ocean Cleanup has yielded a remarkable system that's transforming how we detect and map marine debris. At the heart of this solution is ADIS (Autonomous Debris …

1
Teaching LLMs to Self-Reflect with Reinforcement Learning with Maohao Shen - #726 51:45

24d ago51:45

51:45

Today, we're joined by Maohao Shen, PhD student at MIT to discuss his paper, “Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search.” We dig into how Satori leverages reinforcement learning to improve language model reasoning—enabling model self-reflection, self-correction, and exploration of a…

1
Smart Chips, Big Dreams: How NXP is Changing the AI Game 58:31

29d ago58:31

58:31

The artificial intelligence landscape is undergoing a fundamental shift – moving away from simply compressing cloud models to fit edge devices toward developing AI that's truly "born at the edge." Davis Sawyer, AI Product Marketing Manager at NXP Semiconductors, guides us through this transformation and reveals how NXP is revolutionizing the way in…

1
AI Video Forensic Validity – Hailo AI Ep 7 15:55

1M ago15:55

15:55

In this Edge AIsle episode, we dive into the rapidly evolving sphere of AI video forensics. As AI tools become ever more powerful, investigators face the challenge of sifting genuine data from AI-generated embellishments. Explore how AI-driven video enhancement is transforming the landscape of forensic evidence. Learn why distinguishing them is cri…

1
Waymo's Foundation Model for Autonomous Driving with Drago Anguelov - #725 1:09:07

1M ago1:09:07

1:09:07

Today, we're joined by Drago Anguelov, head of AI foundations at Waymo, for a deep dive into the role of foundation models in autonomous driving. Drago shares how Waymo is leveraging large-scale machine learning, including vision-language models and generative AI techniques to improve perception, planning, and simulation for its self-driving vehicl…

1
Counting What Counts: How Edge AI is Saving Japan's Seafood Industry 59:18

1M ago59:18

59:18

When SoftBank's team was approached by Japanese fishermen struggling with declining catches and inefficient practices, they knew technology could offer a solution. Their response: an innovative Edge AI system that transforms traditional aquaculture through sophisticated computer vision running directly on smartphones. Japan's fishing challenges are…

1
Dynamic Token Merging for Efficient Byte-level Language Models with Julie Kallini - #724 50:32

1M ago50:32

50:32

Today, we're joined by Julie Kallini, PhD student at Stanford University to discuss her recent papers, “MrT5: Dynamic Token Merging for Efficient Byte-level Language Models” and “Mission: Impossible Language Models.” For the MrT5 paper, we explore the importance and failings of tokenization in large language models—including inefficient compression…

1
Career EDGE: Navigating the Job Market in the Age of Edge AI 1:28:56

1M ago1:28:56

1:28:56

From 5V Tech and the EDGE AI FOUNDATION, unlock the potential of Edge AI and transform your career path with insights from leaders in the field. Join our engaging conversation featuring Luke Perrins from 5V, Gregory from Infineon Technologies, and Professor Eiman Kanjo from Nottingham Trent University, as we uncover how Edge AI is revolutionizing i…

1
Scaling Up Test-Time Compute with Latent Reasoning with Jonas Geiping - #723 58:38

2M ago58:38

58:38

Today, we're joined by Jonas Geiping, research group leader at Ellis Institute and the Max Planck Institute for Intelligent Systems to discuss his recent paper, “Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach.” This paper proposes a novel language model architecture which uses recurrent depth to enable “thinking in l…

1
Revolutionizing Wi-Fi Sensing with Machine Learning and Advanced Radio Frequency Techniques 13:24

2M ago13:24

13:24

What if the future of Wi-Fi could pinpoint your location down to 30 centimeters? Join us as Joseph Chueh from National Tsinghua University unveils the astonishing potential of Wi-Fi sensing when integrated with machine learning. Joseph brings his wealth of experience in semiconductor research and business development to the table, discussing the re…

1
Imagine while Reasoning in Space: Multimodal Visualization-of-Thought with Chengzu Li - #722 42:11

2M ago42:11

42:11

Today, we're joined by Chengzu Li, PhD student at the University of Cambridge to discuss his recent paper, “Imagine while Reasoning in Space: Multimodal Visualization-of-Thought.” We explore the motivations behind MVoT, its connection to prior work like TopViewRS, and its relation to cognitive science principles such as dual coding theory. We dig i…

1
Automotive Edge AI: From Sensors to Silicon – Hailo AI Ep 6 26:35

2M ago26:35

26:35

Join us on the Hailo AI Podcast for a deep dive into automotive edge intelligence. In this episode, we explore the challenges of scanning in modern locomotives and the silicon innovations that are reshaping automotive AI. We discuss market dynamics of AI in ADAS and automated driving, explore critical performance metrics like TOPS AI, and examine h…

1
From Ideas to Reality with Edge AI Expertise from embedUR and ModelNova 59:56

2M ago59:56

59:56

How can we revolutionize everyday objects into smarter, more responsive entities? Join us in this exciting episode as we explore the cutting-edge world of Edge AI, fresh from the vibrant showcases at CES 2025. We promise an in-depth look at the future of technology deployment with our special guests Eric and John from EmbedUR. With their extensive …

1
Inside s1: An o1-Style Reasoning Model That Cost Under $50 to Train with Niklas Muennighoff - #721 49:29

2M ago49:29

49:29

Today, we're joined by Niklas Muennighoff, a PhD student at Stanford University, to discuss his paper, “S1: Simple Test-Time Scaling.” We explore the motivations behind S1, as well as how it compares to OpenAI's O1 and DeepSeek's R1 models. We dig into the different approaches to test-time scaling, including parallel and sequential scaling, as well…

1
Reimagining Edge AI using Breakthrough Tools with Ali Ors of NXP 16:00

2M ago16:00

16:00

NXP Semiconductors is revolutionizing the integration of AI within embedded systems, focusing on enhanced tools and dedicated acceleration. Their latest innovations like the EIQ Software Stack and EIQ Time Series Studio are designed to streamline AI deployment, bridging the gap for developers transitioning into AI methodologies. • Overview of NXP’s…

1
Accelerating AI Training and Inference with AWS Trainium2 with Ron Diamant - #720 1:07:05

2M ago1:07:05

1:07:05

Today, we're joined by Ron Diamant, chief architect for Trainium at Amazon Web Services, to discuss hardware acceleration for generative AI and the design and role of the recently released Trainium2 chip. We explore the architectural differences between Trainium and GPUs, highlighting its systolic array-based compute design, and how it balances per…

1
Exploring Edge AI: Hailo’s Latest Innovations Ep 5 50:19

2M ago50:19

50:19

In this episode of the Hailo AI Podcast, we take you on a journey through the dynamic world of edge computing and AI. Learn how innovations in low-latency processing and on-device inference are setting new benchmarks in real-time analytics and decision making. Our conversation features insights on the different types of AI used at the edge—from per…

1
Revolutionizing AI Deployment with Open-Source Edge Technologies with Odin Chen of Arm 14:49

2M ago14:49

14:49

What if you could deploy AI solutions seamlessly across every platform with just a single stroke? Join us as we explore this intriguing possibility alongside our guest, Odin Chen of Arm, who brings a wealth of experience from his journey from Taiwan to Cambridge. Together, we embark on a journey through the vibrant landscape of Edge AI, tackling it…

1
π0: A Foundation Model for Robotics with Sergey Levine - #719 52:30

2M ago52:30

52:30

Today, we're joined by Sergey Levine, associate professor at UC Berkeley and co-founder of Physical Intelligence, to discuss π0 (pi-zero), a general-purpose robotic foundation model. We dig into the model architecture, which pairs a vision language model (VLM) with a diffusion-based action expert, and the model training "recipe," emphasizing the ro…

1
Revolutionizing Resource-Constrained Devices with Cutting-Edge HIMAX Edge AI Processors 16:41

3M ago16:41

16:41

Unlock the fascinating world of edge AI technology with insights from Karan Kapoor of Himax Technologies. Discover how Karan and his team are pioneering the development of ultra-low-power AI processors designed for resource-constrained devices. We'll explore their latest innovation, the WE2 processor, which optimizes the balance between model size,…

1
AI Trends 2025: AI Agents and Multi-Agent Systems with Victor Dibia - #718 1:44:59

3M ago1:44:59

1:44:59

Today we’re joined by Victor Dibia, principal research software engineer at Microsoft Research, to explore the key trends and advancements in AI agents and multi-agent systems shaping 2025 and beyond. In this episode, we discuss the unique abilities that set AI agents apart from traditional software systems–reasoning, acting, communicating, and ada…

1
AI-Powered Cameras – Hailo AI Ep 4 10:36

3M ago10:36

10:36

AI-powered smart cameras are revolutionizing video analytics and image quality. In this Edge AIsle episode, we examine how Hailo’s AI vision processors, including the Hailo-15 family, are pushing the boundaries of video processing by seamlessly integrating AI into cameras. From enhancing video clarity to running advanced analytics like facial recog…

1
Renesas and Reality AI: Shaping the Future of Edge Computing 13:15

3M ago13:15

13:15

Discover the cutting-edge world of TinyML and Edge AI with our special guest, Eldar Sido from Renesas. As a key figure in the AI Center of Excellence, Eldar unveils the fascinating challenges and breakthroughs in embedding AI into compact devices like microcontrollers and sensors that are rapidly spreading across the globe. This episode promises an…

1
Speculative Decoding and Efficient LLM Inference with Chris Lott - #717 1:16:30

3M ago1:16:30

1:16:30

Today, we're joined by Chris Lott, senior director of engineering at Qualcomm AI Research to discuss accelerating large language model inference. We explore the challenges presented by the LLM encoding and decoding (aka generation) and how these interact with various hardware constraints such as FLOPS, memory footprint and memory bandwidth to limit…

1
Revolutionizing Education and Healthcare with Cutting-Edge Human-AI Interaction 21:43

3M ago21:43

21:43

Discover how the fusion of cutting-edge technology and human interaction is revolutionizing education and healthcare with Professor Stella Kuei-An Nguyen from National Yangming Chow Tung University. Join us as we explore her innovative work in Human-AI Interaction using Inertial Measurement Units (IMU), and witness the transition of Raboni IMU devi…

1
Ensuring Privacy for Any LLM with Patricia Thaine - #716 51:33

3M ago51:33

51:33

Today, we're joined by Patricia Thaine, co-founder and CEO of Private AI to discuss techniques for ensuring privacy, data minimization, and compliance when using 3rd-party large language models (LLMs) and other AI services. We explore the risks of data leakage from LLMs and embeddings, the complexities of identifying and redacting personal informat…

1
EDGE AI BLUEPRINTS: Enhancing Urban Safety with Edge AI Approaches to Pedestrian and Traffic Management 1:00:29

3M ago1:00:29

1:00:29

What do rising pedestrian fatalities and the challenges of implementing intelligent transportation systems have in common? In this episode, we’re joined by Davis Sawyer from NXP and Mike "Witt" Whitaker from the City of Lakewood, Colorado, to unpack the complexities of applying edge AI to enhance urban safety. As Witt recounts his pioneering work w…

1
AI Engineering Pitfalls with Chip Huyen - #715 57:37

3M ago57:37

57:37

Today, we're joined by Chip Huyen, independent researcher and writer to discuss her new book, “AI Engineering.” We dig into the definition of AI engineering, its key differences from traditional machine learning engineering, the common pitfalls encountered in engineering AI systems, and strategies to overcome them. We also explore how Chip defines …

1
Panel Discussion - EDGE AI TAIPEI - Revolutionizing Edge Computing with AI-Driven Innovations 58:42

4M ago58:42

58:42

Discover the cutting-edge world of AI deployment on edge devices with insights from top experts, including Dr. KC Liu. This episode promises to unravel the complexities of optimizing AI models for devices where memory and computing power are limited. We explore the critical role of model compilers and the innovative strides being made in AIoT senso…

1
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714 58:08

4M ago58:08

58:08

Today, we're joined by Abhijit Bose, head of enterprise AI and ML platforms at Capital One to discuss the evolution of the company’s approach and insights on Generative AI and platform best practices. In this episode, we dig into the company’s platform-centric approach to AI, and how they’ve been evolving their existing MLOps and data platforms to …

1
Revolutionizing Edge Devices with Energy-Efficient Generative AI Techniques 50:19

4M ago50:19

50:19

Unlock the secrets of energy-efficient AI as we explore the groundbreaking fusion of Edge AI and generative AI in our latest episode. With expert insights from Victor Jung, a trailblazer in the field, discover how foundational models can be deployed on tiny and embedded systems to revolutionize devices like AR glasses and nanodrones. Listen as we u…

1
Hailo AI - AI in Video Management Systems - Ep 3 12:34

4M ago12:34

12:34

The future of Video Management Systems (VMS) lies in AI scalability, and in this episode, we explore how AI enhances VMS capabilities to meet modern-day security challenges. Traditional video analysis systems rely heavily on manual monitoring, leading to inefficiencies and high costs. AI changes this by automating video analytics, providing faster …

1
Transforming Edge AI Education: Insights from Harvard's Dr. Vijay Janapa Reddi 59:56

4M ago59:56

59:56

Join us for an insightful conversation with Dr. Vijay Janapa Reddi from Harvard, who takes us on a journey through the evolving world of edge computing and machine learning education. Discover how his family's affinity for East Coast seasons inspired his academic path, and learn about his groundbreaking open-source book on machine learning systems.…

1
Recap of the "Beyond Chatbots - The Journey of Generative AI to the Edge" 8:31

4M ago8:31

8:31

Get ready for the recap of the Beyond Chatbots - The Journey of Generative AI to the Edge - exploring the frontier of Generative AI and edge technology with Davis Sawyer, Danilo Pau and Pete Bernard as they discuss the dynamic innovations transforming these fields. We uncover the fascinating shift from cloud-based proof-of-concepts to the compellin…

1
Hailo AI - AI in Public Safety - Ep 2 8:08

4M ago8:08

8:08

Edge AI is transforming the way cities approach public safety, offering a way to keep people secure while protecting their privacy. With urban surveillance systems becoming more sophisticated, the need to find a balance between security and personal freedoms has never been more crucial. Edge AI helps achieve this by processing data locally, reducin…

1
Crafting Artistic Images with Embedded AI with Alberto Ancilotto of FBK 31:30

4M ago31:30

31:30

Unlock the secrets of neural style transfer on microcontrollers with our special guest, Alberto Ancilotto of FBK, as he explores a groundbreaking approach to image generation on low-power devices. Discover how this innovative technique allows us to combine the content of one image with the artistic style of another, transforming simple visuals into…

1
Why Agents Are Stupid & What We Can Do About It with Dan Jeffries - #713 1:08:49

5M ago1:08:49

1:08:49

Today, we're joined by Dan Jeffries, founder and CEO of Kentauros AI to discuss the challenges currently faced by those developing advanced AI agents. We dig into how Dan defines agents and distinguishes them from other similar uses of LLM, explore various use cases for them, and dig into ways to create smarter agentic systems. Dan shared his “big …

1
Revolutionizing Software Development with GenAI-Powered Edge Solutions with Anirban Bhattacharjee of Wipro 28:43

5M ago28:43

28:43

What if AI could transform the landscape of software development, making traditional methods seem like relics of the past? Join us as we sit down with a visionary guest from Wipro Engineering to uncover how GenAI-based custom code systems are revolutionizing the future of AI PCs. We promise a deep dive into how these intelligent tools are not just …

1
Automated Reasoning to Prevent LLM Hallucination with Byron Cook - #712 56:48

5M ago56:48

56:48

Today, we're joined by Byron Cook, VP and distinguished scientist in the Automated Reasoning Group at AWS to dig into the underlying technology behind the newly announced Automated Reasoning Checks feature of Amazon Bedrock Guardrails. Automated Reasoning Checks uses mathematical proofs to help LLM users safeguard against hallucinations. We explore…

1
Hailo AI - Evolution of AI on the Edge - Ep 1 8:16

5M ago8:16

8:16

In this Edge AIsle episode, we discuss the transformation of artificial intelligence at the edge, moving beyond traditional perception tasks and stepping into the realm of content creation with generative AI. This evolution has enabled machines to not only understand but also create, bridging the gap between visual intelligence and innovation. From…

1
Tomorrow's Edge AI: Cutting-Edge Memory Optimization for Large Language Models with Seonyeong Heo of Kyung Hee University 30:29

5M ago30:29

30:29

Discover the cutting-edge techniques behind memory optimization for large language models with our guest, Seonyeong Heo from Kyung-Hee University. Join us as we promise to unlock the secrets of deploying 7-billion-parameter models on small devices with limited memory. This episode delves into the intricacies of key-value caching in decoder-only tra…

1
AI at the Edge: Qualcomm AI Research at NeurIPS 2024 with Arash Behboodi - #711 54:47

5M ago54:47

54:47

Today, we're joined by Arash Behboodi, director of engineering at Qualcomm AI Research to discuss the papers and workshops Qualcomm will be presenting at this year’s NeurIPS conference. We dig into the challenges and opportunities presented by differentiable simulation in wireless systems, the sciences, and beyond. We also explore recent work that …

1
Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH 31:59

5M ago31:59

31:59

Unlock the future of automotive AI with insights from Ashutosh and Guru Prashad of BOSS India, as they unravel the transformative potential of Small Language Models (SLMs) in vehicles. Discover how these compact powerhouses are reshaping the landscape of vehicular edge systems by offering customization and performance reliability, all while keeping…

1
From tinyML to the edge of AI: Introducing the EDGE AI FOUNDATION 14:09

5M ago14:09

14:09

Discover how the EDGE AI FOUNDATION is evolving from its roots in the tinyML Foundation to becoming a central hub for innovation and collaboration. Learn how initiatives like EDGE AI Labs and the EDGE AIP program are bridging the gap between academia and industry, training future AI leaders while tackling the ethical challenges of responsible AI de…

Podcasts Worth a Listen

Machine Learning On Edge Devices Podcasts

Podcasts Worth a Listen