Go offline with the Player FM app!
AI and the Future of Work: Artificial Intelligence in the Workplace, Business, Ethics, HR, and IT for AI Enthusiasts, Leaders and Academics
»
366: Inside the Age of Inference: Sid Sheth, CEO and Co-Founder of d-Matrix, on Smaller Models, AI Chips, and the Future of Compute
Manage episode 523274954 series 2986762
Sid Sheth is the CEO and co-founder of d-Matrix, the AI chip company making inference efficient and scalable for datacenters. Backed by Microsoft and with $160M raised, Sid shares why rethinking infrastructure is critical to AI’s future and how a decade in semiconductors prepared him for this moment.
In this conversation, we discuss:
- Why Sid believes AI inference is the biggest computing opportunity of our lifetime and how it will drive the next productivity boom
- The real reason smaller, more efficient models are unlocking the era of inference and what that means for AI adoption at scale
- Why cost, time, and energy are the core constraints of inference, and how D-Matrix is building for performance without compromise
- How the rise of reasoning models and agentic AI shifts demand from generic tasks to abstract problem-solving
- The workforce challenge no one talks about: why talent shortages, not tech limitations, may slow down the AI revolution
- How Sid’s background in semiconductors prepared him to recognize the platform shift toward AI and take the leap into building D-Matrix
Resources:
317 episodes
Manage episode 523274954 series 2986762
Sid Sheth is the CEO and co-founder of d-Matrix, the AI chip company making inference efficient and scalable for datacenters. Backed by Microsoft and with $160M raised, Sid shares why rethinking infrastructure is critical to AI’s future and how a decade in semiconductors prepared him for this moment.
In this conversation, we discuss:
- Why Sid believes AI inference is the biggest computing opportunity of our lifetime and how it will drive the next productivity boom
- The real reason smaller, more efficient models are unlocking the era of inference and what that means for AI adoption at scale
- Why cost, time, and energy are the core constraints of inference, and how D-Matrix is building for performance without compromise
- How the rise of reasoning models and agentic AI shifts demand from generic tasks to abstract problem-solving
- The workforce challenge no one talks about: why talent shortages, not tech limitations, may slow down the AI revolution
- How Sid’s background in semiconductors prepared him to recognize the platform shift toward AI and take the leap into building D-Matrix
Resources:
317 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.