Africa-focused technology, digital and innovation ecosystem insight and commentary.
…
continue reading
Content provided by DataTalks.Club. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by DataTalks.Club or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Similar to DataTalks.Club
Show notes are at https://stevelitchfield.com/sshow/chat.html
…
continue reading
The American healthcare system is one of the most innovative in the world. But it’s also riddled with complex challenges, such as access to affordable medications, inefficiency and administrative burdens, and communication barriers between providers. There’s clearly a better way—and at Surescripts, we have a unique sightline into what that may be. In this series, host Melanie Marcus, Chief Marketing Officer of Surescripts, sits down with today’s most inspiring and innovative leaders in healt ...
…
continue reading
Android Backstage, a podcast by and for Android developers. Hosted by developers from the Android engineering team, this show covers topics of interest to Android programmers, with in-depth discussions and interviews with engineers on the Android team at Google. Subscribe to Android Developers YouTube → https://goo.gle/AndroidDevs
…
continue reading
The power of Data is undeniable. And unharnessed - it’s nothing but chaos. Making data your ally. Using it to lead with confidence and clarity. Host Jess Carter is solving problems in real-time to reveal what’s possible. Helping communities and people thrive. This is Data Driven Leadership, a show brought to you by Resultant.
…
continue reading
Download This Show is your weekly guide to the world of media, culture, and technology. From social media to gadgets, streaming services to privacy issues. Each week Rae Johnston and guests take a fun, deep dive into how technology is reshaping our lives.
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
This is the audio podcast version of Troy Hunt's weekly update video published here: https://www.troyhunt.com/tag/weekly-update/
…
continue reading
The director’s commentary track for Daring Fireball. Long digressions on Apple, technology, design, movies, and more.
…
continue reading
We help founders make something people want.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
Redefining AI Infrastructure: Open-Source, Chips, and the Future Beyond Kubernetes – Andrey Cheptsov
Manage episode 464263663 series 2831626
Content provided by DataTalks.Club. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by DataTalks.Club or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
In this podcast episode, we talked with Andrey Cheptsov about The future of AI infrastructure.
About the Speaker:
Andrey Cheptsov is the founder and CEO of dstack, an open-source alternative to Kubernetes and Slurm, built to simplify the orchestration of AI infrastructure. Before dstack, Andrey worked at JetBrains for over a decade helping different teams make the best developer tools.
During the event, the guest, Andrey Cheptsov, founder and CEO of dstack, discussed the complexities of AI infrastructure. We explore topics like the challenges of using Kubernetes for AI workloads, the need to rethink container orchestration, and the future of hybrid and cloud-only infrastructures. Andrey also shares insights into the role of on-premise and bare-metal solutions, edge computing, and federated learning.
00:00 Andrey's Career Journey: From JetBrains to DStack
5:00 The Motivation Behind DStack
7:00 Challenges in Machine Learning Infrastructure
10:00 Transitioning from Cloud to On-Prem Solutions
14:30 Reflections on OpenAI's Evolution
17:30 Open Source vs Proprietary Models: A Balanced Perspective
21:01 Monolithic vs. Decentralized AI businesses
22:05 The role of privacy and control in AI for industries like banking and healthcare
30:00 Challenges in training large AI models: GPUs and distributed systems
37:03 DeepSpeed's efficient training approach vs. brute force methods
39:00 Challenges for small and medium businesses: hosting and fine-tuning models
47:01 Managing Kubernetes challenges for AI teams
52:00 Hybrid vs. cloud-only infrastructure
56:03 On-premise vs. bare-metal solutions
58:05 Exploring edge computing and its challenges
🔗 CONNECT WITH ANDREY CHEPTSOV
Twitter - / andrey_cheptsov
Linkedin - / andrey-cheptsov
GitHub - https://github.com/dstackai/dstack/
Website - https://dstack.ai/
🔗 CONNECT WITH DataTalksClub
Join DataTalks.Club:https://datatalks.club/slack.html
Our events:https://datatalks.club/events.html
Datalike Substack -https://datalike.substack.com/
LinkedIn: / datatalks-club
183 episodes
Redefining AI Infrastructure: Open-Source, Chips, and the Future Beyond Kubernetes – Andrey Cheptsov
Share
Manage episode 464263663 series 2831626
Content provided by DataTalks.Club. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by DataTalks.Club or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
In this podcast episode, we talked with Andrey Cheptsov about The future of AI infrastructure.
About the Speaker:
Andrey Cheptsov is the founder and CEO of dstack, an open-source alternative to Kubernetes and Slurm, built to simplify the orchestration of AI infrastructure. Before dstack, Andrey worked at JetBrains for over a decade helping different teams make the best developer tools.
During the event, the guest, Andrey Cheptsov, founder and CEO of dstack, discussed the complexities of AI infrastructure. We explore topics like the challenges of using Kubernetes for AI workloads, the need to rethink container orchestration, and the future of hybrid and cloud-only infrastructures. Andrey also shares insights into the role of on-premise and bare-metal solutions, edge computing, and federated learning.
00:00 Andrey's Career Journey: From JetBrains to DStack
5:00 The Motivation Behind DStack
7:00 Challenges in Machine Learning Infrastructure
10:00 Transitioning from Cloud to On-Prem Solutions
14:30 Reflections on OpenAI's Evolution
17:30 Open Source vs Proprietary Models: A Balanced Perspective
21:01 Monolithic vs. Decentralized AI businesses
22:05 The role of privacy and control in AI for industries like banking and healthcare
30:00 Challenges in training large AI models: GPUs and distributed systems
37:03 DeepSpeed's efficient training approach vs. brute force methods
39:00 Challenges for small and medium businesses: hosting and fine-tuning models
47:01 Managing Kubernetes challenges for AI teams
52:00 Hybrid vs. cloud-only infrastructure
56:03 On-premise vs. bare-metal solutions
58:05 Exploring edge computing and its challenges
🔗 CONNECT WITH ANDREY CHEPTSOV
Twitter - / andrey_cheptsov
Linkedin - / andrey-cheptsov
GitHub - https://github.com/dstackai/dstack/
Website - https://dstack.ai/
🔗 CONNECT WITH DataTalksClub
Join DataTalks.Club:https://datatalks.club/slack.html
Our events:https://datatalks.club/events.html
Datalike Substack -https://datalike.substack.com/
LinkedIn: / datatalks-club
183 episodes
All episodes
×
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Similar to DataTalks.Club
Africa-focused technology, digital and innovation ecosystem insight and commentary.
…
continue reading
Show notes are at https://stevelitchfield.com/sshow/chat.html
…
continue reading
The American healthcare system is one of the most innovative in the world. But it’s also riddled with complex challenges, such as access to affordable medications, inefficiency and administrative burdens, and communication barriers between providers. There’s clearly a better way—and at Surescripts, we have a unique sightline into what that may be. In this series, host Melanie Marcus, Chief Marketing Officer of Surescripts, sits down with today’s most inspiring and innovative leaders in healt ...
…
continue reading
Android Backstage, a podcast by and for Android developers. Hosted by developers from the Android engineering team, this show covers topics of interest to Android programmers, with in-depth discussions and interviews with engineers on the Android team at Google. Subscribe to Android Developers YouTube → https://goo.gle/AndroidDevs
…
continue reading
The power of Data is undeniable. And unharnessed - it’s nothing but chaos. Making data your ally. Using it to lead with confidence and clarity. Host Jess Carter is solving problems in real-time to reveal what’s possible. Helping communities and people thrive. This is Data Driven Leadership, a show brought to you by Resultant.
…
continue reading
Download This Show is your weekly guide to the world of media, culture, and technology. From social media to gadgets, streaming services to privacy issues. Each week Rae Johnston and guests take a fun, deep dive into how technology is reshaping our lives.
…
continue reading
Big tech is transforming every aspect of our world. But how, and at what cost? This season of Land of the Giants – The Disney Dilemma – focuses on Disney’s ability to weather the ups and downs of the business cycle and changing tastes and explores what has kept it successful for over 100 years. The entertainment giant has leveraged nostalgia and its intellectual property to build a beloved brand, but after an acquisition spree that included Marvel, Lucasfilm, and 20th Century Fox, can it sus ...
…
continue reading
This is the audio podcast version of Troy Hunt's weekly update video published here: https://www.troyhunt.com/tag/weekly-update/
…
continue reading
The director’s commentary track for Daring Fireball. Long digressions on Apple, technology, design, movies, and more.
…
continue reading
We help founders make something people want.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
