Search a title or topic

Over 20 million podcasts, powered by 

Player FM logo
Artwork

Content provided by Tyfone. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Tyfone or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Beyond ChatGPT: The Hidden Infrastructure Powering AI with JB Baker

1:07:12
 
Share
 

Manage episode 475207134 series 2978868
Content provided by Tyfone. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Tyfone or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

On this episode of the Digital Banking Podcast, Josh DeTar spoke with JB Baker, VP of Products and Marketing at Scale Flux, about the often unseen infrastructure behind AI. They discussed the limitations of current technology and where improvements are needed to handle AI’s growth. JB highlighted the "memory wall," which limits data flow to processors, as a major hurdle.

JB explained how this challenge requires innovation in areas like memory, storage, networking, and even cooling systems. He used a simple analogy of an irrigation system needing bigger pipes to support a growing field, representing the need for faster data delivery to power-hungry GPUs.

The conversation also covered the environmental effects of rising energy demands. JB pointed out data centers' substantial energy consumption and the need for more efficient cooling methods. They explored the ripple effect of innovation, where advancements in one area, like energy production, can unlock progress in seemingly unrelated fields like AI.

  continue reading

118 episodes

Artwork
iconShare
 
Manage episode 475207134 series 2978868
Content provided by Tyfone. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Tyfone or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

On this episode of the Digital Banking Podcast, Josh DeTar spoke with JB Baker, VP of Products and Marketing at Scale Flux, about the often unseen infrastructure behind AI. They discussed the limitations of current technology and where improvements are needed to handle AI’s growth. JB highlighted the "memory wall," which limits data flow to processors, as a major hurdle.

JB explained how this challenge requires innovation in areas like memory, storage, networking, and even cooling systems. He used a simple analogy of an irrigation system needing bigger pipes to support a growing field, representing the need for faster data delivery to power-hungry GPUs.

The conversation also covered the environmental effects of rising energy demands. JB pointed out data centers' substantial energy consumption and the need for more efficient cooling methods. They explored the ripple effect of innovation, where advancements in one area, like energy production, can unlock progress in seemingly unrelated fields like AI.

  continue reading

118 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Listen to this show while you explore
Play