Why AI Can’t Scale Without Infrastructure Fixes | Darrick Horton Open||Source||Data podcast

Content provided by DataStax and Charna Parkey. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by DataStax and Charna Parkey or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

Open||Source||Data »
Why AI Can’t Scale Without Infrastructure Fixes | Darrick Horton

24h ago 50:55

MP3•Episode home

From energy bottlenecks to proprietary GPU ecosystems, the CEO of TensorWave, Darrick Horton explains why today’s AI scale is unsustainable—and how open-source hardware, smarter networking, and nuclear power could be the fix.

QUOTES

Darrick Horton
“The energy crisis is getting worse every day. It’s very hard to find data center capacity—especially capacity that can scale. Five years ago, 10 or 20 megawatts was considered state-of-the-art. Now, 20 is nothing. The real hyperscale AI players are looking at 100 megawatts minimum, going into the gigawatt territory. That’s more than many cities combined just to power one cluster.”

Charna Parkey

“We’re still training models in a very brute-force way—throwing the biggest datasets possible at the problem and hoping something useful emerges. That’s not sustainable. At some point, we have to shift toward smarter, more intentional training methods. We can’t afford to be wasteful at this scale.”

TIMESTAMPS

[00:00:00] Introduction

[00:01:00] Founding TensorWave

[00:04:00] AMD as a Viable Alternative

[00:08:00] Open Source as a Startup Enabler

[00:09:30] Launching ScalarLM

[00:12:00] ScalarLM Impact and Reception

[00:14:30] Roadmap for 2025

[00:16:00] Technical Advantages of AMD

[00:18:00] Emerging Open Source Infrastructure

[00:20:00] Broader Societal Issues AI Must Address

[00:22:00] AI’s Impact on Global Energy

[00:26:00] Fundamental Hardware vs. Human Efficiency

[00:30:00] Data Center Density Evolution

[00:34:00] Advice to Founders and Tech Trends

[00:38:00] AI Energy Challenges

[00:44:00] AI’s Rapid Impact vs. Internet

[00:46:00] Monopoly vs. Democratization in AI

[00:50:00] Close to Season Wrap Discussion and Predictions

99 episodes

#Tech #DataStax #Charna Parkey