Search a title or topic

Over 20 million podcasts, powered by 

Player FM logo
Artwork

Content provided by Dean Bodart. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dean Bodart or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Game over for NVIDIA? Reddit Says This AI Memory Hack Saves You Millions on AI Infrastructure

45:41
 
Share
 

Manage episode 493350544 series 3645872
Content provided by Dean Bodart. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dean Bodart or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

Are you tired of skyrocketing AI infrastructure costs? What if a viral Reddit idea could change everything? In this episode, we dive into Memvid, a groundbreaking open-source project that's turning AI memory on its head by using video compression.

Imagine storing millions of text documents as a single, tiny MP4 file, then searching it in milliseconds โ€“ all without expensive GPUs or complex databases. We reveal the real-world experiment where 10,000 PDFs were compressed to just 1.4GB, slashing RAM usage from over 8GB to 200MB, and working completely offline!

Could Memvid's CPU-friendly retrieval make costly NVIDIA GPU infrastructure obsolete for many AI tasks? We explore how this innovation is democratizing AI, enabling powerful edge and offline applications, and revolutionizing AI software testing with portable "test brains."

Tune in to discover if Memvid is the future of affordable, efficient AI. Don't miss this deep dive into the tech that's got everyone talking!

Check out the content on LinkedIn ๐Ÿ‘‰

Connect with Dean on LinkedIn ๐Ÿ‘‰

  continue reading

18 episodes

Artwork
iconShare
 
Manage episode 493350544 series 3645872
Content provided by Dean Bodart. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Dean Bodart or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

Are you tired of skyrocketing AI infrastructure costs? What if a viral Reddit idea could change everything? In this episode, we dive into Memvid, a groundbreaking open-source project that's turning AI memory on its head by using video compression.

Imagine storing millions of text documents as a single, tiny MP4 file, then searching it in milliseconds โ€“ all without expensive GPUs or complex databases. We reveal the real-world experiment where 10,000 PDFs were compressed to just 1.4GB, slashing RAM usage from over 8GB to 200MB, and working completely offline!

Could Memvid's CPU-friendly retrieval make costly NVIDIA GPU infrastructure obsolete for many AI tasks? We explore how this innovation is democratizing AI, enabling powerful edge and offline applications, and revolutionizing AI software testing with portable "test brains."

Tune in to discover if Memvid is the future of affordable, efficient AI. Don't miss this deep dive into the tech that's got everyone talking!

Check out the content on LinkedIn ๐Ÿ‘‰

Connect with Dean on LinkedIn ๐Ÿ‘‰

  continue reading

18 episodes

Tutti gli episodi

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play