Making artificial intelligence practical, productive & accessible to everyone. Practical AI is a show in which technology professionals, business people, students, enthusiasts, and expert guests engage in lively discussions about Artificial Intelligence and related topics (Machine Learning, Deep Learning, Neural Networks, GANs, MLOps, AIOps, LLMs & more). The focus is on productive implementations and real-world scenarios that are accessible to everyone. If you want to keep up with the lates ...
…
continue reading
Content provided by Skynet Today. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Skynet Today or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Similar to Last Week in AI
The award-winning WIRED UK Podcast with James Temperton and the rest of the team. Listen every week for the an informed and entertaining rundown of latest technology, science, business and culture news. New episodes every Friday.
…
continue reading
Android Backstage, a podcast by and for Android developers. Hosted by developers from the Android engineering team, this show covers topics of interest to Android programmers, with in-depth discussions and interviews with engineers on the Android team at Google. Subscribe to Android Developers YouTube → https://goo.gle/AndroidDevs
…
continue reading
Every Friday and Sunday, Slate’s popular daily news podcast What Next brings you TBD, a clear-eyed look into the future. From fake news to fake meat, algorithms to augmented reality, Lizzie O’Leary is your guide to the tech industry and the world it’s creating for us to live in.
…
continue reading
Python Bytes is a weekly podcast hosted by Michael Kennedy and Brian Okken. The show is a short discussion on the headlines and noteworthy news in the Python, developer, and data science space.
…
continue reading
BBC Radio 5 live’s award winning gaming podcast, discussing the world of video games and games culture.
…
continue reading
TechStuff is getting a system update. Everything you love about Tech Stuff now twice the bandwidth with new hosts, Oz Woloshyn (Sleepwalkers) and Karah Preiss (Sleepwalkers). Oz and Karah bring humour and wit to the table as they break down what's happening in tech...and what it says about us. TechStuff is the podcast where technology meets culture. We speak to the folks building the future to understand what tomorrow will look like and how our technology is changing us: how we live, how we ...
…
continue reading
Centered on Android, unafraid to go far and wide in tech. Each week, hosts Daniel Bader and Will Sattelberg bring you a conversation about the decisions being made from how Google designs its Pixel phones to questions about the efficacy of mass consumption artificial intelligence products. Join us as we reflect on the facts, the feelings, and the connections we're all making today.
…
continue reading
1
Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec
Jerry Bell and Andrew Kalat
1k
200
Defensive Security is a weekly information security podcast which reviews recent high profile cyber security breaches, data breaches, malware infections and intrusions to identify lessons that we can learn and apply to the organizations we protect.
…
continue reading
How does artificial intelligence change when people — not profit — truly come first? Join IRL’s host Bridget Todd, as she meets people around the world building responsible alternatives to the tech that’s changing how we work, communicate, and even listen to music.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
AI Computing Hardware - Past, Present, and Future
Manage episode 463695413 series 3010767
Content provided by Skynet Today. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Skynet Today or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible.
Join our brand new Discord here! https://discord.gg/nTyezGSKwP
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
Sponsors:
- The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.
In this episode:
- Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.
- ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.
- Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.
- New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms.
If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
Timestamps:
- 00:00:00 Introduction
- 00:03:08 Historical Recap: Early AI and Hardware
- 00:11:51 The Rise of GPUs and Deep Learning
- 00:15:39 Scaling Laws and the Evolution of AI Models
- 00:24:05 The Bitter Lesson and the Future of AI Compute
- 00:25:58 Moore's Law and Huang's Law
- 00:30:12 Memory and Logic in AI Hardware
- 00:34:53 Challenges in AI Hardware: The Memory Wall
- 00:37:08 The Role of GPUs in Modern AI
- 00:42:27 Fitting Neural Nets in GPUs
- 00:48:04 Batch Sizes and GPU Utilization
- 00:52:47 Parallelism in AI Models
- 00:55:53 Matrix Multiplications and GPUs
- 00:59:57 Understanding B200 and GB200
- 01:05:41 Data Center Hierarchy
- 01:13:42 High Bandwidth Memory (HBM)
- 01:16:45 Fabrication and Packaging
- 01:20:17 The Complexity of Semiconductor Fabrication
- 01:24:34 Understanding Process Nodes
- 01:28:26 The Art of Fabrication
- 01:33:17 The Role of Yield in Fabrication
- 01:35:47 The Photolithography Process
- 01:40:38 Deep Ultraviolet Lithography (DUV)
- 01:43:58 Extreme Ultraviolet Lithography (EUV)
- 01:51:46 Export Controls and Their Impact
- 01:54:22 The Rise of Custom AI Hardware
- 02:00:10 The Future of AI and Hardware
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
265 episodes
Share
Manage episode 463695413 series 3010767
Content provided by Skynet Today. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Skynet Today or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
A special one-off episode with a deep dive into the past, present, and future of how computer hardware makes AI possible.
Join our brand new Discord here! https://discord.gg/nTyezGSKwP
Read out our text newsletter and comment on the podcast at https://lastweekin.ai/.
Sponsors:
- The Generator - An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.
In this episode:
- Google and Mistral sign deals with AP and AFP, respectively, to deliver up-to-date news through their AI platforms.
- ChatGPT introduces a tasks feature for reminders and to-dos, positioning itself more as a personal assistant.
- Synthesia raises $180 million to enhance its AI video platform for generating videos of human avatars.
- New U.S. guidelines restrict exporting AI chips to various countries, impacting Nvidia and other tech firms.
If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form.
Timestamps:
- 00:00:00 Introduction
- 00:03:08 Historical Recap: Early AI and Hardware
- 00:11:51 The Rise of GPUs and Deep Learning
- 00:15:39 Scaling Laws and the Evolution of AI Models
- 00:24:05 The Bitter Lesson and the Future of AI Compute
- 00:25:58 Moore's Law and Huang's Law
- 00:30:12 Memory and Logic in AI Hardware
- 00:34:53 Challenges in AI Hardware: The Memory Wall
- 00:37:08 The Role of GPUs in Modern AI
- 00:42:27 Fitting Neural Nets in GPUs
- 00:48:04 Batch Sizes and GPU Utilization
- 00:52:47 Parallelism in AI Models
- 00:55:53 Matrix Multiplications and GPUs
- 00:59:57 Understanding B200 and GB200
- 01:05:41 Data Center Hierarchy
- 01:13:42 High Bandwidth Memory (HBM)
- 01:16:45 Fabrication and Packaging
- 01:20:17 The Complexity of Semiconductor Fabrication
- 01:24:34 Understanding Process Nodes
- 01:28:26 The Art of Fabrication
- 01:33:17 The Role of Yield in Fabrication
- 01:35:47 The Photolithography Process
- 01:40:38 Deep Ultraviolet Lithography (DUV)
- 01:43:58 Extreme Ultraviolet Lithography (EUV)
- 01:51:46 Export Controls and Their Impact
- 01:54:22 The Rise of Custom AI Hardware
- 02:00:10 The Future of AI and Hardware
See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.
265 episodes
All episodes
×
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Similar to Last Week in AI
Making artificial intelligence practical, productive & accessible to everyone. Practical AI is a show in which technology professionals, business people, students, enthusiasts, and expert guests engage in lively discussions about Artificial Intelligence and related topics (Machine Learning, Deep Learning, Neural Networks, GANs, MLOps, AIOps, LLMs & more). The focus is on productive implementations and real-world scenarios that are accessible to everyone. If you want to keep up with the lates ...
…
continue reading
The award-winning WIRED UK Podcast with James Temperton and the rest of the team. Listen every week for the an informed and entertaining rundown of latest technology, science, business and culture news. New episodes every Friday.
…
continue reading
Android Backstage, a podcast by and for Android developers. Hosted by developers from the Android engineering team, this show covers topics of interest to Android programmers, with in-depth discussions and interviews with engineers on the Android team at Google. Subscribe to Android Developers YouTube → https://goo.gle/AndroidDevs
…
continue reading
Every Friday and Sunday, Slate’s popular daily news podcast What Next brings you TBD, a clear-eyed look into the future. From fake news to fake meat, algorithms to augmented reality, Lizzie O’Leary is your guide to the tech industry and the world it’s creating for us to live in.
…
continue reading
Python Bytes is a weekly podcast hosted by Michael Kennedy and Brian Okken. The show is a short discussion on the headlines and noteworthy news in the Python, developer, and data science space.
…
continue reading
BBC Radio 5 live’s award winning gaming podcast, discussing the world of video games and games culture.
…
continue reading
TechStuff is getting a system update. Everything you love about Tech Stuff now twice the bandwidth with new hosts, Oz Woloshyn (Sleepwalkers) and Karah Preiss (Sleepwalkers). Oz and Karah bring humour and wit to the table as they break down what's happening in tech...and what it says about us. TechStuff is the podcast where technology meets culture. We speak to the folks building the future to understand what tomorrow will look like and how our technology is changing us: how we live, how we ...
…
continue reading
Centered on Android, unafraid to go far and wide in tech. Each week, hosts Daniel Bader and Will Sattelberg bring you a conversation about the decisions being made from how Google designs its Pixel phones to questions about the efficacy of mass consumption artificial intelligence products. Join us as we reflect on the facts, the feelings, and the connections we're all making today.
…
continue reading
1
Defensive Security Podcast - Malware, Hacking, Cyber Security & Infosec
Jerry Bell and Andrew Kalat
1k200
Defensive Security is a weekly information security podcast which reviews recent high profile cyber security breaches, data breaches, malware infections and intrusions to identify lessons that we can learn and apply to the organizations we protect.
…
continue reading
How does artificial intelligence change when people — not profit — truly come first? Join IRL’s host Bridget Todd, as she meets people around the world building responsible alternatives to the tech that’s changing how we work, communicate, and even listen to music.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
