Android Backstage, a podcast by and for Android developers. Hosted by developers from the Android engineering team, this show covers topics of interest to Android programmers, with in-depth discussions and interviews with engineers on the Android team at Google. Subscribe to Android Developers YouTube → https://goo.gle/AndroidDevs
…
continue reading
Content provided by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
Measuring LLMs with Jodie Burchell
MP3•Episode home
Manage episode 474870730 series 11362
Content provided by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.
…
continue reading
612 episodes
MP3•Episode home
Manage episode 474870730 series 11362
Content provided by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Carl Franklin and Richard Campbell, Carl Franklin, and Richard Campbell or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.
…
continue reading
612 episodes
All episodes
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.