The avforums podcast brings you the latest tech, movie and gaming news, plus special features, interviews and show reports from the world of audio visual home entertainment
…
continue reading
Content provided by David Gerard. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by David Gerard or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Similar to Pivot to AI
The Official AWS Podcast is a podcast for developers and IT professionals looking for the latest news and trends in storage, security, infrastructure, serverless, and more. Join Simon Elisha and Hawn Nguyen-Loughren for regular updates, deep dives, launches, and interviews. Whether you’re training machine learning models, developing open source projects, or building cloud solutions, the Official AWS Podcast has something for you.
…
continue reading
Feel brighter every day with our 20-minute pop-biz news podcast. The 3 business stories you need, with fresh takes you can pretend you came up with — Pairs perfectly with your morning oatmeal ritual. Hosted by Jack Crivici-Kramer & Nick Martell. Formerly known as “Snacks Daily”, Nick and Jack continue their podcast independent from Robinhood.
…
continue reading
FRONTLINE Editor-in-Chief and Executive Producer Raney Aronson-Rath sits down with journalists and filmmakers for probing conversations about the investigative journalism that drives each FRONTLINE documentary and the stories that shape our time. Produced at FRONTLINE’s headquarters at GBH and powered by PRX. The FRONTLINE Dispatch is made possible by the Abrams Foundation Journalism Initiative.
…
continue reading
Daily cybersecurity news for practitioners. Vulnerabilities, defenses, threats, network security insight, research and more to make you sound smarter as you get to the office in the morning. New each weekday.
…
continue reading
A daily dose of irreverent, offbeat, and informative takes on business & tech news. Hosted by Jon Weigell and the rotating cast of The Hustle. Plus, expert insight on business strategies including marketing, scaling, sales, and overall entrepreneurship.
…
continue reading
Thanks for visiting The Cell Phone Junkie! I will be taking the time each week to discuss my favorite topic, cell phones. Any feedback is appreciated and welcome. You can email me at: questions (AT) thecellphonejunkie (DOT) com or call: 206-203-3734 Thanks and welcome!
…
continue reading
Media and tech aren’t just intersecting — they’re fully intertwined. And to understand how those worlds work, and what they mean for you, veteran journalist Peter Kafka talks to industry leaders, upstarts and observers - and gets them to spell it out in plain, BS-free English. Part of the Vox Media Podcast Network.
…
continue reading
He was born Hamish Watson, a surfie dude from Sydney – but he could morph into whatever you needed him to be. Hamish is due to be sentenced to jail in early 2019 for swindling a handful of victims out of more than $7m. But these crimes are just the final pages in a resume too thick to staple; for decades he’s duped victims in the US, Canada, Britain, Hong Kong and Australia. How did he do it? How did he evade authorities around the world for so long and what’s he done with all those tens of ...
…
continue reading
Join Larry Mantle weekdays for lively and in-depth discussions of Los Angeles and Southern California news, politics, science, entertainment, the arts and more. More AirTalk at www.kpcc.org.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
20251106 - Oxford pretends AI benchmarks are science, not marketing
Manage episode 518002128 series 3662020
Content provided by David Gerard. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by David Gerard or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
How could all these benchmarks be fake, it's a mystery
https://pivot-to-ai.com/2025/11/06/oxford-pretends-ai-benchmarks-are-science-not-marketing/ - text
- Patreon: https://www.patreon.com/davidgerard
- Ko-Fi: https://ko-fi.com/A1529D5
- Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
- Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com
Send in your story tips: [email protected]
Sources:
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks (press release) https://oxrml.com/measuring-what-matters/
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks (PDF) https://openreview.net/pdf?id=mdA5lVvNcU
Previously on Pivot to AI:
- OpenAI o3 beats FrontierMath — because OpenAI funded the test and had access to the questions https://pivot-to-ai.com/2025/01/20/openai-o3-beats-frontiermath-because-openai-funded-the-test-and-had-access-to-questions/
- AI benchmarks are self-promoting trash — but regulators keep using them https://pivot-to-ai.com/2025/02/25/ai-benchmarks-are-self-promoting-trash-but-regulators-keep-using-them/
- The finance press finally starts talking about the 'AI bubble' https://pivot-to-ai.com/2025/09/28/the-finance-press-finally-starts-talking-about-the-ai-bubble/
- video: https://www.youtube.com/watch?v=AgR1TCllRgc&list=UU9rJrMVgcXTfa8xuMnbhAEA
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA
235 episodes
Share
Manage episode 518002128 series 3662020
Content provided by David Gerard. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by David Gerard or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
How could all these benchmarks be fake, it's a mystery
https://pivot-to-ai.com/2025/11/06/oxford-pretends-ai-benchmarks-are-science-not-marketing/ - text
- Patreon: https://www.patreon.com/davidgerard
- Ko-Fi: https://ko-fi.com/A1529D5
- Buy me nice things: https://www.amazon.co.uk/hz/wishlist/ls/3Q8VZW46J6DM6
- Get an extremely cool Pivot to AI shirt or mug: https://pivot-to-ai.redbubble.com
Send in your story tips: [email protected]
Sources:
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks (press release) https://oxrml.com/measuring-what-matters/
- Measuring what Matters: Construct Validity in Large Language Model Benchmarks (PDF) https://openreview.net/pdf?id=mdA5lVvNcU
Previously on Pivot to AI:
- OpenAI o3 beats FrontierMath — because OpenAI funded the test and had access to the questions https://pivot-to-ai.com/2025/01/20/openai-o3-beats-frontiermath-because-openai-funded-the-test-and-had-access-to-questions/
- AI benchmarks are self-promoting trash — but regulators keep using them https://pivot-to-ai.com/2025/02/25/ai-benchmarks-are-self-promoting-trash-but-regulators-keep-using-them/
- The finance press finally starts talking about the 'AI bubble' https://pivot-to-ai.com/2025/09/28/the-finance-press-finally-starts-talking-about-the-ai-bubble/
- video: https://www.youtube.com/watch?v=AgR1TCllRgc&list=UU9rJrMVgcXTfa8xuMnbhAEA
Full Pivot to AI playlist: https://www.youtube.com/playlist?list=UU9rJrMVgcXTfa8xuMnbhAEA
235 episodes
All episodes
×
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Similar to Pivot to AI
The avforums podcast brings you the latest tech, movie and gaming news, plus special features, interviews and show reports from the world of audio visual home entertainment
…
continue reading
The Official AWS Podcast is a podcast for developers and IT professionals looking for the latest news and trends in storage, security, infrastructure, serverless, and more. Join Simon Elisha and Hawn Nguyen-Loughren for regular updates, deep dives, launches, and interviews. Whether you’re training machine learning models, developing open source projects, or building cloud solutions, the Official AWS Podcast has something for you.
…
continue reading
Feel brighter every day with our 20-minute pop-biz news podcast. The 3 business stories you need, with fresh takes you can pretend you came up with — Pairs perfectly with your morning oatmeal ritual. Hosted by Jack Crivici-Kramer & Nick Martell. Formerly known as “Snacks Daily”, Nick and Jack continue their podcast independent from Robinhood.
…
continue reading
FRONTLINE Editor-in-Chief and Executive Producer Raney Aronson-Rath sits down with journalists and filmmakers for probing conversations about the investigative journalism that drives each FRONTLINE documentary and the stories that shape our time. Produced at FRONTLINE’s headquarters at GBH and powered by PRX. The FRONTLINE Dispatch is made possible by the Abrams Foundation Journalism Initiative.
…
continue reading
Daily cybersecurity news for practitioners. Vulnerabilities, defenses, threats, network security insight, research and more to make you sound smarter as you get to the office in the morning. New each weekday.
…
continue reading
A daily dose of irreverent, offbeat, and informative takes on business & tech news. Hosted by Jon Weigell and the rotating cast of The Hustle. Plus, expert insight on business strategies including marketing, scaling, sales, and overall entrepreneurship.
…
continue reading
Thanks for visiting The Cell Phone Junkie! I will be taking the time each week to discuss my favorite topic, cell phones. Any feedback is appreciated and welcome. You can email me at: questions (AT) thecellphonejunkie (DOT) com or call: 206-203-3734 Thanks and welcome!
…
continue reading
Media and tech aren’t just intersecting — they’re fully intertwined. And to understand how those worlds work, and what they mean for you, veteran journalist Peter Kafka talks to industry leaders, upstarts and observers - and gets them to spell it out in plain, BS-free English. Part of the Vox Media Podcast Network.
…
continue reading
He was born Hamish Watson, a surfie dude from Sydney – but he could morph into whatever you needed him to be. Hamish is due to be sentenced to jail in early 2019 for swindling a handful of victims out of more than $7m. But these crimes are just the final pages in a resume too thick to staple; for decades he’s duped victims in the US, Canada, Britain, Hong Kong and Australia. How did he do it? How did he evade authorities around the world for so long and what’s he done with all those tens of ...
…
continue reading
Join Larry Mantle weekdays for lively and in-depth discussions of Los Angeles and Southern California news, politics, science, entertainment, the arts and more. More AirTalk at www.kpcc.org.
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
