Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Content provided by Audioboom. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Audioboom or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
Similar to VoxTalks Economics
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
The kickass science and technology radio show that delivers an irreverent look at the week in science and technology.
…
continue reading
The Knowledge at Wharton Network Acast feed serves as a curated showcase highlighting the best content from our podcast collection. Each week, we feature one standout episode from each show in the Wharton Podcast Network, giving listeners a comprehensive sample of our diverse business and academic content. This rotating selection allows audiences to discover new shows within our network while experiencing the depth and variety of Wharton's thought leadership across different topics and forma ...
…
continue reading
The BBC brings you all the week's science news.
…
continue reading
The show that helps you maximize your wealth by turning complex financial situations into actionable advice. On Your Money. Your Mission., we answer the questions you’ve been asking about -- financial planning, investing, retirement and everything in between. Whether you’re navigating the complexities of the market or looking for the best ways to save or spend your money, tune in to hear from experienced financial advisors with JFG. Walk away from each episode with savvy tips and financial t ...
…
continue reading
Learn research-tested strategies for a happier, more meaningful life, drawing on the science of compassion, gratitude, mindfulness, and awe. Hosted by award-winning psychologist Dacher Keltner. Co-produced by PRX and UC Berkeley's Greater Good Science Center. Follow us on Instagram @HappinessPod.
…
continue reading
In each episode, we talk with inspiring scientists, thinkers, and other self-actualized individuals who will give you a greater understanding of yourself, others, and the world we live in. Scott Barry Kaufman explores the depths of human potential and tries to get a glimpse into human possibility in every episode.
…
continue reading
1
Wholesaling Inc with Brent Daniels
Find distressed properties for pennies on the dollar and turn them for huge profits!
2k
1k
Let’s face it, Real estate education has lost the script. Everybody “claims” to have the secret sauce. They get you to sign up, get you to bite on a “magic” formula, but there’s no real tools to get there. There’s so much talk, no practical steps. It’s not instructional, it’s hype. The ideas aren’t focused on your success, it’s focused on theirs. Well, it doesn’t have to be that way. If you’ve been searching for a way to escape the rat race and achieve true financial freedom wholesaling real ...
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
))
S8 Ep34: How good are LLMs at doing our jobs?
Manage episode 493486411 series 2404194
Content provided by Audioboom. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Audioboom or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
In the second of special series recorded live at the PSE-CEPR Policy Forum 2025, we are asking, how good is AI at doing real-world job task? And how can we measure their capability without resorting to technical benchmarks that may not mean much in the workplace?
Since we all became aware of large language models, LLMs scientists have been attempting to evaluate how good they are at performing expert tasks. The results of those tests can show us whether LLMs can be useful complements to our work, or even replacements for us, as many fear. But setting or grading a test to decide whether an LLM can do a problem-solving job task, rather than solve an abstract problem, isn't easy to do. Maria del Rio-Chanona, a computer scientist at UCL, tells Tim Phillips about her innovative work-in-progress, in which she asks an LLM to set a tricky workplace exam, then tells another LLM to take the test – which a third LLM evaluates.
Since we all became aware of large language models, LLMs scientists have been attempting to evaluate how good they are at performing expert tasks. The results of those tests can show us whether LLMs can be useful complements to our work, or even replacements for us, as many fear. But setting or grading a test to decide whether an LLM can do a problem-solving job task, rather than solve an abstract problem, isn't easy to do. Maria del Rio-Chanona, a computer scientist at UCL, tells Tim Phillips about her innovative work-in-progress, in which she asks an LLM to set a tricky workplace exam, then tells another LLM to take the test – which a third LLM evaluates.
409 episodes
Share
Manage episode 493486411 series 2404194
Content provided by Audioboom. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Audioboom or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.
In the second of special series recorded live at the PSE-CEPR Policy Forum 2025, we are asking, how good is AI at doing real-world job task? And how can we measure their capability without resorting to technical benchmarks that may not mean much in the workplace?
Since we all became aware of large language models, LLMs scientists have been attempting to evaluate how good they are at performing expert tasks. The results of those tests can show us whether LLMs can be useful complements to our work, or even replacements for us, as many fear. But setting or grading a test to decide whether an LLM can do a problem-solving job task, rather than solve an abstract problem, isn't easy to do. Maria del Rio-Chanona, a computer scientist at UCL, tells Tim Phillips about her innovative work-in-progress, in which she asks an LLM to set a tricky workplace exam, then tells another LLM to take the test – which a third LLM evaluates.
Since we all became aware of large language models, LLMs scientists have been attempting to evaluate how good they are at performing expert tasks. The results of those tests can show us whether LLMs can be useful complements to our work, or even replacements for us, as many fear. But setting or grading a test to decide whether an LLM can do a problem-solving job task, rather than solve an abstract problem, isn't easy to do. Maria del Rio-Chanona, a computer scientist at UCL, tells Tim Phillips about her innovative work-in-progress, in which she asks an LLM to set a tricky workplace exam, then tells another LLM to take the test – which a third LLM evaluates.
409 episodes
Tất cả các tập
×
Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.
Similar to VoxTalks Economics
Interviews with Anthropologists about their New Books Support our show by becoming a premium member! https://newbooksnetwork.supportingcast.fm/anthropology
…
continue reading
Flash Forward is a show about possible (and not so possible) future scenarios. What would the warranty on a sex robot look like? How would diplomacy work if we couldn’t lie? Could there ever be a fecal transplant black market? (Complicated, it wouldn’t, and yes, respectively, in case you’re curious.) Hosted and produced by award winning science journalist Rose Eveleth, each episode combines audio drama and journalism to go deep on potential tomorrows, and uncovers what those futures might re ...
…
continue reading
The kickass science and technology radio show that delivers an irreverent look at the week in science and technology.
…
continue reading
The Knowledge at Wharton Network Acast feed serves as a curated showcase highlighting the best content from our podcast collection. Each week, we feature one standout episode from each show in the Wharton Podcast Network, giving listeners a comprehensive sample of our diverse business and academic content. This rotating selection allows audiences to discover new shows within our network while experiencing the depth and variety of Wharton's thought leadership across different topics and forma ...
…
continue reading
The BBC brings you all the week's science news.
…
continue reading
The show that helps you maximize your wealth by turning complex financial situations into actionable advice. On Your Money. Your Mission., we answer the questions you’ve been asking about -- financial planning, investing, retirement and everything in between. Whether you’re navigating the complexities of the market or looking for the best ways to save or spend your money, tune in to hear from experienced financial advisors with JFG. Walk away from each episode with savvy tips and financial t ...
…
continue reading
Learn research-tested strategies for a happier, more meaningful life, drawing on the science of compassion, gratitude, mindfulness, and awe. Hosted by award-winning psychologist Dacher Keltner. Co-produced by PRX and UC Berkeley's Greater Good Science Center. Follow us on Instagram @HappinessPod.
…
continue reading
In each episode, we talk with inspiring scientists, thinkers, and other self-actualized individuals who will give you a greater understanding of yourself, others, and the world we live in. Scott Barry Kaufman explores the depths of human potential and tries to get a glimpse into human possibility in every episode.
…
continue reading
1
Wholesaling Inc with Brent Daniels
Find distressed properties for pennies on the dollar and turn them for huge profits!
2k1k
Let’s face it, Real estate education has lost the script. Everybody “claims” to have the secret sauce. They get you to sign up, get you to bite on a “magic” formula, but there’s no real tools to get there. There’s so much talk, no practical steps. It’s not instructional, it’s hype. The ideas aren’t focused on your success, it’s focused on theirs. Well, it doesn’t have to be that way. If you’ve been searching for a way to escape the rat race and achieve true financial freedom wholesaling real ...
…
continue reading
Welcome to Curiosity Weekly from Discovery, hosted by Dr. Samantha Yammine. Once a week, we’ll bring you the latest and greatest in scientific discoveries and break down the details so that you don’t need a PhD to understand it. From neuroscience to climate tech to AI and genetics, no subject is off-limits. Join Sam as she interviews expert guests and investigates the research guiding some of the most exciting scientific breakthroughs affecting our world today. Hosted on Acast. See acast.com ...
…
continue reading
Player FM - Podcast App
Go offline with the Player FM app!
Go offline with the Player FM app!
