Search a title or topic

Over 20 million podcasts, powered by 

Player FM logo
Artwork

Content provided by Gowri Ramkumar. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gowri Ramkumar or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

Rethinking Content Evaluation in the AI Era: Insights from Netra Pawar, Meta

15:22
 
Share
 

Manage episode 516163029 series 2945649
Content provided by Gowri Ramkumar. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gowri Ramkumar or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

In this episode of the Knowledge Base Ninjas podcast, Netra Pawar, Lead Documentation Engineer, shares how AI is transforming content creation and evaluation in technical writing. She explains the concept of an evaluation-first content lifecycle, where content is tested and validated before going live, applying a CICD-like approach to documentation. Netra discusses key metrics for content quality, retrieval, and impact, and how AI can help scale evaluation. She also talks about the evolving role of technical writers, the importance of error analysis, and how partnering with engineering and ML teams can improve content performance. Finally, she emphasizes the need for writers to experiment with AI, shares an example of how a well-written document failed to be retrieved correctly by an LLM, and explains the takeaways.

Thank you for tuning in!

In the meantime, if you're ready to explore Document360, a knowledge base platform that can help your customers and teams get instant answers, we’d love to invite you to try it first-hand.

Simply use this link - https://bit.ly/4ktBnZZ to start your free trial

  continue reading

152 episodes

Artwork
iconShare
 
Manage episode 516163029 series 2945649
Content provided by Gowri Ramkumar. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Gowri Ramkumar or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

In this episode of the Knowledge Base Ninjas podcast, Netra Pawar, Lead Documentation Engineer, shares how AI is transforming content creation and evaluation in technical writing. She explains the concept of an evaluation-first content lifecycle, where content is tested and validated before going live, applying a CICD-like approach to documentation. Netra discusses key metrics for content quality, retrieval, and impact, and how AI can help scale evaluation. She also talks about the evolving role of technical writers, the importance of error analysis, and how partnering with engineering and ML teams can improve content performance. Finally, she emphasizes the need for writers to experiment with AI, shares an example of how a well-written document failed to be retrieved correctly by an LLM, and explains the takeaways.

Thank you for tuning in!

In the meantime, if you're ready to explore Document360, a knowledge base platform that can help your customers and teams get instant answers, we’d love to invite you to try it first-hand.

Simply use this link - https://bit.ly/4ktBnZZ to start your free trial

  continue reading

152 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Copyright 2025 | Privacy Policy | Terms of Service | | Copyright
Listen to this show while you explore
Play