Go offline with the Player FM app!
Understanding AI Error Rates: Best Practices for MSPs in Workflow Automation and Project Management with Mike Psenka
Manage episode 501693765 series 2555839
Mike Psenka, CEO of Moovila, discusses the limitations and challenges of large foundational AI models, particularly in the context of their application in complex tasks. While these models have shown impressive capabilities, there is a growing concern about their reliability, especially when it comes to analyzing intricate data structures like graph data. Psenka emphasizes that these models excel at generating content but struggle with tasks that require deep understanding and analysis of relationships and dependencies within data.
The conversation highlights the importance of recognizing the error rates associated with AI models. Psenka points out that while advancements have been made in areas like 2D and 3D vision, certain domains, such as graph data, still exhibit unacceptably high error rates. This limitation raises questions about the trustworthiness of AI in critical applications, where a single mistake can lead to significant consequences. He urges caution in relying solely on generative AI for complex evaluations and suggests a hybrid approach that combines traditional deterministic AI methods with generative models.
As the discussion progresses, Psenka shares insights on the emerging trend of agentic AI, which aims to automate decision-making processes. He argues that while agentic AI can handle small, discrete tasks effectively, it falls short in managing complex workflows that require nuanced understanding. The need for a structured framework that integrates both deterministic and generative AI is emphasized, allowing for more reliable outcomes in complex scenarios. This hybrid model could help mitigate the risks associated with AI errors and improve overall efficiency.
Finally, Psenka offers guidance for managed service providers (MSPs) and IT service providers on workflow automation. He stresses the importance of identifying which processes can be automated while ensuring that human oversight remains integral to the workflow. By developing flexible templates that can adapt to various customer needs, MSPs can enhance their service offerings and improve operational efficiency. The conversation concludes with a call to action for organizations to build AI capabilities and stay competitive in a rapidly evolving landscape.
All our Sponsors: https://businessof.tech/sponsors/
Do you want the show on your podcast app or the written versions of the stories? Subscribe to the Business of Tech: https://www.businessof.tech/subscribe/
Looking for a link from the stories? The entire script of the show, with links to articles, are posted in each story on https://www.businessof.tech/
Support the show on Patreon: https://patreon.com/mspradio/
Want to be a guest on Business of Tech: Daily 10-Minute IT Services Insights? Send Dave Sobel a message on PodMatch, here: https://www.podmatch.com/hostdetailpreview/businessoftech
Want our stuff? Cool Merch? Wear “Why Do We Care?” - Visit https://mspradio.myspreadshop.com
Follow us on:
LinkedIn: https://www.linkedin.com/company/28908079/
YouTube: https://youtube.com/mspradio/
Facebook: https://www.facebook.com/mspradionews/
Instagram: https://www.instagram.com/mspradio/
1740 episodes
Manage episode 501693765 series 2555839
Mike Psenka, CEO of Moovila, discusses the limitations and challenges of large foundational AI models, particularly in the context of their application in complex tasks. While these models have shown impressive capabilities, there is a growing concern about their reliability, especially when it comes to analyzing intricate data structures like graph data. Psenka emphasizes that these models excel at generating content but struggle with tasks that require deep understanding and analysis of relationships and dependencies within data.
The conversation highlights the importance of recognizing the error rates associated with AI models. Psenka points out that while advancements have been made in areas like 2D and 3D vision, certain domains, such as graph data, still exhibit unacceptably high error rates. This limitation raises questions about the trustworthiness of AI in critical applications, where a single mistake can lead to significant consequences. He urges caution in relying solely on generative AI for complex evaluations and suggests a hybrid approach that combines traditional deterministic AI methods with generative models.
As the discussion progresses, Psenka shares insights on the emerging trend of agentic AI, which aims to automate decision-making processes. He argues that while agentic AI can handle small, discrete tasks effectively, it falls short in managing complex workflows that require nuanced understanding. The need for a structured framework that integrates both deterministic and generative AI is emphasized, allowing for more reliable outcomes in complex scenarios. This hybrid model could help mitigate the risks associated with AI errors and improve overall efficiency.
Finally, Psenka offers guidance for managed service providers (MSPs) and IT service providers on workflow automation. He stresses the importance of identifying which processes can be automated while ensuring that human oversight remains integral to the workflow. By developing flexible templates that can adapt to various customer needs, MSPs can enhance their service offerings and improve operational efficiency. The conversation concludes with a call to action for organizations to build AI capabilities and stay competitive in a rapidly evolving landscape.
All our Sponsors: https://businessof.tech/sponsors/
Do you want the show on your podcast app or the written versions of the stories? Subscribe to the Business of Tech: https://www.businessof.tech/subscribe/
Looking for a link from the stories? The entire script of the show, with links to articles, are posted in each story on https://www.businessof.tech/
Support the show on Patreon: https://patreon.com/mspradio/
Want to be a guest on Business of Tech: Daily 10-Minute IT Services Insights? Send Dave Sobel a message on PodMatch, here: https://www.podmatch.com/hostdetailpreview/businessoftech
Want our stuff? Cool Merch? Wear “Why Do We Care?” - Visit https://mspradio.myspreadshop.com
Follow us on:
LinkedIn: https://www.linkedin.com/company/28908079/
YouTube: https://youtube.com/mspradio/
Facebook: https://www.facebook.com/mspradionews/
Instagram: https://www.instagram.com/mspradio/
1740 episodes
Semua episode
×Welcome to Player FM!
Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.