Interested in being a guest? Email us at [email protected]

The explosion of generative AI has created an urgent need for enterprises to run AI workloads on-premises to protect sensitive data, maintain governance, and safeguard intellectual property. In this illuminating conversation with Tasha Drew, who leads the engineering team for private AI services within VMware Cloud Foundation, we explore how Broadcom is transforming enterprise AI infrastructure following their landmark announcements at VMware Explorer.
Tasha reveals how VMware's AI platform, now baked directly into VCF, enables organizations to implement comprehensive model governance, scale models efficiently as a service, and programmatically prepare data for RAG applications. What's particularly fascinating is VMware's commitment to "dogfooding" their own platform by using it to deliver VCF Intelligent Assist, ensuring the technology is constantly tested and improved under real-world conditions.
One surprising trend Tasha highlights is how organizations are increasingly migrating bare metal AI workloads to VCF for superior enterprise manageability. While data science teams may start with bare metal for experimentation, production AI workloads demand the scheduled maintenance, workload mobility, and scalability that VCF has perfected over decades. This shift underscores a fundamental truth: as AI matures within enterprises, infrastructure management becomes just as critical as model performance.
The conversation explores VMware's partnerships with AMD, NVIDIA, Intel, and Canonical, emphasizing their commitment to an open ecosystem approach that lets customers choose the hardware and software stack that best suits their specific AI use cases. Looking toward the future, Tasha shares exciting developments around Model-Context-Protocol (MCP) integration, agent builder capabilities, and tools for enterprises to safely implement agentic AI workflows with proper authentication and governance.
With real-world examples from customers like Walmart and manufacturing environments that require air-gapped AI infrastructure, this episode provides a comprehensive look at how VMware is making enterprise-grade AI infrastructure accessible, manageable, and secure. Don't miss Tasha's insights on what's coming next, including the technical preview of Intelligent Assist expected early next year.

Support the show

More at https://linktr.ee/EvanKirstel