Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Azure & DevOps Podcast

Content provided by Jeffrey Palermo. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Jeffrey Palermo or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://podcastplayer.com/legal.

1M ago 35:44

MP3•Episode home

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

Topics of Discussion:

[3:02] More about Per’s background in nearly two decades in .NET and Azure consulting.

[6:11] The concept of a boutique consultant.

[7:00] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02] Building trust with customers by open-sourcing “generic” components.

[11:50] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08] Why Per “fell in love” with Semantic Kernel’s abstraction layers and extension possibilities.

[21:44] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33] What do we mean by “vector” in the AI space?

[26:39] What is a “text chunker”?

[31:43] Azure AI search.

[34:07] Finding the right tool for the right task.

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at [email protected].

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer’s Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

347 episodes