Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

LLMOps & Conversational Intelligence for AI

LLMOps & Conversational Intelligence for AI

FromThe Cloudcast


LLMOps & Conversational Intelligence for AI

FromThe Cloudcast

ratings:
Length:
30 minutes
Released:
Dec 6, 2023
Format:
Podcast episode

Description

GUEST: Alex Kvamme (@KwameKvamme, CEO @GetPathlight)SHOW: 777CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"SHOW SPONSORS:Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to data with Enterprise Tech with theCUBESHOW NOTES:Pathlight (homepage)VentureBeat article on Pathlight & AI AgentsArticle on Real World Productivity of LLMsTopic 1 - Welcome to the show. Alex, Tell us a bit about your background.Topic 2 - What is the concept of conversational intelligence and how does it apply to most organizations today? What problem is it trying to solve?Topic 3 - I would think there is a trade off between time and resources to get to a customer issue vs. the value of that insight. How does an organization weigh the opportunity cost? How do you keep the insights generated from being overwhelmingTopic 4 - Let’s move from the concept to practical. Where is the data in most organizations today that will yield results and solve problems? How would you suggest folks get started and what use case are they likely to implement first? Is this data that humans either can’t or won’t get too because it is an enormous amount or maybe too tedious to pay for?Topic 5 - How does all of this work under the hood? Is this one model or multiple models working in parallel? Is there a framework for the operations and lifecycle managed by an organization?Topic 6 - Let’s talk about what it takes to get an LLM into production. The the rise of LLM’s and foundational models such as Llama2, there is an interest for organizations to use LLM’s, but going from concept to production still has a high barrier to entry. It’s easy to download a model, it’s much harder to either fine-tune it or set up RAG with a vector database for your specific use case. Would you agree and what are your thoughts?FEEDBACK?Email: show at the cloudcast dot netTwitter: @thecloudcastnet
Released:
Dec 6, 2023
Format:
Podcast episode

Titles in the series (100)

The Cloudcast is the industry's leading, independent Cloud Computing podcast. Since 2011, co-hosts Aaron Delp & Brian Gracely have interviewed technology and business leaders that are shaping the future of computing. Topics will include Cloud Computing | Open Source | AWS | Azure | GCP | Serverless | DevOps | Big Data | ML | AI | Security | Kubernetes | AppDev | SaaS | PaaS | CaaS | IoT.