Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

APIs and AI Gateways

APIs and AI Gateways

FromThe Cloudcast


APIs and AI Gateways

FromThe Cloudcast

ratings:
Length:
33 minutes
Released:
Feb 14, 2024
Format:
Podcast episode

Description

Marco Palladino (@subnetmarco, CTO/Co-Founder @thekonginc) talks about the evolution of APIs, the need for consolidation and integration of AI APIs, and introduces the AI GatewaySHOW: 795CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotwNEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"SHOW SPONSORS:Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and SpotifyKeep up to date with Enterprise Tech with theCUBESHOW NOTES:Kong (homepage)What is an AI Gateway?Hugging Face (AI model community)Topic 1 - Welcome to the show. Before we dive into today’s discussion, tell us a little bit about your background at Kong and prior to Kong.Topic 2 - Now that the world is obsessed with AI and AI Models, what roles do APIs continue to play for applications? Topic 3 - You’ve lived through the API marketplace days. Do you see a lot of differences between API marketplaces and model marketplaces (e.g. like HuggingFace)?Topic 4 - You’ve talked recently about the concept of an AI Gateway, somewhat as an evolution of an API Gateway. Walk us through this new concept.Topic 5 - API Gateways can provide a lot of protection for known things by looking into various headers, security keys, and packet data. Can you imagine AI Gateways being able to have insights into model data to do things like Prompt Control, Hallucination Control, etc.?Topic 6 - We’ve seen the merging of API Gateways (North/South) and Service Mesh (East/West) traffic as new application patterns emerged. Do you think we’ll see new traffic patterns again with AI traffic and AI model interactions? FEEDBACK?Email: show at the cloudcast dot netTwitter: @cloudcastpodInstagram: @cloudcastpodTikTok: @cloudcastpod
Released:
Feb 14, 2024
Format:
Podcast episode

Titles in the series (100)

The Cloudcast is the industry's leading, independent Cloud Computing podcast. Since 2011, co-hosts Aaron Delp & Brian Gracely have interviewed technology and business leaders that are shaping the future of computing. Topics will include Cloud Computing | Open Source | AWS | Azure | GCP | Serverless | DevOps | Big Data | ML | AI | Security | Kubernetes | AppDev | SaaS | PaaS | CaaS | IoT.