Starcast
Join the waitlist
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Building Voice AI Agents That Don’t Suck with Kwindla Kramer - #739
Coming soon to iPhone. Already have it? “Listen in Starcast” takes you straight there.
On this episode
About this episode
In this episode, Kwindla Kramer, co-founder and CEO of Daily and creator of the open source Pipecat framework, joins us to discuss the architecture and challenges of building real-time, production-ready conversational voice AI. Kwin breaks down the full stack for voice agents—from the models and APIs to the critical orchestration layer that manages the complexities of multi-turn conversations. We explore why many production systems favor a modular, multi-model approach over the end-to-end models demonstrated by large AI labs, and how this impacts everything from latency and cost to observability and evaluation. Kwin also digs into the core challenges of interruption handling, turn-taking,…