More The TWIML AI Podcast episodes
Published 29 Jan 2026
Duration: 3981
Language models can struggle to generate diverse responses, despite adjustments, and improving their performance requires addressing data quality and training techniques.
Today, we're joined by Yejin Choi, professor and senior fellow at Stanford University in the Computer Science Department and the Institute for Human-C...
The podcast examines how both small and large language models tend to generate similar, homogeneous outputs in response to open-ended prompts, even when temperature settings are modified to encourage diversity. It investigates research efforts aimed at improving small language models (SLMs) by refining their reasoning abilities through methods like better data curation, synthetic data generation, and hybrid model designs. The discussion points out the limitations of relying on internet-based training data and stresses the value of high-quality, specialized content created by humans to train SLMs more effectively.
The podcast also reviews techniques such as imitation learning, reinforcement learning with verification, and data filtering to enhance model performance and output diversity. Additionally, it raises broader concerns about the effects of AI on human creativity and thought, as well as the potential for AI to contribute to the homogenization of online content. Emphasis is placed on the importance of making AI more accessible, exploring diverse alignment approaches, and developing systems that are more data-efficient and ethically responsible.
7 May 2026 How to Find the Agent Failures Your Evals Miss with Scott Clark
Distributional employs post-production analytics, unsupervised learning, and LLMs to analyze agent traces, detect patterns and anti-patterns like hallucinations, address distributional shifts, and generate actionable insights for AI system refinement in security and enterprise settings, emphasizing adaptive analytics and domain expertise.
30 Apr 2026 How to Engineer AI Inference Systems with Philip Kiely
AI inference deployment is accelerating, emphasizing inference engineering's critical role in optimizing generative models with advanced hardware and complex systems, while addressing challenges like latency, scalability, and modality-specific optimizations amid evolving industry trends and fragmented yet open-source-driven markets.
16 Apr 2026 How Capital One Delivers Multi-Agent Systems with Rashmi Shetty
Capital One's *Chat Concierge* multi-agentic AI system streamlines car-buying through self-reflection, real-time APIs, and LLM-driven workflows, addressing enterprise AI challenges like governance, scalability, and legacy system integration while prioritizing compliance, observability, and flexible platform adoption.
26 Mar 2026 The Race to Production-Grade Diffusion LLMs with Stefano Ermon
The text traces generative models' evolution from early image generation to diffusion models' stability, highlights Mercury II's advancements in speed and efficiency, and addresses ongoing challenges in scalability, multimodal integration, and future research in controllability and cross-modal unification.
10 Mar 2026 Agent Swarms and Knowledge Graphs for Autonomous Software Development with Siddhant Pardeshi
AI integration into software development is transforming code creation, maintenance, and optimization, with significant implications for technical and business outcomes.