12 Nov 2026 Marian Kamenistak on Product Management for Software Engineers
As AI automates coding, engineers must master product management, focusing on customer value, rigorous validation, and business outcomes to remain valuable.
More Software Engineering Radio episodes
Published 14 Jan 2026
Duration: 54:47
A key factor in AI applications is reducing latency, which requires a balance between model size, accuracy, and performance, along with ongoing optimization and monitoring.
In this episode, Sahaj Garg, CTO of wispr.ai, joins SE Radio host Robert Blumen to talk about the challenges of building low-latency AI applications....
The podcast emphasizes the critical role of latency in applications, especially within AI systems, and how it affects user perception and overall experience. It explains that users are sensitive to both average and tail latency, and that acceptable thresholds vary depending on the specific application. The discussion explores various techniques aimed at reducing latency while preserving accuracy, such as speculative decoding and model distillation. It also outlines the challenges involved in managing AI workloads, including network delays, deployment configurations, and the necessity for ongoing monitoring and optimization.
The conversation further examines the trade-offs between model size, accuracy, and latency, highlighting the use of quantization and efficient compute architectures as ways to enhance performance. It underscores the importance of aligning AI outputs with user expectations, considering factors like the balance between response size and usability. The podcast also notes the value of tailoring AI systems to specific application contexts, such as voice dictation, recommendation systems, and interactive interfaces, to ensure optimal performance and user satisfaction.
12 Nov 2026 Marian Kamenistak on Product Management for Software Engineers
As AI automates coding, engineers must master product management, focusing on customer value, rigorous validation, and business outcomes to remain valuable.
29 Oct 2026 Danilo Krummrich on Rust in the Linux Kernel
"Nova GPU driver project integrates Rust into the Linux kernel to replace the aging Novo driver, leveraging Rust's memory safety for better reliability and performance while addressing firmware and architectural challenges through incremental, collaborative updates."
7 Oct 2026 Sahil Walia on Schema Changes and Data Migrations
Recommended: Schema as source of truth
"Schemas define data structure, apply across systems, and require careful evolution to avoid breaking changes, with best practices including additive updates, blue-green deployments, and stable identifiers."
30 Sept 2026 Raju Dandigam on Building Production AI Agents
"Explores production AI agents, their autonomy, safety, and engineering best practices, comparing workflows, tool design, orchestration, and memory systems while addressing challenges like cost, latency, and reliability."
16 Sept 2026 Milan Milanovic on the Laws of Software Engineering
"Explores key software engineering principles (like Conway's Law, Brooks' Law) and their impact on systems, teams, and decision-making, emphasizing context-dependent trade-offs, AI's role, and practical applications like measuring technical debt."