More MLOps.community episodes

Performance Optimization and Software/Hardware Co-design across PyTorch, CUDA, and NVIDIA GPUs thumbnail

Performance Optimization and Software/Hardware Co-design across PyTorch, CUDA, and NVIDIA GPUs

Published 24 Feb 2026

Duration: 01:25:49

The podcast dives into AI development, software engineering, and GPU innovation, focusing on efficient workloads and the trade-offs between quick solutions and scalable systems.

Episode Description

March 3rd, Computer History Museum CODING AGENTS CONFERENCE, come join us while there are still tickets left.https://luma.com/codingagentsChris Fregly...

Overview

The podcast covers multiple topics related to product innovation, software development, and engineering practices, focusing on trends and challenges in AI and machine learning. It examines the use of SageMaker HyperPods, which employ pre-warmed GPUs to improve efficiency for AI workloads, and discusses the rise of "throwaway" applications designed for specific, short-term needs without long-term maintenance. The conversation also addresses the trade-off between quick, functional solutions and scalable, robust systems, emphasizing the role of software engineers in developing reliable production-grade applications. Additionally, the episode explores the use of AI tools in code generation and debugging, including a feature called the "playground skill" for visualizing code flow.

The discussion extends to issues with GPU hardware and limitations in AI infrastructure, highlighting the need for better documentation and transparency. It also touches on the growing interest in optimizing AI models for specific applications and newer hardware such as NVIDIA's Blackwell. The author reflects on writing a book focused on co-design principles that integrate hardware, software, and algorithms, and underscores the importance of open-source tools and community collaboration in advancing AI development and deployment.

Recent Episodes of MLOps.community

12 May 2026 The Latency Goldilocks Zone Explained

iFood's ILO AI agent leverages a Learning Context Model to deliver hyper-personalized food recommendations by integrating diverse AI techniques, navigating cultural nuances, and balancing familiar and novel choices while addressing multi-channel design, latency, scalability, data alignment, and experimental innovation challenges.

8 May 2026 Building MCP Before MCP Existed: Inside Despegar's Sofia Agent

Sophia, an AI-powered travel concierge using a multi-agent system and decentralized collaboration, aims to streamline bookings, in-trip services, and personalized experiences through AI-driven automation, chat/voice interfaces, and orchestration layers, while expanding capabilities and reducing friction in travel processes.

1 May 2026 Voice Agent Use Cases

Designing voice-based AI systems involves balancing user control with automation, addressing speech quality-latency trade-offs, creating intuitive non-technical interfaces, overcoming transcription and turn-taking challenges in real-world environments, integrating hybrid models and domain-specific tuning, while ensuring compliance, user trust, and ethical considerations in applications like customer support and dynamic environments through feedback loops.

24 Apr 2026 The Creator of Superpowers: Why Real Agentic Engineering Beats Vibe Coding

The text discusses using the Greenfield toolset to convert legacy code into structured specifications and the Superpowers framework to enhance AI agents through psychological persuasion techniques, emphasizing task decomposition, subagent roles, challenges in consistency and security, and future trends in agentic problem-solving and ethical AI development.

21 Apr 2026 It's 2026, and We're Still Talking Evals

Evaluations in AI product development must be integrated early, address real-world complexities, use nuanced metrics beyond accuracy, employ user-centric and iterative testing, leverage post-deployment data, and adapt tailored strategies to balance quality, domain-specific metrics, and system reliability.

More MLOps.community episodes