Published 12 Feb 2026
Duration: 5011
The discussion highlights the need to balance the development of highly capable AI models with efficient and cost-effective alternatives, emphasizing strategies for optimization and deployment.
From rewriting Googles search stack in the early 2000s to reviving sparse trillion-parameter models and co-designing TPUs with frontier ML research, J...
The podcast examines key areas in AI research and development, emphasizing the challenge of achieving both advanced model capabilities and efficient, cost-effective deployment. It discusses the concept of owning the Pareto Frontier by integrating hardware, model design, and techniques to develop AI systems that are both powerful and efficient. Model distillation is presented as a vital strategy for transferring knowledge from large models to smaller, more efficient counterparts, ensuring performance is maintained across different scales of deployment.
The conversation also highlights the importance of balancing theoretical innovation with practical implementation, covering topics such as the evolution of search systems, hardware advancements like TPUs, and the integration of multimodal capabilities in models like Gemini. Other considerations include the need for efficient data movement, energy-efficient computing, and the expanding ability of AI to handle complex tasks such as long-context processing, video understanding, and code generation. The discussion also touches on challenges in benchmarking, model evaluation, and system scaling, along with future goals like improving model reliability, enhancing AI reasoning, and developing more specialized hardware.
22 Jun 2026 Red-Teaming after Mythos Zico Kolter & Matt Fredrikson, Gray Swan
AI security challenges in large language models, such as data leakage and prompt injection, require adversarial testing, red teaming, tools like *Shade* and *Signal*, and structured frameworks to address integration risks, robustness gaps, and enterprise-specific security demands.
3 Jun 2026 Scaling Past Informal AI - Carina Hong, Axiom Math
Formal verification is positioned as a critical tool for advancing AI by ensuring system correctness through mathematical rigor, exemplified by Axiom Math's achievements, tools like Lean, challenges in AI generalization, and the vision of AI as a "superhuman mathematician" through verified reasoning.
3 Jun 2026 Satya Nadella: No Priors x Latent Space Crossover Special at Microsoft Build
Strategic AI development shifts to ecosystem-driven frameworks prioritizing value creation, covering Microsoft's rigorous model training, agent-driven workflow management, real-world impact challenges, innovative business models, inclusive AI participation, and redefining work through agentic systems.
2 Jun 2026 GitHub's plan for Agents Kyle Daigle, GitHub
Advanced AI integration in developer workflows leverages tools like GitHub Copilot and agentic systems to automate tasks and boost productivity, while addressing challenges like skill bloat, security, open-source trust issues, and the shift to modular AI capabilities in enterprise and collaborative environments.
1 Jun 2026 Why Video Agent models are next Ethan He, xAI Grok Imagine
Advancements in AI research through community-driven knowledge sharing, challenges in scaling video models, technical innovations like vision transformers and diffusion models, and the integration of language models in generative media, alongside hurdles in training efficiency and sustainable development.