More Latent Space episodes

METRs Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity thumbnail

METRs Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity

Published 27 Feb 2026

Duration: 3374

The podcast explores the intersection of AI capabilities and societal risks, discussing challenges in evaluating and deploying AI systems.

Episode Description

This is a free preview of a paid episode. To hear more, visit www.latent.spaceAIE Europe CFP and AIE Worlds Fair paper submissions for CAIS peer revie...

Overview

The podcast explores the META framework, a method for evaluating AI models through two main components: Model Evaluation (M-E), which assesses AI capabilities and real-world performance, and Threat Research (T-R), which investigates potential societal risks associated with AI advancements. It introduces the Model Time Horizon Chart, a visualization that depicts the linear progression of model capabilities over time, based on the difficulty and reliability of human-equivalent tasks. The discussion also covers challenges in measuring AI performance, the selection of appropriate tasks for evaluation, and how AI advancements could impact developer workflows and productivity.

The conversation further delves into concerns related to AI safety, the potential for rapid capability growth, and the future of AI autonomy. It addresses limitations in current benchmarking systems, the role of increasing computational power, and the possibility of AI systems improving themselves independently. The podcast also touches on topics like AI-driven trading and prediction markets, along with the ethical considerations that arise from evaluating and deploying AI technologies. Finally, it reflects on the ongoing evolution of AI research and the importance of developing open-ended evaluation methods to balance progress with long-term safety and risk management.

Recent Episodes of Latent Space

5 May 2026 Doing Vibe Physics Alex Lupsasca, OpenAI

AI is advancing theoretical physics by rapidly solving complex problems like quantum field theory calculations and simulating models such as SYK, though it still relies on human collaboration for original insights and contextual validation, reshaping research methodologies and education.

23 Apr 2026 AIE Europe Debrief + Agent Labs Thesis: Unsupervised Learning x Latent Space Crossover Special (2026)

The text discusses AI's evolving landscape, focusing on experimental agents potentially breaking containment by 2026, market disruptions from foundation models, infrastructure advancements like RAG, debates between infrastructure and application firms, outsourcing strategies, pre-2023 training data advantages, competitive coding AI sectors, and future trends in personalization and industry transformation amid scalability and quality challenges.

More Latent Space episodes