More Latent Space episodes

METRs Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity thumbnail

METRs Joel Becker on exponential Time Horizon Evals, Threat Models, and the Limits of AI Productivity

Published 27 Feb 2026

Duration: 3374

The podcast explores the intersection of AI capabilities and societal risks, discussing challenges in evaluating and deploying AI systems.

Episode Description

This is a free preview of a paid episode. To hear more, visit www.latent.spaceAIE Europe CFP and AIE Worlds Fair paper submissions for CAIS peer revie...

Overview

The podcast explores the META framework, a method for evaluating AI models through two main components: Model Evaluation (M-E), which assesses AI capabilities and real-world performance, and Threat Research (T-R), which investigates potential societal risks associated with AI advancements. It introduces the Model Time Horizon Chart, a visualization that depicts the linear progression of model capabilities over time, based on the difficulty and reliability of human-equivalent tasks. The discussion also covers challenges in measuring AI performance, the selection of appropriate tasks for evaluation, and how AI advancements could impact developer workflows and productivity.

The conversation further delves into concerns related to AI safety, the potential for rapid capability growth, and the future of AI autonomy. It addresses limitations in current benchmarking systems, the role of increasing computational power, and the possibility of AI systems improving themselves independently. The podcast also touches on topics like AI-driven trading and prediction markets, along with the ethical considerations that arise from evaluating and deploying AI technologies. Finally, it reflects on the ongoing evolution of AI research and the importance of developing open-ended evaluation methods to balance progress with long-term safety and risk management.

Recent Episodes of Latent Space

20 Mar 2026 Dreamer: the Personal Agent OS David Singleton

Dreamer is an AI platform democratizing access to agentic tools for non-technical users via customizable AI assistants, community-built apps, cross-device integration, and privacy-focused features, with a beta emphasis on accessibility, real-world productivity use cases, and third-party developer opportunities.

More Latent Space episodes