More The Pragmatic Engineer episodes
Published 21 Jan 2026
Duration: 4694
Amazon Web Services S3 is discussed in terms of its massive scale, engineering complexities, and capabilities in managing and processing large volumes of data.
Brought to You By:Statsig The unified platform for flags, analytics, experiments, and more.Sonar The makers of SonarQube, the industry standard for au...
The podcast provides an in-depth look at the scale, engineering, and evolution of AWS S3, highlighting its position as the world's largest cloud storage service. It processes over a quadrillion requests annually, stores hundreds of exabytes of data, and manages more than 500 trillion objects. The discussion covers S3's foundational design based on eventual consistency, its shift toward strong consistency, and the use of formal methods to ensure correctness and reliability.
The podcast also examines S3's expanding role in data lakes and big data applications, including its growing support for structured and vector data formats such as Parquet, Iceberg, and S3 Vectors. Engineering challenges like crash consistency, failure allowances, and replication strategies are explored in detail. Innovations such as S3 tables, intelligent tiering, and cost management features are highlighted as key advancements. The overall focus is on S3's ability to evolve and adapt, supporting new data formats, integrating with AI and analytics workflows, and maintaining high availability, durability, and performance at scale.
12 Aug 2026 Stop being skeptical about AI for development with Charity Majors
"AI's impact on software engineering is reshaping code review, reliability, and career paths, demanding new verification methods, ethical accountability, and adaptability in a rapidly evolving field."
29 Jul 2026 Formal methods with Hillel Wayne
"Formal verification methods, like TLA+ in AWS's DynamoDB, ensure AI-generated code correctness, with property-based testing offering a practical middle ground; the discussion affirms software engineering as a legitimate discipline, balancing traditional principles with rapid iteration and open-source culture, while exploring AI's future impact on development and job markets."
15 Jul 2026 Context engineering with Dex Horthy
"Explores AI's role in software development, addressing challenges like code quality, human oversight, and balancing automation with human judgment while evaluating different AI-assisted approaches and future implications."
1 Jul 2026 How Kent Beck shapes the software engineering industry
Ken Beck's career in software engineering, contributions to TDD, XP, and the Agile Manifesto, critiques of Agile commercialization, AI's impact, challenges of OOP, Smalltalk's legacy, JUnit, and the balance between technical mastery and human-centric skills in evolving development practices.
24 Jun 2026 Tech interviews with NeetCode
Engineering careers are shifting from algorithm memorization to problem-solving and critical thinking amid AI's influence, critiquing outdated hiring practices, highlighting adaptation divides, trade-offs, cultural contrasts, and the enduring need for human-driven decision-making in tech.