Published 20 Jan 2026
Duration: 1822
The podcast discusses the evolution of data systems, shifting from building from scratch to reusing established technologies like Apache Arrow and Parquet for efficient data storage and analysis.
This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/412 Andrew Lamb - Staff Engin...
The podcast examines the evolution of data systems, focusing on the increasing preference for reusing existing technologies to construct modern data solutions. It emphasizes a shift away from building systems from scratch, instead utilizing established tools such as Apache Arrow, Parquet, and Iceberg. These technologies facilitate efficient columnar storage, standardized data formats, and interoperability between different systems. The discussion highlights the advantages of columnar storage for analytical workloads, the role of Apache Arrow in unifying in-memory data formats, and the use of Parquet for efficient, persistent storage.
Additionally, the conversation covers the integration of query engines like Apache Data Fusion and the significance of open source collaboration in advancing database technologies. The podcast also touches on the rising adoption of time series databases, the incorporation of distributed systems, and how modern hardware is influencing the efficiency of data processing. These developments are shaping the future of data infrastructure by enabling more scalable, interoperable, and high-performance solutions.
31 Mar 2026 Platform Engineering Ajay Chankramath & Nic Cheneweth
Platform engineering challenges are addressed through product-centric internal development, standardized "golden paths," control planes abstracting cloud infrastructure for self-service, developer ownership of pipelines, Kubernetes-driven self-healing systems, balancing AI's infrastructure benefits with reliability risks, domain-specific design, clear team boundaries, and the critical role of human oversight in automation.
27 Mar 2026 State of the Art of Container Security Adrian Mouat & Charles Humble
Modern software development must prioritize container security, updated practices for base images, minimized attack surfaces, SBOMs for dependency tracking, and defense-in-depth strategies to combat supply chain risks and outdated components.
24 Mar 2026 The Rush to Adopt AI: How to Get it Right & Business Risks Nick Selby & Sarah Wells
Enterprise AI integration demands robust governance, cross-functional collaboration, and clear terminology to address communication gaps, data leakage risks, security vulnerabilities, and strategic misalignment caused by rapid adoption.
20 Mar 2026 Learn C++ by Example Frances Buontempo & Matt Godbolt
Modern C++ innovations like the spaceship operator, coroutines, and structure bindings are explored through practical examples, interactive learning, and tools like Compiler Explorer, emphasizing the balance between low-level control, high-level abstractions, and educational challenges in mastering advanced concepts.
17 Mar 2026 State of the Art of Biological Computing Ewelina Kurtys & Charles Humble
Bio-inspired computing using living neurons offers potential energy efficiency and paradigm shifts in AI, yet faces scalability, ethical, and technical challenges requiring interdisciplinary collaboration to advance biocomputing and neuroscience.