Published 23 Jan 2026
Duration: 2479
Apache Spark's development and significance in data processing is analyzed, focusing on its efficiency, flexibility, and challenges in AI and machine learning tasks.
This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/410 Holden Karau - Co-Founder...
The podcast explores the development and current role of Apache Spark in modern data processing, emphasizing its efficiency over older technologies like MapReduce. It discusses how Spark has evolved to support AI and machine learning workloads, addressing challenges such as data skew, fault tolerance in ML training, and the integration of AI tools with data processing frameworks. The discussion also highlights Spark's flexibility and distributed computing features, along with strategies for optimizing performance.
Additionally, the podcast touches on a real-world project that uses AI to help individuals appeal denied health insurance claims. This involves analyzing reasons for denials and generating appeals, while addressing challenges related to data quality, the complexity of insurance systems, and the sustainability of open source projects. The conversation also covers technical aspects such as GPU utilization, checkpointing, and resource management in the context of training machine learning models.
31 Mar 2026 Platform Engineering Ajay Chankramath & Nic Cheneweth
Platform engineering challenges are addressed through product-centric internal development, standardized "golden paths," control planes abstracting cloud infrastructure for self-service, developer ownership of pipelines, Kubernetes-driven self-healing systems, balancing AI's infrastructure benefits with reliability risks, domain-specific design, clear team boundaries, and the critical role of human oversight in automation.
27 Mar 2026 State of the Art of Container Security Adrian Mouat & Charles Humble
Modern software development must prioritize container security, updated practices for base images, minimized attack surfaces, SBOMs for dependency tracking, and defense-in-depth strategies to combat supply chain risks and outdated components.
24 Mar 2026 The Rush to Adopt AI: How to Get it Right & Business Risks Nick Selby & Sarah Wells
Enterprise AI integration demands robust governance, cross-functional collaboration, and clear terminology to address communication gaps, data leakage risks, security vulnerabilities, and strategic misalignment caused by rapid adoption.
20 Mar 2026 Learn C++ by Example Frances Buontempo & Matt Godbolt
Modern C++ innovations like the spaceship operator, coroutines, and structure bindings are explored through practical examples, interactive learning, and tools like Compiler Explorer, emphasizing the balance between low-level control, high-level abstractions, and educational challenges in mastering advanced concepts.
17 Mar 2026 State of the Art of Biological Computing Ewelina Kurtys & Charles Humble
Bio-inspired computing using living neurons offers potential energy efficiency and paradigm shifts in AI, yet faces scalability, ethical, and technical challenges requiring interdisciplinary collaboration to advance biocomputing and neuroscience.