Published 23 Jan 2026
Duration: 2479
Apache Spark's development and significance in data processing is analyzed, focusing on its efficiency, flexibility, and challenges in AI and machine learning tasks.
This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/410 Holden Karau - Co-Founder...
The podcast explores the development and current role of Apache Spark in modern data processing, emphasizing its efficiency over older technologies like MapReduce. It discusses how Spark has evolved to support AI and machine learning workloads, addressing challenges such as data skew, fault tolerance in ML training, and the integration of AI tools with data processing frameworks. The discussion also highlights Spark's flexibility and distributed computing features, along with strategies for optimizing performance.
Additionally, the podcast touches on a real-world project that uses AI to help individuals appeal denied health insurance claims. This involves analyzing reasons for denials and generating appeals, while addressing challenges related to data quality, the complexity of insurance systems, and the sustainability of open source projects. The conversation also covers technical aspects such as GPU utilization, checkpointing, and resource management in the context of training machine learning models.
19 Jun 2026 Continuous Delivery in a World of Constant Change Abby Bangser & Dave Farley
Continuous delivery principles, AI's challenges in code generation, and the necessity of incrementalism, rigorous testing, and human validation in software development are emphasized, alongside critiques of AI's lack of precision and the push for structured validation in high-stakes systems.
16 Jun 2026 Go for Java Programmers Barry Feigenbaum & Shon Saliga
Go emphasizes simplicity, concurrency, and efficiency for lightweight applications through explicit error handling and goroutines, while Java offers a feature-rich, object-oriented framework with extensive libraries and inheritance for complex, general-purpose systems, each suited to distinct development priorities and domains.
12 Jun 2026 Engineering Leadership in Turbulent Times Sarah Wells, Pat Kua & Daniel Terhorst-North
The text contrasts technical leadership and management, highlighting leadership's emphasis on vision and team alignment with management's focus on systems and accountability, while exploring change strategies, frameworks like the "Three Threes Model," challenges in technical debt and cross-functional alignment, and the role of communication, culture, and adaptability in fostering innovation.
9 Jun 2026 Modern Concurrency in Java Bazlur Rahman & Michael Redlich
Modern Java concurrency explores the shift from traditional threads to virtual threads (JDK 21) and structured concurrency, emphasizing scalability for I/O-bound tasks, task management simplification, limitations in CPU-bound work, comparisons with reactive programming, adoption challenges, and the book's unification of knowledge around Project Loom and scoped values for intermediate developers.
5 Jun 2026 Roc & Zig: A Compiler Rewrite Story Anjana Vakil & Richard Feldman
The text covers Rock's evolution as a simplified, statically typed alternative to Elm with a Zig-based compiler, AI's expanding role in software development beyond automation, open-source challenges, education's shift toward conceptual understanding, and the tension between rapid AI-driven productivity and quality-focused project development.