More Goto tech episodes

Building Planetary-Scale Data Systems with Venice  Felix GV & Olimpiu Pop thumbnail

Building Planetary-Scale Data Systems with Venice Felix GV & Olimpiu Pop

Published 3 Mar 2026

Duration: 1718

The architecture of the Venice database system, used by LinkedIn, balances scalability and consistency through an asynchronous ingestion model and eventual consistency, prioritizing availability and partition tolerance.

Episode Description

This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/421 Felix GV - Current Intere...

Overview

The podcast details the architecture of the Venice database system, a modular, distributed solution designed for recommendation data storage at LinkedIn. It emphasizes the system's unbundled structure, with distinct components such as a write-ahead log, a server fleet utilizing RuxDB, and specialized clients for querying, caching, and real-time data streaming. This design prioritizes scalability and flexibility, enabling efficient handling of large-scale data workloads. The discussion contrasts Venices asynchronous ingestion and eventual consistency model with traditional databases like PostgreSQL, which emphasize immediate consistency, highlighting the trade-offs between scalability and data consistency in distributed systems.

The systems resilience is evaluated through load simulations and chaos engineering techniques, such as those inspired by Netflixs Chaos Monkey, to test reliability during data center outages. The podcast also addresses the implications of the CAP theorem, noting Venices focus on availability and partition tolerance over strong consistency, particularly in multi-region architectures where reliability often takes precedence over strict consistency guarantees. Additional topics include data ingestion strategies, the use of derived data systems for optimization, and experimental integrations like DOXDB to enhance querying capabilities, underscoring ongoing efforts to adapt the system for evolving use cases.

Recent Episodes of Goto tech

31 Mar 2026 Platform Engineering Ajay Chankramath & Nic Cheneweth

Platform engineering challenges are addressed through product-centric internal development, standardized "golden paths," control planes abstracting cloud infrastructure for self-service, developer ownership of pipelines, Kubernetes-driven self-healing systems, balancing AI's infrastructure benefits with reliability risks, domain-specific design, clear team boundaries, and the critical role of human oversight in automation.

20 Mar 2026 Learn C++ by Example Frances Buontempo & Matt Godbolt

Modern C++ innovations like the spaceship operator, coroutines, and structure bindings are explored through practical examples, interactive learning, and tools like Compiler Explorer, emphasizing the balance between low-level control, high-level abstractions, and educational challenges in mastering advanced concepts.

More Goto tech episodes