More Goto tech episodes

Building Planetary-Scale Data Systems with Venice  Felix GV & Olimpiu Pop thumbnail

Building Planetary-Scale Data Systems with Venice Felix GV & Olimpiu Pop

Published 3 Mar 2026

Duration: 1718

The architecture of the Venice database system, used by LinkedIn, balances scalability and consistency through an asynchronous ingestion model and eventual consistency, prioritizing availability and partition tolerance.

Episode Description

This interview was recorded for GOTO Unscripted. https://gotopia.tech Check out more here: https://gotopia.tech/articles/421 Felix GV - Current Intere...

Overview

The podcast details the architecture of the Venice database system, a modular, distributed solution designed for recommendation data storage at LinkedIn. It emphasizes the system's unbundled structure, with distinct components such as a write-ahead log, a server fleet utilizing RuxDB, and specialized clients for querying, caching, and real-time data streaming. This design prioritizes scalability and flexibility, enabling efficient handling of large-scale data workloads. The discussion contrasts Venices asynchronous ingestion and eventual consistency model with traditional databases like PostgreSQL, which emphasize immediate consistency, highlighting the trade-offs between scalability and data consistency in distributed systems.

The systems resilience is evaluated through load simulations and chaos engineering techniques, such as those inspired by Netflixs Chaos Monkey, to test reliability during data center outages. The podcast also addresses the implications of the CAP theorem, noting Venices focus on availability and partition tolerance over strong consistency, particularly in multi-region architectures where reliability often takes precedence over strict consistency guarantees. Additional topics include data ingestion strategies, the use of derived data systems for optimization, and experimental integrations like DOXDB to enhance querying capabilities, underscoring ongoing efforts to adapt the system for evolving use cases.

Recent Episodes of Goto tech

8 May 2026 Java Cookbook Ian Darwin & Jeanne Boyarsky

Java's evolution through features like Records and Switch Expressions, career transitions from Fortran, integration with R for data analysis, AI's role in coding, structured learning resources, open-source contributions, and concerns about AI's impact on education and intellectual property are explored.

1 May 2026 Learning API Styles Lukasz Dynowski & Sam Newman

This exploration of API design delves into networking fundamentals, communication paradigms, protocol mechanics, trade-offs in security and performance, data formats, microservices communication patterns, emerging technologies like Web Transport and gRPC, and the critical role of secure, documented, and reproducible frameworks aligned with architectural and use-case demands.

More Goto tech episodes