33 min listen
CRDTs and Distributed Consensus with Christopher Meiklejohn - Episode 14
CRDTs and Distributed Consensus with Christopher Meiklejohn - Episode 14
ratings:
Length:
46 minutes
Released:
Jan 15, 2018
Format:
Podcast episode
Description
As we scale our systems to handle larger volumes of data, geographically distributed users, and varied data sources the requirement to distribute the computational resources for managing that information becomes more pronounced. In order to ensure that all of the distributed nodes in our systems agree with each other we need to build mechanisms to properly handle replication of data and conflict resolution. In this episode Christopher Meiklejohn discusses the research he is doing with Conflict-Free Replicated Data Types (CRDTs) and how they fit in with existing methods for sharing and sharding data. He also shares resources for systems that leverage CRDTs, how you can incorporate them into your systems, and when they might not be the right solution. It is a fascinating and informative treatment of a topic that is becoming increasingly relevant in a data driven world.
Released:
Jan 15, 2018
Format:
Podcast episode
Titles in the series (100)
MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24: Fast and Scalable Financial Timeseries Dataframes with MarketStore (Interview) by Data Engineering Podcast