4 min listen
Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer
Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer
ratings:
Length:
42 minutes
Released:
Jun 9, 2021
Format:
Podcast episode
Description
The way to build maintainable software and systems is through composition of individual pieces. By making those pieces high quality and flexible they can be used in surprising ways that the original creators couldn't have imagined. One such component that has gone above and beyond its originally envisioned use case is BookKeeper, a distributed storage system that is optimized for durability and speed. In this episode Matteo Merli shares the story behind the creation of BookKeeper, the various ways that it is being used today, and the architectural aspects that make it such a strong building block for projects such as Pulsar. He also shares some of the other interesting systems that have been built on top of it and an amusing war story of running it at scale in its early years.
Released:
Jun 9, 2021
Format:
Podcast episode
Titles in the series (100)
Introducing The Show - Episode 0 by Data Engineering Podcast