Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer

Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer

FromData Engineering Podcast


Make Sure Your Records Are Reliable With The BookKeeper Distributed Storage Layer

FromData Engineering Podcast

ratings:
Length:
42 minutes
Released:
Jun 9, 2021
Format:
Podcast episode

Description

The way to build maintainable software and systems is through composition of individual pieces. By making those pieces high quality and flexible they can be used in surprising ways that the original creators couldn't have imagined. One such component that has gone above and beyond its originally envisioned use case is BookKeeper, a distributed storage system that is optimized for durability and speed. In this episode Matteo Merli shares the story behind the creation of BookKeeper, the various ways that it is being used today, and the architectural aspects that make it such a strong building block for projects such as Pulsar. He also shares some of the other interesting systems that have been built on top of it and an amusing war story of running it at scale in its early years.
Released:
Jun 9, 2021
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry