Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Bringing The Power Of The DataHub Real-Time Metadata Graph To Everyone At Acryl Data

Bringing The Power Of The DataHub Real-Time Metadata Graph To Everyone At Acryl Data

FromData Engineering Podcast


Bringing The Power Of The DataHub Real-Time Metadata Graph To Everyone At Acryl Data

FromData Engineering Podcast

ratings:
Length:
68 minutes
Released:
Oct 16, 2021
Format:
Podcast episode

Description

The binding element of all data work is the metadata graph that is generated by all of the workflows that produce the assets used by teams across the organization. The DataHub project was created as a way to bring order to the scale of LinkedIn's data needs. It was also designed to be able to work for small scale systems that are just starting to develop in complexity. In order to support the project and make it even easier to use for organizations of every size Shirshanka Das and Swaroop Jagadish founded Acryl Data. In this episode they discuss the recent work that has been done by the community, how their work is building on top of that foundation, and how you can get started with DataHub for your own work to manage data discovery today. They also share their ambitions for the near future of adding data observability and data quality management features.
Released:
Oct 16, 2021
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry