Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata

Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata

FromData Engineering Podcast


Build Confidence In Your Data Platform With Schema Compatibility Reports That Span Systems And Domains Using Schemata

FromData Engineering Podcast

ratings:
Length:
60 minutes
Released:
Sep 12, 2022
Format:
Podcast episode

Description

Data engineering systems are complex and interconnected with myriad and often opaque chains of dependencies. As they scale, the problems of visibility and dependency management can increase at an exponential rate. In order to turn this into a tractable problem one approach is to define and enforce contracts between producers and consumers of data. Ananth Packildurai created Schemata as a way to make the creation of schema contracts a lightweight process, allowing the dependency chains to be constructed and evolved iteratively and integrating validation of changes into standard delivery systems. In this episode he shares the design of the project and how it fits into your development practices.
Released:
Sep 12, 2022
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry