Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Re-Bundling The Data Stack With Data Orchestration And Software Defined Assets Using Dagster

Re-Bundling The Data Stack With Data Orchestration And Software Defined Assets Using Dagster

FromData Engineering Podcast


Re-Bundling The Data Stack With Data Orchestration And Software Defined Assets Using Dagster

FromData Engineering Podcast

ratings:
Length:
58 minutes
Released:
Jul 24, 2022
Format:
Podcast episode

Description

The current stage of evolution in the data management ecosystem has resulted in domain and use case specific orchestration capabilities being incorporated into various tools. This complicates the work involved in making end-to-end workflows visible and integrated. Dagster has invested in bringing insights about external tools' dependency graphs into one place through its "software defined assets" functionality. In this episode Nick Schrock discusses the importance of orchestration and a central location for managing data systems, the road to Dagster's 1.0 release, and the new features coming with Dagster Cloud's general availability.
Released:
Jul 24, 2022
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry