46 min listen
Laying The Foundation Of Your Data Platform For The Era Of Big Complexity With Dagster
Laying The Foundation Of Your Data Platform For The Era Of Big Complexity With Dagster
ratings:
Length:
65 minutes
Released:
Nov 20, 2021
Format:
Podcast episode
Description
The technology for scaling storage and processing of data has gone through massive evolution over the past decade, leaving us with the ability to work with massive datasets at the cost of massive complexity. Nick Schrock created the Dagster framework to help tame that complexity and scale the organizational capacity for working with data. In this episode he shares the journey that he and his team at Elementl have taken to understand the state of the ecosystem and how they can provide a foundational layer for a holistic data platform.
Released:
Nov 20, 2021
Format:
Podcast episode
Titles in the series (100)
Dask with Matthew Rocklin - Episode 2 by Data Engineering Podcast