34 min listen
SE-Radio Episode 272: Frances Perry on Apache Beam
FromSoftware Engineering Radio - the podcast for professional software developers
SE-Radio Episode 272: Frances Perry on Apache Beam
FromSoftware Engineering Radio - the podcast for professional software developers
ratings:
Length:
58 minutes
Released:
Oct 25, 2016
Format:
Podcast episode
Description
Jeff Meyerson talks with Frances Perry about Apache Beam, a unified batch and stream processing model. Topics include a history of batch and stream processing, from MapReduce to the Lambda Architecture to the more recent Dataflow model, originally defined in a Google paper. Dataflow overcomes the problem of event time skew by using watermarks and other methods discussed between Jeff and Frances. Apache Beam defines a way for users to define their pipelines in a way that is agnostic of the underlying execution engine, similar to how SQL provides a unified language for databases. This seeks to solve the churn and repeated work that has occurred in the rapidly evolving stream processing ecosystem.
Released:
Oct 25, 2016
Format:
Podcast episode
Titles in the series (100)
Episode 5: Model-Driven Software Development Pt. 1: In this Episode, Eberhard and Markus provide an introduction to Model-Driven Software Development. Since the discussion turned out to be too long, we separated things into two episodes, thus Episode 6 will be the second part of this discussion. by Software Engineering Radio - the podcast for professional software developers