Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

SE-Radio Episode 272: Frances Perry on Apache Beam

SE-Radio Episode 272: Frances Perry on Apache Beam

FromSoftware Engineering Radio - the podcast for professional software developers


SE-Radio Episode 272: Frances Perry on Apache Beam

FromSoftware Engineering Radio - the podcast for professional software developers

ratings:
Length:
58 minutes
Released:
Oct 25, 2016
Format:
Podcast episode

Description

Jeff Meyerson talks with Frances Perry about Apache Beam, a unified batch and stream processing model. Topics include a history of batch and stream processing, from MapReduce to the Lambda Architecture to the more recent Dataflow model, originally defined in a Google paper. Dataflow overcomes the problem of event time skew by using watermarks and other methods discussed between Jeff and Frances. Apache Beam defines a way for users to define their pipelines in a way that is agnostic of the underlying execution engine, similar to how SQL provides a unified language for databases. This seeks to solve the churn and repeated work that has occurred in the rapidly evolving stream processing ecosystem.
Released:
Oct 25, 2016
Format:
Podcast episode

Titles in the series (100)

Software Engineering Radio is a podcast targeted at the professional software developer. The goal is to be a lasting educational resource, not a newscast. SE Radio covers all topics software engineering. Episodes are either tutorials on a specific topic, or an interview with a well-known character from the software engineering world. All SE Radio episodes are original content — we do not record conferences or talks given in other venues. Each episode comprises two speakers to ensure a lively listening experience. SE Radio is brought to you by the IEEE Computer Society and IEEE Software magazine.