11 min listen
Data Provenance and Reproducibility with Pachyderm
FromData Skeptic
ratings:
Length:
40 minutes
Released:
Feb 3, 2017
Format:
Podcast episode
Description
Versioning isn't just for source code. Being able to track changes to data is critical for answering questions about data provenance, quality, and reproducibility. Daniel Whitenack joins me this week to talk about these concepts and share his work on Pachyderm. Pachyderm is an open source containerized data lake. During the show, Daniel mentioned the Gopher Data Science github repo as a great resource for any data scientists interested in the Go language. Although we didn't mention it, Daniel also did an interesting analysis on the 2016 world chess championship that complements our recent episode on chess well. You can find that post here Supplemental music is Lee Rosevere's Let's Start at the Beginning. Thanks to Periscope Data for sponsoring this episode. More about them at periscopedata.com/skeptics
Released:
Feb 3, 2017
Format:
Podcast episode
Titles in the series (100)
[MINI] Bayesian Updating: In this minisode, we discuss Bayesian Updating - the process by which one can calculate the most likely hypothesis might be true given one's older / prior belief and all new evidence. by Data Skeptic