Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Interactive Exploratory Data Analysis On Petabyte Scale Data Sets With Arkouda

Interactive Exploratory Data Analysis On Petabyte Scale Data Sets With Arkouda

FromData Engineering Podcast


Interactive Exploratory Data Analysis On Petabyte Scale Data Sets With Arkouda

FromData Engineering Podcast

ratings:
Length:
41 minutes
Released:
Jul 31, 2022
Format:
Podcast episode

Description

Exploratory data analysis works best when the feedback loop is fast and iterative. This is easy to achieve when you are working on small datasets, but as they scale up beyond what can fit on a single machine those short iterations quickly become long and tedious. The Arkouda project is a Python interface built on top of the Chapel compiler to bring back those interactive speeds for exploratory analysis on horizontally scalable compute that parallelizes operations on large volumes of data. In this episode David Bader explains how the framework operates, the algorithms that are built into it to support complex analyses, and how you can start using it today.
Released:
Jul 31, 2022
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry