33 min listen
Interactive Exploratory Data Analysis On Petabyte Scale Data Sets With Arkouda
Interactive Exploratory Data Analysis On Petabyte Scale Data Sets With Arkouda
ratings:
Length:
41 minutes
Released:
Jul 31, 2022
Format:
Podcast episode
Description
Exploratory data analysis works best when the feedback loop is fast and iterative. This is easy to achieve when you are working on small datasets, but as they scale up beyond what can fit on a single machine those short iterations quickly become long and tedious. The Arkouda project is a Python interface built on top of the Chapel compiler to bring back those interactive speeds for exploratory analysis on horizontally scalable compute that parallelizes operations on large volumes of data. In this episode David Bader explains how the framework operates, the algorithms that are built into it to support complex analyses, and how you can start using it today.
Released:
Jul 31, 2022
Format:
Podcast episode
Titles in the series (100)
MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24: Fast and Scalable Financial Timeseries Dataframes with MarketStore (Interview) by Data Engineering Podcast