33 min listen
DataOps For Streaming Systems With Lenses.io
DataOps For Streaming Systems With Lenses.io
ratings:
Length:
46 minutes
Released:
Jul 6, 2020
Format:
Podcast episode
Description
There are an increasing number of use cases for real time data, and the systems to power them are becoming more mature. Once you have a streaming platform up and running you need a way to keep an eye on it, including observability, discovery, and governance of your data. That's what the Lenses DataOps platform is built for. In this episode CTO Andrew Stevenson discusses the challenges that arise from building decoupled systems, the benefits of using SQL as the common interface for your data, and the metrics that need to be tracked to keep the overall system healthy. Observability and governance of streaming data requires a different approach than batch oriented workflows, and this episode does an excellent job of outlining the complexities involved and how to address them.
Released:
Jul 6, 2020
Format:
Podcast episode
Titles in the series (100)
MarketStore: Managing Timeseries Financial Data with Hitoshi Harada and Christopher Ryan - Episode 24: Fast and Scalable Financial Timeseries Dataframes with MarketStore (Interview) by Data Engineering Podcast