59 min listen
Building a Multi-Tenant Managed Platform For Streaming Data With Pulsar at Datastax
Building a Multi-Tenant Managed Platform For Streaming Data With Pulsar at Datastax
ratings:
Length:
60 minutes
Released:
Jul 28, 2021
Format:
Podcast episode
Description
Everyone expects data to be transmitted, processed, and updated instantly as more and more products integrate streaming data. The technology to make that possible has been around for a number of years, but the barriers to adoption have still been high due to the level of technical understanding and operational capacity that have been required to run at scale. Datastax has recently introduced a new managed offering for Pulsar workloads in the form of Astra Streaming that lowers those barriers and make stremaing workloads accessible to a wider audience. In this episode Prabhat Jha and Jonathan Ellis share the work that they have been doing to integrate streaming data into their managed Cassandra service. They explain how Pulsar is being used by their customers, the work that they have done to scale the administrative workload for multi-tenant environments, and the challenges of operating such a data intensive service at large scale. This is a fascinating conversation with a lot of useful lessons for anyone who wants to understand the operational aspects of Pulsar and the benefits that it can provide to data workloads.
Released:
Jul 28, 2021
Format:
Podcast episode
Titles in the series (100)
Wallaroo with Sean T. Allen - Episode 12: Fast and Scalable Real-Time Stream Computation with Wallaroo (Interview) by Data Engineering Podcast