Apache Hudi: Large Scale Data Systems with Vinoth Chandar

Blissfully: Comprehensive IT Management with Aaron White: Delivering Saas products involves a lot more than just building the product. Saas management involves customer relationship management, licensing, renewals, maintaining software visibility, and the general management of the technology portfolio. by Data Archives - Software Engineering Daily

56 min listen

Stemma: Understanding Big Data with Mark Grover: Amundsen was started at Lyft and is the leading open-source data catalog with the fastest-growing community and the most integrations. Amundsen enables you to search your entire organization by text search, see automated and curated metadata, by Data Archives - Software Engineering Daily

41 min listen

Akita: Application Programming Interfaces with Jean Yang: An Application Programming Interface, API for short, is the connector between 2 applications. For example, a user interface that needs user data will call an endpoint, like a special URL, with request parameters and receive the data back if the request... by Data Archives - Software Engineering Daily

45 min listen

Better Stack: A New DevOps Experience with Juraj Masar: DevOps has shortened the development life cycle for countless applications and is embraced by companies around the world. But managing and monitoring multiple environments is still a major pain point, particularly when companies need to mix cloud and l... by Data Archives - Software Engineering Daily

52 min listen

Data Science on AWS: Implementing AI and ML Pipelines on AWS with Chris Fregly: Data science is an interdisciplinary field that combines strong technical skills with industry knowledge to perform a large range of jobs. Data scientists solve business questions with hands-on work cleaning and analyzing data, by Data Archives - Software Engineering Daily

47 min listen

Preset: Visualizing Big Data with Srini Kadamati: Apache Superset is an open-source, fast, lightweight and modern data exploration and visualization platform. It can connect to any SQL based data source through SQLAlchemy at petabyte scale. Its architecture is highly scalable and it ships with a wide ... by Data Archives - Software Engineering Daily

54 min listen

Nextmv: Optimization in Fluid Work Environments with Carolyn Mooney: The traveling salesman problem is a classic challenge of finding the shortest and most efficient route for a person to take given a list of destinations. This is one of many real-world optimization problems that companies encounter. by Data Archives - Software Engineering Daily

53 min listen

Druid: Event-Driven Data with Eric Tschetter: Whether sending messages, shopping in an app, or watching videos, modern consumers expect information and responsiveness to be near-instant in their apps and devices. From a developer’s perspective, this means clean code and a fast database. by Data Archives - Software Engineering Daily

56 min listen

Apache Hudi: Large Scale Data Systems with Vinoth Chandar: Apache Hudi is an open-source data management framework used to simplify incremental data processing and data pipeline development. This framework more efficiently manages business requirements like data lifecycle and improves data quality. by Data Archives - Software Engineering Daily

52 min listen

Data Lineage: Understanding Data Lineage at Scale with Julien Le Dem by Data Archives - Software Engineering Daily

59 min listen

Prophecy: Apple of Data Engineering with Raj Bains: Prophecy is a complete Low-Code Data Engineering Platform for the Enterprise. Prophecy enables all your teams on Apache Spark with a unique low-code designer. While you visually build your Dataflows – Prophecy generates high-quality Spark code on Git. by Data Archives - Software Engineering Daily

58 min listen

LayerCI with Colin Chartier: Continuous integration is a coding practice where engineers deliver incremental and frequent code changes to create higher quality software and collaborate more. Teams attempting to continuously integrate new code need a consistent and automated pipeli... by Data Archives - Software Engineering Daily

50 min listen

ClickHouse: Data Warehousing with Robert Hodges: Columnar databases store and retrieve columns of data rather than rows of data. Each block of data in a columnar database stores up to 3 times as many records as row-based storage. This means you can read data with a third of the power needed in row-ba... by Data Archives - Software Engineering Daily

44 min listen

New Relic: Telemetry and Intelligent Observability with Zain Asgar and Ishan Mukherjee: In software engineering, telemetry is the data that is collected about your applications. Unlike logging, which is used in the development of apps to pinpoint errors and code flows, telemetry data includes all operational data including logs, metrics, by Data Archives - Software Engineering Daily

56 min listen

InfluxData: Time-Series Data with Russ Savage: Time series data are simply measurements or events that are tracked, monitored, downsampled, and aggregated over time. This could be server metrics, application performance monitoring, network data, sensor data, events, clicks, trades in a market, by Data Archives - Software Engineering Daily

44 min listen

Imply Infra: Big Data Analysis and Real-World Examples with Jad Naous: Big data analytics is the process of collecting data, processing and cleaning it, then analyzing it with techniques like data mining, predictive analytics, and deep learning. This process requires a suite of tools to operate efficiently. by Data Archives - Software Engineering Daily

45 min listen

Reverse ETL: Operationalizing Data Warehouses with Tejas Manohar: Enterprise data warehouses store all company data in a single place to be accessed, queried, and analyzed. They’re essential for business operations because they support managing data from multiple sources, providing context, by Data Archives - Software Engineering Daily

54 min listen

Firebolt: Data Warehouses with Eldad Farkash: Cloud data warehouses are databases hosted in cloud environments. They provide typical benefits of the cloud like flexible data access, scalability, and performance. The company Firebolt provides a cloud data warehouse built for modern data environmen... by Data Archives - Software Engineering Daily

58 min listen

Instabase with Anant Bhardwaj: Instabase is a technology platform for building automation solutions. Users deploy it onto their own infrastructure and can leverage the tools offered by the platform to build complex workflows for handling tasks like income verification and claims pro... by Data Archives - Software Engineering Daily

48 min listen

Uber Data Science with Kevin Novak: Uber is one of many examples we’ve discussed on this show that has changed the world with big data analysis. With over 8 million users, 1 billion Uber trips and people driving for Uber in over 400 cities and 66 countries, by Data Archives - Software Engineering Daily

50 min listen

Scalable Streaming Video with Amit Mishra: The internet is a layer cake of technologies and protocols. At a fundamental level, the internet runs on the TCP/IP protocol. It’s a packet based system. When your browser requests a file from a web server, by Data Archives - Software Engineering Daily

36 min listen

Meltano: ELT for DataOps with Douwe Maan: ELT is a process for copying data from a source system into a target system. It stands for “Extract, Load, Transform” and starts with extracting a copy of data from the source location. It’s loaded into the target system like a data warehouse, by Data Archives - Software Engineering Daily

52 min listen

Trifacta with Joe Hellerstein: If you haven’t encountered a data quality problem, then you haven’t yet worked on a large enough project. Invariably, a gap exists between the state of raw data and what an analyst or machine learning engineer needs to solve their problem. by Data Archives - Software Engineering Daily

41 min listen

CockroachDB: Distributed Databases and Containerization with Spencer Kimball: In 2003, Google developed a robust cluster management system called Borg. This enabled them to manage clusters with tens of thousands of machines, moving them away from virtual machines and firmly into container management. Then, in 2014, by Data Archives - Software Engineering Daily

52 min listen

LinearB with Dan Lines: A developer’s core deliverables are individual commits and the pull requests they aggregate into. While the number of lines of code written alone may not be very informative, in total, the code and metadata about the code found in tracking systems pres... by Data Archives - Software Engineering Daily

46 min listen

Risk and Compliance with Terry O’Daniel: Consumers are increasingly becoming aware of how detrimental it can be when companies mismanage data. This demand has fueled regulations, defined standards, and applied pressure to companies. Modern enterprises need to consider corporate risk managem... by Data Archives - Software Engineering Daily

58 min listen

StreamSets: DataOps and Smart Pipelines with Arvind Prabhakar: The company StreamSets is enabling DataOps practices in today’s enterprises. StreamSets is a data engineering platform designed to help engineers design, deploy, and operate smart data pipelines. StreamSets Data Collector is a codeless solution for des... by Data Archives - Software Engineering Daily

56 min listen

DaaS with Auren Hoffman: Auren Hoffman is the CEO of SafeGraph. In this episode we discuss data as a service and more. This interview was also recorded as a video podcast. Check out the video on the Software Daily YouTube channel. Sponsorship inquiries: sponsor@softwareenginee... by Data Archives - Software Engineering Daily

108 min listen

Data Exploration with a New Python Library with Doris Lee: Data exploration uses visual exploration to understand what is in a dataset and the characteristics of the data. Data scientists explore data to understand things like customer behavior and resource utilization. by Data Archives - Software Engineering Daily

48 min listen

Text Blaze: Text Shortcuts with Scott Fortmann-Roe: There are over 4 billion people using email. Many people using email for business communicate quick questions to colleagues, send repetitive, template-based information to potential customers and freshly hired employees, by Data Archives - Software Engineering Daily

46 min listen

Discover this podcast and so much more

Apache Hudi: Large Scale Data Systems with Vinoth Chandar

Description

Titles in the series (99)

More Episodes from Data Archives - Software Engineering Daily

Related podcast episodes