Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Data Engineering: where are we and where are we going? w/ Joe Reis and Matt Housley of Ternary Data

Data Engineering: where are we and where are we going? w/ Joe Reis and Matt Housley of Ternary Data

FromCatalog & Cocktails: The Honest, No-BS Data Podcast


Data Engineering: where are we and where are we going? w/ Joe Reis and Matt Housley of Ternary Data

FromCatalog & Cocktails: The Honest, No-BS Data Podcast

ratings:
Length:
72 minutes
Released:
Sep 8, 2022
Format:
Podcast episode

Description

What is the state of Data engineering today and where is it going (or should it be going)?  Who better to talk about Data Engineering than the authors of the recent O’Reilly book “Fundamentals of Data Engineering”, Joe Reis and Matt Housley from Ternary Data.  Join Tim, Juan, Joe and Matt to discuss the state of data engineering. Conversation highlights: [00:44] Introduction to Joe Reis and Matt Housley[03:24] Warm up: what have you engineered or built that has gone terribly wrong?[08:28] Data engineering tools and magpie syndrome[13:15] How often and where do you see data teams stumbling to get the value out of the technology they have?[17:08] Thoughts on diving deep into technologies where there is a skills gap[19:39] The curse of familiarity in the context of tools[23:55] Learning outside the context of an enterprise, and continously educating yourself on data[27:23] Data modeling and where to start learning[30:48] Data modeling = business concepts and definitions to relations among data[32:05] The human aspect and technical side of data modeling[36:19] Business literacy for data engineers[38:39] The lifecycle of data[43:02] Analytics engineering, the knowledge scientists[46:09] Roles within data engineering and bifurcation[48:26 The future of data engineering and tabular data[52:12] Auto Machine Learning and Tabular Data[55:00] Lightning round[01:01:01] Tim and Juan's takeaways[01:06:18] Three questions about data, life, resources and the show's next guest
Released:
Sep 8, 2022
Format:
Podcast episode

Titles in the series (100)

Listed in the TOP 3 Knowledge Management Podcasts You Must Follow in 2021, Catalog & Cocktails is an honest, no-BS, non-salesy conversation about enterprise data management and analytics. This is your 30-minute elixir containing everything interesting about data and metadata management, DataOps, architecture, and more. Join Juan Sequeda and Tim Gasper to explore emerging topics and hear from visionary leaders.