Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Optimize Your Machine Learning Development And Serving With The Open Source Vector Database Milvus

Optimize Your Machine Learning Development And Serving With The Open Source Vector Database Milvus

FromData Engineering Podcast


Optimize Your Machine Learning Development And Serving With The Open Source Vector Database Milvus

FromData Engineering Podcast

ratings:
Length:
59 minutes
Released:
Aug 6, 2022
Format:
Podcast episode

Description

The optimal format for storage and retrieval of data is dependent on how it is going to be used. For analytical systems there are decades of investment in data warehouses and various modeling techniques. For machine learning applications relational models require additional processing to be directly useful, which is why there has been a growth in the use of vector databases. These platforms store direct representations of the vector embeddings that machine learning models rely on for computing relevant predictions so that there is no additional processing required to go from input data to inference output. In this episode Frank Liu explains how the open source Milvus vector database is implemented to speed up machine learning development cycles, how to think about proper storage and scaling of these vectors, and how data engineering and machine learning teams can collaborate on the creation and maintenance of these data sets.
Released:
Aug 6, 2022
Format:
Podcast episode

Titles in the series (100)

Weekly deep dives on data management with the engineers and entrepreneurs who are shaping the industry