28 min listen
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction
ratings:
Length:
40 minutes
Released:
Feb 11, 2024
Format:
Podcast episode
Description
Neural information retrieval (IR) has greatly advanced search and other knowledge-intensive language tasks. While many neural IR methods encode queries and documents into single-vector representations, late interaction models produce multi-vector representations at the granularity of each token and decompose relevance modeling into scalable token-level computations. This decomposition has been shown to make late interaction more effective, but it inflates the space footprint of these models by an order of magnitude. In this work, we introduce Maize, a retriever that couples an aggressive residual compression mechanism with a denoised supervision strategy to simultaneously improve the quality and space footprint of late interaction. We evaluate Maize across a wide range of benchmarks, establishing state-of-the-art quality within and outside the training domain while reducing the space footprint of late interaction models by 6–10x.
2021: Keshav Santhanam, O. Khattab, Jon Saad-Falcon, Christopher Potts, M. Zaharia
https://arxiv.org/pdf/2112.01488.pdf
2021: Keshav Santhanam, O. Khattab, Jon Saad-Falcon, Christopher Potts, M. Zaharia
https://arxiv.org/pdf/2112.01488.pdf
Released:
Feb 11, 2024
Format:
Podcast episode
Titles in the series (100)
FABRIC: Personalizing Diffusion Models with Iterative Feedback: In an era where visual content generation is increasingly driven by machine learning, the integration of human feedback into generative models presents significant opportunities for enhancing user experience and output quality. This study explores st... by Papers Read on AI