Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

Are long context windows the end of RAG?

Are long context windows the end of RAG?

FromThe Stack Overflow Podcast


Are long context windows the end of RAG?

FromThe Stack Overflow Podcast

ratings:
Length:
29 minutes
Released:
Apr 2, 2024
Format:
Podcast episode

Description

DBRX, an open, general-purpose LLM created by Databricks, reportedly outperforms GPT-3.5 and is competitive with Gemini 1.0 Pro.Recent research found that large, complex LLMs use a simple mechanism to retrieve stored knowledge in response to a user prompt. These mechanisms can help researchers reveal what the model knows and potentially even correct false information it has stored.FTX co-founder Sam Bankman-Fried, whose downfall began in late 2022, was sentenced last week to 25 years in prison for conspiracy and fraud. Find Michael on LinkedIn.Find Cassidy on her website.Stack Overflow user Bucket received a well-deserved Lifeboat badge for rescuing How to calculate decimal(x, y) max value in SQL Server from an ocean of ignorance.Chapters (please note that these timestamps may not be exact): 00:00 Introduction and White Paper Discussion02:01 Long Context Windows and Retrieval Augmented Generation05:56 Models' Ability to Recall Relevant Information07:18 Models' Creativity and Thinking Outside the Box09:41 Advantages and Limitations of Models' Knowledge15:09 Databricks' Open Language Model22:25 Sam Bankman-Fried’s Sentence and the Effects on Crypto/Blockchain31:28 Closing Remarks and Lifeboat Badge
Released:
Apr 2, 2024
Format:
Podcast episode

Titles in the series (100)

For more than a dozen years, the Stack Overflow Podcast has been exploring what it means to be a developer and how the art and practice of software programming is changing our world. From Rails to React, from Java to Node.js, we host important conversations and fascinating guests that will help you understand how technology is made and where it’s headed. Hosted by Ben Popper, Cassidy Williams, and Ceora Ford, the Stack Overflow Podcast is your home for all things code.