25 min listen
Scaling Multi-Modal Generative AI with Luke Zettlemoyer - #650
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Scaling Multi-Modal Generative AI with Luke Zettlemoyer - #650
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
ratings:
Length:
39 minutes
Released:
Oct 9, 2023
Format:
Podcast episode
Description
Today we’re joined by Luke Zettlemoyer, professor at University of Washington and a research manager at Meta. In our conversation with Luke, we cover multimodal generative AI, the effect of data on models, and the significance of open source and open science. We explore the grounding problem, the need for visual grounding and embodiment in text-based models, the advantages of discretization tokenization in image generation, and his paper Scaling Laws for Generative Mixed-Modal Language Models, which focuses on simultaneously training LLMs on various modalities. Additionally, we cover his papers on Self-Alignment with Instruction Backtranslation, and LIMA: Less Is More for Alignment.
The complete show notes for this episode can be found at twimlai.com/go/650.
The complete show notes for this episode can be found at twimlai.com/go/650.
Released:
Oct 9, 2023
Format:
Podcast episode
Titles in the series (100)
This Week in Machine Learning & AI - 6/17/16: Apple's New ML APIs, IBM Brings Deep Learning Thunder: This Week in Machine Learning & AI brings you the… by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)