26 min listen
Personalization for Text-to-Image Generative AI with Nataniel Ruiz - #648
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Personalization for Text-to-Image Generative AI with Nataniel Ruiz - #648
FromThe TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
ratings:
Length:
44 minutes
Released:
Sep 25, 2023
Format:
Podcast episode
Description
Today we’re joined by Nataniel Ruiz, a research scientist at Google. In our conversation with Nataniel, we discuss his recent work around personalization for text-to-image AI models. Specifically, we dig into DreamBooth, an algorithm that enables “subject-driven generation,” that is, the creation of personalized generative models using a small set of user-provided images about a subject. The personalized models can then be used to generate the subject in various contexts using a text prompt. Nataniel gives us a dive deep into the fine-tuning approach used in DreamBooth, the potential reasons behind the algorithm’s effectiveness, the challenges of fine-tuning diffusion models in this way, such as language drift, and how the prior preservation loss technique avoids this setback, as well as the evaluation challenges and metrics used in DreamBooth. We also touched base on his other recent papers including SuTI, StyleDrop, HyperDreamBooth, and lastly, Platypus.
The complete show notes for this episode can be found at twimlai.com/go/648.
The complete show notes for this episode can be found at twimlai.com/go/648.
Released:
Sep 25, 2023
Format:
Podcast episode
Titles in the series (100)
This Week In Machine Learning & AI - 5/27/16: The White House on AI & Aggressive Self-Driving Cars: This Week in Machine Learning & AI brings you the… by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)