33 min listen
Data synthesis for SOTA LLMs
Data synthesis for SOTA LLMs
ratings:
Length:
47 minutes
Released:
Feb 6, 2024
Format:
Podcast episode
Description
Nous Research has been pumping out some of the best open access LLMs using SOTA data synthesis techniques. Their Hermes family of models is incredibly popular! In this episode, Karan from Nous talks about the origins of Nous as a distributed collective of LLM researchers. We also get into fine-tuning strategies and why data synthesis works so well.
Released:
Feb 6, 2024
Format:
Podcast episode
Titles in the series (100)
OpenAI, reinforcement learning, robots, safety: with Wojciech Zaremba by Practical AI: Machine Learning, Data Science