59 min listen
The Future is Small Models, with Matei Zaharia, CTO of Databricks
FromNo Priors: Artificial Intelligence | Technology | Startups
The Future is Small Models, with Matei Zaharia, CTO of Databricks
FromNo Priors: Artificial Intelligence | Technology | Startups
ratings:
Length:
39 minutes
Released:
Apr 6, 2023
Format:
Podcast episode
Description
If you have 30 dollars, a few hours, and one server, then you are ready to create a ChatGPT-like model that can do what’s known as instruction-following. Databricks’ latest launch, Dolly, foreshadows a potential move in the industry toward smaller and more accessible but extremely capable AIs. Plus, Dolly is open source, requires less computing power, and fewer data parameters than its counterparts.
Matei Zaharia, Cofounder & Chief Technologist at Databricks, joins Sarah and Elad to talk about how big data sets actually need to be, why manual annotation is becoming less necessary to train some models, and how he went from a Berkeley PhD student with a little project called Spark to the founder of a company that is now critical data infrastructure that’s increasingly moving into AI.
No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode.
Show Links:
Hello Dolly: Democratizing the magic of ChatGPT with open models
Dolly Source Code on Github
Matei Zaharia - Chief Technologist & Cofounder - Databricks | LinkedIn
Matei Zaharia - Google Scholar
Databricks debuts ChatGPT-like Dolly, a clone any enterprise can own | VentureBeat
Sign up for new podcasts every week. Email feedback to show@no-priors.com
Follow us on Twitter: @Saranormous | @EladGil | @Databricks | @Matei_Zaharia
Show Notes:
[01:29] - Origin of Databricks
[4:30] - Work at Stanford Lab
[5:29] - Dolly and Role of Open Source
[12:30] - Industry focus on high parameter count, understanding reasoning at small model scale
[18:42] - Enterprise applications for Dolly & chat bots
[25:06] - Making bets as an academic turned CTO
[36:23] - The early stages of AI and future predictions
Matei Zaharia, Cofounder & Chief Technologist at Databricks, joins Sarah and Elad to talk about how big data sets actually need to be, why manual annotation is becoming less necessary to train some models, and how he went from a Berkeley PhD student with a little project called Spark to the founder of a company that is now critical data infrastructure that’s increasingly moving into AI.
No Priors is now on YouTube! Subscribe to the channel on YouTube and like this episode.
Show Links:
Hello Dolly: Democratizing the magic of ChatGPT with open models
Dolly Source Code on Github
Matei Zaharia - Chief Technologist & Cofounder - Databricks | LinkedIn
Matei Zaharia - Google Scholar
Databricks debuts ChatGPT-like Dolly, a clone any enterprise can own | VentureBeat
Sign up for new podcasts every week. Email feedback to show@no-priors.com
Follow us on Twitter: @Saranormous | @EladGil | @Databricks | @Matei_Zaharia
Show Notes:
[01:29] - Origin of Databricks
[4:30] - Work at Stanford Lab
[5:29] - Dolly and Role of Open Source
[12:30] - Industry focus on high parameter count, understanding reasoning at small model scale
[18:42] - Enterprise applications for Dolly & chat bots
[25:06] - Making bets as an academic turned CTO
[36:23] - The early stages of AI and future predictions
Released:
Apr 6, 2023
Format:
Podcast episode
Titles in the series (62)
The bot Cicero can collaborate, scheme and build trust with humans. What does this mean for the next frontier of AI? With Noam Brown, Research Scientist at Meta: AGI can beat top players in chess, poker, and, now, Diplomacy. In November 2022, a bot named Cicero demonstrated mastery in this game, which requires natural language negotiation and cooperation with humans. In short, Cicero can lie, scheme, build trust, pass as human, and ally with humans. So what does that mean for the future of AGI? This week’s guest is research scientist Noam Brown. He co-created Cicero on the Meta Fundamental AI Research Team, and is considered one of the smartest engineers and researchers working in AI today. Co-hosts Sarah Guo and Elad Gil talk to Noam about why all research should be high risk, high reward, the timeline until we have AGI agents negotiating with humans, why scaling isn’t the only path to breakthroughs in AI, and if the Turing Test is still relevant. by No Priors: Artificial Intelligence | Technology | Startups