83 min listen
E51: Replit's VP of AI, Michele Catasta, on Artificial Developer Intelligence
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
E51: Replit's VP of AI, Michele Catasta, on Artificial Developer Intelligence
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
102 minutes
Released:
Aug 8, 2023
Format:
Podcast episode
Description
In this episode, Nathan sits down with Replit’s VP of AI, Michele Catasta. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Michele and Nathan discuss Replit's state of AI development report, advantages when it comes to AI development, and the company's custom models. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDED PODCAST:
Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators.
https://link.chtbl.com/TurpentineVC
TIMESTAMPS:
(00:00) Episode Preview
(00:00:57) Introduction
(04:44) What is artificial developer intelligence?
(15:05) Sponsors: Netsuite | Omneky
(16:58) Michele's background at Google & decision to join Replit
(19:16) Startups vs incumbents
(24:42) Whether Replit identifies as an e/acc company
(26:37) Staying apolitical on AI while being responsible
(30:36) The rise of LangChain and polarized reactions
(35:14) Estimates on developer productivity gains from AI assistance (2x-10x)
(38:35) Democratizing software development through easy customization
(44:02) AI generating disposable single-use software
(51:33) Optimism about humanity's ability to handle transformative AI
(55:01) The need for nuanced AI safety discussions
(56:14) Replit's data advantage from user code execution
(01:04:31) Replit's approach to training custom AI models
(01:08:51) The value of both open source and commercial models
(01:13:18) Michele’s highlights from being a Google researcher
(01:15:47) World knowledge needs in AI development
(01:20:37) Replit’s approach to AI safety
(01:24:28) The advantage of having a commercial model
(01:25:54) The costs of serving AI features to millions of users
(01:28:49) Modeling cost per user with AI workloads
(01:30:50) Pushing AI inference to the edge
(01:32:18) Ghostwriter integrating more deeply into Replit's IDE
(01:33:37) Replit as a potential "substrate for AGI"
LINKS:
https://replit.com/
Replit's State of AI Development Report: https://blog.replit.com/ai-on-replit
X:
@pirroh (Michele)
@labenz (Nathan)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
- NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform, head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
- Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
RECOMMENDED PODCAST:
Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators.
https://link.chtbl.com/TurpentineVC
TIMESTAMPS:
(00:00) Episode Preview
(00:00:57) Introduction
(04:44) What is artificial developer intelligence?
(15:05) Sponsors: Netsuite | Omneky
(16:58) Michele's background at Google & decision to join Replit
(19:16) Startups vs incumbents
(24:42) Whether Replit identifies as an e/acc company
(26:37) Staying apolitical on AI while being responsible
(30:36) The rise of LangChain and polarized reactions
(35:14) Estimates on developer productivity gains from AI assistance (2x-10x)
(38:35) Democratizing software development through easy customization
(44:02) AI generating disposable single-use software
(51:33) Optimism about humanity's ability to handle transformative AI
(55:01) The need for nuanced AI safety discussions
(56:14) Replit's data advantage from user code execution
(01:04:31) Replit's approach to training custom AI models
(01:08:51) The value of both open source and commercial models
(01:13:18) Michele’s highlights from being a Google researcher
(01:15:47) World knowledge needs in AI development
(01:20:37) Replit’s approach to AI safety
(01:24:28) The advantage of having a commercial model
(01:25:54) The costs of serving AI features to millions of users
(01:28:49) Modeling cost per user with AI workloads
(01:30:50) Pushing AI inference to the edge
(01:32:18) Ghostwriter integrating more deeply into Replit's IDE
(01:33:37) Replit as a potential "substrate for AGI"
LINKS:
https://replit.com/
Replit's State of AI Development Report: https://blog.replit.com/ai-on-replit
X:
@pirroh (Michele)
@labenz (Nathan)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
- NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform, head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
- Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
Released:
Aug 8, 2023
Format:
Podcast episode
Titles in the series (100)
E10: The AI Voice Revolution with Mahmoud Felfel of Play.ht: The development of ultra-realistic human voices is upon us, and Mahmoud Felfel's company Play.ht is leading the next generation of text-to-voice models. In this episode, we discuss the challenges and opportunities of automating a more human voice, as well as concerns about deep fakes and user safety. Also, you might be interested to check out the debut of Erik Torenberg's new podcast "Upstream". This coming season features interviews with Marc Andreessen (Episode 1 is out now), David Sacks, Ezra Klein, Balaji Srinivasan, Katherine Boyle, and more. Subscribe here: https://podcasts.apple.com/us/podcast/id1678893467 Timestamps: (0:00) Preview of Mahmoud on this episode (0:55) Sponsor: Omneky.com (1:45) Nathan clones his voice using Play.ht (6:11) Why Mahmoud started Play.ht and the problem they tried to solve (13:08) The job to be done for Play.ht & how they’re thinking about APIs and models (24:45) Mahmoud breaks by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis