81 min listen
E49: Open AI, Anthropic, and Meta | Analyzing the AI Frontier with Zvi
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
E49: Open AI, Anthropic, and Meta | Analyzing the AI Frontier with Zvi
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
182 minutes
Released:
Aug 2, 2023
Format:
Podcast episode
Description
This isn't news, it's analysis! Nathan Labenz sits down for an with Zvi Mowshowitz, the writer behind Don't Worry About the Vase to talk about the major players in AI over the last few months. In this extended conversation, Nathan and Zvi debate if AI has attained the intelligence of a well-read college graduate (per OpenAI's Yann LeCun), a live player analysis (who to count/ who not to count), and the role of independent red teaming organizations. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. Highly recommend.
TIMESTAMPS:
(00:00) Episode preview
(03:15) Is AI as intelligent as a college grad?
(07:45) Memories and context processing
(15:45) Sponsor: NetSuite | Omneky
(17:13) Is AI as intelligent as a college grad? cont'd
(20:47) Strengths and weaknesses of AI vs human
(31:05) OpenAI Superalignment
(37:23) The relationship between OpenAI and Anthropic
(44:31) Anthropic's security recommendations and adversarial attacks
(50:50) Is OpenAI using a constitutional AI approach?
(01:01:26) Context and stochastic parrots
(01:10) Is more context better?
(01:15:29) Should Nathan work at Anthropic?
(01:21:35) Google DeepMind's RT-2
(01:27:47) Multi-modal Med-PaLM
(01:31:50) Speculating about Gato
(01:35:10) Skepticism about Med-PaLM usage in radiology
(01:41:37) Llama 2 - what is going on at Meta??
(01:51:14) Llama 2 vs other models
(01:55:29) Who are the live players?
(02:01:38) China's AI developments
(02:02:41) Character AI and Inflection
(02:05:26) Replit as the perfect substrate for AGI
(02:10) AI girlfriends
(02:18:53) AI safety: The White House
(02:25:43) Bottlenecks to progress
(02:35:27) Can new players influence AI policy?
(02:39:00) Liabilities
(02:47:54) Independent red teaming organizations
(02:57:18) Mechanistic interpretability
LINKS
Zvi's blog: https://thezvi.wordpress.com/
Google's RT-2: https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action
Gato: https://www.deepmind.com/publications/a-generalist-agent
Llama 2: https://ai.meta.com/llama/
Adversarial attacks paper: https://arxiv.org/abs/2307.15043
X:
@labenz (Nathan)
@thezvi (Zvi)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
-NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.
-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that *actually work* customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT:
MusicLM
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. Highly recommend.
TIMESTAMPS:
(00:00) Episode preview
(03:15) Is AI as intelligent as a college grad?
(07:45) Memories and context processing
(15:45) Sponsor: NetSuite | Omneky
(17:13) Is AI as intelligent as a college grad? cont'd
(20:47) Strengths and weaknesses of AI vs human
(31:05) OpenAI Superalignment
(37:23) The relationship between OpenAI and Anthropic
(44:31) Anthropic's security recommendations and adversarial attacks
(50:50) Is OpenAI using a constitutional AI approach?
(01:01:26) Context and stochastic parrots
(01:10) Is more context better?
(01:15:29) Should Nathan work at Anthropic?
(01:21:35) Google DeepMind's RT-2
(01:27:47) Multi-modal Med-PaLM
(01:31:50) Speculating about Gato
(01:35:10) Skepticism about Med-PaLM usage in radiology
(01:41:37) Llama 2 - what is going on at Meta??
(01:51:14) Llama 2 vs other models
(01:55:29) Who are the live players?
(02:01:38) China's AI developments
(02:02:41) Character AI and Inflection
(02:05:26) Replit as the perfect substrate for AGI
(02:10) AI girlfriends
(02:18:53) AI safety: The White House
(02:25:43) Bottlenecks to progress
(02:35:27) Can new players influence AI policy?
(02:39:00) Liabilities
(02:47:54) Independent red teaming organizations
(02:57:18) Mechanistic interpretability
LINKS
Zvi's blog: https://thezvi.wordpress.com/
Google's RT-2: https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action
Gato: https://www.deepmind.com/publications/a-generalist-agent
Llama 2: https://ai.meta.com/llama/
Adversarial attacks paper: https://arxiv.org/abs/2307.15043
X:
@labenz (Nathan)
@thezvi (Zvi)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
-NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.
-Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that *actually work* customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
MUSIC CREDIT:
MusicLM
Released:
Aug 2, 2023
Format:
Podcast episode
Titles in the series (100)
E2: Why AI Will Cause a Cognitive Revolution with Nathan Labenz and Erik Torenberg: Welcome to The Cognitive Revolution, where co-hosts Nathan Labenz and Erik Torenberg, interview builders and researchers working at the edge of AI. (00:00) Coming Up (01:00) The Cognitive Revolution (01:20) Sponsor (01:39) Intro (02:09) Nathan’s path to AI (04:27) Founding Waymark (06:56) The future of AI is just starting (10:00) AI dramatically enhances human capabilities (10:50) Why we started The Cognitive Revolution and what to expect (14:55) Which guests will appear on the show and topics to be discussed (18:59) Being replaced by an AI host (20:42) Unpacking the future of AI with “no new breakthroughs” (32:21) What’s underhyped and overhyped (43:46) The dangers of AI (44:51) Applying AI safely (52:19) Losing faith in technology (53:38) A new AI ecology (55:14) Facebook, Google and Open AI (58:00) Upside and downside case for AI (58:18) Sam Altman’s case for AI (01:09:25) Starting an AI company by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis