119 min listen
OpenAI Sora, Google Gemini, and Meta with Zvi Mowshowitz
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
OpenAI Sora, Google Gemini, and Meta with Zvi Mowshowitz
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
138 minutes
Released:
Feb 21, 2024
Format:
Podcast episode
Description
In this episode, Zvi Mowshowitz returns to the show to discuss OpenAI’s Sora model, Google’s Gemini announcement, Anthropic’s Sleeper Agents, and other live player analysis. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase
(https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news.
LINKS:
-Zvi’s Blog: https://thezvi.substack.com/
- Waymark The Frost Episode: https://www.youtube.com/watch?v=c1pPiGD7cBw
-Anthropic Sleeper Agents: https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
X/Social:
@TheZvi (Zvi)
@labenz (Nathan)
@CogRev_Podcast
TIMESTAMPS:
(00:04:37) - Zvi’s feedback on the type of content the show should create
(00:05:33) - Zvi’s experience with Gemini
(00:09:42) - Speculating on Google Gemini’s launch timing
(00:12:54) - Advantages of Gemini
(00:16:11) - Sponsors: Brave
(00:25:00) - Speculating on Gemini 1.5 and market dynamics for foundational models.
(00:28:18) How long context windows change things
(00:30:57) - Sponsor: Netsuite | Omneky
(00:41:06) - LLM Leaderboards
(00:43:37) - Physics world modelling in OpenAI Sora
(00:57:25) - Object permanence in Sora
(01:04:40) - Experiments Zvi would run on Sora
(01:06:21) - Superalignment and Anthropic Sleeper Agent
(01:10:47) - When do agents actually start to work?
(01:16:00) - Raising the standard for AI app developers
(01:22:07) - Dangers of open soure development
(01:30:53) - The future of compact models
(01:33:58) - Superalignment
(01:53:00) - Meta
(01:54:20) - Mistral’s hold over the regulatory environment
(02:04:16) - The Impact of Chip Bans on AI Development
Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase
(https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news.
LINKS:
-Zvi’s Blog: https://thezvi.substack.com/
- Waymark The Frost Episode: https://www.youtube.com/watch?v=c1pPiGD7cBw
-Anthropic Sleeper Agents: https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training
SPONSORS:
The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
X/Social:
@TheZvi (Zvi)
@labenz (Nathan)
@CogRev_Podcast
TIMESTAMPS:
(00:04:37) - Zvi’s feedback on the type of content the show should create
(00:05:33) - Zvi’s experience with Gemini
(00:09:42) - Speculating on Google Gemini’s launch timing
(00:12:54) - Advantages of Gemini
(00:16:11) - Sponsors: Brave
(00:25:00) - Speculating on Gemini 1.5 and market dynamics for foundational models.
(00:28:18) How long context windows change things
(00:30:57) - Sponsor: Netsuite | Omneky
(00:41:06) - LLM Leaderboards
(00:43:37) - Physics world modelling in OpenAI Sora
(00:57:25) - Object permanence in Sora
(01:04:40) - Experiments Zvi would run on Sora
(01:06:21) - Superalignment and Anthropic Sleeper Agent
(01:10:47) - When do agents actually start to work?
(01:16:00) - Raising the standard for AI app developers
(01:22:07) - Dangers of open soure development
(01:30:53) - The future of compact models
(01:33:58) - Superalignment
(01:53:00) - Meta
(01:54:20) - Mistral’s hold over the regulatory environment
(02:04:16) - The Impact of Chip Bans on AI Development
Released:
Feb 21, 2024
Format:
Podcast episode
Titles in the series (100)
E14: The Reasoning Revolution with Ought's Jungwon Byun and Andreas Stuhlmüller: We've looked forward to today's episode since we launched the show! Andreas Stuhlmuller and Jungwon Byun are the co-founders of Ought, a product-driven research lab that develops mechanisms for delegating open-ended thinking to advanced machine learning systems. Their flagship product, Elicit (elicit.org) is an AI research assistant that helps researchers accelerate time-consuming workflows, starting with literature review. by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis