85 min listen
AI Deception, Interpretability, and Affordances with Apollo Research CEO Marius Hobbhahn
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
AI Deception, Interpretability, and Affordances with Apollo Research CEO Marius Hobbhahn
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
117 minutes
Released:
Dec 15, 2023
Format:
Podcast episode
Description
In this episode, Marius Hobbhahn, CEO of Apollo Research, sits down with Nathan Labenz to discuss Apollo’s research in AI deception, interpretability, and affordances. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive
MasterClass https://masterclass.com/cognitive get two memberships for the price of 1
Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/cognitive
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
X/SOCIAL:
@labenz (Nathan)
@MariusHobbhahn (Marius)
@eriktorenberg (Erik)
@CogRev_Podcast
TIMESTAMPS:
(00:00:00) - Episode Preview
(00:05:40) - Understanding the Role of Apollo Research
(00:08:02) - The Evolution of AI Safety
(00:11:30) - Apollo’s Framework
(00:15:10) - Sponsors: Shopify
(00:16:49) - Understanding AI Affordances and Resulting Interactions in the World
(00:31:00) - Sponsors: Omneky
(00:39:00) - Interpretability and deceptive alignment
(00:45:55) - Why might deception arise in the first place?
(00:47:46) - Understanding deceptive alignment
(00:57:49) - New Architectures
(01:02:23) - Interpretability at deployment phase
(01:03:35) - Deception in AI | A Case Study
(01:09:03) - Deceptive AI Stock Trader
(01:18:51) - Impact of discouragement on unethical AI behaviour
(01:19:45) - Giving the AI a Reasoning Scratchpad and Impact on Deception
(01:21:06) - Double-edged sword of removing the scratchpad
(01:23:00) - Analyzing impact of model size on insider training
(01:28:00) - Challenges and necessity of 3rd Party Auditing
(01:31:00) - Role of government in regulation
(01:52:17) - How can individuals get involved in red teaming?
SPONSORS:
Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive
MasterClass https://masterclass.com/cognitive get two memberships for the price of 1
Learn from the best to become your best. Learn how to negotiate a raise with Chris Voss or manage your relationships with Esther Perel. Boost your confidence and find practical takeaways you can apply to your life and at work. If you own a business or are a team leader, use MasterClass to empower and create future-ready employees and leaders. Moment of Zen listeners will get two memberships for the price of one at https://masterclass.com/cognitive
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
X/SOCIAL:
@labenz (Nathan)
@MariusHobbhahn (Marius)
@eriktorenberg (Erik)
@CogRev_Podcast
TIMESTAMPS:
(00:00:00) - Episode Preview
(00:05:40) - Understanding the Role of Apollo Research
(00:08:02) - The Evolution of AI Safety
(00:11:30) - Apollo’s Framework
(00:15:10) - Sponsors: Shopify
(00:16:49) - Understanding AI Affordances and Resulting Interactions in the World
(00:31:00) - Sponsors: Omneky
(00:39:00) - Interpretability and deceptive alignment
(00:45:55) - Why might deception arise in the first place?
(00:47:46) - Understanding deceptive alignment
(00:57:49) - New Architectures
(01:02:23) - Interpretability at deployment phase
(01:03:35) - Deception in AI | A Case Study
(01:09:03) - Deceptive AI Stock Trader
(01:18:51) - Impact of discouragement on unethical AI behaviour
(01:19:45) - Giving the AI a Reasoning Scratchpad and Impact on Deception
(01:21:06) - Double-edged sword of removing the scratchpad
(01:23:00) - Analyzing impact of model size on insider training
(01:28:00) - Challenges and necessity of 3rd Party Auditing
(01:31:00) - Role of government in regulation
(01:52:17) - How can individuals get involved in red teaming?
Released:
Dec 15, 2023
Format:
Podcast episode
Titles in the series (100)
E11: OpenAI's GPT-4 Discussion with Nathan Labenz and Erik Torenberg: In this episode, hosts Nathan Labenz and Erik Torenberg delve into the exciting and concerning aspects of GPT4, the latest large multimodal model from OpenAI. Nathan, who was a Red Teamer for GPT4, shares his experience working with the model, using it for real-life scenarios, and how he found it to be human-level rather than human-like intelligence. Nathan also highlights some of its fundamental weaknesses and limitations and shares the most concerning elements of GPT4. They end the episode pondering the arrival of GPT5 and whether we are in AI's "goldilocks moment." Check out the debut of Erik Torenberg's new podcast Upstream. This coming season features interviews with Marc Andreessen (Episode 1 live now), David Sacks, Ezra Klein, Balaji Srinivasan, Katherine Boyle, and more. Subscribe here: Apple Podcasts: bit.ly/3z8TldL Spotify: bit.ly/40letd0 Timestamps for E11: Nathan Labenz and Erik Torenberg of The C by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis