88 min listen
E52: Advancements in AI: Updating the Scouting Report, Task Automation, and Google Breakthroughs
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
E52: Advancements in AI: Updating the Scouting Report, Task Automation, and Google Breakthroughs
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
41 minutes
Released:
Aug 10, 2023
Format:
Podcast episode
Description
Join Nathan Labenz and Erik Torenberg as they analyze the last month in AI advancements. Nathan takes us through the meaningful updates to his Scouting Report (released last month, linked below), discusses highlights from recent episodes of The Cognitive Revolution, and gives us a sneak peek at upcoming interviews with Google researchers. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive
RECOMMENDED PODCAST:
Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators. Listen wherever you get your podcasts: https://link.chtbl.com/TurpentineVC
TIMESTAMPS:
(01:00) How does the AI Scouting Report hold up a few weeks later?
(03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape
(10:25) The universal LLM jailbreak and adversarial examples
(12:53) Human performance is much more variable than AI performance
(14:45) Sponsors: NetSuite | Omneky
(16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses?
(20:05) Is GPT-4 getting worse or better?
(22:00) Getting explicit about what good looks like
(24:00) Prompting best practices are very accessible
(26:35) Ghostwriting - and the art of the hook
(28:05) Live Players: Which companies have say so over how the future goes?
(31:10) Upcoming guests from Google AI
(35:40) Possible post-transformer architectures
LINKS:
SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ
SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E
SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E
3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown
Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s
.
Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s
Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/jonathan-gpt-swift/
X:
@labenz (Nathan)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
RECOMMENDED PODCAST:
Turpentine VC: Delve deep into the art and science of building successful venture firms through conversations with the world’s best investors and operators. Listen wherever you get your podcasts: https://link.chtbl.com/TurpentineVC
TIMESTAMPS:
(01:00) How does the AI Scouting Report hold up a few weeks later?
(03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape
(10:25) The universal LLM jailbreak and adversarial examples
(12:53) Human performance is much more variable than AI performance
(14:45) Sponsors: NetSuite | Omneky
(16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses?
(20:05) Is GPT-4 getting worse or better?
(22:00) Getting explicit about what good looks like
(24:00) Prompting best practices are very accessible
(26:35) Ghostwriting - and the art of the hook
(28:05) Live Players: Which companies have say so over how the future goes?
(31:10) Upcoming guests from Google AI
(35:40) Possible post-transformer architectures
LINKS:
SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ
SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E
SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E
3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown
Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s
.
Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s
Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/jonathan-gpt-swift/
X:
@labenz (Nathan)
@eriktorenberg (Erik)
@cogrev_podcast
SPONSORS: NetSuite | Omneky
NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.
Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Released:
Aug 10, 2023
Format:
Podcast episode
Titles in the series (100)
E5: The Embedding Revolution: Anton Troynikov on Chroma, Stable Attribution, and future of AI: Anton Troynikov, the founder of Chroma and Stable Attribution, discusses embeddings, the trade offs and optimizations involved with working with embeddings at scale, the "Stable Attribution" project, and the big picture of recent AI developments. (0:00) Preview(1:17) Sponsor (4:00) Anton breaks down the advantages of vector databases (4:45) How embeddings have created an AI-native way to represent data(11:50) Anton identifies the watershed moment and step changes in AI (12:55) Open AI’s pricing (18:50) How chroma works (33:04) Stable Attribution and systematic bias(36:48) How latent diffusion models work (51:26) How AI is like the early days of aviation (56:01) How Disney inspired the release of Stable Attribution (59:53):Why noise can lead to generalization (1:01:04) Nathan’s KPI for The Cognitive Revolution (1:01:59) Other use cases for embedding (1:03: 19) Anton touches on the application by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis