83 min listen
E29: The AI Chip Revolution with Andrew Feldman of Cerebras
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
E29: The AI Chip Revolution with Andrew Feldman of Cerebras
From"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
ratings:
Length:
81 minutes
Released:
May 25, 2023
Format:
Podcast episode
Description
Nathan Labenz sits down with Andrew Feldman, CEO and Co-Founder of Cerebras Systems, a company building a new class of computer system for accelerating AI and changing the future of work. Cerebras Systems is the creator of the world’s largest chip, at 2.6 trillion transistors. In this episode, they discuss the founding story of Cerebras, the experience of creating the world’s largest chip, and the process that goes into chip design and manufacturing for an AI-focused chip.
This episode is the first part of our hardware exploration series focused on the people building at the forefront of hardware applications in AI.
LINKS:
Cerebras: https://www.cerebras.net/
Book: The Chip War by Chris Miller
PODCAST RECOMMENDATION:
The AI Breakdown: https://pod.link/1680633614
As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis.
TIMESTAMPS
(00:00) Preview
(04:27) Andrew’s story of creating the world’s largest chip and Cerebras
(07:19) What is a chip?
(08:14) The diversity of chips and what they can accomplish
(09:47) What is it like to design a 2.5 trillion transistor chip?
(12:41) The founding story of Cerebras and building the team
(14:20) Sponsor: Omneky
(23:00) What was the hardest part about building the company?
(26:11) What happens after designing the chip’s blueprint?
(27:29) The tradeoffs needed in chipmaking
(34:08) The comparison between chips and neural networks
(38:31) The generalization vs specialization of a chip
(40:11) Sparse compute vs dense compute
(43:55) Ghost in the machine
(46:54) Supply chain challenges of the Cerebras chip
(54:59) The future for chips
(58:19) Building chip clusters
(58:57) The Cerebras business model
(01:00:41) Building a chip cluster vs using a Cerebras chip
(01:02:57) Giant chips on the edge
(01:05:32) What is the edge?
(01:08:04) Andrew’s favorite AI products
(01:10:08) Would Andrew get a Neuralink implant?
(01:14:16) Consciousness and chips
(01:17:50) AI hopes and fears
TWITTER:
@CogRev_Podcast
@andrewdfeldman (Andrew)
@labenz (Nathan)
@eriktorenberg (Erik)
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music Credit: MusicLM
More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com
This episode is the first part of our hardware exploration series focused on the people building at the forefront of hardware applications in AI.
LINKS:
Cerebras: https://www.cerebras.net/
Book: The Chip War by Chris Miller
PODCAST RECOMMENDATION:
The AI Breakdown: https://pod.link/1680633614
As anyone in AI knows, the pace of progress of new releases is relentless. The AI Breakdown is a daily podcast (10-20min long) that helps us ensure we don't miss anything important by curating news and analysis.
TIMESTAMPS
(00:00) Preview
(04:27) Andrew’s story of creating the world’s largest chip and Cerebras
(07:19) What is a chip?
(08:14) The diversity of chips and what they can accomplish
(09:47) What is it like to design a 2.5 trillion transistor chip?
(12:41) The founding story of Cerebras and building the team
(14:20) Sponsor: Omneky
(23:00) What was the hardest part about building the company?
(26:11) What happens after designing the chip’s blueprint?
(27:29) The tradeoffs needed in chipmaking
(34:08) The comparison between chips and neural networks
(38:31) The generalization vs specialization of a chip
(40:11) Sparse compute vs dense compute
(43:55) Ghost in the machine
(46:54) Supply chain challenges of the Cerebras chip
(54:59) The future for chips
(58:19) Building chip clusters
(58:57) The Cerebras business model
(01:00:41) Building a chip cluster vs using a Cerebras chip
(01:02:57) Giant chips on the edge
(01:05:32) What is the edge?
(01:08:04) Andrew’s favorite AI products
(01:10:08) Would Andrew get a Neuralink implant?
(01:14:16) Consciousness and chips
(01:17:50) AI hopes and fears
TWITTER:
@CogRev_Podcast
@andrewdfeldman (Andrew)
@labenz (Nathan)
@eriktorenberg (Erik)
Thank you Omneky for sponsoring The Cognitive Revolution. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work, customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Music Credit: MusicLM
More show notes and reading material released in our Substack: https://cognitiverevolution.substack.com
Released:
May 25, 2023
Format:
Podcast episode
Titles in the series (100)
E1: The Pixel Revolution with Playground AI 's Suhail Doshi: Suhail Doshi, founder of Playground AI, Mixpanel and Mighty, explores the rapidly evolving world of AI image creation software. In this episode, we dive deep into the latest advancements and breakthroughs in the field, and their impact on the future of art and design. by "The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis