Yann LeCun: Filling the Gap in Large Language Models

FromEye On A.I.

Start listening View podcast show

Yann LeCun: Filling the Gap in Large Language Models

FromEye On A.I.

ratings:

Length:

55 minutes

Released:

Feb 16, 2023

Format:

Podcast episode

Description

Yann LeCun talks about what's missing in large language models and about his new joint embedding predictive architecture may be a step toward filling that gap.

Released:

Feb 16, 2023

Format:

Podcast episode

Titles in the series (100)

Eye on A.I. is a biweekly podcast, hosted by longtime New York Times correspondent Craig S. Smith. In each episode, Craig will talk to people making a difference in artificial intelligence. The podcast aims to put incremental advances into a broader context and consider the global implications of the developing technology. AI is about to change your world, so pay attention.

Skip carousel

Episode 2 demo - Jack Clark: In Episode 2 of Eye on AI, I talk to Jack Clark, Strategy and Communications Director at OpenAI, a nonprofit A.I. research company, in a wide-ranging conversation off of things highlighted in Jack’s popular Import AI newsletter. Topics include... by Eye On A.I.
28 min listen
Democratizing AI for the Warfighter: NSCAI staff David Kumashiro and Courtney Barno talked about the commission’s recommendations on democratizing AI for the warfighter and enabling bottom-up AI innovation. by Eye On A.I.
28 min listen
Episode 6 - Julian Togelius: In this episode of Eye on AI, I talk to Julian Togelius, perhaps the most prolific researcher at the intersection of video games and artificial intelligence. Julian works on AI for games and games for AI. Some of his most significant work is in... by Eye On A.I.
28 min listen
AI in Space with NASA’s Steve Chien: NSCAI commissioner Steve Chien, technical supervisor of the artificial intelligence group at NASA's Jet Propulsion Laboratory, talks about the growing demand for AI solutions in space, from coordinating an increasing number of earth-orbiting objects... by Eye On A.I.
49 min listen
Episode 3 - Misha Bilenko: In Episode 3 of Eye on AI, I talk to Misha Bilenko, head of AI at Yandex, the Google of Russia, about Vladimir Putin’s claim that whomever dominates AI will rule the world; about Yandex’s chatty virtual assistant, Alice; and how AI has made the... by Eye On A.I.
20 min listen
US Defense: AI-ready by 2025: NSCAI staff Chris Rice and Courtney Barno talk about what the US has to do to get up to speed on its AI military capabilities by 2025 in order to outpace our competitors, particularly China. by Eye On A.I.
39 min listen
Synthetic Data: Daeil Kim, cofounder of AI.Reverie, talks about the role that synthetic data can play in training AI models. by Eye On A.I.
40 min listen
Episode 7 - Ben Rosman: In this episode of Eye on AI, I talk to Ben Rosman, who runs Africa’s largest machine learning lab at the University of Witwatersrand in Johannesburg, South Africa, where he is focused on reinforcement learning. Ben has been instrumental in unifying... by Eye On A.I.
24 min listen
Eric Horvitz on AI and Allies: Eric Horvitz, chief research scientist at Microsoft and a commissioner on the National Security Commission on AI, talks about ensuring interoperability of AI systems with US allies and working to make all AI systems reliable. by Eye On A.I.
26 min listen
Episode 1 demo - Jack Clark: In Episode 1 of Eye on AI, I talk to Jack Clark, Strategy and Communications Director at OpenAI, a nonprofit A.I. research company, in a wide-ranging conversation off of things highlighted in Jack’s popular Import AI newsletter. Topics include... by Eye On A.I.
34 min listen
Robert O. Work by Eye On A.I.
32 min listen
Building the Foundation for AI in National Security: NSCAI staff Mike Garris and Mike Jackson spoke about what needs to be done to lay the foundations for an AI-infused national security going forward. by Eye On A.I.
25 min listen
Episode 8 - Bernhard Schölkopf & Matthias Bethge: In this episode of Eye on AI, I continue my review of AI research in different regions of the world with a focus on Europe. Europe, with its strong academic tradition, faces unique challenges in scientific research because of the continent's... by Eye On A.I.
22 min listen
Episode 4 - Kaifu Lee: Kaifu Lee by Eye On A.I.
27 min listen
AI and National Security: US vs China: Ylli Bajraktari, executive director of the National Security Commission on AI, talked about what he considers the most important recommendations in the commission’s final report and about the need for Congress and the White House to act swiftly to... by Eye On A.I.
34 min listen
Creating New Materials with AI: Alan Aspuru Guzik, a professor at the University of Toronto, talks about his work in new materials discovery with machine learning and building a fully automated materials lab that can synthesize molecules discovered in a computer. by Eye On A.I.
26 min listen
Riiid, the leader in AI for Education: David Yi and Yohan Lee from Riiid Labs, the leading startup applying machine-learning to education, talk about making personalized instruction available to anyone in the world with an internet-connected device. They spoke about the family of... by Eye On A.I.
45 min listen
Tricky Business: Deploying AI Models on Hardware: An open-source compiler called TVM helps data scientists optimize their model’s performance on specific hardware. by Eye On A.I.
44 min listen
Lt. Gen. Michael S. Groen on AI war fighting: Director of the Pentagon’s Joint AI Center, Lieutenant General Michael S. Groen talks about improving war fighting and the challenge of China. by Eye On A.I.
47 min listen
Biodata as an instrument of National Power: Chris Darby, CEO of the CIA-backed tech investment company In-Q-Tel, talks about the commission's recommendation that AI for national security be extended to biotechnology, and that bio-data be considered an instrument of national power. by Eye On A.I.
34 min listen
Opening AI Career Paths in Government and funding STEM education: This week, NSCAI commissioner Jose-Marie Griffiths talks about her line of effort's recommendations to increase STEM related educational funding by $8 billion in order to prime the pump for an AI ready workforce and to make a variety of bureaucratic... by Eye On A.I.
37 min listen
Episode 5 - Miles Brundage: In this episode of Eye on AI, I talk to Miles Brundage, who studies the societal impacts of artificial intelligence and works on the policy team of OpenAI, the nonprofit A.I. research company founded by Elon Musk. When I spoke to Miles, he was a... by Eye On A.I.
23 min listen
Steps to Drive AI Innovation: NSCAI staff Tess Deblanc-Knowles and Mike Garris talk about the steps the US government needs to take to foster AI innovation in the years ahead. by Eye On A.I.
31 min listen
Geoff Hinton on his quest to decode learning in the brain: Geoff Hinton has lived at the outer reaches of machine learning research since an aborted attempt at a carpentry career a half century ago. He spoke to me about his work In 2020 and what he sees on the horizon for AI. by Eye On A.I.
39 min listen
Reorganizing DoD for the AI Future: NSCAI staff Justin Lynch, Ryan Carpenter and Lance Lantier talk about how the 1986 Goldwater Nichols Act that reorganized the US military inspired the commission’s recommendations to reorganize the Department of Defense to drive adoption of emerging... by Eye On A.I.
29 min listen
AI for the Heartland: NSCAI staff Aristotle Vainikos and Parker Wild spoke about the commission’s recommendations for establishing public-private innovation hubs around the country that can encourage and tap the entrepreneurial potential between the coasts and expand the... by Eye On A.I.
25 min listen
XPRIZE TELEPORTATION: Jacki Morie, a senior XPRIZE advisor, talks about the ANA Avatar XPRIZE, a competition focused on creating a physical avatar system that will seamlessly transport human skills and experience to distant locations. The four-year competition is in its... by Eye On A.I.
37 min listen
Yoshua Bengio and Iulian Serban on AI for Education: Turing award winner Yoshua Bengio and his colleague Julian Serban, co-founder of Korbit, an AI ed-tech startup with the aim of democratizing education, talk about enhancing education through the application of deep learning systems that can track... by Eye On A.I.
40 min listen
Educating the Warfighter to use AI by Eye On A.I.
38 min listen
Cade Metz on Genius Makers: This week, I talk to Cade Metz, the New York Times' lead reporter on artificial intelligence, about his new book, “Genius Makers, the Mavericks Who Brought AI to Google Facebook and the World." The book focuses on some of the... by Eye On A.I.
34 min listen

More Episodes from Eye On A.I.

Skip carousel

#186 Ronen Dar: Maximizing GPU Utilization for AI with Run:ai: This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting... by Eye On A.I.
71 min listen
#185 Damon Rasheed & Saurabh Jain: Achieving Up to 90% Accuracy in Predicting Drug Clinical Trial Outcomes with Opyl's Trialkey.ai: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. NetSuite is offering a one-of-a-kind flexible financing program. Head to to know... by Eye On A.I.
52 min listen
#184 André van Schaik: Building An Artificial Brain With 100 Billion Neurons: Dive into the cutting-edge realm of neuromorphic computing with André van Schaik, a professor of electrical engineering at the Western Sydney University, and director of the International Centre for Neuromorphic Systems, in Penrith, New South Wales,... by Eye On A.I.
46 min listen
#183 William Falcon: How Lightning Studio Transforms ML Model Deployment at Scale: This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting... by Eye On A.I.
51 min listen
#182 Dragomir Anguelov: The Future of Transportation - Waymo's Vision for Autonomous Driving: This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting... by Eye On A.I.
63 min listen
#181 Nick Bostrom: The Meaning of Life in a World where AI can do Everything for Us: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. NetSuite is offering a one-of-a-kind flexible financing program. Head to to know... by Eye On A.I.
55 min listen
#180 Thomas Lah: Navigating AI Adoption in Tech Businesses: This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI... by Eye On A.I.
53 min listen
#179 Ylli Bajraktari: AI and National Security - The Race with China: Dive into the heart of the AI race between the US and China with Craig Smith in episode #179 of Eye on AI. This discussion features Ylli Bajraktari, the President and CEO of the Special Competitive Studies Project, as he unveils the strategic... by Eye On A.I.
49 min listen
#178 Terry Sejnowski: The Role Of Neural Networks in Advancing AI: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent... by Eye On A.I.
53 min listen
#177 Björn Ommer: Are Diffusion Models The Key to Unlocking AI's Potential?: Join host Craig Smith on episode #177 of Eye on AI as he explores the cutting-edge world of generative models in artificial intelligence with Björn Ommer, a visionary AI researcher and Head of Computer Vision & Learning Group at Ludwig Maximilian... by Eye On A.I.
46 min listen
#176 Sergey Levine: Decoding The Evolution of AI in Robotics: Join host Craig Smith on episode #176 of Eye on AI as he dives deep into the realm of robotic artificial intelligence with Sergey Levine, associate professor in the Department of Electrical Engineering and Computer Sciences at UC Berkeley. In... by Eye On A.I.
43 min listen
#175 Aravind Srinivas: Revolutionizing Search with Perplexity AI: Join host Craig Smith on episode #175 of Eye on AI as he engages in an enlightening conversation with Aravind Srinivas, co-founder and CEO of Perplexity AI. In this episode, Aravind delves into the intricacies of Perplexity AI, a groundbreaking... by Eye On A.I.
53 min listen
#174 Tianmin Shu: How World Models are Shaping The Future of AI: Join host Craig Smith on episode #174 of Eye on AI as he sits down with Tianmin Shu, Assistant Professor at Hawkins in both the Computer Science and Cognitive Science departments. In this episode, Tianmin unravels the fascinating concept of... by Eye On A.I.
49 min listen
#173 Vincent Vanhoucke: How Is AI Helping Advance Robotics?: Join host Craig Smith for episode #173 of Eye on AI, featuring a groundbreaking discussion with Vincent Vanhoucke, distinguished Scientist, and Senior Director for Robotics at Google DeepMind. In this episode, Vincent dives into the cutting-edge... by Eye On A.I.
33 min listen
#172 Cristóbal Valenzuela: Can AI Revolutionize How We Create Art?: Join host Craig Smith on episode #172 of Eye on AI as he sits down with Cris Valenzuela, co-founder and CEO of Runway, an applied AI research company shaping the next era of art, entertainment and human creativity Cris shares insights into the origins... by Eye On A.I.
45 min listen
#171 Anna Marie Wagner: Harnessing AI for Synthetic Biology: Join host Craig Smith on episode #171 of Eye on AI, for an enlightening conversation with Anna Marie Wagner, SVP, Head of AI at Ginkgo Bioworks, renowned for their work in synthetic biology and its integration with artificial intelligence. In this... by Eye On A.I.
54 min listen
#169 Guillermo Rauch: How To Use AI to Improve Web Development: Join host Craig Smith on episode #169 of Eye on AI as we sit down with Guillermo Rauch, CEO of Vercel, a company that optimizes frontend deployment, making web projects faster to execute and easier to scale. In this episode, we explore the... by Eye On A.I.
59 min listen
#168 Ian Bremmer on Regulating AI for a Safer Future: Join host Craig Smith on episode #168 of Eye on AI as we sit down with Ian Bremmer, the founder and president of the Eurasia Group, a leading global political risk research and consulting firm. In this episode, we delve into the complex world of... by Eye On A.I.
54 min listen
#167 Matt Powell: The Impact of AI on Security and Surveillance: This episode is sponsored by ISS, a leading global provider of video intelligence and data awareness solutions. Founded in 1996 and headquartered in Woodbridge, N.J., ISS offers a robust portfolio of AI-powered, high-trust video analytics for... by Eye On A.I.
66 min listen
#166 Itamar Arel: Is Voice AI the Future of Customer Service?: Join host Craig Smith on episode #166 of Eye on AI as we sit down with Itamar Arel, CEO of Tenyx, a company that uses proprietary neuroscience-inspired AI technology to build the next generation of voice-based conversational agents. Itamar... by Eye On A.I.
46 min listen
#165 Andy Hock: Can AI Fully Automate Your Business?: This episode is sponsored by Babbel. Babbel is conversation-based learning built with science-backed cognitive tools like spaced repetition and interactive lessons created by real language teachers and voiced by real native speakers. Get 55% off your... by Eye On A.I.
66 min listen
#164 Hrant Khachatrian: Deep Dive Into The Breakthroughs & Challenges of AI Research: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent... by Eye On A.I.
61 min listen
#163 Rem Darbinyan: Inside The Armenia’s Tech Revolution & Rise of AI Startups: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent... by Eye On A.I.
52 min listen
#162 Vasi Philomin: Behind the Scenes of Amazon's AI Breakthroughs: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent... by Eye On A.I.
39 min listen
#161 Harut Martirosyan: What Secrets Lie Behind Armenia's AI Surge?: This episode is sponsored by Babbel. Babbel is conversation-based learning built with science-backed cognitive tools like spaced repetition and interactive lessons created by real language teachers and voiced by real native speakers. Get 55% off your... by Eye On A.I.
45 min listen
#160 Atul Deo: The Future of Generative AI at Amazon: This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you’re selling online, on social media, or in person, Shopify has you covered on every base. With... by Eye On A.I.
49 min listen
#159 Peter Chen: Building the AI-Driven Future of Robotics: This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI... by Eye On A.I.
51 min listen
#158 Connor Leahy: The Unspoken Risks of Centralizing AI Power: This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. Download NetSuite’s popular KPI Checklist, designed to give you consistently excellent... by Eye On A.I.
65 min listen

Related podcast episodes

Skip carousel

#125 Pascal Weinberger: Harnessing the Power of Generative AI for Creativity & Productivity: Welcome to episode 125 of Eye on AI, where we embark on a journey into the realm of Generative AI. In this episode, we have the pleasure of chatting with Pascal Weinberger, co-founder and CEO of Bardeen AI, who takes us through the evolution of AI and... by Eye On A.I.
57 min listen
Russia-Ukraine War Update for April 22, 2023 by The Russia-Ukraine War Report
20 min listen
016 Consciousness: Can AI be conscious? ocdevel.com/mlg/16 for notes and resources by Machine Learning Guide
74 min listen
The Return of Marco Polo's World, with Robert D. Kaplan: If you wish to understand the depth and breadth of the geographical, historical, technological, and political forces that are shaping our world, there is no better guide than Robert Kaplan. Using Marco Polo's journey as "a geographical framing device... by Carnegie Council Podcasts
60 min listen
How the IMF and World Bank Repress the Poor (WiM263): Alex Gladstein is the Chief Strategy Officer at the Human Rights Foundation. He joins me for a deep dive into his upcoming book “Hidden Repression”. We discuss how the IMF and World Bank repress poor countries and funnel their resources to rich ones, and more. by The "What is Money?" Show
112 min listen
How LLMs and Generative AI are Revolutionizing AI for Science with Anima Anandkumar - #614 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
62 min listen
China’s Property Market Crisis by The Journal.
18 min listen
Russia-Ukraine War Update for April 8, 2023 by The Russia-Ukraine War Report
33 min listen
0070: We Don’t Get to Choose: Or do we? http://traffic.libsyn.com/friendlyai/ConcerningAI-episode-0070-2018-09-30.mp3 by Concerning AI | Existential Risk From Artificial Intelligence
20 min listen
Kaifu Lee Tells Our Future: AI commentator and investor Kaifu Lee talks about his book AI 2041 in which he considers possible futures for humanity if deep learning applications develop as planned. by Eye On A.I.
47 min listen
Chip War: 'If there's a war over Taiwan, semiconductors will be the first casualty': Americans who waited endlessly for products to make it through the pandemic-era global supply chain crisis know all too well how disastrous a shortage of semiconductor chips can be to the global economy — but few know the extent to which a chips shortage could further exacerbate U.S.-China tensions. Chris Miller, author of “Chip War: The fight for the world’s most critical technology," joins Chuck to detail his research on the global infrastructure behind producing semiconductors. by The Chuck ToddCast
31 min listen
War and Politics in the 21st Century, with Sir Lawrence Freedman by Intelligence Squared
58 min listen
These Top Energy Trends Will Shape 2023 | Doomberg by Wealthion - Be Financially Resilient
58 min listen
Is time running out for Ukraine?: As US and EU funding falters, is time running out for Ukraine to win the war with Russia? by The Real Story
49 min listen
187. CONCEIVED IN LIBERTY PART 2 with Michael Saylor & Patrick Newman on Murray Rothbard by The Bitcoin Standard Podcast
123 min listen
2. President, Ramar Foods: From School Teacher to President! by Human Capital
39 min listen
Are LLMs Overhyped or Underappreciated? with Marti Hearst - #626 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
38 min listen
024 Tech Stack: TensorFlow, Pandas, Numpy, Scikit-Learn, Keras, TensorForce. ocdevel.com/mlg/24 for notes and resources by Machine Learning Guide
61 min listen
#334 – Abbas Amanat: Iran Protests, Mahsa Amini, History, CIA & Nuclear Weapons: Abbas Amanat is a historian at Yale specializing in the modern history of Iran. Please support this podcast by checking out our sponsors: – Henson Shaving: https://hensonshaving.com/lex and use code LEX to get 100 free blades with your razor – InsideTr... by Lex Fridman Podcast
191 min listen
Israel, Gaza, and America’s Broken Middle East Policy by Power Problems
47 min listen
Ilya Sutskever: Ilya Sutskever, a cofounder and chief scientist of OpenAI and one of the primary minds behind the large language model GPT-4 and it’s public progeny, ChatGPT, talks about AI hallucinations and his vision of AI democracy. by Eye On A.I.
43 min listen
EP 41 - Exploring the Universe with Stephen Wolfram: Artificial Intelligence, Physics, and More: 0:00 Intro 1:54 How Stephen Wolfram approaches productivity 6:12 Stephen's day-in-life 7:45 Stephen's outlook on artificial intelligence 13:05 The human brain-artificial intelligence analogy 16:40 Wolfram's unique approach to GPT 31:00 The Pi computation 34:14 Risks of AI 45:32 Stephen's X factor 51:36 Are things as complex as they seem? 1:03:00 Do the simple things right Renowned physicist, mathematician, and computer scientist Stephen Wolfram joined us on the podcast to discuss AI, physics, and more. We explored the state of artificial intelligence and the challenges and opportunities it presents. Stephen shared his insights into the computational universe and cellular automata and their relationship to physics. ?️ The Good Times Show: Aarthi Ramamurthy and Sriram Krishnan host conversations with leading builders, and CEOs and reveal what it takes to make it to the inside. by The Aarthi and Sriram Show
66 min listen
The Lab-Leak Hypothesis & the Origin of Covid-19 | Alina Chan & Matt Ridley: In Episode 219 of , Demetri Kofinas speaks with Matt Ridley and Alina Chan. Alina is a Canadian molecular biologist specializing in gene therapy and cell engineering at the Broad Institute of MIT and Harvard and Matt is a British science journalist... by Hidden Forces
66 min listen
Moving Towards Decarbonization: Proposals for RTO and Market Development by Know Power
53 min listen
All Good Things: For the final (for now?) episode of AI with AI, Andy and Dave discuss the latest in AI news and research, including a political declaration from the US Department of State on the responsible military use of AI and autonomy. NATO begins work on an AI... by AI with AI: Artificial Intelligence with Andy Ilachinski
28 min listen
Mustafa Suleyman: How can AI be safely developed?: Stephen Sackur speaks to a British pioneer in the field of artificial intelligence by HARDtalk
23 min listen
Arnold Kling on Economics for the 21st Century: Arnold Kling talks with host Russ Roberts about the state of 21st century economics. He argues that economics would be more useful if it took account of intangibles like culture, incorporated the role of financial intermediation in the economy, and modeled some of the the subtleties of the labor market--how wages are set and the role of team production. by EconTalk
65 min listen
AI Agents and Data Integration with GPT and LLaMa with Jerry Liu - #628 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
41 min listen
Paul Mason and Jesse Norman on a Revolutionary Defence of Humanity: In this week's episode of the Intelligence Squared podcast, the left-wing economics journalist Paul Mason was interviewed by the Conservative MP Jesse Norman. They discussed Mason's vision for a ut... by Intelligence Squared
46 min listen
Zeke Faux, "Number Go Up: Inside Crypto's Wild Rise and Staggering Fall" (Currency, 2023): A Conversation with Zeke Faux by New Books in Economic and Business History
52 min listen

Discover this podcast and so much more

Yann LeCun: Filling the Gap in Large Language Models

Yann LeCun: Filling the Gap in Large Language Models

Description

Titles in the series (100)

More Episodes from Eye On A.I.

Related podcast episodes