Recurrent Neural Nets

FromLinear Digressions

Start listening View podcast show

Recurrent Neural Nets

FromLinear Digressions

ratings:

Length:

13 minutes

Released:

Nov 28, 2016

Format:

Podcast episode

Description

This week, we're doing a crash course in recurrent neural networks--what the structural pieces are that make a neural net recurrent, how that structure helps RNNs solve certain time series problems, and the importance of forgetfulness in RNNs.

Relevant links:
http://colah.github.io/posts/2015-08-Understanding-LSTMs/

Released:

Nov 28, 2016

Format:

Podcast episode

Titles in the series (100)

Linear Digressions is a podcast about machine learning and data science. Machine learning is being used to solve a ton of interesting problems, and to accomplish goals that were out of reach even a few short years ago.

Skip carousel

Electoral Insights (Part 2): Following up on our last episode about how experi… by Linear Digressions
21 min listen
Better Facial Recognition with Fisherfaces: Now that we know about eigenfaces (if you don't, … by Linear Digressions
12 min listen
The Enron Dataset: In 2000, Enron was one of the largest and compani… by Linear Digressions
12 min listen
How Outliers Helped Defeat Cholera: In the 1850s, there were a lot of things we didn’… by Linear Digressions
11 min listen
Hunting for the Higgs: Machine learning and particle physics go together… by Linear Digressions
10 min listen
Neural Nets (Part 2): In the last episode, we zipped through neural net… by Linear Digressions
11 min listen
Introducing Hidden Markov Models (HMM Part 1): Wikipedia says, "A hidden Markov model (HMM) is a… by Linear Digressions
15 min listen
Stats of World Series Streaks: Baseball is characterized by a high level of equa… by Linear Digressions
13 min listen
Labels and Where To Find Them: Supervised classification is built on the backs o… by Linear Digressions
13 min listen
Guinness: Not to oversell it, but the student's t-test has … by Linear Digressions
15 min listen
Facial Recognition with Eigenfaces: A true classic topic in ML: Facial recognition is… by Linear Digressions
10 min listen
Computers Try to Tell Jokes: Computers are capable of many impressive feats, b… by Linear Digressions
9 min listen
Um Detector 1: So, um... what about machine learning for audio a… by Linear Digressions
13 min listen
Lie Detectors: Often machine learning discussions center around … by Linear Digressions
9 min listen
Inferring Authorship (Part 1): This episode is inspired by one of our projects f… by Linear Digressions
9 min listen
Random Kanye: Ever feel like you could randomly assemble words … by Linear Digressions
9 min listen
Genetics and Um Detection (HMM Part 2): In part two of our series on Hidden Markov Models… by Linear Digressions
15 min listen
Zipf's Law: Zipf's law is related to the statistics of how wo… by Linear Digressions
12 min listen
Statistical Mistakes and the Challenger Disaster: After the Challenger exploded in 1986, killing al… by Linear Digressions
13 min listen
Falsifying Data: In the first of a few episodes on fraud in electi… by Linear Digressions
18 min listen
Careers in Data Science: Let’s talk money. As a “hot” career right now, da… by Linear Digressions
17 min listen
Reporter Bot: There’s a big difference between a table of numbe… by Linear Digressions
11 min listen
Bayesian Psychics: Come get a little "out there" with us this week, … by Linear Digressions
12 min listen
Monte Carlo For Physicists: This is another physics-centered podcast, about a… by Linear Digressions
8 min listen
Yiddish Translation: Imagine a language that is mostly spoken rather t… by Linear Digressions
12 min listen
Watson: This machine learning algorithm beat the human ch… by Linear Digressions
16 min listen
Inferring Authorship (Part 2): Now that we’re up to speed on the classic author … by Linear Digressions
14 min listen
Electoral Insights (Part 1): The first of our two-parter discussing the recent… by Linear Digressions
9 min listen
The State of Data Science: How many data scientists are there, where do they… by Linear Digressions
16 min listen
Kalman Runners: The Kalman Filter is an algorithm for taking nois… by Linear Digressions
15 min listen

More Episodes from Linear Digressions

Skip carousel

So long, and thanks for all the fish: All good things must come to an end, including th… by Linear Digressions
36 min listen
A Reality Check on AI-Driven Medical Assistants: The data science and artificial intelligence comm… by Linear Digressions
14 min listen
A Data Science Take on Open Policing Data: A few weeks ago, we put out a call for data scien… by Linear Digressions
24 min listen
Procella: YouTube's super-system for analytics data storage: This is a re-release of an episode that originall… by Linear Digressions
30 min listen
The Data Science Open Source Ecosystem: Open source software is ubiquitous throughout dat… by Linear Digressions
23 min listen
Rock the ROC Curve: This is a re-release of an episode that first ran… by Linear Digressions
16 min listen
Criminology and Data Science: This episode features Zach Drake, a working data … by Linear Digressions
31 min listen
Racism, the criminal justice system, and data science: As protests sweep across the United States in the… by Linear Digressions
32 min listen
An interstitial word from Ben: A message from Ben around algorithmic bias, and h… by Linear Digressions
6 min listen
Convolutional Neural Networks: This is a re-release of an episode that originall… by Linear Digressions
22 min listen
Stein's Paradox: This is a re-release of an episode that was origi… by Linear Digressions
27 min listen
Protecting Individual-Level Census Data with Differential Privacy: The power of finely-grained, individual-level dat… by Linear Digressions
21 min listen
Causal Trees: What do you get when you combine the causal infer… by Linear Digressions
15 min listen
The Grammar Of Graphics: You may not realize it consciously, but beautiful… by Linear Digressions
36 min listen
Gaussian Processes: It’s pretty common to fit a function to a dataset… by Linear Digressions
21 min listen
Keeping ourselves honest when we work with observational healthcare data: The abundance of data in healthcare, and the valu… by Linear Digressions
19 min listen
Changing our formulation of AI to avoid runaway risks: Interview with Prof. Stuart Russell: AI is evolving incredibly quickly, and thinking n… by Linear Digressions
29 min listen
Putting machine learning into a database: Most data scientists bounce back and forth regula… by Linear Digressions
24 min listen
The work-from-home episode: Many of us have the privilege of working from hom… by Linear Digressions
29 min listen
Understanding Covid-19 transmission: what the data suggests about how the disease spreads: Covid-19 is turning the world upside down right n… by Linear Digressions
25 min listen
Network effects re-release: when the power of a public health measure lies in widespread adoption: This week’s episode is a re-release of a recent e… by Linear Digressions
27 min listen
Causal inference when you can't experiment: difference-in-differences and synthetic controls: When you need to untangle cause and effect, but y… by Linear Digressions
21 min listen
Better know a distribution: the Poisson distribution: This is a re-release of an episode that originall… by Linear Digressions
32 min listen
The Lottery Ticket Hypothesis: Recent research into neural networks reveals that… by Linear Digressions
20 min listen
Interesting technical issues prompted by GDPR and data privacy concerns: Data privacy is a huge issue right now, after yea… by Linear Digressions
20 min listen
Thinking of data science initiatives as innovation initiatives: Put yourself in the shoes of an executive at a bi… by Linear Digressions
17 min listen
Building a curriculum for educating data scientists: Interview with Prof. Xiao-Li Meng: As demand for data scientists grows, and it remai… by Linear Digressions
32 min listen
Running experiments when there are network effects: Traditional A/B tests assume that whether or not … by Linear Digressions
25 min listen
Zeroing in on what makes adversarial examples possible: Adversarial examples are really, really weird: pi… by Linear Digressions
23 min listen
Unsupervised Dimensionality Reduction: UMAP vs t-SNE: Dimensionality reduction redux: this episode cove… by Linear Digressions
30 min listen

Related podcast episodes

Skip carousel

[MINI] Long Short Term Memory: Thanks to our sponsor brilliant.org/dataskeptics A Long Short Term Memory (LSTM) is a neural unit, often used in Recurrent Neural Network (RNN) which attempts to provide the network the capacity to store information for longer periods of time. An... by Data Skeptic
15 min listen
Learning Long-Time Dependencies with RNNs w/ Konstantin Rusch - #484: Today we conclude our 2021 ICLR coverage joined by Konstantin Rusch, a PhD Student at ETH Zurich. In our conversation with Konstantin, we explore his recent papers, titled coRNN and uniCORNN respectively, which focus on a novel architecture of... by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
38 min listen
023 Deep NLP 2: RNN review, bi-directional RNNs, LSTM & GRU cells. ocdevel.com/mlg/23 for notes and resources by Machine Learning Guide
43 min listen
#51 Francois Chollet - Intelligence and Generalisation by Machine Learning Street Talk (MLST)
122 min listen
This Week In Machine Learning & AI - 5/27/16: The White House on AI & Aggressive Self-Driving Cars: This Week in Machine Learning & AI brings you the… by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
26 min listen
What is beyond PoCs? ML project-hurdles you should be prepared to take with Balázs Kégl - 016: Why do we do PoCs all the time and why do we struggle with Real projects? We are going to talk about ML project-hurdles with the head of AI at Huawei Paris, Balazs Kegl. by Machine Learning Cafe
56 min listen
This Week In Machine Learning & AI - 5/20/16: AI at Google I/O, Amazon's Deep Learning DSSTNE: This Week In Machine Learning & AI - May 20, 2016… by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
19 min listen
Episode 39: Reshaping Energy Storage by Materialism: A Materials Science Podcast
41 min listen
DR. JEFF BECK - THE BAYESIAN BRAIN by Machine Learning Street Talk (MLST)
70 min listen
Unlocking the Brain's Mysteries: Chris Eliasmith on Spiking Neural Networks and the Future of Human-Machine Interaction by Machine Learning Street Talk (MLST)
110 min listen
41. Bob Nystrom by It's All Widgets! Flutter Podcast
45 min listen
Hyperparameter Optimization through Neural Network Partitioning with Christos Louizos - #627 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
33 min listen
Declarative Machine Learning For High Performance Deep Learning Models With Predibase by The Python Podcast.__init__
59 min listen
018 Natural Language Processing 1: Introduction to Natural Language Processing (NLP) topics. ocdevel.com/mlg/18 for notes and resources by Machine Learning Guide
58 min listen
006 Certificates & Degrees: Discussion on certificates and degrees from Udacity to a Masters degree. ocdevel.com/mlg/6 for notes and resources by Machine Learning Guide
16 min listen
MLA 018 Descript: (Optional episode) just showcasing a cool application using machine learning Dept uses Descript for some of their podcasting. I'm using it like a maniac, I think they're surprised at how into it I am. Check out the transcript & see how it... by Machine Learning Guide
6 min listen
Build Better Machine Learning Models With Confidence By Adding Validation With Deepchecks: A cross-over episode from The Machine Learning Podcast with the team from Deepchecks, exploring the challenges of testing and validating machine learning applications and their work to make it easier. by The Python Podcast.__init__
48 min listen
#10 Data Science, the Environment and MOOCs: Air pollution, the environment and data science: where do these intersect? Find out in this episode of DataFramed, in which Hugo speaks with Roger Peng, Professor in the Department of Biostatistics at the Johns Hopkins Bloomberg School of Public Health... by DataFramed
55 min listen
Are LLMs Overhyped or Underappreciated? with Marti Hearst - #626 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
38 min listen
Deploying Edge and Embedded AI Systems with Heather Gorr - #655 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
39 min listen
Graph Analytic Systems with Zachary Hanif - TWiML Talk #188: In this, the final episode of our Strata Data Conference series, we’re joined by Zachary Hanif, Director of Machine Learning at Capital One’s Center for Machine Learning. Zach led a session at Strata called “Network effects: Working with modern... by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
54 min listen
Forecasting Principles and Practice: Welcome to Timeseries! Today’s episode is an interview with Rob Hyndman, Professor of Statistics at Monash University in Australia, and author of Forecasting: Principles and Practices. by Data Skeptic
32 min listen
S3E03: Principal Components Analysis is your PAL by Quantitude
58 min listen
047 Interpretable Machine Learning - Christoph Molnar by Machine Learning Street Talk (MLST)
100 min listen
How LLMs and Generative AI are Revolutionizing AI for Science with Anima Anandkumar - #614 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
62 min listen
One Shot and Metric Learning - Quadruplet Loss (Machine Learning Dojo) by Machine Learning Street Talk (MLST)
149 min listen
Programming Languages, Software Engineering and Machine Learning by Machine Learning Street Talk (MLST)
84 min listen
004 Algorithms - Intuition: Overview of machine learning algorithms. Infer/predict, error/loss, train/learn. Supervised, unsupervised, reinforcement learning. ocdevel.com/mlg/4 for notes and resources by Machine Learning Guide
23 min listen
Machines Learn Better if We Teach Them the Basics: To improve reinforcement learning algorithms, computer scientists are training them as if they were human. by Quanta Science Podcast
21 min listen
The Past, Present, and Future of Deep Learning In PyTorch: An interview with the creator of the popular PyTorch deep learning framework by The Python Podcast.__init__
42 min listen

Discover this podcast and so much more

Recurrent Neural Nets

Recurrent Neural Nets

Description

Titles in the series (100)

More Episodes from Linear Digressions

Related podcast episodes