Calibrated Models

FromLinear Digressions

Start listening View podcast show

Calibrated Models

FromLinear Digressions

ratings:

Length:

15 minutes

Released:

Feb 6, 2017

Format:

Podcast episode

Description

Remember last week, when we were talking about how great the ROC curve is for evaluating models? How things change... This week, we're exploring calibrated risk models, because that's a kind of model that seems like it would benefit from some nice ROC analysis, but in fact the ROC AUC can steer you wrong there.

Released:

Feb 6, 2017

Format:

Podcast episode

Titles in the series (100)

Linear Digressions is a podcast about machine learning and data science. Machine learning is being used to solve a ton of interesting problems, and to accomplish goals that were out of reach even a few short years ago.

Skip carousel

Computers Try to Tell Jokes: Computers are capable of many impressive feats, b… by Linear Digressions
9 min listen
Genetics and Um Detection (HMM Part 2): In part two of our series on Hidden Markov Models… by Linear Digressions
15 min listen
Introducing Hidden Markov Models (HMM Part 1): Wikipedia says, "A hidden Markov model (HMM) is a… by Linear Digressions
15 min listen
How Outliers Helped Defeat Cholera: In the 1850s, there were a lot of things we didn’… by Linear Digressions
11 min listen
Stats of World Series Streaks: Baseball is characterized by a high level of equa… by Linear Digressions
13 min listen
Better Facial Recognition with Fisherfaces: Now that we know about eigenfaces (if you don't, … by Linear Digressions
12 min listen
Hunting for the Higgs: Machine learning and particle physics go together… by Linear Digressions
10 min listen
Electoral Insights (Part 1): The first of our two-parter discussing the recent… by Linear Digressions
9 min listen
The Enron Dataset: In 2000, Enron was one of the largest and compani… by Linear Digressions
12 min listen
Facial Recognition with Eigenfaces: A true classic topic in ML: Facial recognition is… by Linear Digressions
10 min listen
Inferring Authorship (Part 1): This episode is inspired by one of our projects f… by Linear Digressions
9 min listen
Statistical Mistakes and the Challenger Disaster: After the Challenger exploded in 1986, killing al… by Linear Digressions
13 min listen
Um Detector 1: So, um... what about machine learning for audio a… by Linear Digressions
13 min listen
Labels and Where To Find Them: Supervised classification is built on the backs o… by Linear Digressions
13 min listen
Lie Detectors: Often machine learning discussions center around … by Linear Digressions
9 min listen
Data Science for Making the World a Better Place: There's a good chance that great data science is … by Linear Digressions
10 min listen
That's "Dr Katie" to You: Katie successfully defended her thesis! We celebr… by Linear Digressions
3 min listen
Bayesian Psychics: Come get a little "out there" with us this week, … by Linear Digressions
12 min listen
Inferring Authorship (Part 2): Now that we’re up to speed on the classic author … by Linear Digressions
14 min listen
Careers in Data Science: Let’s talk money. As a “hot” career right now, da… by Linear Digressions
17 min listen
Monte Carlo For Physicists: This is another physics-centered podcast, about a… by Linear Digressions
8 min listen
Random Kanye: Ever feel like you could randomly assemble words … by Linear Digressions
9 min listen
Neural Net Inception: When you sleep, the neural pathways in your brain… by Linear Digressions
15 min listen
Neural Nets (Part 1): There is no known learning algorithm that is more… by Linear Digressions
9 min listen
Falsifying Data: In the first of a few episodes on fraud in electi… by Linear Digressions
18 min listen
Reporter Bot: There’s a big difference between a table of numbe… by Linear Digressions
11 min listen
Thresholdout: Down with Overfitting: Overfitting to your training data can be avoided … by Linear Digressions
16 min listen
PFun with P Values: Doing some science, and want to know if you might… by Linear Digressions
17 min listen
Troll Detection: Ever found yourself wasting time reading online c… by Linear Digressions
13 min listen
Neural Nets (Part 2): In the last episode, we zipped through neural net… by Linear Digressions
11 min listen

More Episodes from Linear Digressions

Skip carousel

So long, and thanks for all the fish: All good things must come to an end, including th… by Linear Digressions
36 min listen
A Reality Check on AI-Driven Medical Assistants: The data science and artificial intelligence comm… by Linear Digressions
14 min listen
A Data Science Take on Open Policing Data: A few weeks ago, we put out a call for data scien… by Linear Digressions
24 min listen
Procella: YouTube's super-system for analytics data storage: This is a re-release of an episode that originall… by Linear Digressions
30 min listen
The Data Science Open Source Ecosystem: Open source software is ubiquitous throughout dat… by Linear Digressions
23 min listen
Rock the ROC Curve: This is a re-release of an episode that first ran… by Linear Digressions
16 min listen
Criminology and Data Science: This episode features Zach Drake, a working data … by Linear Digressions
31 min listen
Racism, the criminal justice system, and data science: As protests sweep across the United States in the… by Linear Digressions
32 min listen
An interstitial word from Ben: A message from Ben around algorithmic bias, and h… by Linear Digressions
6 min listen
Convolutional Neural Networks: This is a re-release of an episode that originall… by Linear Digressions
22 min listen
Stein's Paradox: This is a re-release of an episode that was origi… by Linear Digressions
27 min listen
Protecting Individual-Level Census Data with Differential Privacy: The power of finely-grained, individual-level dat… by Linear Digressions
21 min listen
Causal Trees: What do you get when you combine the causal infer… by Linear Digressions
15 min listen
The Grammar Of Graphics: You may not realize it consciously, but beautiful… by Linear Digressions
36 min listen
Gaussian Processes: It’s pretty common to fit a function to a dataset… by Linear Digressions
21 min listen
Keeping ourselves honest when we work with observational healthcare data: The abundance of data in healthcare, and the valu… by Linear Digressions
19 min listen
Changing our formulation of AI to avoid runaway risks: Interview with Prof. Stuart Russell: AI is evolving incredibly quickly, and thinking n… by Linear Digressions
29 min listen
Putting machine learning into a database: Most data scientists bounce back and forth regula… by Linear Digressions
24 min listen
The work-from-home episode: Many of us have the privilege of working from hom… by Linear Digressions
29 min listen
Understanding Covid-19 transmission: what the data suggests about how the disease spreads: Covid-19 is turning the world upside down right n… by Linear Digressions
25 min listen
Network effects re-release: when the power of a public health measure lies in widespread adoption: This week’s episode is a re-release of a recent e… by Linear Digressions
27 min listen
Causal inference when you can't experiment: difference-in-differences and synthetic controls: When you need to untangle cause and effect, but y… by Linear Digressions
21 min listen
Better know a distribution: the Poisson distribution: This is a re-release of an episode that originall… by Linear Digressions
32 min listen
The Lottery Ticket Hypothesis: Recent research into neural networks reveals that… by Linear Digressions
20 min listen
Interesting technical issues prompted by GDPR and data privacy concerns: Data privacy is a huge issue right now, after yea… by Linear Digressions
20 min listen
Thinking of data science initiatives as innovation initiatives: Put yourself in the shoes of an executive at a bi… by Linear Digressions
17 min listen
Building a curriculum for educating data scientists: Interview with Prof. Xiao-Li Meng: As demand for data scientists grows, and it remai… by Linear Digressions
32 min listen
Running experiments when there are network effects: Traditional A/B tests assume that whether or not … by Linear Digressions
25 min listen
Zeroing in on what makes adversarial examples possible: Adversarial examples are really, really weird: pi… by Linear Digressions
23 min listen
Unsupervised Dimensionality Reduction: UMAP vs t-SNE: Dimensionality reduction redux: this episode cove… by Linear Digressions
30 min listen

Related podcast episodes

Skip carousel

[MINI] Receiver Operating Characteristic (ROC) Curve: An ROC curve is a plot that compares the trade off of true positives and false positives of a binary classifier under different thresholds. The area under the curve (AUC) is useful in determining how discriminating a model is. Together, ROC and AUC... by Data Skeptic
11 min listen
Predictive Models on Random Data: This week is an insightful discussion with Claudia Perlich about some situations in machine learning where models can be built, perhaps by well-intentioned practitioners, to appear to be highly predictive despite being trained on random data. Our... by Data Skeptic
37 min listen
Generally AI Episode 6: You Are Here: In this season finale of the Generally AI podcast… by The InfoQ Podcast
59 min listen
Yasser Megahed, "Practiceopolis: Stories from the Architectural Profession" (Routledge, 2020): An interview with Yasser Megahed by New Books in Architecture
31 min listen
10: Isn't the last stage of grieving acceptance?: Ben Orenstein is joined by Joe Ferris and Mike Burns. They start off with some recommendations for awesome programming books and then dive right in to questions about not following "Tell don't ask" in the view, how MVC and the Single Responsibility Princi by Giant Robots Smashing Into Other Giant Robots
43 min listen
Agile Backlog Management: The Rock Crusher by Business Analysis Live!
41 min listen
Barry: Dymension – Modular Blockchains and RollApps: Sebastien was joined by Barry, Head of Product at Dymension, to discuss the advantages of developing modular blockchains, their scalability and how RollApps integrate in this environment. by Epicenter - Learn about Crypto, Blockchain, Ethereum, Bitcoin and Distributed Technologies
71 min listen
Private lending for real estate, with Alex Breshears (Lend2Live): a banking podcast by How to Lend Money to Strangers
30 min listen
Screenwriting Guru Robert McKee Demystifies Character and Structure: There are countless books, guides, and templates on writing screenplays - but how important are they? by The No Film School Podcast
58 min listen
Changing your approach to testing with Alan Richardson: In this episode of Cocktails, “The Evil Tester” A… by Coding Over Cocktails
39 min listen
AI Revolution: Economics, Scaling Laws, and Product: The AI Revolution is here. In this episode, you’ll learn what the most important themes that some of the world’s most prominent AI builders – from OpenAI, Anthropic, CharacterAI, Roblox, and more – are paying attention to. You’ll hear about the economics of AI, broad vs specialized models, the importance of UX, and whether we can expect scaling laws to continue. This footage is from an exclusive event, AI Revolution, that a16z ran in San Francisco recently. If you’d like to access all the talks in full, visit a16z.com/airevolution. by a16z Podcast
38 min listen
162. How to Work With Dormant Gates: This episode of That Projector Life dives into dormant gates and how you can work with them on your Human Design journey. We'll talk about what dormant gates are, where you can find them in your chart, and how they impact you. It's also important to... by That Projector Life
33 min listen
String Gas Cosmology: Challenging Inflation | Robert Brandenberger: String Gas Cosmology: Challenging Inflation | Robert Brandenberger by Into the Impossible With Brian Keating
116 min listen
Are Emergent Behaviors in LLMs an Illusion? with Sanmi Koyejo - #671 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
66 min listen
Giving Shelter: A conversation with Sofia Borges & R. Scott Mitchell about architecture's potential to house us all by Archinect Sessions
68 min listen
Quantile Regression: Linear regression is a great tool if you want to … by Linear Digressions
22 min listen
S1E5. How to Design Character Behaviour on Screen: This week’s discussion on Once Upon a Timeline is all about one of the most fascinating areas of our craft, human behaviour. by Once Upon a Timeline
37 min listen
Ray Iwanowski, Co-Founder and CIO, SECOR Asset Management: There’s not much natural intersection between the study of mathematics and Russian literature. But for the ever-curious mind of Ray Iwanowski, the Wharton School provided exposure to both. Ultimately, Ray’s interest in math and physics would lead him to finance where he came upon the Black-Scholes equation and option pricing theory. After a stint in fixed income research focused on modeling mortgage securities, Ray set upon the Ph.D. program at the University of Chicago in the early 1990s, a vibrant time for advancement in the empirical study of asset pricing. Utilizing the toolkit he developed, Ray landed at Goldman Sachs Asset Management where he ultimately co-ran the firm’s Global Alpha business. Today, Ray is co-founder and CIO of SECOR Asset Management, a firm that provides customized portfolio solutions to institutional clients around the world. My conversation with Ray considers the current state of factor investin by Alpha Exchange
65 min listen
MySQL Document Store: In this episode, Lois Houston and Nikita Abraham are joined by MySQL Developer Advocate Scott Stroz to talk about MySQL Document Store, a NoSQL solution built on top of MySQL. Oracle MyLearn: Oracle University Learning Community: ... by Oracle University Podcast
15 min listen
7.1 - Modeljobs | Types | Identification: You will get to know different types of model jobs in this chapter! by The Model Book by CM Models
12 min listen
Whiteboard Confessional: Everything's a Database Except SQLite: Join me as I continue a new series called Whiteboard Confessional with a look at the awesomeness that is SQLite, including how it wasn’t designed to work in a client-server fashion, when you should use it and when you absolutely shouldn’t, how deciding to by AWS Morning Brief
11 min listen
160. Going to the Talent Marketplace: Part 1 by At Work with The Ready
28 min listen
Transformers On Large-Scale Graphs with Bayan Bruss - #641 by The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
39 min listen
Statistical Review – Observational Studies with Dr. David Harrington: Although randomized controlled trials get much of the attention in journal club, observational studies allow researchers to ask questions that may ... by Curbside Consults
11 min listen
Simon Unwin, "Analysing Architecture: The Universal Language of Place-Making" (Routledge, 2020): An interview with Simon Unwin by New Books in Art
42 min listen
Simon Unwin, "Analysing Architecture: The Universal Language of Place-Making" (Routledge, 2020): An interview with Simon Unwin by New Books in Architecture
42 min listen
#4 Convenience Stores in the Movies: Michael Klein, communications professional and author by Convenience Matters
28 min listen
Ep. 349: Donald MacKenzie Interview with Michael Covel on Trend Following Radio: Michael Covel speaks with Donald MacKenzie on today’s podcast. MacKenzie is a Professor of Sociology at the University of Edinburgh, Scotland. He works on the sociology of markets, focusing on automated trading, the use of mathematical models,... by Michael Covel's Trend Following
37 min listen
Episode 48: Interview Dragos Manolescua: In this Episode we discuss software architecture evaluation with Dragos Manolescu, an architect at Microsoft's patterns & practices group. - We start off the discussion by trying to define what software architecture evaluation is and when and you wan... by Software Engineering Radio - the podcast for professional software developers
45 min listen
Varsity A/B Testing: When you want to understand if doing something ca… by Linear Digressions
36 min listen

Discover this podcast and so much more

Calibrated Models

Calibrated Models

Description

Titles in the series (100)

More Episodes from Linear Digressions

Related podcast episodes