Skeptical Survey Interpretation

FromData Skeptic

Start listening View podcast show

Skeptical Survey Interpretation

FromData Skeptic

ratings:

Length:

22 minutes

Released:

May 10, 2023

Format:

Podcast episode

Description

Kyle shares his own perspectives on challenges getting insight from surveys. The discussion ranges from commentary on the market research industry to specific advice for detecting disingenuous or fraudulent responses and filtering them from your analysis. Finally, he shares some quick thoughts on the usage of the Chi-Square test for interpreting cross tab results in survey analysis.

Released:

May 10, 2023

Format:

Podcast episode

Titles in the series (100)

Data Skeptic is a data science podcast exploring machine learning, statistics, artificial intelligence, and other data topics through short tutorials and interviews with domain experts.

Skip carousel

Introduction: The Data Skeptic Podcast features conversations with topics related to data science, statistics, machine learning, artificial intelligence and the like, all from the perspective of applying critical thinking and the scientific method to evaluate the... by Data Skeptic
4 min listen
Contest Announcement: The Data Skeptic Podcast is launching a contest- not one of chance, but one of skill. Listeners are encouraged to put their data science skills to good use, or if all else fails, guess! The contest works as follows. Below is some data about the... by Data Skeptic
12 min listen
[MINI] p-values: In this mini, we discuss p-values and their use in hypothesis testing, in the context of an hypothetical experiment on plant flowering, and end with a reference to the Particle Fever documentary and how statistical significance played a role. by Data Skeptic
17 min listen
[MINI] type i / type ii errors: In this first mini-episode of the Data Skeptic Podcast, we define and discuss type i and type ii errors (a.k.a. false positives and false negatives). by Data Skeptic
11 min listen
Jackson Pollock Authentication Analysis with Kate Jones-Smith: Our guest this week is Hamilton physics professor Kate Jones-Smith who joins us to discuss the evidence for the claim that drip paintings of Jackson Pollock contain fractal patterns. This hypothesis originates in a paper by Taylor, Micolich,... by Data Skeptic
50 min listen
$Jackson Pollock Authentication Analysis with Kate Jones-Smith: Our guest this week is Hamilton physics professor Kate Jones-Smith who joins us to discuss the evidence for the claim that drip paintings of Jackson Pollock contain fractal patterns. This hypothesis originates in a paper by Taylor, Micolich,...$
[MINI] Noise!!: Our topic for this week is "noise" as in signal vs. noise. This is not a signal processing discussions, but rather a brief introduction to how the work noise is used to describe how much information in a dataset is useless (as opposed to... by Data Skeptic
16 min listen
[MINI] Experimental Design: This episode loosely explores the topic of Experimental Design including hypothesis testing, the importance of statistical tests, and an everyday and business example. by Data Skeptic
16 min listen
Personalized Medicine with Niki Athanasiadou: In the second full length episode of the podcast, we discuss the current state of personalized medicine and the advancements in genetics that have made it possible. by Data Skeptic
57 min listen
[MINI] Decision Tree Learning: Linhda and Kyle talk about Decision Tree Learning in this miniepisode. Decision Tree Learning is the algorithmic process of trying to generate an optimal decision tree to properly classify or forecast some future unlabeled element based by... by Data Skeptic
13 min listen
[MINI] Ant Colony Optimization: In this week's mini episode, Linhda and Kyle discuss Ant Colony Optimization - a numerical / stochastic optimization technique which models its search after the process ants employ in using random walks to find a goal (food) and then leaving a... by Data Skeptic
15 min listen
Data in Healthcare IT with Shahid Shah: Our guest this week is Shahid Shah. Shahid is CEO at Netspective, and writes three blogs: Health Care Guy, Shahid Shah, and HitSphere - the Healthcare IT Supersite. During the program, Kyle recommended a talk from the 2014 MIT Sloan CIO Symposium... by Data Skeptic
57 min listen
[MINI] Bayesian Updating: In this minisode, we discuss Bayesian Updating - the process by which one can calculate the most likely hypothesis might be true given one's older / prior belief and all new evidence. by Data Skeptic
11 min listen
Streetlight Outage and Crime Rate Analysis with Zach Seeskin: This episode features a discussion with statistics PhD student Zach Seeskin about a project he was involved in as part of the Eric and Wendy Schmidt Data Science for Social Good Summer Fellowship. The project involved exploring the... by Data Skeptic
33 min listen
Advertising Attribution with Nathan Janos: A conversation with Convertro's Nathan Janos about methodologies used to help advertisers understand the affect each of their marketing efforts (print, SEM, display, skywriting, etc.) contributes to their overall return. by Data Skeptic
76 min listen
[MINI] Is the Internet Secure?: This episode explores the basis of why we can trust encryption. Suprisingly, a discussion of looking up a word in the dictionary (binary search) and efficiently going wine tasting (the travelling salesman problem) help introduce computational... by Data Skeptic
26 min listen
The Science of Online Data at Plenty of Fish with Thomas Levi: Can algorithms help you find love? Many happy couples successfully brought together via online dating websites show us that data science can help you find love. I'm joined this week by Thomas Levi, Senior Data Scientist at Plenty of Fish, to... by Data Skeptic
59 min listen
[MINI] The T-Test: The t-test is this week's mini-episode topic. The t-test is a statistical testing procedure used to determine if the mean of two datasets differs by a statistically significant amount. We discuss how a wine manufacturer might apply a t-test to... by Data Skeptic
17 min listen
The Right (big data) Tool for the Job with Jay Shankar: In this week's episode, we discuss applied solutions to big data problem with big data engineer Jay Shankar. The episode explores approaches and design philosophy to solving real world big data business problems, and the exploration of the wide... by Data Skeptic
50 min listen
[MINI] Cross Validation: This miniepisode discusses the technique called Cross Validation - a process by which one randomly divides up a dataset into numerous small partitions. Next, (typically) one is held out, and the rest are used to train some model. The hold out set can... by Data Skeptic
1 min listen
Data Science at ZestFinance with Marick Sinay: Marick Sinay from ZestFianance is our guest this weel. This episode explores how data science techniques are applied in the financial world, specifically in assessing credit worthiness. by Data Skeptic
31 min listen
[MINI] Monkeys on Typewriters: What is randomness? How can we determine if some results are randomly generated or not? Why are random numbers important to us in our everyday life? These topics and more are discussed in this mini-episode on random numbers. Many readers will be... by Data Skeptic
3 min listen
[MINI] Value of Information: A discussion about getting ready in the morning, negotiating a used car purchase, and selecting the best AirBnB place to stay at help frame a conversation about the decision theoretic principal known as the Value of Information equation. by Data Skeptic
14 min listen
Guerilla Skepticism on Wikipedia with Susan Gerbic: Our guest this week is Susan Gerbic. Susan is a skeptical activist involved in many activities, the one we focus on most in this episode is Guerrilla Skepticism on Wikipedia, an organization working to improve the content and citations of... by Data Skeptic
70 min listen
Practicing and Communicating Data Science with Jeff Stanton: Jeff Stanton joins me in this episode to discuss his book An Introduction to Data Science, and some of the unique challenges and issues faced by someone doing applied data science. A challenge to any data scientist is making sure they have a... by Data Skeptic
37 min listen
[MINI] Partially Observable State Spaces: When dealing with dynamic systems that are potentially undergoing constant change, its helpful to describe what "state" they are in. In many applications the manner in which the state changes from one to another is not completely predictable,... by Data Skeptic
13 min listen
[MINI] Selection Bias: A discussion about conducting US presidential election polls helps frame a converation about selection bias. by Data Skeptic
15 min listen
Mining the Social Web with Matthew Russell: This week's episode explores the possibilities of extracting novel insights from the many great social web APIs available. Matthew Russell's Mining the Social Web is a fantastic exploration of the tools and methods, and we explore a few... by Data Skeptic
50 min listen
Game Science Dice with Louis Zocchi: In this bonus episode, guest Louis Zocchi discusses his background in the gaming industry, specifically, how he became a manufacturer of dice designed to produce statistically uniform outcomes. During the show Louis mentioned a two part video... by Data Skeptic
47 min listen
[MINI] Confidence Intervals: Commute times and BBQ invites help frame a discussion about the statistical concept of confidence intervals. by Data Skeptic
12 min listen
[MINI] Cornbread and Overdispersion: For our 50th episode we enduldge a bit by cooking Linhda's previously mentioned "healthy" cornbread. This leads to a discussion of the statistical topic of overdispersion in which the variance of some distribution is larger than what... by Data Skeptic
16 min listen

More Episodes from Data Skeptic

Skip carousel

Behavioral Genetics: It’s almost impossible to think about animal behavior without thinking of dogs! Our canine friends are a subspecies of wolf that has been co-evolving with us for tens of thousands of years. The transition from wolf to pet has required intense... by Data Skeptic
47 min listen
Signal in the Noise: In this episode, we are joined by Barbara Webb and Anna Hadjitofi. Barbara runs the Insect Robotics lab at the University of Edinburgh, and Anna is a PhD student at the School of Informatics at the university. She is interested in studying and... by Data Skeptic
42 min listen
Pose Tracking: Many researchers and students have painstakingly labeled precise details about the body positions of the creatures they study. Can AI be used for this labeling? Of course it can! Today's episode discusses Social LEAP Estimates Animal Poses (SLEAP), a... by Data Skeptic
51 min listen
Modeling Group Behavior: Our guest in this episode is Sebastien Motsch, an assistant professor at Arizona State University, working in the School of Mathematical and Statistical Science. He works on modeling self-organized biological systems to understand how complex patterns... by Data Skeptic
41 min listen
Advances in Data Loggers: Our guest in this episode is Ryan Hanscom. Ryan is a Ph.D. candidate in a joint doctoral evolution program at San Diego State University and the University of California, Riverside. He is a terrestrial ecologist with a focus on herpetology and... by Data Skeptic
36 min listen
What You Know About Intelligence is Wrong (fixed): We are joined by Hank Schlinger, a professor of psychology at California State University, Los Angeles. His research revolves around theoretical issues in psychology and behavioral analysis. Hank establishes that words have references and... by Data Skeptic
42 min listen
Animal Decision Making: On today’s episode, we are joined by Aimee Dunlap. Aimee is an assistant professor at the University of Missouri–St. Louis and the interim director at the Whitney R. Harris World Ecology Center. Aimee discussed how animals perceive information and... by Data Skeptic
37 min listen
Octopus Cognition: We are joined by Tamar Gutnick, a visiting professor at the University of Naples Federico II, Napoli, Italy. She studies the octopus nervous system and their behavior, focusing on cognition and learning behaviors. Tamar gave a background to the kind... by Data Skeptic
38 min listen
Optimal Foraging: Claire Hemmingway, an assistant professor in the Department of Psychology and Ecology and Evolutionary Biology at the University of Tennessee in Knoxville, is our guest today. Her research is on decision-making in animal cognition, focusing on... by Data Skeptic
38 min listen
Memory in Chess: On today’s show, we are joined by our co-host, Becky Hansis-O’Neil. Becky is a Ph.D. student at the University of Missouri, St Louis, where she studies bumblebees and tarantulas to understand their learning and cognitive work. She joins us... by Data Skeptic
49 min listen
OpenWorm: On this episode, we are joined by Stephen Larson, the CEO of MetaCell and an affiliate of the OpenWorm foundation. Stephen discussed what the Openworm project is about. They hope to use a digital C. elegans nematode (C. elegans for... by Data Skeptic
34 min listen
What the Antlion Knows: Our guest is Becky Hansis-O’Neil, a Ph.D. student at the University of Missouri, St Louis, and our co-host for the new "Animal Intelligence" season. Becky shares her background on how she got into the field of behavioral intelligence and biology. by Data Skeptic
42 min listen
AI Roundtable: Kyle is joined by friends and former guests Pramit Choudhary and Frank Bell to have an open discussion of the impacts LLMs and machine learning have had in the past year on industry, and where things may go in the current year. by Data Skeptic
51 min listen
Uncontrollable AI Risks: We are joined by Darren McKee, a Policy Advisor and the host of Reality Check — a critical thinking podcast. Darren gave a background about himself and how he got into the AI space. Darren shared his thoughts on AGI's achievements in the coming... by Data Skeptic
39 min listen
I LLM and You Can Too: It took a massive financial investment for the first large language models (LLMs) to be created. Did their corporate backers lock these tools away for all but the richest? No. They provided comodity priced API options for using... by Data Skeptic
24 min listen
Q&A with Kyle: We celebrate episode 1000000000 with some Q&A from host Kyle Polich. We boil this episode down to four key questions: 1) How do you find guests 2) What is Data Skeptic all about? 3) What is Kyle all about? 4) What are Kyle's thoughts on AGI?... by Data Skeptic
40 min listen
LLMs for Data Analysis: In this episode, we are joined by Amir Netz, a Technical Fellow at Microsoft and the CTO of Microsoft Fabric. He discusses how companies can use Microsoft's latest tools for business intelligence. Amir started by discussing how business intelligence... by Data Skeptic
29 min listen
AI Platforms: Our guest today is Eric Boyd, the Corporate Vice President of AI at Microsoft. Eric joins us to share how organizations can leverage AI for faster development. Eric shared the benefits of using natural language to build products. He discussed the... by Data Skeptic
34 min listen
Deploying LLMs: We are excited to be joined by Aaron Reich and Priyanka Shah. Aaron is the CTO at Avanade, while Priyanka leads their AI/IoT offering for the SEA Region. Priyanka is also the MVP for Microsoft AI. They join us to discuss how LLMs are deployed in... by Data Skeptic
35 min listen
A Survey Assessing Github Copilot: In this episode, we are joined by Jenny Liang, a PhD student at Carnegie Mellon University, where she studies the usability of code generation tools. She discusses her recent survey on the usability of AI programming assistants. Jenny discussed the... by Data Skeptic
26 min listen
Program Aided Language Models: We are joined by Aman Madaan and Shuyan Zhou. They are both PhD students at the Language Technology Institute at Carnegie Mellon University. They join us to discuss their latest published paper, PAL: Program-aided Language Models. Aman and Shuyan... by Data Skeptic
32 min listen
Which Programming Language is ChatGPT Best At: In this episode, we have Alessio Buscemi, a software engineer at Lifeware SA. Alessio was a post-doctoral researcher at the University of Luxembourg. He joins us to discuss his paper, A Comparative Study of Code Generation using ChatGPT 3.5 across 10... by Data Skeptic
40 min listen
GraphText: On the show today, we are joined by Jianan Zhao, a Computer Science student at Mila and the University of Montreal. His research focus is on graph databases and natural language processing. He joins us to discuss how to use graphs with LLMs... by Data Skeptic
31 min listen
arXiv Publication Patterns: Today, we are joined by Rajiv Movva, a PhD student in Computer Science at Cornell Tech University. His research interest lies in the intersection of responsible AI and computational social science. He joins to discuss the findings of this work that... by Data Skeptic
28 min listen
Do LLMs Make Ethical Choices: We are excited to be joined by Josh Albrecht, the CTO of Imbue. Imbue is a research company whose mission is to create AI agents that are more robust, safer, and easier to use. He joins us to share findings of his work; Despite "super-human"... by Data Skeptic
29 min listen
Emergent Deception in LLMs: On today’s show, we are joined by Thilo Hagendorff, a Research Group Leader of Ethics of Generative AI at the University of Stuttgart. He joins us to discuss his research, . Thilo discussed how machine psychology is useful in machine learning... by Data Skeptic
27 min listen
Agents with Theory of Mind Play Hanabi: Nieves Montes, a Ph.D. student at the Artificial Intelligence Research Institute in Barcelona, Spain, joins us. Her PhD research revolves around value-based reasoning in relation to norms. She shares her latest study, Combining theory of mind and... by Data Skeptic
38 min listen
LLMs for Evil: We are joined by Maximilian Mozes, a PhD student at the University College, London. His PhD research focuses on Natural Language Processing (NLP), particularly the intersection of adversarial machine learning and NLP. He joins us to discuss his latest... by Data Skeptic
26 min listen
The Defeat of the Winograd Schema Challenge: Our guest today is Vid Kocijan, a Machine Learning Engineer at Kumo AI. Vid has a Ph.D. in Computer Science at the University of Oxford. His research focused on common sense reasoning, pre-training in LLMs, pretraining in knowledge-based completion,... by Data Skeptic
31 min listen

Related podcast episodes

Skip carousel

The Future of Customer Research Teams: Innovating for Success in 2024 and Beyond: The Future of Customer Research Teams: Innovating for Success in 2024 and Beyond AI's enthralling me these days, and it seems the world's caught in the same spell. One realm set for a profound AI makeover is customer market research—a topic... by The Intuitive Customer - Helping You Improve Your Customer Experience To Gain Growth
26 min listen
Are Display Ads Cheaper Than Search Ads?: In this episode, Kyle answers the questions: What’s the psychology behind Display Ads? What are the advantages of Display Ads? What types of businesses can benefit from Display Ads? What are the advantages and disadvantages of Search Ads? What... by Google Ads Strategy with Kyle Sulerud
10 min listen
Top 6 A/B Test Experiments of All-Time + Brand CRO Operating System + Leveraging Exit Intent Survey Data: Brad Redding and Elevar's Lead CRO Strategist, Kirby Crook share their top 6 a/b test experiments of all time. Plus you'll learn what processes separate brands with successful experimentation programs, what survey questions work today to help with CRO, an by Conversion Tracking Playbook
37 min listen
20. What Makes a "Good" UX Professional? by NN/g UX Podcast
33 min listen
Data for the Win: With Guests Michael Kist & Cade Massey: Netflix recommendations, Amazon suggestions, Google searches, airline ticket prices, your social media feed. All of these things are driven by algorithms—computer models that crunch massive amounts of data to generate useful results. These types of online algorithms are commonplace and so, generally speaking, we’re used to them. But what about the algorithms behind self-driving cars or airplane autopilots? What about algorithms used to predict crimes or to diagnose medical conditions? These are domains in which it often feels uncomfortable to let a computer model make what could be life-or-death decisions. In this episode of Choiceology with Katy Milkman, we’re exploring the places where algorithms and computer models bump up against resistance from their human users. Seeing as it’s Super Bowl season, it seemed like a good time to revisit last year’s contest as a case study in decision making. The 2018 Super Bowl champion Phi by Choiceology with Katy Milkman
31 min listen
From fraud to quality: How to use trusted market research environments to drive growth with Sharekh Shaikh by Predictable B2B Success
47 min listen
TTU92: Clear & Explainable Trend Models ft. Andreas Clenow of ACIES Asset Management – 2of2 by Top Traders Unplugged
63 min listen
Ryan Caldbeck – Quant in Private Markets - [Invest Like the Best, EP.110]: My guest this week is Ryan Caldbeck, a private equity investor who wants to bring quantitative rigor to the private markets. Ryan is the CEO of Circle Up, which uses a system it calls Helio to identify attractive investments in early stage consumer brands by Invest Like the Best with Patrick O'Shaughnessy
69 min listen
#338: Site Selection for Clinical Trials by Global Medical Device Podcast powered by Greenlight Guru
54 min listen
Ep. 76: Jack Schwager Interview #2 with Michael Covel on Trend Following Radio: Famed writer and trader Jack Schwager returns to the podcast to speak with Michael Covel about his new book, "Market Sense and Nonsense: How the Markets Really Work (and How They Don't)", which is released today. For those that have had a pulse in the... by Michael Covel's Trend Following
55 min listen
Michael Liu on why he thinks Cogstate $COGZF is a great business wrapped in a special situation play by Yet Another Value Podcast
50 min listen
How to Practice Chaos Engineering with Michael Sage: How is Chaos Engineering different and like performance testing? In Michael Sage, a solutions architect, and chaos engineer at Gremlin, shares real-world examples of applying Chaos engineering to the banking industry. Discover practices like Chaos... by TestGuild Devops Toolchain Podcast
29 min listen
195 From Category Contenders to Category Kings with Al Ramadan: On this episode of Lochhead on Marketing, we enjoy the first of many visits from Al Ramadan in 2024, as we talk about moving from being a Category Contender to a Category King. We’ll dig into what is a category contender in what it takes to win the 18... by Lochhead on Marketing
91 min listen
#333: Exploring Breakthrough Device Designation by Global Medical Device Podcast powered by Greenlight Guru
35 min listen
#251 A Brief Introduction to The Purpose of Customer Discovery Calls: In this episode of the Sales Engineering Podcast, we explore the different purposes of demos and discovery calls. We consider the different challenges inherent in them and the strategies we can employ to get around these challenges. Specifically, we... by We The Sales Engineers: A Resource for Sales Engineers, by Sales Engineers
21 min listen
#46 – Should You Choose In House or Agency For Experimentation? by CRO Live Hour
35 min listen
#57 The Credibility Crisis in Data Science by DataFramed
55 min listen
Some Assembly Preferred: With Guests Mike Norton & Michael Ojo: Hardware stores and home improvement shows often promote do-it-yourself projects. And while it’s challenging to make your own projects look as good as the ones on TV or in glossy brochures, building something yourself can be a very rewarding experience. The trouble is, the DIY approach can sometimes cloud your perceptions of the value of your project. In this episode of Choiceology with Katy Milkman, we look at how putting personal effort into something—be it a hand-knit scarf, a new deck, or even a small business—can lead people to overestimate the value of that effort. by Choiceology with Katy Milkman
36 min listen
The Structure of SaaS Pricing and Designing SaaS Pricing Models with Ulrik Lehrskov-Schmidt: Ulrik Lehrskov-Schmidt is the partner of where they help companies create pricing models that radically accelerates growth and unlocks the value of their underlying technology. He has founded and sold two different companies, and he has a master's... by Impact Pricing
32 min listen
Kurt Leedy and Kyle Coots - The Three Methods to Grow Capital - Ep.134 by Think Like an Owner
70 min listen
AI Today Podcast: AI Glossary Series- methodology, waterfall, Agile, CRISP-DM, Cognitive Project Management for AI (CPMAI): In this episode of the AI Today podcast hosts Kathleen Walch and Ron Schmelzer define the terms Methodology, Waterfall, Agile, CRISP-DM, Cognitive Project Management for AI (CPMAI). In this episde we explain how these terms relate to AI and why it's... by AI Today Podcast: Artificial Intelligence Insights, Experts, and Opinion
21 min listen
#30 – Should You Be Launching A/A Tests? by CRO Live Hour
28 min listen
The Fabulous Search for a Tech Job with Kyle Elliot: Kyle Elliott, the Founder and Career Coach behind CaffeinatedKyle.com, joins the pod on his quest to transform boring job searches into something fabulous. Kyle specializes in helping job seekers, especially those in technology and cybersecurity, fin... by Hacker Valley Studio
25 min listen
3 Examples of Market Research by ALEPH - GLOBAL SCRUM TEAM - Agile Coaching. Agile Training and Digital Marketing Certifications
3 min listen
AMA #8-Ask Me Anything! Listeners and Detailers Questions Answered About the Auto Detailing Business and Auto Detailing Processes- Episode #814 by Pints & Polishing Auto Detailing Podcast
42 min listen
Best Practices for Clinical Evidence Management: <p>How do you bring a medical device through the development process? What are issues that development engineers face during the different phases of the design controls process, especially when researching clinical evidence? </p><p>In this episode... by Global Medical Device Podcast powered by Greenlight Guru
46 min listen
QDD Redux Ep. 2: How to Handle Competing Failure Modes by Quality during Design
9 min listen
ML Observability by The Cloudcast
26 min listen
Leveraging DAP: A Guide for Solution Consultants Driving Digital Adoption: In this engaging episode of the DAP Upskill podcast, host Aryaa welcomes Nicolas, a seasoned solution consultant at Whatfix, to unravel the complexities of digital adoption platforms (DAPs) and their transformative impact on organizations. by The Digital Adoption Show | Upskilling the Future Digital Workforce
21 min listen
112. Senior Engineer Interviews: Today on the show we are looking at the contestation that senior developers are being shut out of jobs in the interviewing process. This idea opens up a few areas of discussion, namely the pros and cons of popular interview techniques and how skills... by The Rabbit Hole: The Definitive Developer's Podcast
23 min listen

Discover this podcast and so much more

Skeptical Survey Interpretation

Skeptical Survey Interpretation

Description

Titles in the series (100)

More Episodes from Data Skeptic

Related podcast episodes