Are you one who believes the reliability of research is assured when the sample size is adequate and the respondents are properly qualified? If so, “research” will likely lead you to some tragic conclusions if it hasn't done so already.The problem with most research is that it's done by mathematical types who have little appreciation of the nuances of language. Ask a witness, “How fast were the cars going when they smashed into each other?” and they will name a much higher speed than if they are asked, “How fast were the cars going when they made contact?” (This is not a speculative assertion. The full report can be found in Essentials of Human Memory by Dr. Alan Baddeley.)What's missing in most survey writers is an understanding of the illogic that we humans call logic.Neurologist Richard Cytowic was nominated for a Pulitzer in 1982. This is what he had to say in The Man Who Tasted Shapes: “My innate analytic personality had been reinforced by twenty years of training in science and medicine. I reflexively analyzed whatever passed my way and firmly believed that the intellect could conquer everything through reason. 'You need an antidote to your incessant intellectualizing,' Clark had once suggested, 'something to put you in touch with the irrational side of your mind.'… I had never considered that there might be more to the human mind than the rational part that I was familiar with. It had never once occurred to me that a force to balance rationality existed, let alone that it might be a normal part of the human psyche.”When Cytowic began to study this “force to balance rationality” he learned: “…some of our personal knowledge is off limits even to our own inner thoughts! Perhaps this is why humans are so often at odds with themselves, because there is more going on in our minds than we can ever consciously know.”“If a new soft drink came along that you thought tasted better than your current favorite, would you switch to it?”“Which of these two colas tastes better to you?”“Thank you for your opinion. You have been very helpful.”But when New Coke was introduced, America hated it. We were outraged, You're messing with our heritage! New Coke wasn't a genius marketing ploy to remind us of how much we loved old Coke. It was a genuine screw-up, fueled by millions in research.Joey Reiman, a founding partner of the BrightHouse Institute, (one of Coca-Cola's research partners) gave an interview to the New York Times on Oct 26, 2003. “Focus groups are ultimately less about gathering hard data and more about pretending to have concrete justifications for a hugely expensive ad campaign. 'The sad fact is, people tell you what you want to hear, not what they really think,' Reiman said. 'Sometimes there's a focus-group bully, a loudmouth who's so insistent about his opinion that it influences everyone else. This is not a science; it's a circus.'” The article went on to say: “Advertising's main tool, of course, has been the focus group, a classic technique of social science. Marketers in the United States spent more than $1 billion last year on focus groups, the results of which guided about $120 billion in advertising. But focus groups are plagued by a basic flaw of human psychology: people often do not know their own minds.”Ask a person to speculate about what they would do in a particular circumstance and they'll tell you what they truly believe they would do. But when the actual circumstance comes upon them, they do something else entirely. My advice: Quit asking people what they think. Begin watching what they do. Ignore their words; study their actions.Still not convinced that numbers are easily misinterpreted and misunderstood?