Ponder this list for a moment…
- Social desirability: Some people tend to answer questions in a way that makes them look good to other people. “I truly believe that men and women are equal even though I’ve never given a raise to nor promoted any women who’ve worked for me.”
- Order effects: Items that are earlier in a list get chosen and remembered more often than those later in list. Because this item is second in a list of ten, chances are you will be more likely to remember this bias.
- Interviewer effect: The demographic and psychographic characteristics of an interviewer affect the responses given by an interviewee. “It doesn’t matter that we’re both women, I would have still would have told a man that women are smarter.”
- Acquiescence bias: Someone who tends to answer a question with agreement regardless of what the question is. “Of course I agree with you that I shouldn’t be paid for working overtime.”
- Recall bias: The way we answer a question is affected by our memory of an event. “I don’t remember hearing anything about a product recall so it couldn’t have been a big deal.
- Optimism bias: People believe they are less likely to experience a negative event than other people are. “I won’t get sick from smoking even though most people who smoke end up with some smoking related illness.”
- Cognitive dissonance: In order to feel better about themselves, people find a logical reason for their negative actions. “I had to cut that guy off in traffic or the receipts on my dashboard would have flown all over the place.”
- Anchoring: People often rely heavily on a single trait when making decisions. “That guy is just a stupid idiot. His forget to set his alarm so obviously he can’t do anything right.”
- Self-serving bias: People claim more responsibility for the good that happen to themselves than the bad things. “I worked really hard for my raise but all those problems with my work are because my colleague screwed up my filing system.”
- Dunning Kruger effect: People who are lacking in a skill overestimate their own skill in that area. “I took an introductory statistics course in my undergrad so I could easily do that factor analysis.”
Clearly, people’s opinions are affected by myriad unconscious effects that prevent them from accessing true answers. Now tell me, if we’ve been teaching and learning about response biases in school and we learn oh so many more on the job as market researchers, why do we ask research participants to verbalize responses to the following questions:
- Why did you buy Brand A?
- Why did you choose red over blue?
- Why did you use the $1 coupon for the $3 item but not the $2 coupon for the $4 dollar item?
Why? Why oh why?
- Correlation vs Causation: Give me popcorn and a movie will be shown
- Really Simple Statistics: Sample Sizes
- Radical Market Research Idea #1: Banish probability sampling
- Radical Market Research Idea #6: Don’t calculate p-values