A biased sample falsely claims to be typical of the whole group. Someone saying "Everyone liked that movie!" might not mention that the "everyone" was them and three of their friends, or a group of the star's fans.

Online and call-in polls are particularly at risk of this error, because the respondents are self-selected. At best, this means you get the people who care most about an issue; at worst, people listening to a particular radio host, or on a political mailing list, flood the poll.

Biased samples aren't always an attempt to mislead: in 1936, in the early days of opinion polling, the American Literary Digest magazine called two million random telephone numbers, questioned the people who answered, and predicted the election result. They got it wrong because, at the time, telephones were far from universal, and telephone owners weren't a good sample of the electorate as a whole. In contrast, a poll of only 50,000 citizens selected by George Gallup's organisation successfully predicted the result, leading to the popularity of the Gallup poll.

Spotlight fallacy

A variation of this is the spotlight fallacy. This is the fallacy of assuming that all of a group correspond to those members that receive most attention, from the media or otherwise.

Examples:

  1. I wouldn't like to go to America because the of all the gun crime, we see it on the news all the time.
  2. Doctor: "Why don't patients make some effort to look after themselves. My surgery is full of people who eat, drink, smoke and don't get any exercise". Of course (s)he may have many more patients who do look after themselves and don't often turn up in his surgery.
  3. Why do young people all take drugs and go around mugging old ladies? You read about it in the paper all the time!
  4. Child "When I grow up I want to be a singer. Have you seen how much money those pop-stars make!"

See also : Logical fallacy