Bias in Polls & Surveys: Definition, Common Sources & Examples

An error occurred trying to load this video.

Try refreshing the page, or contact customer support.

Coming up next: Misleading Uses of Statistics

You're on a roll. Keep up the good work!

Take Quiz Watch Next Lesson
Your next lesson will play in 10 seconds
  • 0:01 What Is Bias?
  • 1:13 Why Be Biased?
  • 1:56 Sources of Bias
  • 3:45 Lesson Summary
Save Save Save

Want to watch this again later?

Log in or sign up to add this lesson to a Custom Course.

Log in or Sign up

Speed Speed
Lesson Transcript
Instructor: Kevin Newton

Kevin has edited encyclopedias, taught history, and has an MA in Islamic law/finance. He has since founded his own financial advice firm, Newton Analytical.

When Mark Twain commented that there were three types of lies, he included statistics in the count. In this lesson, we look at bias, one of the ways in which statistics can mislead, and in some cases, flat out lie to us.

What Is Bias?

Let's say you were sitting at home cleaning up dinner. Your phone rings, and while the number is unknown, you are eager for an excuse to stick your little brother with the dishes. You say hello and a voice asks you if you'd be willing to answer some questions on the performance of your city mayor. Since your favorite morning routine is reading the local news, you feel pretty well-informed to give your opinions on her performance. The caller asks you which of the following words best sum up your opinion of the mayor: fair, poor, bad, or horrible?

Wait a minute, you wonder, maybe you missed a choice. You actually think that your mayor has been doing an exceptionally great job. You ask the pollster about this and are told that those four--fair, poor, bad, and horrible--are your only options. You shrug your shoulders and say fair, knowing that it's really not how you feel. As you hang up, you can't help but wonder if you're the only one.

The poll you just took part in was full of bias. Bias can come in many shapes, as we will see in this lesson, but always has the effect of creating a data set that is markedly different from what the reality actually is. While bias can be dangerous in pharmaceutical experiments, it can be used by pollsters to further their own means.

Why Be Biased?

Chances are that the call you just took was funded by someone who didn't like the mayor. We can tell this because the answers are structured in such a way that more people could say that the mayor is doing a bad job. Statistics make great news stories, so this increases the chance of enough people saying that the mayor is doing a bad job so that the newspaper would publish a story on the findings of the poll.

As such, bias can be used to make the other side look bad. It can also be used to make one's own side look great. Imagine the same question, but this time with answer choices like superior, great, good, and fair. Now someone who legitimately doesn't like the work that the mayor has been doing is forced to say fair, when that's not really how they feel.

Sources of Bias

Still, whether or not a party intends on being biased, there are plenty of sources possible. The kind of bias that you suspect from above, where someone who didn't like the mayor paid for the poll, is called funding bias. As you'd imagine, this is the kind of bias that results when the study is done by a company or individual that has an interest in the final outcome. Think about how big tobacco companies used to use statistics to lessen the connection between smoking and lung cancer, and you've got a good idea of what funding bias looks like.

The type of bias that involves the choice of answers is reporting bias, since only answers of a certain variety are likely to be reported. In the phone call you got, there was no way to record an answer of superior performance by the mayor, so those sentiments were not expressed in the final data set. For a second, let's even think about why you were called.

To unlock this lesson you must be a Member.
Create your account

Register to view this lesson

Are you a student or a teacher?

Unlock Your Education

See for yourself why 30 million people use

Become a member and start learning now.
Become a Member  Back
What teachers are saying about
Try it risk-free for 30 days

Earning College Credit

Did you know… We have over 200 college courses that prepare you to earn credit by exam that is accepted by over 1,500 colleges and universities. You can test out of the first two years of college and save thousands off your degree. Anyone can earn credit-by-exam regardless of age or education level.

To learn more, visit our Earning Credit Page

Transferring credit to the school of your choice

Not sure what college you want to attend yet? has thousands of articles about every imaginable degree, area of study and career path that can help you find the school that's right for you.

Create an account to start this course today
Try it risk-free for 30 days!
Create an account