Methods for Improving Measurement Reliability

An error occurred trying to load this video.

Try refreshing the page, or contact customer support.

You're on a roll. Keep up the good work!

Take Quiz Watch Next Lesson
 Replay
Your next lesson will play in 10 seconds
  • 0:06 Reliability
  • 2:00 Inconsistency
  • 3:27 Improving Reliability
  • 5:35 Lesson Summary
Autoplay
Autoplay
Create an account to start this course today
Try it free for 5 days!
Create An Account

Recommended Lessons and Courses for You

Lesson Transcript
Instructor: Natalie Boyd

Natalie is a teacher and holds an MA in English Education and is in progress on her PhD in psychology.

Reliability is the consistency of the results of a measurement tool. But what causes a tool to have low reliability? And what can be done to improve reliability? In this lesson, we'll answer both of those questions.

Reliability

Imagine that you wake up one morning and hop on the scale to see how much that chocolate cake you had last night is going to cost you in terms of weight. You look down at the scale, and it reads 100 lbs. 'That can't be right,' you think, 'I'm normally around 150 lbs.' Just to make sure, you step off the scale and step back on. This time, it says 184 lbs. Confused, you step off and back on, and it reads 137 lbs. What's going on?

Reliability is when a measurement tool consistently gives the same answer. If your scale tells you that you weigh 150 lbs every time you step on it, it is reliable. But if it says 100 lbs one time, 184 lbs the next time, and 137 lbs the time after that, and nothing has changed, it is not reliable.

Why is reliability important? If a measure is not reliable, we cannot trust what it tells us. It's like being a manager and having an employee who never does what he's supposed to do. He comes in late, surfs Facebook instead of working, and doesn't ever tell the truth when you ask him questions. How can you trust and depend on him?

The same thing is true for measurement tools. If we have a survey that's supposed to measure sexism, we want it to consistently measure sexism. But if it tells us that Johnny is sexist when he takes it one day and then it says he's not on the next day and Johnny hasn't had a personality change, then the survey is not reliable. As a result, we can't trust or depend on the results of the survey. Let's look closer at some things that cause measurement tools to be unreliable and some ways to improve the reliability of measures.

Inconsistency

Let's go back to our sexism survey for a moment. We give the survey to Johnny, and the level of his sexism is different every time he takes it. One day it says he's sort of sexist, the next day it says that he's not sexist at all, and the day after that it says that he's the most sexist person who ever lived.

Why is the survey inconsistent? There are three main factors that could be making the survey less reliable.

1. Traits of the subject

Johnny himself might be causing the inconsistent results. Maybe he's not feeling well one day when he takes the survey, or he just got in a fight with his girlfriend, or maybe he just doesn't understand what the survey questions mean. All of these things could cause inconsistent results.

2. Testing conditions

If Johnny is asked to take the survey in the middle of a loud strip club, his answers might be different than if he is asked to take the survey in the middle of a library. Likewise, the way the person giving him the survey gives instructions can cause the results to be less reliable.

3. Chance factors

What if, in the middle of taking the survey, a woman runs by and knocks Johnny over? Or what if Johnny just randomly chooses answers, not even bothering to read the questions? Both of these things can have an impact on Johnny's score and, therefore, lower reliability.

Improving Reliability

But if all of those things can make a survey or other measurement tool less reliable, how can we ever hope to end up with a reliable measure? What can a researcher do to improve the reliability of his or her measurement tool?

There are several specific things that can improve reliability:

1. Sample size

Remember that Johnny might have personal issues or traits that lead to a lower reliability. If Johnny is the only subject that you give the survey to, this is a big deal. But what if Johnny is just one of hundreds of people taking the survey? If that's the case, then traits of the subjects have less impact on the reliability of the measure.

2. Controlled testing conditions

To unlock this lesson you must be a Study.com Member.
Create your account

Register for a free trial

Are you a student or a teacher?
I am a teacher
What is your educational goal?
 Back

Unlock Your Education

See for yourself why 10 million people use Study.com

Become a Study.com member and start learning now.
Become a Member  Back

Earning College Credit

Did you know… We have over 49 college courses that prepare you to earn credit by exam that is accepted by over 2,000 colleges and universities. You can test out of the first two years of college and save thousands off your degree. Anyone can earn credit-by-exam regardless of age or education level.

To learn more, visit our Earning Credit Page

Transferring credit to the school of your choice

Not sure what college you want to attend yet? Study.com has thousands of articles about every imaginable degree, area of study and career path that can help you find the school that's right for you.

Click "next lesson" whenever you finish a lesson and quiz. Got It
You now have full access to our lessons and courses. Watch the lesson now or keep exploring. Got It
You're 25% of the way through this course! Keep going at this rate,and you'll be done before you know it.
1
The first step is always the hardest! Congrats on finishing your first lesson. Go to Next Lesson Take Quiz
5
Way to go! If you watch at least 30 minutes of lessons each day you'll master your goals before you know it. Go to Next Lesson Take Quiz
10
Congratulations on earning a badge for watching 10 videos but you've only scratched the surface. Keep it up! Go to Next Lesson Take Quiz
20
You've just watched 20 videos and earned a badge for your accomplishment! Go to Next Lesson Take Quiz
50
You've just earned a badge for watching 50 different lessons. Keep it up, you're making great progress! Go to Next Lesson Take Quiz
100
You just watched your 100th video lesson. You have earned a badge for this achievement! Go to Next Lesson Take Quiz
200
Congratulations! You just finished watching your 200th lesson and earned a badge! Go to Next Lesson Take Quiz
300
Congratulations! You just finished watching your 300th lesson and earned a badge! Go to Next Lesson Take Quiz
500
You are a superstar! You have earned the prestigious 500 video lessons watched badge. Go to Next Lesson Take Quiz
1K
Incredible. You have just entered the exclusive club and earned the 1000 videos watched badge. Go to Next Lesson Take Quiz
20
You have earned a badge for watching 20 minutes of lessons.
50
You have earned a badge for watching 50 minutes of lessons.
100
You have earned a badge for watching 100 minutes of lessons.
250
You have earned a badge for watching 250 minutes of lessons.
500
You have earned a badge for watching 500 minutes of lessons.
1K
You have earned a badge for watching 1000 minutes of lessons.