Education Portal is now! Same great content, just under a new name. Learn more

Issues in Psychological Assessment: Reliability, Validity, and Bias

  • 0:05 Psychological Assessment
  • 1:28 Reliability
  • 4:31 Validity
  • 6:27 Bias
  • 7:24 Lesson Summary
Create An Account
To Start This Course Today
Used by over 10 million students worldwide
Create An Account
Try it free for 5 days
Lesson Transcript
Instructor: Natalie Boyd

Natalie is a teacher and holds an MA in English Education and is in progress on her PhD in psychology.

In order to diagnose and treat patients, psychologists use assessments. But how well do psychological tests work? In this lesson, we'll look closer at three areas that inform a good psychological assessment: reliability, validity, and bias.

Psychological Assessment

Imagine that you are a psychologist and Kevin comes to see you. He's been having trouble concentrating recently. It's gotten so bad that even in the middle of a conversation, he sometimes forgets who he's talking to and what they are talking about. He thinks something might be very wrong with him.

You think Kevin might be right that something's wrong. But what? There are many psychological disorders that could cause the symptoms that Kevin has. In order to diagnose him, you need to assess him. That is, you need to gather more information about Kevin and his symptoms.

Psychological assessments come in many different forms. Interviewing, brain imaging, genetic testing and intelligence testing are just a few types of psychological assessments. Each of these assessments has its strengths and weaknesses, and a single psychologist might use several assessments with a patient.

So, let's say that you choose which assessments to use on Kevin. How do you know if the assessments you choose will actually help you? What if they don't give you a good answer? What if they say he has a disorder, but he really doesn't? In order to make sure a test is a good assessment, it must have reliability and validity. In addition, it should be free of bias. Let's look at each of these things a little more in-depth.


Remember Kevin? He comes to you with a problem, and you choose an assessment to help you diagnose him. For example, let's say that you want to do an fMRI - a type of brain scan - to see if Kevin has a tumor. So you put Kevin in the MRI machine and the computer says that nope, Kevin doesn't have a tumor. But wait! Last week, Kevin had the same test done. That time, it showed that he does have a tumor. What's going on?

In this case, the assessment (the fMRI) lacks reliability. Reliability is when an assessment consistently delivers the same results. Of course, usually fMRI machines have high reliability, but Kevin's case is an exception.

Let's look at another example of reliability. Imagine that you have a bathroom scale. You get on it one morning and it says that you weigh 157 pounds. A minute later, you get on it and it says that you weigh 208 pounds. A third time, it tells you that you weigh 81 pounds. You're not changing your weight from minute to minute, so the scale is not reliable.

If, however, you get on the scale three times in a row and each time the scale reads 150 pounds, it is reliable. Of course, there's usually some variance, so even if the scale reads 155, 157 and 156, you could say that it still has a high reliability. There are two major types of reliability that are important in psychological assessments: inter-rater reliability and test-retest reliability.

Inter-rater reliability is when two people will come up with the same answer when using the same assessment. For example, let's say that you have a questionnaire that will help you diagnose Kevin. You ask him the questions and he answers. From his answers, you diagnose him with attention deficit disorder.

But then Kevin goes down the street to another psychologist. That psychologist has the same questionnaire. She asks the same questions and gets the same responses from Kevin. But she diagnoses him with obsessive-compulsive disorder. In this example, the questionnaire has a low inter-rater reliability. If it had a high inter-rater reliability, each time a different psychologist used the questionnaire and got the same answers from Kevin, he or she would come up with the same diagnosis.

The other type of reliability is test-retest reliability, which is when an assessment yields the same answer over and over. Remember your bathroom scale? If the readings on the scale are 157, 208 and 81 pounds, it has a low test-retest reliability because every time you get on the scale, the number is very different. On the other hand, if it reads 150 every time, it has a high test-retest reliability.


Obviously, it's important for an assessment to have high reliability. But just because an assessment has reliability doesn't mean it's a good measure of what's going on. Let's go back to the bathroom scale example. If your bathroom scale reads 150 pounds every time you step on it, it has a high reliability. But what if you actually weigh 200 pounds? In this case, your scale is reliable, but it's not valid.

Validity is when an assessment accurately measures what it's supposed to measure. Your bathroom scale has low validity because it is not accurately measuring your weight. Notice that the definition for validity has two parts: an assessment has to measure accurately and it has to measure what it is supposed to measure. Your bathroom scale may be measuring weight (what it's supposed to measure) but not measuring it accurately.

To unlock this lesson you must be a Member.
Create your account

Unlock Your Education

See for yourself why 10 million people use

Become a member and start learning now.
Become a Member

Already a member? Log In

Start Your Free Trial To Take This Quiz

As a member, you'll also get unlimited access to over 10,000 lessons in math, English, science, history, and more. Plus, get practice tests, quizzes, and personalized coaching to help you succeed.

Free 5-day trial
It only takes a few minutes to set up and you can cancel at any time.
Already registered? Login here for access

Earning College Credit

Did you know… We have over 100 college courses that prepare you to earn credit by exam that is accepted by over 2,900 colleges and universities. You can test out of the first two years of college and save thousands off your degree. Anyone can earn credit-by-exam regardless of age or education level.

To learn more, visit our Earning Credit Page

Transferring credit to the school of your choice

Not sure what college you want to attend yet? has thousands of articles about every imaginable degree, area of study and career path that can help you find the school that's right for you.