Classical Test Theory & Item Response Theory

Lesson Transcript
Instructor: Emily Cummins

Emily Cummins received a Bachelor of Arts in Psychology and French Literature and an M.A. and Ph.D. in Sociology. She has instructor experience at Northeastern University and New Mexico State University, teaching courses on Sociology, Anthropology, Social Research Methods, Social Inequality, and Statistics for Social Research.

Psychometrics is the study of developing tests and measurements. In this lesson, we'll talk about two different theories of how psychologists can create good tests and measurement: classical test theory and item response theory. Updated: 03/24/2021

Psychometric Tests

When you think of the word ''test,'' you probably imagine yourself sitting in a classroom about to answer an exam. This might bring back stressful memories of school! But in psychology, the word ''test'' has a particular meaning, and it's a little more in-depth than simply some questions you need to answer. In particular, in this lesson we're talking about psychometric tests, which are scientific and systematic ways to test someone's ability to do a job or measure their personality or some mental ability (abilities which can be things like math or even critical thinking).

Psychometrics means the study of developing measurements. So there's an entire field of study dedicated to just how we write things, like exams. Psychometric tests are standardized, and they are designed to assess a particular variable. The people who write them try to make them objective and unbiased. In this lesson, we'll talk about two of these kinds of test theories: classical test theory and item response theory. Think of these as theories about how psychologists create tests and measures.

An error occurred trying to load this video.

Try refreshing the page, or contact customer support.

Coming up next: The Standards for Education & Psychological Testing

You're on a roll. Keep up the good work!

Take Quiz Watch Next Lesson
Your next lesson will play in 10 seconds
  • 0:04 Psychometric Tests
  • 1:08 Classical Test Theory
  • 3:06 Item Response Theory
  • 4:54 Lesson Summary
Save Save Save

Want to watch this again later?

Log in or sign up to add this lesson to a Custom Course.

Log in or Sign up

Speed Speed

Classical Test Theory

Classical test theory (CTT) in psychometrics is all about reliability. We use the word ''reliable'' or ''reliability'' often in our colloquial language. Your friend who is always on time is reliable, for instance. But in psychology, reliability refers to how consistent a test or measure is. In other words, if you took the same test several times, you should get about the same score each time. So, assuming the conditions are the same, you'd get the same score on a test because the test itself is well designed.

There are three ideas we need to keep in mind when we're talking about CTT: test score, error, and true score. The test score is what we call the observed score. So, if you take a math exam and get an 85, that's your test score.

Error refers to, well, exactly what it sounds like! It's the amount of error that is found in a test or measure. This might be a mistake in the test, or it might also refer to things in the external environment that we can't totally control but that impact testing. Let's say you're taking your history exam, and there's construction going on in the building next door. Hammering isn't great for concentration, is it? This is a form of error because the terrible noise might impact your score.

Then, we have the true score. This is the score you would have achieved if there were absolutely no errors in the measurement. Alas, this isn't really possible. But psychometrics assumes everyone has, in theory, a true score. We can calculate this true score with an equation.

Charles Spearman, a psychologist and statistician, thought that we could reduce random error as much as possible, thereby making tests better. Spearman is widely considered one of the founders of CTT. So the important take away of CTT is that it's a theory that tries to explain and deal with error so our tests are more reliable.

Item Response Theory

Item response theory (IRT) is all about your performance on an exam and how it relates to individual items or questions on a test. IRT is an example of what psychologists call a latent trait model. These models try to figure if there's an underlying trait that that accounts for your performance on a test. The mathematical models we use to calculate IRT measurements are much more sophisticated than CTT, and with IRT we don't even need a sample of test takers.

To unlock this lesson you must be a Member.
Create your account

Register to view this lesson

Are you a student or a teacher?

Unlock Your Education

See for yourself why 30 million people use

Become a member and start learning now.
Become a Member  Back
What teachers are saying about
Try it now
Create an account to start this course today
Used by over 30 million students worldwide
Create an account