Inter-Rater Reliability in Psychology: Definition & Formula


Choose an answer and hit 'next'. You will receive your score and answers at the end.

question 1 of 3

Which measure of IRR would be used when art pieces are ranked for beauty on a scale of 1-10?

Create Your Account To Take This Quiz

As a member, you'll also get unlimited access to over 79,000 lessons in math, English, science, history, and more. Plus, get practice tests, quizzes, and personalized coaching to help you succeed.

Try it risk-free
Try it risk-free for 30 days. Cancel anytime
Already registered? Log in here for access

1. Which measure of IRR would be used when art pieces are scored for beauty on a yes/no basis?

2. If two judges are assessing a beauty pageant, which element would NOT benefit from checking inter-rater reliability?

Create your account to access this entire worksheet
A Premium account gives you access to all lesson, practice exams, quizzes & worksheets
Access to all video lessons
Quizzes, practice exams & worksheets
Certificate of Completion
Access to instructors
Create an account to get started Create Account

About This Quiz & Worksheet

To pass this quiz on inter-rater reliability (IRR), you'll need to understand particular measures of IRR and how inter-rater reliability is used in assessment. As soon as you finish answering the questions, your quiz will be automatically scored.

Quiz & Worksheet Goals

Be sure you understand the following if you hope to pass this quiz:

  • The measure of IRR used for numeric scales
  • The measure of IRR used for yes/no scoring
  • Applying IRR to judging a beauty pageant
  • The measure of IRR that accounts for chance agreement
  • Whether 0.2 is a high rating for Cohen's Kappa

Skills Practiced

  • Reading comprehension - ensure that you draw the most important information from the related lesson on inter-rater reliability in psychology
  • Interpreting information - verify that you can read information regarding the measures of IRR and interpret it correctly
  • Knowledge application - use your knowledge to answer questions about when to use each measure of IRR

Additional Learning

Learn more by continuing to review the accompanying lesson, Inter-Rater Reliability in Psychology: Definition & Formula. This lesson covers the following topics:

  • Definition of IRR
  • Comparing and contrasting the methods of computing IRR
  • Examples of applying these methods