Which scenario indicates high interrater reliability?

• A. Different assessors produce similar scores.
• B. Scores vary widely across raters.
• C. Raters disagree about every item.
• D. Only one rater is used for all assessments.

Answer: (A)

Interrater reliability is about how consistently different evaluators rate the same performance. When independent assessors produce similar scores for the same sample, it shows that the scoring is applied in a stable, replicable way and that the ratings reflect the performance rather than individual bias or interpretation.

If scores vary widely across raters, it suggests the criteria aren’t being applied consistently, which undermines reliability. If raters disagree about every item, that indicates a lack of agreement and poor reliability as well. If only one rater is used for all assessments, you can’t assess agreement between raters at all, so you don’t demonstrate high interrater reliability.

So, the scenario where different assessors produce similar scores best demonstrates high interrater reliability.