Skip to main content

Table 1 Overall Scores for Good, Average and Weak Candidate comparing scores given by Single Examiners when examining alone and the agreed consensus score when in pairs. The middle column illustrates what the average score would have been for each examiner pair

From: Inter-rater reliability in clinical assessments: do examiner pairings influence candidate ratings?

Examiner
Number
Good Candidate Overall ScoreAverage Candidate Overall ScoreWeak Candidate Overall Score
 AlonePaired
(avg)
Paired
(agreed)
AlonePaired
(avg)
Paired
(agreed)
AlonePaired
(avg)
Paired
(agreed)
1646464444148342726
3747878504946363124
5646464384148202726
6647982445156241818
7686964424952343734
9808588444648282928
10808380343444283130
11827878484946263124
12706964564952403734
14947982585156121818
16908588484648302928
17868380504244343130
Candidate
Mean
76.33 (10.54)76.33 (8.19)76
(9.87)
46.33 (6.86)45
(6.41)
49
(4.33)
28.83 (7.69)28.83
(6.27)
34
(5.46)
Range302124241712281916
  1. Avg Average