Inter-rater reliability in clinical assessments: do examiner pairings influence candidate ratings?

BMC Medical Education

Table 1 Overall Scores for Good, Average and Weak Candidate comparing scores given by Single Examiners when examining alone and the agreed consensus score when in pairs. The middle column illustrates what the average score would have been for each examiner pair

Examiner Number	Good Candidate Overall Score			Average Candidate Overall Score			Weak Candidate Overall Score
	Alone	Paired (avg)	Paired (agreed)	Alone	Paired (avg)	Paired (agreed)	Alone	Paired (avg)	Paired (agreed)
1	64	64	64	44	41	48	34	27	26
3	74	78	78	50	49	46	36	31	24
5	64	64	64	38	41	48	20	27	26
6	64	79	82	44	51	56	24	18	18
7	68	69	64	42	49	52	34	37	34
9	80	85	88	44	46	48	28	29	28
10	80	83	80	34	34	44	28	31	30
11	82	78	78	48	49	46	26	31	24
12	70	69	64	56	49	52	40	37	34
14	94	79	82	58	51	56	12	18	18
16	90	85	88	48	46	48	30	29	28
17	86	83	80	50	42	44	34	31	30
Candidate Mean	76.33 (10.54)	76.33 (8.19)	76 (9.87)	46.33 (6.86)	45 (6.41)	49 (4.33)	28.83 (7.69)	28.83 (6.27)	34 (5.46)
Range	30	21	24	24	17	12	28	19	16

ISSN: 1472-6920