Skip to main content

Table 5 Variance components of model 2 (reliability model with adjustment for rater stringency)

From: Cutting costs of multiple mini-interviews – changes in reliability and efficiency of the Hamburg medical school admission test between two applications

 

2009

2010

Effect

Variance components (95% CI)

%

Variance components (95% CI)

%

Cand

Systematic differences in candidate performance

0.13 (0.08-0.20)

13.9

0.21 (0.16-0.28)

19.6

Cand*stat

Differences in candidate performance between stations

0.30 (0.02-0.19)

31.6

0.38 (0.34-0.43)

35.6

Rater*cand (+ error)

Adjusted differences in rater candidate taste, and residual variance

0.52 (0.55-0.64)

54.5

0.48 (0.45-0.51)

44.8

Total

0.95

100

1.07

100

  1. 2009: Rel = Vcand/(Vcand + Vcand*stat/12 + Vrater*cand/28) = 0.75.
  2. 2010: Rel = Vcand/(Vcand + Vcand*station/9 + Vrater*cand/19.5) = 0.76.