Table 3 Correlations between score adjustments derived from using linking scores provided by all participating (76%) of examiners and score adjustments derived from linking scores provided by different permutations of fewer participating examiners
Correlation Coefficient rho | p | |
|---|---|---|
All participating examiners (76%) | 1.000 | - |
Score adjustments derived from 70% examiner participation | ||
Combination A | 0.99 | 0.000 |
Combination B | 0.95 | 0.000 |
Combination C | 0.86 | 0.000 |
Combination D | 0.98 | 0.000 |
Combination E | 0.97 | 0.000 |
Median | 0.97 | IQR (0.91–0.99) |
Score adjustments derived from 60% examiner participation | ||
Combination A | 0.94 | 0.000 |
Combination B | 0.98 | 0.000 |
Combination C | 0.92 | 0.000 |
Combination D | 0.95 | 0.000 |
Combination E | 0.98 | 0.000 |
Median | 0.95 | IQR (0.93–0.98) |
Score adjustments derived from 50% examiner participation | ||
Combination A | 0.65 | 0.000 |
Combination B | 0.78 | 0.000 |
Combination C | 0.83 | 0.000 |
Combination D | 0.29 | 0.002 |
Combination E | 0.93 | 0.000 |
Median | 0.78 | IQR (0.47–0.88) |