Table 1 Mean ratings by domain and assessor
Assessor 1 | Assessor 2 | Assessor 3 | Assessor 4 | Assessor 5 | Assessor 6 | Assessor 7 | |
d1 | 5.14 (1.66) | 5.14 (0.53) | 5.50 (1.29) | 5.23 (0.72) | 5.82 (1.25) | 5.23 (0.93) | 5.36 (0.80) |
d2 | 5.29 (1.44) | 4.86 (1.23) | 4.92 (1.71) | 4.75 (1.22) | 5.00 (0.77) | 4.92 (0.95) | 5.32 (1.14) |
d3 | 5.29 (1.54) | 5.14 (0.95) | 5.36 (1.34) | 5.46 (0.97) | 5.80 (1.03) | 4.67 (0.89) | 4.82 (0.98) |
d4 | 5.36 (1.39) | 4.86 (0.95) | 5.86 (0.95) | 5.38 (1.04) | 5.91 (1.30) | 4.54 (0.88) | 5.36 (0.81) |
d5 | 5.29 (1.33) | 5.07 (1.49) | 5.71 (0.99) | 5.46 (0.97) | 5.00 (1.00) | 4.62 (0.87) | 5.00 (0.77) |
d6 | 5.07 (1.82) | 4.43 (1.60) | 5.57 (0.85) | 5.31 (0.85) | 5.09 (0.94) | 5.00 (1.34) | 4.65 (1.11) |
Holistic | 8.31 (0.96) | 7.89 (0.63) | 8.89 (1.05) | 7.96 (0.44) | 7.64 (0.34) | 8.12 (0.75) | 7.96 (0.49) |
Assessor 8 | Assessor 9 | Assessor 10 | Assessor 11 | Assessor 12 | Assessor 13 | Assessor 14 | |
d1 | 6.43 (0.76) | 5.93 (1.32) | 5.62 (0.87) | 5.92 (1.04) | 5.92 (1.04) | 5.73 (0.90) | 5.62 (1.04) |
d2 | 6.08 (1.03) | 6.14 (1.16) | 5.38 (0.65) | 4.92 (1.55) | 5.92 (1.32) | 5.91 (0.70) | 5.08 (1.04) |
d3 | 6.07 (0.99) | 5.00 (1.46) | 5.33 (0.65) | 4.46 (1.05) | 5.60 (0.97) | 5.82 (0.87) | 4.69 (1.18) |
d4 | 6.00 (0.85) | 5.14 (1.79) | 5.62 (0.87) | 4.92 (0.86) | 5.62 (1.26) | 5.82 (0.75) | 4.15 (0.99) |
d5 | 5.43 (1.01) | 5.57 (1.45) | 5.46 (0.78) | 5.15 (1.21) | 5.54 (1.39) | 4.73 (0.65) | 4.46 (0.88) |
d6 | 5.54 (1.05) | 4.92 (1.82) | 5.17 (0.39) | 4.46 (1.61) | 4.83 (1.53) | 5.27 (0.90) | 4.77 (1.09) |
Holistic | 8.36 (0.93) | 8.75 (1.07) | 8.15 (0.47) | 7.82 (0.71) | 8.12 (0.85) | 7.95 (0.39) | 8.04 (0.85) |