Table 4 Level of education experience: Summary of effects, estimated variance components and reliability coefficients
From: Validity of a new assessment rubric for a short-answer test of clinical reasoning
PT group (n = 16) | ||||
Effect | df | MS (PT) | VC (PT) | % VC (PT) |
p | 15 | 35.1493 | 0.2761 | 17.4239 |
r | 1 | 50.2609 | 0.0570 | 3.5970 |
q | 17 | 12.3626 | 0.1075 | 6.7825 |
i:q | 28 | 1.1671 | 0.0110 | 0.6924 |
pr | 15 | 7.3319 | 0.1319 | 8.3238 |
pq | 255 | 2.6669 | 0.3093 | 19.5244 |
pi:q | 420 | 0.4812 | 0.0803 | 5.06634 |
rq | 17 | 1.7434 | 0.0111 | 0.7025 |
ri:q | 28 | 0.6554 | 0.0209 | 1.3204 |
prq | 255 | 0.9652 | 0.2588 | 16.3313 |
pri:q | 420 | 0.3206 | 0.3206 | 20.2357 |
1.5844 | 100 | |||
G-coefficient (95 % confidence interval) | 0.657 (0.536–0.752) | |||
Novice group (n = 14) | ||||
Effect | df | MS (novice) | VC (novice) | % VC (novice) |
p | 13 | 7.2683 | 0.0186 | 1.3620 |
r | 1 | 0.8455 | 0 | 0 |
q | 17 | 14.1553 | 0.1236 | 9.0729 |
i:q | 28 | 3.8639 | 0.0938 | 6.8854 |
pr | 13 | 3.7050 | 0.0534 | 3.9186 |
pq | 221 | 2.3371 | 0.2300 | 16.88143 |
pi:q | 364 | 0.6905 | 0.08780 | 6.4392 |
rq | 17 | 1.5828 | 0.0006 | 0.0448 |
ri:q | 28 | 1.0611 | 0.0390 | 2.8626 |
prq | 221 | 1.0155 | 0.2009 | 14.7450 |
pri:q | 364 | 0.5150 | 0.5150 | 37.7886 |
1.36274 | 100 | |||
G-coefficient (95 % confidence interval) | 0.203 (0.017–0.376) | |||