From: Borderline grades in high stakes clinical examinations: resolving examiner uncertainty
Items Student No. | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | F | B | P | Ability: b/(b + f)*p/(p + b) |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | 5↓ | 5↑ | 7 | 7 | 9 | 9 | 9 | 7 | 7 | 7 | 7 | 7 | 0 | 2 | 10 | 0.833 |
2 | 9 | 9 | 7 | 7 | 9 | 9 | 7 | 9 | 9 | 9 | 9 | 9 | 0 | 0 | 12 | |
3 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 3 | 5↓ | 5↓ | 7 | 7 | 1 | 2 | 9 | 0.545 |
4 | 5↓ | 5↓ | 7 | 7 | 7 | 7 | 7 | 3 | 7 | 7 | 3 | 7 | 2 | 2 | 8 | 0.400 |
5 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 9 | 9 | 7 | 7 | 0 | 0 | 12 | |
6 | 9 | 5↑ | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 1 | 11 | 0.917 |
7 | 7 | 9 | 7 | 7 | 9 | 9 | 7 | 7 | 9 | 9 | 7 | 7 | 0 | 0 | 12 | |
8 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 9 | 7 | 7 | 0 | 0 | 12 | |
9 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 9 | 9 | 9 | 7 | 7 | 0 | 0 | 12 | |
10 | 7 | 7 | 7 | 5↓ | 5↓ | 7 | 7 | 7 | 7 | 7 | 5↑ | 7 | 0 | 3 | 9 | 0.750 |
11 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 5↓ | 5↓ | 5↑ | 7 | 0 | 3 | 9 | 0.750 |
12 | 7 | 9 | 7 | 7 | 9 | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 0 | 0 | 12 | |
13 | 7 | 7 | 5↓ | 5↓ | 7 | 9 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 2 | 10 | 0.833 |
14 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 9 | 0 | 0 | 12 | |
15 | 7 | 9 | 7 | 5↓ | 7 | 7 | 7 | 3 | 5↓ | 7 | 7 | 7 | 1 | 2 | 9 | 0.545 |
16 | 7 | 5↑ | 7 | 7 | 9 | 9 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 1 | 11 | 0.917 |
17 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 0 | 12 | |
18 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 5↑ | 5↓ | 7 | 7 | 0 | 2 | 10 | 0.833 |
19 | 7 | 7 | 9 | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 7 | 0 | 0 | 12 | |
20 | 7 | 9 | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 9 | 9 | 0 | 0 | 12 | |
21 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 0 | 12 | |
22 | 7 | 7 | 9 | 9 | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 0 | 0 | 12 | |
23 | 7 | 7 | 9 | 9 | 7 | 7 | 7 | 7 | 9 | 9 | 7 | 9 | 0 | 0 | 12 | |
24 | 9 | 9 | 7 | 7 | 7 | 9 | 7 | 7 | 7 | 7 | 7 | 7 | 0 | 0 | 12 | |
F | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 | 0 | 0 | 1 | 0 | ||||
B | 2 | 4 | 1 | 3 | 1 | 0 | 0 | 0 | 4 | 3 | 2 | 0 | ||||
P | 22 | 20 | 23 | 21 | 23 | 24 | 24 | 21 | 20 | 21 | 21 | 24 | ||||
Difficulty: b/(b + f)*p/(p + b) | 0.917 | 0.833 | 0.958 | 0.875 | 0.958 | 0.833 | 0.875 | 0.609 |