Table 2 Shows item analysis of i-Rat and expert rating of items
From: AI in medical education: uses of AI in construction type A MCQs
Q | A | B | C | D | Dif. index | Dis. index | NFD | Expert rating | ||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
% | Interp | Score | Interp | NU | Interp | Average | Interp | |||||
1 | 27.1 | 56.3 | 6.3 | 8.3 | 56.3 | M.DI | 0.31 | Good | 0 | Excellent | 1.6 | Easy |
2 | 33.3 | 52.1 | 6.3 | 6.3 | 33.3 | M.DI | 0 | None | 0 | Excellent | 1.7 | Easy |
3 | 8.3 | 18.8 | 47.9 | 25.0 | 47.9 | M.DI | 0.77 | Excellent | 0 | Excellent | 1.4 | Easy |
4 | 25.0 | 58.3 | 12.5 | 4.2 | 58.3 | M.DI | 0.15 | Poor | 1 | Good | 1.5 | Easy |
5 | 14.6 | 37.5 | 4.2 | 43.8 | 37.5 | M.DI | 0.54 | Excellent | 1 | Good | 1.8 | M.DI |
6 | 64.6 | 14.6 | 4.2 | 12.5 | 64.6 | M.DI | 0.62 | Excellent | 1 | Good | 1.5 | Easy |
7 | 14.6 | 66.7 | 14.6 | 4.2 | 14.6 | DI | 0.31 | Good | 1 | Good | 1.5 | Easy |
8 | 58.3 | 22.9 | 6.3 | 12.5 | 58.3 | M.DI | 0.69 | Excellent | 0 | Excellent | 1.4 | Easy |
9 | 52.1 | 22.9 | 16.7 | 8.3 | 52.1 | M.DI | 0.38 | Excellent | 0 | Excellent | 1.8 | M.DI |
10 | 54.2 | 29.2 | 8.3 | 8.3 | 54.2 | M.DI | 0.30 | Good | 0 | Excellent | 1.5 | Easy |
Average i-Rat | 47.7 | M.DI | 0.41 | Excellent | - | - | 1.6 | Easy | ||||