Table 1 Descriptive Statistics for Evaluated Assessment Items (N = 173)
Variable | No. (%) |
|---|---|
Format | |
Case based item | 134 (77.5) |
Non-case based item | 39 (22.5) |
Type/Structure | |
Open-ended/essay item | 98 (56.6) |
Multiple choice item | 75 (43.4) |
Number of Choices* | |
2 (True/False) | 11 (14.7) |
3 | 3 (4) |
4 | 33 (44) |
5 | 28 (37.3) |
Bloom’s level | |
Remembering and Understanding Skills | 60 (34.7) |
Analysis skills | 57 (32.9) |
Application Skills | 28 (16.2) |
Evaluation and Creation Skills | 28 (16.2) |
Difficulty Index (Difficulty) Levels1 | |
Difficult (Difficulty< 20%) | 6 (3.5) |
Acceptable/Good (20% ≤ Difficulty< 50%) | 29 (16.7) |
Excellent (50 ≤ Difficulty< 80%) | 93 (53.8) |
Easy/Poor (Difficulty≥80%) | 45 (26) |
Discriminating Index (Discrimination) Levels1 | |
Poor/Flawed (Discrimination< 0) | 5 (2.9) |
Poor (0 ≤ Discrimination<.2) | 36 (20.8) |
Acceptable (.2 ≤ Discrimination<.3) | 40 (23.1) |
Good (.3 ≤ Discrimination<.4) | 39 (22.5) |
Excellent (Discrimination≥.4) | 53 (30.6) |
Point-Biserial Levels2 | |
Poor/Flawed (Point biserial < 0) | 14 (8.1) |
Poor (0 ≤ Point biserial <.15) | 28 (16.2) |
Recommended (.15 ≤ Point biserial <.25) | 28 (16.2) |
Good (Point biserial ≥.25) | 103 (59.5) |