Table 1 Frequency of item-writing flaws

Awkward stem structure

494

29.4 %

Implausible distractors

386

22.9 %

Longest response is correct

347

20.6 %

True-false distractors

288

17.1 %

Grammatical Clues

259

15.4 %

Negative stem

198

11.8 %

Vague language

188

11.2 %

Unfocused question

147

8.7 %

Absolute terms

99

5.9 %

Misleading stem

76

4.5 %

Mutually-exclusive distractors

53

3.6 %

All of the above

40

2.4 %

None of the above

28

1.7 %

Complex or K-type

15

0.9 %