Skip to main content

Table 1 Simulation parameters for generating a score made by Judge j for item i

From: Insights into the Angoff method: results from a simulation study

Notation Parameter Random function
A Judge’s Accuracy Normal (μ = 0; σ = 1)
S Judge’s Stringency Normal (μ = 0; σ = 1)
L Judge’s Leadership Normal (μ = 0; σ = 1)
Wa Accuracy’s Weight (Normal (μ = 0; σ = 1) + 3)/3
Ws Stringency’s Weight (Normal (μ = 0; σ = 1) + 3)/3
Ji Judge’s raw score of item i Normal (μ = 0; σ = Aj)
Sji Judge’s Stringency for item i Normal (μ = Sj; σ = 1)
Sa The impacts of Accuracy on Stringencya Normal (μ = 1-Aj; σ = 1)
La The impacts of Accuracy on Leadershipa Normal (μ = 1-Aj; σ = 1)
Lji Judge’s Leadership in the second round Normal (μ = Lj; σ = 1)
  1. aImpact of accuracy is the component of Accuracy (expertise) that contributes to Stringency or Leadership