Skip to main content

Table 1 Simulation parameters for generating a score made by Judge j for item i

From: Insights into the Angoff method: results from a simulation study

Notation

Parameter

Random function

A

Judge’s Accuracy

Normal (μ = 0; σ = 1)

S

Judge’s Stringency

Normal (μ = 0; σ = 1)

L

Judge’s Leadership

Normal (μ = 0; σ = 1)

Wa

Accuracy’s Weight

(Normal (μ = 0; σ = 1) + 3)/3

Ws

Stringency’s Weight

(Normal (μ = 0; σ = 1) + 3)/3

Ji

Judge’s raw score of item i

Normal (μ = 0; σ = Aj)

Sji

Judge’s Stringency for item i

Normal (μ = Sj; σ = 1)

Sa

The impacts of Accuracy on Stringencya

Normal (μ = 1-Aj; σ = 1)

La

The impacts of Accuracy on Leadershipa

Normal (μ = 1-Aj; σ = 1)

Lji

Judge’s Leadership in the second round

Normal (μ = Lj; σ = 1)

  1. aImpact of accuracy is the component of Accuracy (expertise) that contributes to Stringency or Leadership