Skip to main content

Table 2 Average ratings of items by RC on the one hand, and STA on the other

From: Toward a better judgment of item relevance in progress testing

Variable

RC

N raters = 3

STA

N raters = 45

RC/STA difference

M

SD

p 1)

M

SD

p 1)

Mrc-Msta

p 2)

Relevance

0.610

0.304

 

0.626

0.264

 

−0.016

0.26

Inclusion

0.720

0.325

0.0003

0.729

0.281

0.0003

−0.009

0.37

  1. 1)One-sided p-value of a one-sample t-test against the null hypothesis: population mean rating of inclusion = 1, which corresponds to the before-study judgment by the RC on each of the 50 items in the sample
  2. 2)One-sided p-value of a paired samples t-test against the null hypothesis: mean RC/STA difference = 0