Skip to main content

Table 2 Pearson correlation coefficients of each reviewer against the average of the remaining reviewers for each validation question (VQ1-VQ5) and for the overall score

From: Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education

 

Reviewer 1

Reviewer 2

Reviewer 3

Reviewer 4

Reviewer 5

VQ1^

0.08

CONSTANT

0.07

0.3**

0.21

 

P=0.6

 

P=0.6

P=0.03

P=0.1

VQ2^

0.13

0.18

−0.17

CONSTANT

−0.08

 

p= 0.4

p= 0.2

p= 0.2

 

p= 0.6

VQ3^

−0.02

0.18

0.01

0.29**

0.05

 

p=0.9

p=0.2

p= 0.9

p=0.03

p= 0.8

VQ4^

−0.03

−0.01

0.11

0.02

0.24

 

p=0.8

p= 0.9

p= 0.4

p=0.9

p= 0.1

VQ5^

−0.04

0.07

0

−0.05

0.09

 

p= 0.8

p=0.6

p=0.9

p= 0.7

p= 0.5

Total Score

−0.03

−0.1

−0.07

0.2

0.15

 

p= 0.9

p= 0.5

p= 0.6

p=0.2

p= 0.3

  1. ** Correlation is significant at the 0.05 level (2-tailed).
  2. ^ VQ denotes “validation question”.
  3. CONSTANT indicates that at least one reviewer has given all test items a constant rating for one of the validation questions.