Skip to main content

Table 2 Pearson correlation coefficients of each reviewer against the average of the remaining reviewers for each validation question (VQ1-VQ5) and for the overall score

From: Constructing a question bank based on script concordance approach as a novel assessment methodology in surgical education

  Reviewer 1 Reviewer 2 Reviewer 3 Reviewer 4 Reviewer 5
VQ1^ 0.08 CONSTANT 0.07 0.3** 0.21
  P=0.6   P=0.6 P=0.03 P=0.1
VQ2^ 0.13 0.18 −0.17 CONSTANT −0.08
  p= 0.4 p= 0.2 p= 0.2   p= 0.6
VQ3^ −0.02 0.18 0.01 0.29** 0.05
  p=0.9 p=0.2 p= 0.9 p=0.03 p= 0.8
VQ4^ −0.03 −0.01 0.11 0.02 0.24
  p=0.8 p= 0.9 p= 0.4 p=0.9 p= 0.1
VQ5^ −0.04 0.07 0 −0.05 0.09
  p= 0.8 p=0.6 p=0.9 p= 0.7 p= 0.5
Total Score −0.03 −0.1 −0.07 0.2 0.15
  p= 0.9 p= 0.5 p= 0.6 p=0.2 p= 0.3
  1. ** Correlation is significant at the 0.05 level (2-tailed).
  2. ^ VQ denotes “validation question”.
  3. CONSTANT indicates that at least one reviewer has given all test items a constant rating for one of the validation questions.