Skip to main content

Table 4 Changes in examiner ratings

From: “On the same page”? The effect of GP examiner feedback on differences in rating severity in clinical assessments: a pre/post intervention study

(a) Analysis of Effectiveness of Intervention
 Outlier Analysis
  Diagnostic Case Type Management Case Type
  Pre-intervention 8 (out of 11 examiners) 5 (out of 9 examiners)
  Post-intervention 7 (out of 13 examiners) 4 (out of 13 examiners)
 Bootstrapping Analysis
  Diagnostic Case Type Management Case Type
  Change in lenient examiner ratings −0.18 (95%CI −0.52 – +0.17) −0.18 (95%CI −0.79 – +0.34)
  Change in stringent examiner ratings +0.37 (95%CI +0.14 – +0.28) +0.17 (95%CI −0.35 – +0.64)
  Difference in change between lenient and stringent examiners +0.55 (95%CI +0.05 – +0.68) +0.35 (95% CI −0.37 – +1.07)
 Multivariable Linear Regression
  Diagnostic Case Type Management Case Type
  Full model F (4,3) = 4.96; p > 0.11 F (5,1) = 0.52; p > 0.77
  Intervention effect t = 0.54; p > 0.62 t = −0.16; p > 0.90
(b) Analysis of Historical Stability of Examiner Severity
 Intra-class Correlation Analysis
  Diagnostic Case Type Management Case Type
  Intra-examiner correlation between average ratings 2012 and pre-intervention 2013 0.420 0.179
  Intra-examiner correlation between average ratings pre- and post-intervention 2013 0.665 0.578