Skip to main content

Table 2 Results of Decision D- Studies for Overall, Inter-rater and Internal Consistency reliabilities for different combination of observations

From: Learning from errors: assessing final year medical students’ reflection on safety improvement, five year cohort study

Overall Reliability
Number of Questions Number of Raters G
11 1 0.71
11 2 0.82
11 3 0.87
Inter-Rater Reliability
Number of Questions Number of Raters G
1 1 0.56
1 2 0.72
1 3 0.79
Internal Consistency
Number of Questions Number of Raters G
11 1 0.95
  1. (Calculations based on formulae given in Table 1)