Skip to main content

Table 2 Results of Decision D- Studies for Overall, Inter-rater and Internal Consistency reliabilities for different combination of observations

From: Learning from errors: assessing final year medical students’ reflection on safety improvement, five year cohort study

Overall Reliability

Number of Questions

Number of Raters

G

11

1

0.71

11

2

0.82

11

3

0.87

Inter-Rater Reliability

Number of Questions

Number of Raters

G

1

1

0.56

1

2

0.72

1

3

0.79

Internal Consistency

Number of Questions

Number of Raters

G

11

1

0.95

  1. (Calculations based on formulae given in Table 1)