Skip to main content

Table 4 D study to investigate the effect of more ratings by the same assessor and more cases on the G coefficients in fourth and fifth year student reflection scores

From: Using video-cases to assess student reflection: Development and validation of an instrument

Cases Fourth year students Fifth year students
  1 rating 2 ratings 3 ratings 4 ratings 1 rating 2 ratings 3 ratings 4 ratings
1 0.51 0.55 0.56 0.57 0.35 0.39 0.41 0.42
2 0.67 0.71 0.72 0.73 0.50 0.55 0.57 0.58
3 0.76 0.78 0.79 0.80* 0.59 0.64 0.66 0.67
4 0.81* 0.83* 0.84* 0.84* 0.64 0.70 0.72 0.73
5 0.84* 0.86* 0.87* 0.87* 0.68 0.73 0.76 0.77
6 0.86* 0.88* 0.89* 0.89* 0.70 0.76 0.78 0.80*
7 0.88* 0.89* 0.90* 0.90* 0.72 0.78 0.80* 0.81*
8 0.89* 0.91* 0.91* 0.91* 0.74 0.80* 0.82* 0.83*
9 0.90* 0.92* 0.92* 0.92* 0.75 0.81* 0.83* 0.84*
10 0.91* 0.92* 0.93* 0.93* 0.77 0.82* 0.84* 0.86*
  1. * identifies an adequate number of cases and ratings to achieve a G coefficient ≥ 0.80.