Skip to main content

Table 4 D study to investigate the effect of more ratings by the same assessor and more cases on the G coefficients in fourth and fifth year student reflection scores

From: Using video-cases to assess student reflection: Development and validation of an instrument

Cases

Fourth year students

Fifth year students

 

1 rating

2 ratings

3 ratings

4 ratings

1 rating

2 ratings

3 ratings

4 ratings

1

0.51

0.55

0.56

0.57

0.35

0.39

0.41

0.42

2

0.67

0.71

0.72

0.73

0.50

0.55

0.57

0.58

3

0.76

0.78

0.79

0.80*

0.59

0.64

0.66

0.67

4

0.81*

0.83*

0.84*

0.84*

0.64

0.70

0.72

0.73

5

0.84*

0.86*

0.87*

0.87*

0.68

0.73

0.76

0.77

6

0.86*

0.88*

0.89*

0.89*

0.70

0.76

0.78

0.80*

7

0.88*

0.89*

0.90*

0.90*

0.72

0.78

0.80*

0.81*

8

0.89*

0.91*

0.91*

0.91*

0.74

0.80*

0.82*

0.83*

9

0.90*

0.92*

0.92*

0.92*

0.75

0.81*

0.83*

0.84*

10

0.91*

0.92*

0.93*

0.93*

0.77

0.82*

0.84*

0.86*

  1. * identifies an adequate number of cases and ratings to achieve a G coefficient ≥ 0.80.