Skip to main content

Table 1 Generalizability theory study (G study) results for the scores of medical students (n = 46) in professional competencies using two PBL tutors as raters and four measurement occasions in PBL tutorials

From: Measuring medical students’ professional competencies in a problem-based curriculum: a reliability study

Facets

df

SS

MS

Variance component

Percent variance

Students (s)

45.00

51.10

1.14

0.12

27.0%

Occasion (t)

3.00

16. 88

5.63

0.04

10.0%

Rater (r): t

4.00

7.23

1.81

0.03

8.0%

s × t

135.00

26.83

0.20

0.00

0.0%

s × r:t

180.00

42.48

0.24

0.24

55.0%

G coefficient: 0.80

  

Absolute SEM: 0.21

  1. SS Sum of squares, MS Mean of squares, df Degree of freedom, SEM Standard error of measurement. The proportion of observed variance explained by each facet is calculated by dividing the individual variance component by the total observed variance