Table 4 Proportion of variability accounted for by the relationship between summative assessment and clinical performance

Baker et al. [25]

Osteopathic Medicine

OSCE measures and COMLEX-USA Level 2-PE Pass or Failure

OSCE Total score

0.33

<0.01

0.109

10.9 %

OSCE Physical Examination subscore

0.40

<0.01

0.16

16.0  %

Berg et al. [23]

Medicine

OSCE and USMLE Step 2 CS Data Gathering

0.18

<0.05

0.032

3.2 %

OSCE and USMLE Step 2 CS Documentation

0.35

<0.05

0.123

12.3 %

OSCE and USMLE Step 2 CS and Communication/Personal

0.32

<0.05

0.102

10.2 %

Campos-Outcalt et al. [30]

OSCE total score and residency director ratings

0.305

<0.01

0.093

9.3 %

Carr et al. [20]

Medicine

Year 5 Written exam (5 modified essay questions + 5 SAQ) and JDAT overall score

0.076

0.148

0.022

2.2 %

Year 6 Written exam (100 EMQ + 10 SAQ) and JDAT overall score

0.178

0.014

0.032

3.2 %

Year 4 OSCE and JDAT overall score

0.137

0.027

0.019

1.9 %

Year 5 OSCE and JDAT overall score

0.161

0.022

0.026

2.6 %

Cope, Baker et al.[26]

Osteopathic medicine

OSCE Total and Subscores 1, 3–5

0.31–0.43

<0.01

0.096–0.185

9.6–18.5 %

OSCE Total and Subscore 2

0.25

<0.05

0.063

6.3 %

OSCE - History score and Subscores 1, 3–5

0.31–0.40

<0.01

0.096–0.16

9.6–16 %

OSCE - Physical Examination score and Subscores 1,3,5

0.24–0.29

<0.05

0.058–0.084

5.8–8.4 %

OSCE - SOAP Note Form score and Subscore 1, 3

0.34–0.38

<0.01

0.116–0.144

11.6–14.4 %

OSCE - SOAP Note Form score and Subscores 2,5

0.28–0.30

<0.05

0.078–0.090

7.8–9 %

Dong et al. [24]

Medicine

Year 2 OSCE and USMLE Step 2 CS ICE Component

0.25

<0.01

0.063

6.3 %

Year 2 OSCE and USMLE Step 2 CS CIS Component

0.26

<0.01

0.068

6.8 %

Year 3 OSCE and USMLE Step 2 CS ICE Component

0.16

<0.01

0.026

2.6 %

Year 3 OSCE and USMLE Step 2 CS CIS Component

0.27

<0.01

0.073

7.3 %

Ferguson et al. [19]

Medicine

MCQ Written Examination and Clinical Evaluation Form

0.27

0.0009

0.073

7.3 %

Case based learning group participation

0.28

0.0004

0.078

7.8 %

Case based learning written reports

0.21

0.009

0.044

4.4 %

Gadbury-Amyot et al. [18]

Dental Hygiene

Portfolio and CRDTS clinical licensure examination

0.27

<0.05

0.073

7.3 %

Graham et al. [34]

Dentistry

OSCE and Clinical Productivity Value

2010 Cohort = 0.614

<0.0001

0.377

37.7 % - 29.2 %

2011 Cohort = 0.54

<0.0001

0.292

Han et al. [27]

Medicine

OSCE and Intern performance score

0.278

0.028

0.077

7.7 %

CPX clinical skills subset and intern performance score

0.278

0.027

0.077

7.7 %

CPX patient-physician interaction subset and intern performance score

0.503

<0.001

0.253

25.3 %

Ho et al. [17]

Speech Pathology

- Treatment skill subset

0.331

<0.01

0.110

11.0 %

- Interpersonal skill subset

0.272

<0.05

0.074

7.4 %

- Treatment skill subset

0.242

<0.05

0.059

5.9 %

- Interpersonal skill subset

0.280

<0.05

0.078

7.8 %

PBL Evaluation Tutorial Process and COMPASS® generic competencies

0.315–0.407

<0.01

0.099–0.166

9.9–16.6 %

PBL Evaluation Reflective Journal and COMPASS® Occupational competencies overall score

0.271

<0.05

0.073

7.3 %

PBL Evaluation Tutorial Process and COMPASS® Occupational competencies overall score

0.367

<0.01

0.135

13.5 %

Kahn et al. [29]

Medicine

OSCE and Program director evaluations

0.22

0.15

0.048

4.8%

McLaughlin et al. [33]

Pharmacy

Year 2 Fall OSCE and APPE online evaluations

0.13–0.14

<0.05

0.017–0.020

1.7–2 %

Year 2 Spring OSCE and Acute Care APPE

0.12

<0.05

0.014

1.4 %

- acute care APPE

0.12

<0.05

0.014

1.4 %

- ambulatory care APPE

0.25

<0.01

0.063

6.3 %

- clinical specialty APPE

0.13

<0.05

0.017

1.7 %

Wessel et al. [31]

Physiotherapy

OSCE and Physiotherapy Clinical Performance Instrument

−0.13

Reported as not significant

0.017

1.7%

Wilkinson & Frampton [21]

Medicine

- total score

0.59

<0.001

0.348

34.8 %

- clinical skills subscale

0.63

<0.001

0.397

39.7 %

- Humanistic subscale

0.44

<0.001

0.194

19.4 %

- total score

0.17

0.201

0.029

2.9 %

- clinical skills subscale

0.24

0.071

0.058

5.8 %

- humanistic subscale

0.05

0.738

0.003

0.03 %

- total score

0.54

<0.001

0.292

29.2 %

- clinical skills subscale

0.57

<0.001

0.325

32.5 %

- humanistic subscale

0.41

<0.001

0.168

16.8 %