Skip to main content

Table 2 Reliability of the first eight Specialty Certificate Examinations.

From: The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations

Year

Specialty

Candidates

Number of scored items

Alpha

SD

SEM

2008

Gastroenterology

8

200

.84

7.00%

2.80%

2009

Dermatology

39

200

.88

7.27%

2.52%

2009

Endocrinology and Diabetes

39

200

.89

9.03%

2.99%

2009

Geriatric Medicine

15

200

.48

3.97%

2.86%

2009

Infectious Diseases

6

200

.94

12.13%

2.97%

2009

Neurology

25

200

.89

9.13%

3.03%

2009

Nephrology

33

200

.86

7.80%

2.92%

2009

Respiratory Medicine

25

200

.85

7.47%

2.89%

Mean

(SD)

All SCEs (n = 8)

23.8

(13.1)

200

(0)

.829

(.144)

7.97%

(2.31%)

2.87%

(.16%)

Mean

(SD)

MRCP (UK) Pt1

2005/3 to 2008/3

 

191.6

(4.84)

.912

(.012)

10.94%

(0.72%)

3.25%

(0.05%)

Mean

(SD)

MRCP(UK) Pt2

2005/3 to 2008/3

 

257.0

(6.46)

.828

(.025)

6.72%

(0.40%)

2.77%

(0.04%)

  1. Results are scored as percentage of answers correct, and therefore are directly comparable with value shown in Table 1.