Skip to main content

Table 1 Reliability of the MRCP(UK) Part 1 and Part 2 examinations.

From: The standard error of measurement is a more appropriate measure of quality for postgraduate medical assessments than is reliability: an analysis of MRCP(UK) examinations

 

Part 1

   

Part 2

   

Diet

Number of scored items

Alpha

SD

SEM

Number of scored items

Alpha

SD

SEM

2002/3

-

-

-

-

149

.79

7.67%

3.51%

2003/1

-

-

-

-

146

.76

7.43%

3.66%

2003/2

-

-

-

-

150

.73

6.94%

3.58%

2003/3

199

.89

9.23%

3.09%

152

.76

7.24%

3.52%

2004/1

200

.89

9.70%

3.10%

149

.75

7.10%

3.55%

2004/2

200

.89

10.46%

3.14%

177

.83

8.05%

3.28%

2004/3

200

.91

9.68%

3.14%

183

.78

6.94%

3.26%

2005/1

200

.89

10.67%

3.16%

181

.76

6.77%

3.30%

2005/2

200

.92

9.27%

3.08%

180

.80

7.33%

3.25%

2005/3

195

.90

10.19%

3.21%

253

.83

6.73%

2.78%

2006/1

194

.92

11.08%

3.23%

250

.81

6.46%

2.82%

2006/2

193

.90

10.09%

3.24%

251

.85

7.20%

2.75%

2006/3

195

.89

9.83%

3.27%

253

.82

6.52%

2.80%

2007/1

195

.92

11.49%

3.25%

249

.77

5.84%

2.83%

2007/2

195

.91

10.59%

3.25%

263

.84

6.89%

2.72%

2007/3

195

.92

11.51%

3.26%

262

.85

7.13%

2.76%

2008/1

184

.93

11.90%

3.15%

264

.82

6.52%

2.76%

2008/2

185

.91

11.13%

3.34%

266

.85

6.95%

2.73%

2008/3

185

.92

11.59%

3.28%

259

.84

6.99%

2.77%

Mean (SD)

All diets

194.7

(5.57)

.907

(.014)

10.53%

(0.68%)

3.20%

(.08%)

212.5

(49.7)

.802

(.039)

6.98%

(0.48%)

3.09%

(0.36%)

Mean (SD)

2005/3 to 2008/3

191.6

(4.84)

.912

(.012)

10.94%

(0.72%)

3.25%

(0.05%)

257.0

(6.46)

.828

(.025)

6.72%

(0.40%)

2.77%

(0.04%)

  1. The Part 1 papers consist entirely of Best-of-Five questions. The Part 2 papers are mostly Best-of-Five questions, with two or three >Several-from-Many (questions in each diet. Negative marking is not used in either examination.