Exploring assessor cognition as a source of score variability in a performance assessment of practice-based competencies

Table 2 Pearson correlations between domains by assessor

	Assessor	d2	d3	d4	d5	d6	holistic
d1	1	0.92	0.86	0.91	0.89	0.89	0.96
	2	0.50	−0.04	0.04	0.37	0.46	0.51
	3	0.87	0.34	0.10	0.14	0.37	0.58
	4	0.47	0.45	0.31	0.66	0.68	0.53
	5	0.41	−0.20	0.10	0.28	0.10	0.15
	6	0.36	0.50	0.44	0.75	0.63	0.76
	7	0.61	0.65	0.38	0.65	0.64	0.73
	8	0.88	0.77	0.65	0.72	0.52	0.88
	9	0.70	0.59	0.52	0.58	0.70	0.77
	10	0.39	0.69	0.34	0.58	0.62	0.57
	11	0.36	−0.04	0.55	0.27	0.62	0.58
	12	0.25	0.79	0.35	0.39	0.11	0.68
	13	0.27	0.31	0.36	−0.14	0.10	0.29
	14	0.49	0.64	0.30	0.48	0.65	0.77
d2	1		0.79	0.94	0.88	0.82	0.88
	2		−0.51	−0.28	0.09	0.42	0.28
	3		0.44	0.35	0.28	0.60	0.79
	4		0.84	0.78	0.86	0.67	0.94
	5		0.53	0.62	0.69	0.68	0.83
	6		0.54	0.94	0.46	0.80	0.78
	7		0.57	0.18	0.34	0.69	0.91
	8		0.77	0.65	0.80	0.63	0.94
	9		0.40	0.50	0.45	0.33	0.71
	10		0.44	0.69	0.56	0.81	0.73
	11		0.33	0.37	0.85	0.51	0.69
	12		0.11	0.40	0.42	0.28	0.61
	13		−0.03	−0.03	−0.06	0.04	−0.02
	14		0.63	0.48	0.14	0.68	0.66
d3	1			0.77	0.79	0.73	0.87
	2			0.37	0.21	0.06	0.03
	3			0.72	0.78	0.75	0.78
	4			0.84	0.87	0.65	0.85
	5			0.46	−0.05	0.13	0.55
	6			0.55	0.82	0.59	0.66
	7			0.32	0.83	0.74	0.70
	8			0.62	0.60	0.65	0.82
	9			0.79	0.79	0.81	0.86
	10			0.26	0.44	0.37	0.79
	11			0.41	0.46	0.31	0.46
	12			0.63	0.61	0.53	0.83
	13			0.25	0.08	0.83	0.61
	14			0.69	0.55	0.84	0.84
d4	1				0.94	0.90	0.89
	2				0.23	0.45	0.36
	3				0.84	0.87	0.74
	4				0.71	0.32	0.66
	5				0.39	0.27	0.80
	6				0.46	0.77	0.81
	7				0.32	0.64	0.12
	8				0.64	0.35	0.68
	9				0.94	0.78	0.88
	10				0.51	0.59	0.55
	11				0.33	0.45	0.59
	12				0.97	0.73	0.71
	13				0.30	0.37	0.71
	14				0.68	0.50	0.44
d5	1					0.92	0.93
	2					0.53	0.71
	3					0.84	0.74
	4					0.82	0.92
	5					0.59	0.60
	6					0.67	0.75
	7					0.61	0.63
	8					0.73	0.82
	9					0.89	0.87
	10					0.81	0.73
	11					0.73	0.84
	12					0.72	0.71
	13					0.48	0.57
	14					0.29	0.48
d6	1						0.92
	2						0.70
	3						0.86
	4						0.75
	5						0.49
	6						0.78
	7						0.66
	8						0.69
	9						0.80
	10						0.69
	11						0.90
	12						0.65
	13						0.84
	14						0.91

Note: d = domain; d1 = professionalism; d2 = communication; d3 = theory, models and/or frame of reference; d4 = knowledge of client; d5 = clinical reasoning; d6 = evidence-based practice
N = 92 (listwise deletion)

ISSN: 1472-6920