Construct validation of judgement-based assessments of medical trainees’ competency in the workplace using a “Kanesian” approach to validation

Table 4 Measurement invariance for nested model comparisons of major sub-groups^a

Grouping	Model	df	χ^2b	χ ²/df	RMSEA	CFI	TLI	SRMR	∆χ²	p-value for ∆χ²	∆CFI	∆TLI	∆SRMR
Grouping	Model	df	χ^2b	χ ²/df	(90 % CI)	CFI	TLI	SRMR	∆χ²	p-value for ∆χ²	∆CFI	∆TLI	∆SRMR
Female and Male Supervisors	Unconstrained	107	302.01	2.82	0.072	0.914	0.912	0.0746
	Unconstrained	107	302.01	2.82	(0.063–0.082)	0.914	0.912	0.0746
	All factor loadings constrained equal	118	323.37	2.74	0.071	0.910	0.916	0.0739	21.36	0.030	0.004	−0.004	0.0007
	All factor loadings constrained equal	118	323.37	2.74	(0.062–0.080)	0.910	0.916	0.0739	21.36	0.030	0.004	−0.004	0.0007
Female and Male Trainees	Unconstrained	107	296.97	2.775	0.072	0.916	0.914	0.0599
	Unconstrained	107	296.97	2.775	(0.062–0.081)	0.916	0.914	0.0599
	All factor loadings constrained equal	118	304.27	2.579	0.067	0.918	0.924	0.0601	7.299	0.774	0.002	−0.010	0.0002
	All factor loadings constrained equal	118	304.27	2.579	(0.058–0.077)	0.918	0.924	0.0601	7.299	0.774	0.002	−0.010	0.0002
Overseas (OTDs) and Australian Trained Doctors (ATDs)	Unconstrained	107	283.35	2.648	0.069	0.922	0.919	0.0718
	Unconstrained	107	283.35	2.648	(0.059–0.079)	0.922	0.919	0.0718
	All factor loadings constrained equal	118	301.60	2.556	0.067	0.918	0.924	0.0710	18.248	0.076	0.004	−0.004	0.0008
	All factor loadings constrained equal	118	301.60	2.556	(0.058–0.076)	0.918	0.924	0.0710	18.248	0.076	0.004	−0.004	0.0008

^aAssuming models unconstrained to be correct
^bAll p-values <0.000 for the model χ2
χ2 minimum fit function chi-square, RMSEA root mean square error of approximation, CFI comparative fit index, TLI Tucker-Lewis index, SMSR standardized root mean square residual, Δ parameter difference between constrained and unconstrained model

ISSN: 1472-6920