Skip to main content

Table 2 Model Fit Indexes for alternative non-nested models

From: Construct validation of judgement-based assessments of medical trainees’ competency in the workplace using a “Kanesian” approach to validation

Model

Chi-squared (χ2)

Ratio of χ2 to df

Akaike information criterion (AIC)

Bayes information criterion (BIC)

Tucker–Lewis index (TLI)

Comparative fit index (CFI)

Root mean square error of approximation (RMSEA) (95%CI)

Standardised root mean square residual (SRMR)

Weighted root mean residual (WRMR)

Ideal Benchmarka

Non-significant

p-value

<3;

useful for nested models

Smaller the better; for model comparison (non-nested)

Smaller the better; for model comparison (non-nested)

≥ 0.95 ideal

≥ 0.95 ideal

<0.06 ideal;

≤ 0.08

< 0.90

<0.90 reject

<0.90 reject

<0.08 acceptable; and with narrow 95 % confidence intervals

3 Factor Model 1b

116.563 p-value <0.00

2.8

3879

4018

0.93

0.95

0.07

0.039

0.93

(0.057–0.088)

3 Factor Model 3c

223.258 p-value <0.00

3.0

4732

4906

0.89

0.91

0.08

0.048

1.14

(0.067–0.090)

3 Factor Model 4d

121.571 p-value <0.00

3.0

3884

4023

0.92

0.94

0.08

(0.060–0.091)

0.041

1.07

3 Factor Modele

211.42 p-value <0.00

2.85

4711

4884

0.90

0.92

0.07

0.045

1.06

(0.062–0.085)

1 Factor

Modelf

170.483 p-value <0.00

3.9

3955

4082

0.87

0.91

0.09

(0.077–0.105)

0.050

1.24

2 Factor

Modelg

139.489 p-value <0.00

3.2

3910

4041

0.91

0.93

0.08

0.043

1.11

(0.066–0.095)

1 Factor OC Modelh

46.586 p-value <0.00

5.1

2103

2172

0.92

0.95

0.109

0.037

0.882

(0.080–0.141)

  1. aFrom (Schreiber et al., 2006)
  2. b3 Factor Model 1 = Factor structure from SPSS EFA identifying a possible general job performance factor as Factor 1
  3. c3 Factor Model 3 = Factor structure from EFA using the a priori defined competency domains as 3 proposed Factors
  4. d3 Factor Model 4 = Factor structure from SPSS EFA using the a priori defined competency domains as 3 proposed Factors but with potentially redundant items removed (Procedural, emergency and teach and learn)
  5. e3 Factor model from original EFA with all 14 items
  6. f1 Factor model with all 14 items
  7. g2 Factor model with all 14 items
  8. h1 Factor model with only those items within the “operational competence” construct and no other items