Skip to main content

Advertisement

Table 2 Model Fit Indexes for alternative non-nested models

From: Construct validation of judgement-based assessments of medical trainees’ competency in the workplace using a “Kanesian” approach to validation

Model Chi-squared (χ2) Ratio of χ2 to df Akaike information criterion (AIC) Bayes information criterion (BIC) Tucker–Lewis index (TLI) Comparative fit index (CFI) Root mean square error of approximation (RMSEA) (95%CI) Standardised root mean square residual (SRMR) Weighted root mean residual (WRMR)
Ideal Benchmarka Non-significant p-value <3; useful for nested models Smaller the better; for model comparison (non-nested) Smaller the better; for model comparison (non-nested) ≥ 0.95 ideal ≥ 0.95 ideal <0.06 ideal; ≤ 0.08 < 0.90
<0.90 reject <0.90 reject <0.08 acceptable; and with narrow 95 % confidence intervals
3 Factor Model 1b 116.563 p-value <0.00 2.8 3879 4018 0.93 0.95 0.07 0.039 0.93
(0.057–0.088)
3 Factor Model 3c 223.258 p-value <0.00 3.0 4732 4906 0.89 0.91 0.08 0.048 1.14
(0.067–0.090)
3 Factor Model 4d 121.571 p-value <0.00 3.0 3884 4023 0.92 0.94 0.08 (0.060–0.091) 0.041 1.07
3 Factor Modele 211.42 p-value <0.00 2.85 4711 4884 0.90 0.92 0.07 0.045 1.06
(0.062–0.085)
1 Factor Modelf 170.483 p-value <0.00 3.9 3955 4082 0.87 0.91 0.09 (0.077–0.105) 0.050 1.24
2 Factor Modelg 139.489 p-value <0.00 3.2 3910 4041 0.91 0.93 0.08 0.043 1.11
(0.066–0.095)
1 Factor OC Modelh 46.586 p-value <0.00 5.1 2103 2172 0.92 0.95 0.109 0.037 0.882
(0.080–0.141)
  1. aFrom (Schreiber et al., 2006)
  2. b3 Factor Model 1 = Factor structure from SPSS EFA identifying a possible general job performance factor as Factor 1
  3. c3 Factor Model 3 = Factor structure from EFA using the a priori defined competency domains as 3 proposed Factors
  4. d3 Factor Model 4 = Factor structure from SPSS EFA using the a priori defined competency domains as 3 proposed Factors but with potentially redundant items removed (Procedural, emergency and teach and learn)
  5. e3 Factor model from original EFA with all 14 items
  6. f1 Factor model with all 14 items
  7. g2 Factor model with all 14 items
  8. h1 Factor model with only those items within the “operational competence” construct and no other items