Skip to main content

Advertisement

Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Table 2 Interrater reliability of CAPE and DASH variables in Bihar, India, 2015–2017 (N = 73 simulation debrief videos)

From: Training and evaluating simulation debriefers in low-resource settings: lessons learned from Bihar, India

IndicatorNReliabilityLevel
CAPE Tool
Communication
 Instructor questions730.52 (0.24–0.69) §Fair
 Instructor statements730.14 (−0.36–0.46) §Poor
 Trainee responses730.96 (0.93–0.97) §Excellent
 Instructor questions to instructor statements ratio730.19 (−0.29–0.49) #Poor
 Trainee responses to instructor questions + statements ratio730.77 (0.63–0.85) §Excellent
Objectives
 Behavioral objectives mentioned730.67 (0.48–0.79) §Good
 Cognitive objectives mentioned730.34 (0.04–0.59) §Poor
 Technical objectives mentioned730.35 (0.07–0.64) #Fair
Structure
 Length of debrief video71 α1.0 (0.99–1.0) §Excellent
 All three debrief structural phases present730.72 (0.56–0.25) Good
 Length of description phase730.78 (0.65–0.86) #Excellent
 Length of analysis phase730.92 (0.87–0.95) §Excellent
 Length of application phase730.67 (0.48–0.79) #Good
Video Use
 Incorporation of simulation video731.0 (1.0–1.0) Excellent
 Length of tape segments played730.98 (0.97–0.99) §Excellent
 Number of times tape paused during730.99 (0.98–0.99) #Excellent
DASH Tool
Elements
 1: Maintain engaged learning environment71 α0.26 (−0.18–0.54) §Poor
 2: Organize the debrief730.59 (0.34–0.74) §Fair
 3: Facilitate discussion72 α0.64 (0.43–0.77) §Good
 4: Identify growth opportunities72 α0.38(0.02–0.61) §Poor
 5: Create success plan72 α0.22 (−0.25–0.51) §Poor
 Mean DASH score68 α0.37 (0.02–0.61) §Poor
  1. § ICC calculated for continuous variables (95% CI).
  2. # ICC calculated from normalized data (95% CI).
  3. ‡ Cohen’s kappa calculated for binary variables (95% CI).
  4. α Some forms had missing data.