Skip to main content

Table 3 Validity evidence

From: Measuring antenatal counseling skill with a milestone-based assessment tool: a validation study

Domains

Elements (code)

Rater Observations (N)

P value*

Level of agreement (weighted κ)

Cronbach’s Alpha (α > 0.70)

Starting the Visit

Posture/Room set-up (SV1)

32

0.001

Fair (0.30)

0.92

Introduction (SV2)

42

0.000

Fair (0.35)

0.92

Attendance/Family (SV3)

42

0.002

Moderate (0.57)

0.93

Setting the Stage

Family Agenda (SS1)

41

0.104

Fair (0.38)

0.93

Detail preference (SS2)

41

0.000

Moderate (0.45)

0.92

Headline (SS3)

41

0.001

Fair (0.28)

0.92

Information Sharing

Medical information (IS1)

42

0.000

Moderate (0.52)

0.92

Shared decision making (IS2)

15

0.049

Slight (0.14)

0.92

Wrap Up

Summary (WU1)

30

0.005

Slight (0.15)

0.92

Recommendations (WU2)

41

0.000

Moderate (0.43)

0.92

Team Availability (WU3)

41

0.087

Fair (0.28)

0.93

Emotions and Values

Cue Recognition (EV1)

41

0.002

Moderate (0.45)

0.92

Empathic Statements (EV2)

42

0.013

Slight (0.15)

0.92

Family Values (EV3)

42

0.012

Moderate (0.45)

0.92

Communication

Personalization (C1)

42

0.000

Moderate (0.58)

0.92

Clarity (C2)

42

0.003

Slight (0.20)

0.93

Support (C3)

42

0.023

Slight (0.12)

0.93

  1. Validity evidence as demonstrated by item scaling amongst skill level (kruskal wallis p-value), interrater reliability (weighted κ), and internal consistency (cronbach’s α). Bolded values indicate statistically significant results
  2. *Kruskal Wallis p value (p < 0.05)