Table 2 Percent agreement (standard error) between standardized patients on each checklist overall and by checklist item
N (Percent Agreement) [Standard Error] | Kappa Statistic (Standard Error) | |
|---|---|---|
History Taking Checklist Overall | N† = 321 | |
267 (83.2) [2.1] | 0.63 (0.06) | |
History Taking Checklist Items | N‡ = 23 | |
1. Asked when the patient first began struggling with weight | 20 (87.0) [7.2] | 0.0 (0.0) |
2. Asked the patient’s highest and lowest weights | 22 (95.7) [4.3] | 0.83 (0.21) |
3. Asked about the patient’s past attempts to lose weight | 22 (95.7) [4.3] | 0.78 (0.20) |
4. Asked why the patient thinks he/she is gaining/gained weight | 17 (73.9) [9.4] | 0.49 (0.20) |
5. Asked a 24-hour diet recall | 20 (87.0) [7.2)] | 0.51 (0.18) |
6. Asked about beverage consumption | 21 (91.3) [6.0} | 0.83 (0.21) |
7. Asked about prior attempts to change his/her diet | 23 (100.0) [0.0] | 1.0 (0.21) |
8. Asked about barriers to healthier eating | 14 (60.9) [10.4] | 0.23 (0.20) |
9. Asked about the type of physical activity the patient performs | 22 (95.7) [4.3] | 0.0 (0.0) |
10. Asked about the amount of physical activity the patient performs* | 15 (68.2) [10.2] | 0.31 (0.20) |
11. Asked about barriers to performing more physical activity | 15 (65.2) [10.2] | 0.32 (0.20) |
12. Asked about the patient’s concerns regarding his/her excess weight | 18 (78.3) [8.8] | 0.23 (0.13) |
13. Asked if the patient feels supported by his/her family or partner | 21 (91.3) [6.0] | 0.83 (0.21) |
14. Completed the encounter in the allotted time | 17 (73.9) [9.4] | 0.39 (0.20) |
Communication Skills Checklist Overall | N† = 207 | |
206 (99.5) [0.5] | 0.72 (0.47) | |
Communication Skills Checklist Items | N‡ = 23 | |
1. Eye contact | 23 (100.0) [0.0] | 1.0 (1.5) |
2. Facial expressions | 23 (100.0) [0.0] | 1.0 (0.72) |
3. Body language | 23 (100.0) [0.0] | 1.0 (1.0) |
4. Language and vocabulary | 23 (100.0) [0.0] | 1.0 (4.6) |
5. Attention | 23 (100.0) [0.0] | 1.0 (3.2) |
6. Verbalizing understanding of history | 23 (100.0) [0.0] | 1.0 (0.0) |
7. Asking open ended questions | 22 (95.7) [4.3] | −0.10 (0.81) |
8. Using people first language | 23 (100.0) [0.0] | 1.0 (0.0) |
9. Organization | 23 (100.0) [0.0] | 1.0 (1.9) |
Professionalism Checklist Overall | N† = 138 | |
135 (97.8) [1.2] | 0.44 (0.37) | |
Professionalism Checklist Items | N‡ = 23 | |
1. Respect | 22 (95.7) [4.3] | −0.10 (0.89) |
2. Empathy | 22 (95.7) [4.3] | 0.28 (0.69) |
3. Honesty/integrity | 23 (100.0) [0.0] | 1.0 (1.47) |
4. Responsibility/accountability | 23 (100.0) [0.0] | 1.0 (0.91) |
5. Promoting a collaborative environment | 22 (95.7) [4.3] | 0.43 (0.58) |
6. Demonstrating lack of bias | 23 (100.0) [0.0] | 1.0 (1.74) |