Table 3 Intraclass correlation coefficients (ICCs) for interrater and intrarater reliability
From: Codebook for rating clinical communication skills based on the Calgary-Cambridge Guide
Item | Interrater reliability N = 83 | Intrarater reliability N = 20 | |||
|---|---|---|---|---|---|
ICC | 95% Cl | ICC | 95% Cl | ||
1 | Identifies problems the patient wishes to address | 0.74 | 0.60–0.83 | 0.55 | −0.14-0.82 |
2 | Clarifies the patient’s prior knowledge and desire for information | 0.68 | 0.48–0.80 | 0.35 | −0.64-0.72 |
3 | Uses easily understood language, avoids jargon | 0.55 | 0.31–0.71 | 0.75 | 0.39–0.90 |
4 | Uses appropriated non-verbal behaviour | 0.71 | 0.55–0.81 | 0.75 | 0.38–0.90 |
5 | Provides support: expresses concern and willingness to help | 0.59 | 0.11–0.78 | 0.78 | 0.45–0.91 |
6 | Structures the interview in logical sequence | 0.56 | 0.33–0.72 | 0.39 | −0.54-0.75 |
7 | Attends to time keeping, and keeps the interview on track | 0.29 | −0.11-0.54 | 0.76 | 0.39–0.90 |
8 | Shares thoughts and reflections with the patient | 0.51 | 0.23–0.69 | 0.43 | −0.4-0.77 |
9 | Checks the patient’s understanding | 0.15 | −0.32-0.45 | 0.76 | 0.40–0.91 |
10 | Negotiates a mutual plan of action | 0.74 | 0.60–0.83 | 0.78 | 0.43–0.91 |
11 | Contracts with the patient about the next steps | 0.88 | 0.80–0.93 | 0.91 | 0.76–0.96 |
12 | Summarizes the session briefly and clarifies the plan of care | 0.65 | 0.46–0.77 | 0.43 | 0.44–0.77 |
Overall score | 0.74 | 0.52–0.85 | 0.86 | 0.65–0.94 | |