Table 4 Agreement between Instructors and ChatGPT
From: Exploring the use of ChatGPT to analyze student course evaluation comments
Prompt Focus | Agreement– M ± SD | All | ||
|---|---|---|---|---|
I/Chat1 | I/Chat2 | Chat1/Chat2 | ||
Course-related Topics | 0.80 ± 0.17 | 0.71 ± 0.14 | 0.82 ± 0.14 | 0.89 ± 0.04 |
Themes related to Student Experience | 0.82 ± 0.14 | 0.60 ± 0.19 | 0.73 ± 0.13 | 0.85 ± 0.08 |
Strengths of the Course | 0.68 ± 0.11 | 0.71 ± 0.12 | 0.92 ± 0.17 | 0.88 ± 0.06 |
Weaknesses of the Course | 0.53 ± 0.06 | 0.57 ± 0.08 | 0.81 ± 0.24 | 0.80 ± 0.04 |
Changes You Might Make | 0.71 ± 0.28 | 0.58 ± 0.29 | 0.89 ± 0.13 | 0.86 ± 0.10 |