Skip to main content

Table 6 Kirkpatrick Four Levels evaluation of the project

From: A case study: a continuous improvement project of lecturing skills for clinical teachers in Chinese residency standardized training

Level Content Method
Level 1 Reaction Training satisfaction of the CTPT course After the CTPT course, the subjects fill out the course satisfaction questionnaire.
Level 2 Learning Knowledge acquisition of the 5 key behaviors a. During and after the CTPT course, the faculty give star ratings to the subjects;
b. Before and after the CTPT course, the subjects directly score their own 5 key behaviors. Compare the self-efficacy [28,29,30,31,32] scores before and after by t-test.
Level 3 Behavior Application of the 5 key behaviors in small lectures for residents a. The teaching secretaries directly score the subjects’ 5 key behaviors in Stage I (Baseline data collection) and Stage III (4 phases of practice transference). Compared the data before and after by t-test.
b. Before the CTPT course and after practice transference, the subjects directly score their own 5 key behaviors. Compare the self-efficacy scores before and after by t-test.
Level 4 Result The improvement of the subjects’ small lectures In Stage I (Baseline data collection) and Stage III(4 phases of practice transference):
a. The teaching secretaries, the residents (secret customers) and general residents use the “Score Sheet of Small Lecture” to assess the subjects’ performance of small lectures, and compared the data before and after.
b. Use the above data to model the performance value of the small lecture. Compare the performance values before and after by t-test.
c. Carry out star rating for the subjects’ overall performance of small lectures. Compare the data before and after by t-test.
d. Make correlation analysis on the change values of both performance values and star rating of the subjects’ overall performance by t-test.
  1. The data analysis of this project adopts descriptive statistics, t-test, correlation analysis, analysis of variance, hypothesis testing
  2. In this test, * as P < 0.05 indicating a statistical difference, ** as P < 0.01 and *** as P < 0.001 indicating a statistically significant difference