Table 6 Kirkpatrick Four Levels evaluation of the project

Level 1 Reaction

Training satisfaction of the CTPT course

After the CTPT course, the subjects fill out the course satisfaction questionnaire.

Level 2 Learning

Knowledge acquisition of the 5 key behaviors

a. During and after the CTPT course, the faculty give star ratings to the subjects;

b. Before and after the CTPT course, the subjects directly score their own 5 key behaviors. Compare the self-efficacy [28,29,30,31,32] scores before and after by t-test.

Level 3 Behavior

Application of the 5 key behaviors in small lectures for residents

a. The teaching secretaries directly score the subjects’ 5 key behaviors in Stage I (Baseline data collection) and Stage III (4 phases of practice transference). Compared the data before and after by t-test.

b. Before the CTPT course and after practice transference, the subjects directly score their own 5 key behaviors. Compare the self-efficacy scores before and after by t-test.

Level 4 Result

The improvement of the subjects’ small lectures

In Stage I (Baseline data collection) and Stage III(4 phases of practice transference):

a. The teaching secretaries, the residents (secret customers) and general residents use the “Score Sheet of Small Lecture” to assess the subjects’ performance of small lectures, and compared the data before and after.

b. Use the above data to model the performance value of the small lecture. Compare the performance values before and after by t-test.

c. Carry out star rating for the subjects’ overall performance of small lectures. Compare the data before and after by t-test.

d. Make correlation analysis on the change values of both performance values and star rating of the subjects’ overall performance by t-test.