Skip to main content

Student standardized patients versus occupational standardized patients for improving clinical competency among TCM medical students: a 3-year prospective randomized study

Abstract

Background

Standardized patient (SP) simulations are well-recognized patterns for practicing clinical skills and interactions. Our previous study showed that a simulation program using occupational SP for Traditional Chinese Medicine (OSP-TCMs) was efficient, however, a high cost and time-intensive nature have limited its use. TCM postgraduates trained as student SPs (SSP-TCMs) present a potentially cost-effective alternative. The purpose of this study was to examine and determine whether SSP simulation offered more benefits over didactic training alone for improving clinical competency among TCM medical students, and conduct a multifaceted analysis comparing SSP-TCMs and OSP-TCMs.

Methods

This was a prospective, single-blinded, randomized controlled trial. Fourth-year TCM undergraduates were recruited as trainees from the Clinical Medical School, Chengdu University of TCM. Data were collected from September 2018 to December 2020. Trainees were randomly divided into the three following groups: traditional method training group, OSP-TCM training group, and SSP-TCM training group (1:1:1). At the end of a 10-week curriculum, trainees received a two-station examination comprising a systematic online knowledge test and an offline clinical performance examination. Post-training and post-exam questionnaires were administered to collect feedback from these trainees.

Results

Students assigned to the SSP-TCM training and OSP-TCM training groups received favorable marks for the “systematic knowledge test” and “TCM clinical skills” (2018, Pa=0.018, Pb=0.042; 2019, Pa=0.01, Pb=0.033; 2020, Pa=0.035, Pb=0.039) compared to the TM trainees. Additionally, trainees in the intervention groups demonstrated a positive post-training edge in scores of “medical records” (2018, Pa=0.042, Pb=0.034; 2019, Pa=0.032, Pb=0.042; 2020, Pa=0.026, Pb=0.03) and “TCM syndrome differentiation and therapeutic regimen” (2018, Pb=0.032; 2019, Pa=0.037, Pb=0.024; 2020, Pa=0.036, Pb=0.043). For the simulation encounter assessment given by SP-TCMs, OSP-TCM trainees and SSP-TCM trainees scored higher than TM trainees (2018, Pa=0.038, Pb=0.037; 2019, Pa=0.024, Pb=0.022; 2020, Pa=0.019, Pb=0.021). For the feedback questionnaires, the students in TM group provided less positive feedback for training efficacy and test performance compared to those in the SSP-TCM and OSP-TCM groups. The trainees responded that the training effect of clinical simulations was similar between the SSP-TCM and OSP-TCM groups. SSP-TCMs were more responsive to unexpected emergencies (Pa=0.022, Pb>0.05) and more likely to encourage questioning (Pa=0.029, Pb>0.05) but tended to provide implied hints (Pc=0.015) and utilize medical jargon (Pc=0.007) as compared to OSP-TCMs.

Conclusion

Simulation training for SSP-TCMs and OSP-TCMs showed great benefits for enhancing clinical competency. SSP-TCM simulation was feasible, practical, and cost-effective, and may serve as an alternative method to OSP-TCM simulation.

Peer Review reports

Introduction

Simulations often utilize a standardized patient (SP), or a “patient-actor” who has been trained to consistently portray a specific patient role outlined by a script [1] for a real encounter experience for healthcare teaching, practice, evaluation, and research [2]. Patient-based simulation training, particularly featuring opportunities for feedback and repetitive practice [3], is more effective for boosting clinical competence compared to didactic instruction [4,5,6,7]. Paula Stillman introduced SP into Chinese medical education in 1991, and it has since been used for instructing and evaluation [8]. Despite progress and preponderance in SP-based simulations in medical education, limited resources and cost of use hinder its utility [9]–[10].

SPs, also known as occupational standardized patients (OSPs), staff and faculty, manikins, or students from higher level cohorts (student standardized patients, SSPs), can be paid actors. SSP was introduced in medical education as early as 1992, whereby third- and fourth-year medical students were recruited to participate as SPs and examiners in the Objective Structured Clinical Examination (OSCE) at the University of Minnesota Medical School [11]. SSPs are usually recruited from higher-level cohorts among student peers. SSP simulation uses student individuals as actors beyond learners in scenarios to minimize cost in combination with other methods, like role-playing. SSP simulation is a complex identity comprising multiple roles, which can help develop and enhance learners’ understanding of professional roles and needs, along with patient-centered healthcare [12]. Additionally, after an SP pilot simulation, postgraduates as participants responded that they gained more experience of interdisciplinary interaction and their confidence in handling clinical work were boosted [13]. Taken together, due to its cost-effectiveness and educational benefits, SSP simulation has been applied in various fields of medical education, including nursing and dental training [6, 14].

Traditional Chinese Medicine (TCM) has its discipline characteristics. At present, teaching modes, including didactic sessions, problem-based learning, and manikin-based skill practice dominate TCM universities in China. These lead to the problems of low enthusiasm and self-directed awareness in learning among the students [15]. Apprenticed approach and bedside teaching of TCM synchronizes the classroom with practice but the model is monotonous (students are more like “visitors” than “participants”) and has no effective evaluation mechanisms. The development of SP in TCM has been relatively late. The Chengdu University of TCM is one of the few TCM universities that conducts SP simulation courses in China. Beginning in 2015, a batch of occupational standardized patients of TCM (OSP-TCMs) were trained and obtained certificates of qualification at the Clinical Skill Center of Clinical Medical School, Chengdu University of TCM. Subsequently, our team conducted a 5-year prospective study and demonstrated the benefits of improving the TCM clinical competency among students who trained with the OSP-TCMs [16]. Although an implementable and efficient OSP-TCM training model has been established, some challenges, like resource constraints of professional social origin SP-TCMs, and the high cost of time and effort, need to be addressed. The present OSP-TCM program does not fully cover these college students.

TCM medical students should be exposed to clinical competency enhancement training as an important part of their summative assessment for pre-clinical and clinical procedures. Since 2018, the Clinical Medical School of Chengdu University of TCM has initiated a student-SP-TCM program and trained a batch of TCM postgraduates as SSP-TCMs. Research on SSP in the field of TCM education has not yet been reported. The main objective of this prospective study was to determine whether SSP-TCM simulation offered benefits over didactic sessions for improving clinical competency among TCM medical students. A multifaceted analysis was also conducted for comparing OSP-TCMs and SSP-TCMs. Our findings are expected to provide a reduced-cost and high-efficiency training mode to enhance clinical competency among students of TCM.

Methods

Ethical review

This was a prospective, single-blinded, randomized controlled trial. The study was approved by the ethics committee of Chengdu University of TCM (no. 3801) and was conducted in accordance with the principles of the Declaration of Helsinki. All methods in this study were carried out in accordance with the “standard of undergraduate medical education-Traditional Chinese Medicine” issued by the National Advisory Committee on Traditional Chinese Medicine in Higher Education under the Ministry of Education of China, and with the training guidelines of TCM medical undergraduates of five-year program released by the Chengdu University of TCM. Informed consent was obtained from all participants. At the conclusion of the trial, trainees in the control group were provided with an opportunity to receive systematic training of OSP-TCM simulation.

Recruitment of SSP-TCMs

18 voluntary first-year postgraduate students were recruited. Students signed appropriate consent forms and participated voluntarily. Voluntary SSP-TCMs should be with physical and mental fitness based on psychological test files and health examination records. Those with acting talent and strong sense of responsibility will be given priority to inclusion. Information on SSP-TCMs were collected including gender, age, scores of the National Entrance Examination for Postgraduate (NEEP), and medical specialty.

Training and eligibility of SSP-TCMs

Four months prior to the study, the enrolled postgraduate students were trained by several senior SP trainers as student standardized patients of TCM (SSP-TCMs), they received a systematic training course consisting of didactic sessions and skill practice, and self-study sessions. The specific training methods are provided in Supplementary Material 1 and eligibility requirements are shown in our previous study [16]. Finally, 15 SSP-TCMs passed the qualification test assessed by SP instructors and internal medicine specialists (both blinded to the SSP-TCMs), and they later participated the study.

Trainees

Enrollment of trainees

A total of 160 fourth-year TCM undergraduates learning the curriculum of TCM clinical competence enhancement training at the Chengdu University of Traditional Chinese Medicine from September 2018 to December 2020 were offered enrollment. Figure 1 shows the flowchart for enrollment, randomization, intervention and assessment of trainees throughout the trial. Informed consent was obtained for all trainees.

Fig. 1
figure 1

Flow chart of the study protocol

Inclusion and exclusion criteria

Inclusion criteria for trainees were: (1) Forth-year undergraduates majoring in TCM at the Chengdu University of Traditional Chinese Medicine. (2) Participation was entirely voluntary, and confidentiality agreement was obtained. (3) Trainees passed the examinations of basic courses of Traditional Chinese Medicine and Western Medicine. (4) Trainees in good physical and psychological condition. Exclusion criteria included the following items: (1) Trainees who had received prior formal training as a standardized patient. (2) Trainees who had or being participated in a similar intervention. (3) Trainees who were failure to complied with the confidentiality agreement regarding the curriculum content. (4) Trainees were unwilling or unable to continue training, missing any of the training sessions.

Randomization and blinding

Using computer-generated randomization, trainees were assigned 1:1:1 to receive either traditional training method (TM group) or OSP-TCM training method (OSP-TCM group) or SSP-TCM training method (SSP-TCM group). An independent investigator carried out the randomization. The assignment and all baseline measures were confidential to the trainees, researchers and study staff involved in this study. Independent study analysts were blinded to collect data during the study period, and the data analysis could not be performed until the data collection was complete.

Training protocol of curriculum

This was a case-based and group-based curriculum that lasted for 10 weeks with a total of 40 class hours. The curriculum was organized by faculty members as a 4-class hour session comprised of two training clinical case, once a week. The curriculum is taught on simulation clinic at Shi-er-qiao campus of Chengdu University of Traditional Chinese medicine. Training assistants who have signed confidentiality agreements were hired to assist faculty members during the curriculum. Three groups referred to the same course syllabus, utilized the same training clinical cases, experienced the same amount of training time. During the project period, an equal number of SPs were employed, that is, 10 student standardized patients in SSP-TCMs group and 10 occupational standardized patients in OSP-TCMs group. The faculty in the three groups were trained to use the identical rubric (e.g., evaluation of TCM clinical skills, written questions of TCM syndrome differentiation and therapeutic regimen), and completed a norming prior to use. Supplementary Material 1 shows the detailed training flow of the three groups.

Evaluation of training effectiveness

Examination design, confidentiality, and objectivity

All trainees took two-station final examinations– a systematic online knowledge test and an offline clinical performance examination. The exam was scheduled for two days. On the first day, a systematic knowledge test was conducted, whereby all trainees completed 50 objective questions online within 60 min. On the next day, the clinical performance examination lasted 60 min—there was a 20 min patient encounter wherein trainees completed a medical interview, performed a physical examination, and gave medical advice. The evaluation of student performance was immediately completed by OSP-TCMs and TCM specialists using checklists. Subsequently, the trainees had 40 min to write a summary report on the simulation encounter, including a presentation of the medical records, making a diagnosis, and giving TCM syndrome differentiation and therapeutic regimen.

To ensure confidentiality and objectivity, new cases were selected from the clinical case database for testing. To eliminate evaluation bias, another group of senior OSP-TCMs and TCM specialists with no exposure to any trainee served as examination evaluators. All the OSP-TCMs and TCM specialists in the exam received evaluation training to ensure consistency. To maintain high fidelity and consistency in performance, the eligibility of OSP-TCMs was determined again 10 days before the final examination. The clinical performance examinations were conducted in a clinical skills center with three waiting areas and six examination areas, separated by appropriate distance and supervised by video to ensure no communication among the staff and trainees. The entire exam process was audiotaped and videotaped. The items needed for clinical performance examination were prepared in advance, and trainees were not allowed to take anything out of the examination area. For trainees not meeting clinical competency for the assessment, a double-check was conducted—another TCM specialist and senior OSP independently reviewed the video, and both evaluators met to discuss and regrade the trainee’s performance.

Systematic knowledge test

The systematic knowledge test was a standardized, 50-item, with a total score of 100, multiple choice question online testing. It examined students’ mastery of basic knowledge and clinical skills, along with their cognitive and application abilities. These objective questions covered the following domains: TCM and western medicine, physical examination, auxiliary examination, humanistic care, and doctor-patient communication skills.

Evaluation of TCM clinical skills

Evaluation for trainees’ proficiency in TCM clinical skills was based on the following dimensions [17]: (1) inspection: 5 points including mental state, facial expression, complexion, physical condition, secretions, and finger venules.; (2) tongue manifestation: 5 points, including changes in the tongue color (pale, pale red, purple, crimson, etc.), form and motility of the tongue body (prickly tongue, spotted tongue, limp wilting tongue, deviated tongue, etc.), and coating (moist or dry, thin or thick, slippery, or slimy fur); (3) listening and smell examination: 5 points, including differentiating abnormal voice and smell (like deep turbid or faint low voice, phlegm rale, fetid mouth odor, etc.); (4) inquiry: 70 points, including basic information (5 points), chief complaints (5 points), present history (30 points), past history (10 points), personal history (10 points), and family history (10 points). Notably, the inquiry domain included some TCM items like “cold and heat”, “condition of sweating”, “Yin-Yang pattern identification”, and “deficiency and excess”, and (5) palpation and pulse diagnosis: 15 points, including three positions and nine indicators of pulsation, along with 28 types of pulse condition. Some TCM-specific symptoms and signs that were not presented in SP-TCMs were orally instructed, or through image presentation (e.g., TCM tongue manifestation), or using specific instruments (e.g., TCM pulse examination). For a more detailed evaluation of the content and related terminology of TCM clinical skills, we referred to the published book [18].

Scoring of medical records

The scoring for written medical records was based on a standardized, 100-point scale checklist published previously [16] and included general data (3 points), chief complaint (5 points), present history (30 points), past history (10 points), personal history (10 points), family history (6 points), physical examination (20 points), and four examinations of TCM (16 points).

Scoring for TCM syndrome differentiation and therapeutic regimen

The written records of TCM syndrome differentiation and therapeutic regimen were scored based on a standardized, 100-point scale described previously [16] and included the diagnosis by TCM (6 points), diagnostic evidence for TCM (6 points), diagnosis by Western medicine (6 points), diagnostic evidence for Western medicine (14 points), syndrome type in TCM (10 points), analysis of TCM syndrome differentiation (24 points), method of TCM treatment (8 points), formula (8 points), medicine, their doses and method of administration (14 points), and medical advice (4 points).

Real-time assessment from SP-TCMs

OSP-TCMs assessed student performances using the Arizona Clinical Interviewing Rating Scale (ACIR) [19]. The rubric contained 20 items on professionalism, communication, and interviewing skills. Each item ranged from 1 to 5 points, with a maximum score of 5. Instructions on using the rubric were given before the exam.

Post-training and post-exam questionnaires from trainees

To investigate students’ attitudes and perceptions toward the curriculum training, anonymous post-training and post-exam surveys were initiated. The project team developed post-training survey questionnaires using a 4- or 5-point Likert scale based on previously published tools [15, 2021] Post-training questionnaire comprised 15 items, including “Enhance the quality of medical record”, “Improve TCM thinking ability” and “Satisfy with the teaching effectiveness of the course.” The post-exam questionnaire comprised 5 items, including “Your test performance achieves fidelity rate of your usual performance?”, “Do you think the scenario preparation in examination is authentic?”

Statistical analysis

Statistical data were analyzed using the SPSS 25.0 software. Data were presented as mean ± standard deviation or percentages. Differences in multi-group comparisons were evaluated using a one-way analysis of variance (ANOVA), followed by the Tukey method for homogeneous data and Dunnett’s T3 method for non-homogeneous data. The comparison of proportion and correlation analyses was conducted using the Chi-square test. p < 0.05 indicated statistical significance.

Results

Demographic data of the trainees

Among the 160 trainees, 147 were enrolled in this study (excluding 13 trainees who were ineligible) and none of them were lost to follow-up. In the final analyses, 45 trainees in 2018, 48 in 2019, and 54 in 2020 were included. Descriptive statistics revealed no significant differences in gender and age among the three groups and the three groups across different years (all P > 0.05). At baseline, no significant differences were found for educational background variables for basic courses of TCM and Western medicine among the three groups and the three groups across different years (all P > 0.05). Table 1 shows detailed demographic data of the trainees of the three groups from 2018 to 2020.

Table 1 Demographic data of the trainees among the three groups from 2018–2020 (n = 147)

Scores for the systematic knowledge test

The objective questions set in advance on the computer system were used for intelligence grading in the systematic knowledge test, and the examinees’ report cards were extracted. The scores of systematic knowledge, and the proportion of trainees with scores above 80, were distinctly higher between the OSP-TCM and SSP-TCM groups but not in the TM group. The results of one-way ANOVA for comparing the differences among the three groups (2018/19/20, F = 4.484/3.338/3.386, P = 0.017/0.044/0.042), along with the post-hoc analysis suggested a statistically significant difference in the overall grading between the SSP-TCM and TM groups (2018/19/20, Pa=0.028/0.022/0.020), and between the OSP-TCM and TM groups (2018/19/20, Pb=0.042/0.045/0.043). However, no statistical differences were observed between the OSP-TCM and SSP-TCM groups (2018/19/20, all Pc > 0.05). The results are shown in Fig. 2A (Note: a = SSP-TCM group vs. TM group, b = OSP-TCM group vs. TM group, c = SSP-TCM group vs. OSP-TCM group).

Fig. 2
figure 2

The results of standardized examination among the TM group, OSP-TCM group and SSP-TCM group (2018–2020). Graphs show 3-group comparisons including (A) scores for systematic knowledge test, (B) scores for TCM clinical skills, (C) scores for written medical records, (D) scores for TCM syndrome differentiation and therapeutic regimen, and (E) sores for real-time assessment from SP-TCMs.

Note: 2-way contrasts are depicted by the gray lines and P values

aSSP-TCM group vs. TM group, bOSP-TCM group vs. TM group, cSSP-TCM group vs. OSP-TCM group

Scores for TCM clinical skills

For the application of TCM clinical skills, results of one-way ANOVA for comparing the differences among the three groups (2018/19/20, F = 4.836/5.434/4.310, P = 0.013/0.008/0.019) and post-hoc analysis showed that trainees in both SSP-TCM and OSP-TCM groups exhibited significantly greater improvements relative to those in the TM group (2018/19/20, Pa=0.018/0.01/0.035; Pb=0.042/0.033/0.039). During the entire study, no significant differences were found between the SSP-TCM and OSP-TCM groups (2018/19/20, all Pc > 0.05). These results suggested that performing case scenario simulation by OSP-TCMs or SSP-TCMs offered an advantage over traditional didactic training. The outcome of TCM clinical skills application among the three groups is shown in Fig. 2B.

Scores for written medical records

After the clinical performance examination, the quality of written medical records was scored. The results of one-way ANOVA for comparing the differences among the three groups (2018/19/20, F = 4.352/4.359/4.700, P = 0.019/0.019/0.013) and post-hoc analysis revealed that trainees of both the OSP-TCM and SSP-TCM groups had more favorable scores than those in TM group, with a statistically significant difference in the overall grading between the SSP-TCM and TM groups (2018/19/20, Pa=0.042/0.032/0.026), and between the OSP-TCM and TM groups (2018/19/20, Pb=0.034/0.042/0.030). Moreover, when comparing the scores between the SSP-TCM and OSP-TCM groups, no statistical differences were observed (2018/19/20, all Pc > 0.05). The scores of written medical records in the three groups are shown in Fig. 2C.

Scores for TCM syndrome differentiation and therapeutic regimen

For TCM syndrome differentiation and therapeutic regimen, the results of one-way ANOVA for comparing the differences among the three groups (2018/19/20, F = 4.171/4.681/4.223, P = 0.022/0.014/0.020) and post-hoc analysis revealed that trainees assigned to SSP-TCM and OSP-TCM groups scored higher than those assigned to TM group (2018/19/20, Pa=0.057/0.037/0.036; Pb=0.032/0.024/0.043). A similar trend was noted in the first year, i.e., in 2018, although no statistical difference was found between the SSP-TCM and TM groups (2018, Pa=0.057). Additionally, mean scores for TCM syndrome differentiation and therapeutic regimen were similar between the SSP-TCM and OSP-TCM groups (2018/19/20, all Pc > 0.05). The results are presented in Fig. 2D.

Scores for real-time assessment from SP-TCMs

For encounter assessment given by SP-TCMs, the results of one-way ANOVA for comparing the differences among the three groups (2018/19/20, F = 4.421/5.035/5.169, P = 0.018/0.011/0.009) and post-hoc analysis showed that OSP-TCM and SSP-TCM trainees achieved a similar performance score, and no significant differences were found (2018/19/20, all Pc > 0.05). In contrast, TM trainees scored lower than OSP-TCM trainees or SSP-TCM trainees in the simulation encounter (2018/19/20, Pa=0.038/0.024/0.019; Pb=0.037/0.022/0.021). In our secondary analyses using the ACIR rubric for assessing the performance of OSP-TCM and SSP-TCM trainees, the latter tended to encourage patients to ask questions and were more likely to use “citation and verification” during the clinical encounter. By contrast, OSP-TCM trainees were able to avoid relevant medical jargon, were concerned more about the impact of the disease and the patient’s expectations, and always checked the patient’s understanding. Real-time assessment for performance examination from SP-TCMs is shown in Fig. 2E.

Post-training feedback analysis

Table 2 shows the results of post-training feedback in the three groups. Trainees in both SSP-TCM and OSP-TCM groups reported that they achieved greater improvements relative to the TM group in “the quality of medical record” (χ2 = 10.584, Pa=0.032; χ2 = 10.04, Pb=0.04), “TCM thinking ability” (χ2 = 10.781, Pa=0.032; χ2 = 10.585, Pb=0.029), “physician-patient interpersonal and communication skills” (χ2 = 12.532, Pa=0.014; χ2 = 9.893, Pb=0.042), and “the confidence in handling clinical work” (χ2 = 10.667, Pa=0.031; χ2 = 9.840, Pb=0.043). Moreover, trainees in SSP-TCM and OSP-TCM groups reported a higher satisfaction index for the training course (χ2 = 11.056, Pa=0.026; χ2 = 9.787, Pb=0.044) with a greater improvement in “interest in learning TCM” following the training (χ2 = 9.642, Pa=0.047; χ2 = 10.094, Pb=0.039) compared to TM controls. They became more proficient in inquiry skills for obtaining the TCM medical history (χ2 = 11.903, Pa=0.018; χ2 = 10.543, Pb=0.032).

Table 2 Post-training feedback on curriculum from trainees in three groups (n = 147)

Interestingly, SSP-TCMs received more positive comments from trainees than OSP-TCMs in specific aspects. They responded flexibly to unexpected emergencies (χ2 = 11.487, Pa=0.022; χ2 = 9.121, Pb>0.05), actively cooperated with clinical physical examination (χ2 = 10.781, Pa=0.029), and encouraged the students to ask questions (χ2 = 10.818, Pa=0.029; χ2 = 8.347, Pb>0.05). However, a majority of trainees reported that SSP-TCMs were more likely to provide implied hints (30/49, 61.22%, χ2 = 12.268, Pc=0.015) and utilize medical jargon (28/49, 57.14%, χ2 = 14.048, Pc=0.007) compared to OSP-TCMs. By contrast, more trainees considered that OSP-TCMs would value and check their understanding (χ2 = 10.246, Pc=0.036) and they possessed a slightly higher proficiency in simulation ability (they were less exaggerated and emotional) (χ2 = 10.464, Pc=0.033) than SSP-TCMs.

Post-examination feedback analysis

Table 3 summarizes the student feedback on examination. The results of post-examination questionnaires revealed that 38.78% of SSP-TCM trainees, 34.69% of OSP-TCM trainees and 12.24% of TM trainees considered their test performances are near or even equal to usual performance, respectively. Intriguingly, more TM trainees than either SSP-TCM trainees or OSP-TCM trainees thought the “patient” in examination act like a real patient (very likely, 36.73% TM vs. 12.24% SSP-TCM vs. 14.29% OSP-TCM). A similar trend was observed in terms of the authenticity of clinical scenario settings, with more TM trainees deemed that the clinical scenario settings was immersive (very much, 42.86% TM vs. 20.41% SSP-TCM vs. 26.53% OSP-TCM). Encounter time was deemed “adequate” by 51.02% of SSP-TCM trainees vs. 46.94% of OSP-TCM trainees vs. 32.65% of TM trainees, while none reported “too long” except for 3 SSP-TCM trainees. A majority of SSP-TCM trainees and OSP-TCM trainees reported that video recording did not (32.65% SSP-TCM trainees vs. 34.69% OSP-TCM trainees) or only slightly (38.78% vs. 28.57%) interfered with their performance. TM trainees, by contrast, believed they were more likely to be interfered by video recording (42.86% very much, 36.73% slightly).

Table 3 Post-examination feedback from trainees in three groups (n = 147)

Discussion

In medical education, given patient safety and rights, patients as a core element in actual clinical settings are regularly absent from pre-clinical training. SPs as salaried persons who portray patients’ symptoms and signs consistently have emerged with the demand. [22] When needed, they cooperate with props and makeup techniques to construct an extra credible and secure learning context for clinical interactions with medical students. [23] In this educational setting that emphasizes early clinical encounters and workplace-based assessment, allowing trainees to safely make mistakes and capture ongoing data will facilitate the identification and addressing of learning needs, thus bridging the gap between medical theory and clinical practice [24]–[25].

This study showed substantial differences between SSP-TCM trainees and TM trainees and between OSP-TCM trainees and TM trainees for evaluation parameters in the systematic knowledge test and clinical competence examination. The results corresponded to those of our previous occupational SP program, suggesting that TCM-tailored SP training was more effective than traditional didactic training. [16] While the average score of “TCM syndrome differentiation and therapeutic regimen” of SSP-TCM trainees was higher relative to TM trainees in 2018, the results did not show a statistically significant difference. A major contributor may be the heterogeneity in the system knowledge and case analysis abilities among students. Our data demonstrated that the clinical scenario simulation training incorporated with either SSPs or OSPs was efficient and worth repeating.

In this study, SSP-TCMs were selected from among graduate students majoring in internal TCM medicine and met the general accuracy and consistency requirements for SSPs after brief training. In comparison to OSPs, SSPs showed faster acceptance, shorter training time, and lower training difficulty. [26] In addition to the above-mentioned advantages, SSP-TCMs had outstanding simulation competence due to their high self-efficacy, ensuring the acquisition of knowledge and skills. They were also involved in the development of script renewal. Similar results were reported by other teams [27]–[28]. In comparison, OSP training required self-contained coaching teams and specific hospital teaching observation, tough on a low budget. [14, 29] We, therefore, believe that the SSP-TCM program is potentially a cost-effective alternative.

Regarding feedback on curriculum, SSP-TCM trainees demonstrated significantly improved proficiency in inquiry skills and TCM thinking, especially physician-patient communication skills, proficiency in recording TCM medical history, the quality of medical records, and confidence in handling clinical work. As students, SSP-TCMs participated in the curricular training in a more interactive education format with specific objectives and valued the experience of portraying patients. They also acquired empathy from the perspective of patients. [23] Some features of SSPs may have contributed to these findings, and consequently, they can grant targeted and valuable feedback on communication delivery and student empathy to trainees.

As an emerging medical education tool, SP combined with feedback and reflection has formative benefits for improvement in clinical competence among medical trainees [30]–[31]. Through training, the combination of role-playing with feedback, repetitive practice, and faculty mentorship would improve session communication skills as a core competency [32]. Moreover, SSP-TCMs were more responsive to unexpected emergencies, showed active cooperation with clinical physical examination, and encouraged trainees to ask questions. Relative to OSP-TCMs, however, SSP-TCMs were more likely to offer implied guidelines and utilize medical jargon. This is in part due to the medical background of the SSP-TCMs and the realistic doctor role of the postgraduate SPs undergoing “Standardized Training for Residents” which may interfere with their simulation presentation.

Limitations

Enlisting graduate students with certain medical knowledge as SSP for teaching has many advantages in medical education. However, some limitations of this study warrant consideration. First, this study was performed in a single institution, and the potential systematic differences in the characteristics of trainees implied reduced external generalizability of the findings. Second, the medical background of SSP-TCMs would inevitably affect their performance in a pretend scenario. For instance, the use of medical terms in role-play simulations is frequent in the initial imitation but gradually decreases as they become more proficient at what they do. Third, the personnel has limited scope and quick turn-round. Graduate students’ mobility is so high that retraining a new batch of SSPs to cope with the graduation of the previous SSPs is required. Finally, the inevitable age limitations of the graduate students make the imitation of age-appropriate standardized patients difficult. The lack of diverse characters (like the elderly, infants, and pregnant women) reduces extrapolation to real-life scenarios. Therefore, well-trained occupational SPs need to be recruited to address these shortcomings.

Conclusion

The cultivation of clinical competency is an important pillar to be integrated into the entire TCM curriculum, and educators now face the difficulty of creating a learning environment that cultivates clinical practice skills in a highly efficient and productive manner. Simulation training with the SSP-TCMs and OSP-TCMs evidenced great benefits for enhancing clinical competency. Relative to OSP-TCMs simulation, SSP-TCM simulation was feasible, practical, and cost-effective. SSP-TCM simulation could serve as an alternative method for practicing, learning, evaluating, and testing. In the future, we want to assess the effects and differences of diverse types of SPs, like virtual standardized patients, for improvement in clinical competence among TCM medical students.

Data Availability

The data generated or analyzed during this study are available in this published article and its supplementary information files.

References

  1. Wilbur K, Elmubark A, Shabana S. Systematic review of standardized patient use in Continuing Medical Education [J]. J Contin Educ Health Prof. 2018;38(1):3–10.

    Article  Google Scholar 

  2. Willson MN, McKeirnan KC, Yabusaki A, Buchman CR. Comparing trained student peers versus paid actors as standardized patients for simulated patient prescription counseling. Explor Res Clin Soc Pharm. 2021;4:100081.

    Google Scholar 

  3. Issenberg SB, McGaghie WC, Petrusa ER, et al. Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teach. 2005;27(1):10–28.

    Article  Google Scholar 

  4. Kaddoura M, Vandyke O, Smallwood C, et al. Perceived benefits and challenges of repeated exposure to high fidelity simulation experiences of first degree accelerated bachelor nursing students. Nurse Educ Today. 2016;36:298–303.

    Article  Google Scholar 

  5. Shin S, Park JH, Kim JH. Effectiveness of patient simulation in nursing education: meta-analysis. Nurse Educ Today. 2015;35(1):176–82.

    Article  Google Scholar 

  6. McKenzie C, Tilashalski K, Peterson DT, et al. Effectiveness of standardized patient simulations in teaching clinical communication skills to dental students. J Dent Educ. 2017;81(10):1179–86.

    Article  Google Scholar 

  7. Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA. 2011;306(9):978–88.

    Article  Google Scholar 

  8. Stillman PL, Sawyer WD. A new program to enhance the teaching and assessment of clinical competencys in the People’s Republic of China. Acad Med. 1992;67(8):495–9.

    Article  Google Scholar 

  9. Carpenter JL. Cost analysis of objective structured clinical examinations. Acad Med. 1995;70(9):828–33.

    Google Scholar 

  10. Downar J, McNaughton N, Abdelhalim T, et al. Standardized patient simulation versus didactic teaching alone for improving residents’ communication skills when discussing goals of care and resuscitation: a randomized controlled trial. Palliat Med. 2017;31(2):130–9.

    Article  Google Scholar 

  11. Feickert JA, Harris IB, Anderson DC et al. Senior medical students as simulated patients in an objective structured clinical examination: motivation and benefits [J]. Med Teach, 1992, 14(2–3): 167 – 77.

  12. Smith LM, Keiser M, Turkelson C, et al. Simulated Interprofessional Education Discharge Planning Meeting to improve skills necessary for effective interprofessional practice. Prof Case Manag. 2018;23(2):75–83.

    Article  Google Scholar 

  13. Tankimovich M, Swails J, Hamburger M. Nurse practitioner and medical students’ perceptions of Teamwork before and after a standardized patient Pilot Simulation. Nurs Educ Perspect. 2020;41(3):171–3.

    Article  Google Scholar 

  14. Cortés-Rodríguez AE, Roman P, López-Rodríguez MM, et al. Role-play versus standardised patient simulation for teaching interprofessional communication in care of the elderly for nursing students[J]. Healthcare. 2021;10(1):46.

    Article  Google Scholar 

  15. Zhu X, Xiong Z, Zheng T, et al. Case-based learning combined with science, technology, engineering and math (STEM) education concept to improve clinical thinking of undergraduate nursing students: a randomized experiment. Nurs Open. 2020;8(1):415–22.

    Article  Google Scholar 

  16. Zeng J, Liang S, Zhang X, et al. Assessment of clinical competency among TCM medical students using standardized patients of traditional chinese medicine: a 5-year prospective randomized study. Integr Med Res. 2022;11(2):100804.

    Article  Google Scholar 

  17. Li N, Yu J, Mao X, Zhao Y, Huang L. The Research and Development thinking on the Status of Artificial Intelligence in Traditional Chinese Medicine. Evid Based Complement Alternat Med. 2022;2022:7644524.

    Google Scholar 

  18. Li ZG, Liang JS, Xie ZF, et al. WHO International Standard Terminologies on Traditional Medicine in the Western Pacific Region. World Health Organization; 2007.

  19. Stillman PL, Brown DR, Redfield DL, Sabers DL. Construct validation of the Arizona clinical interview rating scale. Educ Psychol Meas; 1977.

  20. Wang WD, Yang PC, Chen CY, et al. Using senior residents as standardized patients for evaluating basic clinical competencys of medical students. J Formos Med Assoc. 2004 Jul;103(7):519–25.

  21. Yuasa M, Nagoshi M, Oshiro-Wong C, Tin M, Wen A, Masaki K. Standardized patient and standardized interdisciplinary team meeting: validation of a new performance-based assessment tool. J Am Geriatr Soc. 2014;62(1):171–4.

    Article  Google Scholar 

  22. Mavis BE, Ogle KS, Lovell KL, et al. Medical students as standardized patients to assess interviewing skills for pain evaluation. Med Educ. 2002;36(2):135–40.

    Article  Google Scholar 

  23. Xi DENG, Jia-Mei TAN, Shu-Yuan PAN. Application of “Standardized Patient” and “Standardized Family” teaching model in Training Medical students’ doctor-patient communication skills [J]. J Shenyang Med Coll. 2019;21(05):486–8.

    Google Scholar 

  24. Han S, Gil et al. Virtual reality-based neurological examination teaching tool(VRNET) versus standardized patient in teaching neurological examinations for the medical students: a randomized, single-blind study.BMC medical educationvol. 21,1 493. 15 Sep. 2021.

  25. Shrestha R, Shrestha AP, Shrestha SK, et al. Interdisciplinary in situ simulation-based medical education in the emergency department of a teaching hospital in Nepal. Int J Emerg Med. 2019;12(1):19.

    Article  Google Scholar 

  26. Park Yoon Soo PhD, Hyderi Abbas MDMPH et al. Heine Nancy MEd RN ANP,. Validity Evidence and Scoring Guidelines for Standardized Patient Encounters and Patient Notes From a Multisite Study of Clinical Performance Examinations in Seven Medical Schools. 2017, 92 (11S): S12-S20.

  27. Bandura A. Guide for constructing self-efficacy scales. In: Pajares F, Urdan T, editors. Self-efficacy beliefs of adolescents. Charlotte, NC, USA: Information Age Publishing; 2006.

    Google Scholar 

  28. Lei WANG, Meng CAO, Lian-Cheng WANG, et al. Application of students as standardized patients in the teaching of orthodontics [J]. Basic Med Educ. 2020;22(04):274–7.

    Google Scholar 

  29. Bosse HM, Nickel M, Huwendiek S, Schultz JH, Nikendei C. Cost-effectiveness of peer role play and standardized patients in Undergraduate Communication Training. BMC Med Educ. 2015;15:183.

    Article  Google Scholar 

  30. Taylor DC, Hamdy H. Adult learning theories: implications for learning and teaching in medical education: AMEE guide no. 83. Med Teach. 2013;35(11):e1561–72.

    Article  Google Scholar 

  31. Schwartz A, Peskin S, Spiro A, Weiner SJ. Direct observation of depression screening: identifying diagnostic error and improving accuracy through unannounced standardized patients. Diagnosis (Berl). 2020;7(3):251–6.

    Article  Google Scholar 

  32. Berkhof M, van Rijssen HJ, Schellart AJ, et al. Effective training strategies for teaching communication skills to physicians: an overview of systematic reviews. Patient Educ Couns. 2011;84(2):152–62.

    Article  Google Scholar 

Download references

Acknowledgements

The authors wish to acknowledge Jiansheng Wu as senior SP trainers and colleagues from West China Medical Center of Sichuan University, for their support in the SP-TCM program. The authors also acknowledge to all the OSP-TCMs and SSP-TCMs in this program.

Funding

This work was supported by the program of education and teaching reform from Chengdu University of Traditional Chinese Medicine (grant nos. JGYB2018070 and JGYB2018005) and the education and teaching reform program from the Clinical Medical School of Chengdu University of Traditional Chinese Medicine (grant nos. JYJX202203, JYJX202208, JYJX202215 and JYJX202211), and by the research project from the National Center for TCM Education and Development (grant no. TC2021004) and the construction project of teaching reform and talent cultivation in higher education from the TCM Advisory Committee in Sichuan province (grant no. JZWYB202101).

Author information

Authors and Affiliations

Authors

Contributions

JZ, SL and XF wrote the main manuscript text. JZ and SL together prepared figures and tables, XF collated the data. QD and ZW performed the quantitative data analysis. XZ and SP assisted with interpretation of data and statistics. LW and WL provided technical or material support. JG, YB and SZ assisted in investigation process. YZ, JG and BL provided funding support, HY was responsible for conceptual framework and methodology, YZ provided supervision and project administration. YZ, BL and HY jointly contributed to the design of study and critical revision of the manuscript. All authors approved the final manuscript.

Corresponding authors

Correspondence to Bin Li, Han Yang or Yi Zhang.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the ethics committee of Chengdu University of TCM (no. 3801) and was conducted in accordance with the principles of the Declaration of Helsinki. Informed consent was obtained from all participants.

Consent for publication

Not applicable.

Competing Interest

All authors have no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zeng, J., Liang, S., Fu, X. et al. Student standardized patients versus occupational standardized patients for improving clinical competency among TCM medical students: a 3-year prospective randomized study. BMC Med Educ 23, 216 (2023). https://doi.org/10.1186/s12909-023-04198-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04198-0

Keywords