- Open Access
Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum
BMC Medical Education volume 22, Article number: 352 (2022)
While clinical competency is crucial for traditional East-Asian medical education, available studies on the educational system for fostering clinical performance are scarce. This study aimed to review the educational system, curriculum, facilities, and management of current traditional East-Asian medicine in a well-established university of Korea and develop a Best Practice Framework (BPF) of clinical competency education.
The clinical competency education system in Pusan National University School of Korean Medicine was systematically described through 5 steps of governance of the educational system, competency of the graduates, educational resources, assessment strategies and tools, and gaps in the curriculum. We also reviewed the experiences in education and the points to be improved.
The Office of Traditional Korean Medicine Education governs the development, implementation, and evaluation of the educational curriculum for cultivating students’ clinical competency. Medical students have undertaken 39 modules of clinical biomedicine and 21 of traditional medicine during the clinical clerkship courses in an affiliated hospital, Clinical Skill Practice Center, clinical research center, practice lab for medical herb, and other locations. After training, 15 modules of simulated clinical training using standardized patients, students’ clinical competency are evaluated by a Clinical Performance Test using a Clinical Performance Examination (CPX) and an Objective Structured Clinical Examination (OSCE) for biomedical and traditional medical skills.
A clinical competency framework is required for a qualified physician of traditional East-Asian medicine. This study reviewed the current well-organized educational system of Korean traditional medicine in detail, which can be used for the BPF of competency-based clinical education. We expect the current study to be a representative reference for establishing an educational system of traditional medicine such as acupuncture and medical herbs in other countries.
The shift to Competency-based Medical Education (CBME) that emphasizes actual clinical performance has brought about many clinical skills education and evaluation changes. The goal of medical education has been relocated from learning knowledge in classrooms and textbooks, as “what students know”, to acquiring clinical competency in real life as “what they can do” . In Miller’s pyramid , which is widely used as a framework for evaluating clinical competence, “shows how” and “does” are superordinate to “knows” and “knows how.” This means that clinical competency should be evaluated by measuring not only knowledge, but also skills and attitudes such as clinical performance and communication .
Nowadays, patients want qualified care from well-trained medical professionals with up-to-date medical knowledge and proficient clinical expertise [4, 5]. Therefore, the medical education for prospective clinicians should provide advanced knowledge, efficient skills, and sufficient experience that would lower the risk of medical malpractice and accidents and increase the possibility of precise diagnosis and adequate treatment [5, 6]. In that respect, Objective Structured Clinical Examination (OSCE) and Clinical Performance Examination (CPX) are intensely used in most medical schools to teach and evaluate the clinical competency of medical students.
The OSCE was improvised by Harden and co-authors in 1975 [7, 8], making students perform clinical skills on manikins or standardized patients within an allocated time . Numerous medical schools around the globe have introduced the OSCE to evaluate the clinical competency of their students [10, 11] after its incorporation as clinical skills education by Dundee University of United Kingdom . The CPX evaluates clinical procedures of medical history recordings, physical examinations, differential diagnoses, prescriptions, and patient education using simulated clinical settings and the standardized patient . The standardized patient was developed by Prof. Barrows of the University of California in 1963, and the CPX was implemented for students at the University of Southern Illinois School of Medicine in 1985. The CPX and OSCE, along with the standardized patient, are widely used to evaluate medical practitioners’ medical knowledge, clinical skills, and attitude in medical education [13,14,15,16].
As for the nationally recognized qualification examination, the use of OSCE and CPX as clinical competence tests have been expanded. In the United States, these tests were introduced to evaluate foreign medical school graduates in 1998 and comprised the clinical skill test, along with using the standardized patient for United States Medical Licensing Examination (USMLE) step 2 from 2004. Furthermore, the Japanese Kyoyo test for 2 years of clinical training also comprised an OSCE from 2005 [6, 17,18,19].
In Korea, medical schools of biomedicine have installed clinical competency education and tests using OSCE and CPX for third and fourth graders after finishing core clinical clerkship programs  to evaluate academic achievements and secure clinical competency .
The OSCE and standardized patients were introduced by Seoul National University College of Medicine in 1994 and 1996, respectively [22, 23], and administered as a major part of the National Licensing Examination of Korean biomedical doctors in 2009 [17, 24]. Subsequently, all 40 Korean medical schools of biomedicine have used OSCE and CPX as pivotal clinical education and evaluation programs to nurture medical students’ clinical competence  under the systematized long-term plan since 2009 [6, 20, 25]. Therefore, graduates appraise these educational experiences as beneficial for nurturing clinical proficiency and self-confidence [26, 27]. Additionally, hospital residents consider the experiences of OSCE and CPX as valuable in becoming competent clinical specialists .
The clinical competency test as a part of the Korean National Licensing Exam has been introduced for dental doctors from 2021; in upcoming years, it will also be introduced for the doctors of traditional Korean medicine . Likewise, Taiwan established clinical competency tests in the national exam as an imminent goal , and China allegedly started clinical competency tests for traditional medicine .
The Incorporation of clinical competency tests into the National Licensing Exam represents the implementation of CBME in traditional medicine. Hence, it is important to establish the competencies required to have the knowledge, skills, and attitudes required for a traditional medical doctor and provide an appropriate education system for fostering these. To implement CBME, adequate teaching, assessment strategies, and resources must be prepared, and governance in charge of the overall educational system is needed [30, 31].
The Korean version of clinical competency education and evaluation in traditional East-Asian medicine (Table 1) has been implemented by the Pusan National University (PNU) School of Korean Medicine . After providing the outline (2007) and draft (2008) of clinical skills education as part of the curriculum development, the detailed action plan and textbooks “‘Guidebook for Clinical Skills”  and “Guidebook for Clinical Procedures”  were finalized in 2010 [17, 32, 34]. The clinical competency education consisted of OSCE, CPX, and standardized patients; the Clinical Performance Test program has been working successfully since 2011, and this system was adopted by three Korean colleges of traditional medicine [35,36,37].
Although the clinical use of medical herbs and acupuncture is a subject of great interest worldwide, relevant studies on the efficient and organized educational system for cultivating clinical competency of traditional East-Asian medicine remain scarce . In this context, the present study aims to develop a Best Practice Framework (BPF) of clinical competency education using the case of one traditional Korean medicine school.
The governance of clinical education, steering bodies, facilities, academic calendar, the curriculum, textbooks, educational modules, experiences from the operation, and items to be improved will be shared and discussed.
We hope that this study will provide practical experiences of traditional medicine education to be considered as a reference or guide by countries and colleges looking for the established clinical education.
The current study systematically reviewed structured clinical competency education of traditional Korean medicine that has been practiced for a decade in the School of Korean medicine, PNU. The clinical competency education in there includes OSCE and CPX along with ten modules of Problem-Based Learning (PBL), however it was not included in this study for its focusing on the differential diagnosis rather than hands-on skills. The clinical education system, clinical skills and procedure education, and Clinical Performance Test consisting of OSCE and CPX were showed using five steps of BPF.
Step 1. As for the governance of the educational system, the organizational structure and responsibilities of the Office of Traditional Korean Medicine Education (OTKME) were detailed.
Step 2. The clinical competency of the graduates as a result of clinical education was described.
Step 3. Educational resources, including practice rooms and guidebooks, were reviewed. The utilization of practice rooms such as the Clinical Skill Practice Center (CSPC), the Clinical Skill Simulation Room (CSSR), the Acupuncture Practice Room (APR), and the Practice Lab for Medical Herbs (PLMH) was also presented. The contents of the clinical education were reviewed in two perspectives of clinical skills and procedures, which were detailed in the “Guidebook for Clinical Skills”  and the “Guidebook for Clinical Procedures” , respectively. A comprehensive review was provided on the educational curriculum and learning issues such as clinical skills, an academic calendar, instructors, an educational curriculum, and standardized patients for clinical procedures.
Step 4. Assessment strategies and tools used for evaluating students’ clinical competency in traditional Korean medicine were illustrated. The agenda, governance, question items, and evaluation criteria of the Clinical Performance Test (CPT) that inspect the proficiency of clinical skills and procedures using OSCE and CPX were presented. Furthermore, the detailed processes for testing clinical competency related to acupuncture needling and the processing of medical herbs were also provided, considering their importance for the education of traditional medicine.
Step 5. Gaps in the clinical curriculum to be improved were described.
Governance of the educational system
The OTKME is the central body of development and evaluation of the curriculum, research on teaching-learning methods, management of human resources, equipment and consumables, supervising the educational curriculum for clinical education (Table 1), and others. The OTKME is also in charge of publishing the textbooks “Guidebook for Clinical Skills”  and “Guidebook for Clinical Procedures” , training and utilizing standardized patients, and supervising the use of the CSPC , the Acupuncture Practice Room (APR) and the Medical Herbs Practice Room. They organize and operate the CPT, support the PBL classes, manage the web server for Computer-based Tests (CBT), and receive feedback from students on the curriculum and other items.
The OTKME is controlled by a chairperson and three full-time officers and has two steering bodies; the Steering Committee of OTKME, which discusses curriculum, budget, admission, and graduation issues, and the Steering Committee of Research Program, which supervises the students’ research programs. There also are two committees, including the Committee for Teaching-Learning Method Development and the Committee for Curriculum Assessment for improving the quality of traditional medical education in general.
Clinical competencies of the graduates
There are five core competencies designated for the clinical education of traditional Korean medicine as follows.
The procedures and methods for keeping the clinical setting clean and sterile.
The accurate practice of physical examination on patients.
The correct administration of traditional medical diagnosis and appropriate explanation of its results to the patients.
Safe and effective performance of acupuncture, moxibustion, cupping, and pharmacopuncture.
Proficient preparation, processing, and prescription of medical herbs.
The CSPC, with a space of 118.29m2, has 17 kinds of human manikins and body models, beds for Chuna Manual Therapy, inspection devices  of ultrasound, electrocardiogram, ryodoraku, and more for teaching clinical skills and procedures. CSPC also has two CSSR with a one-way mirror and closed-circuit recording system, which are equipped with devices for teaching procedures of abdominal examination or physical examinations using standardized patients (Fig. 1). It also has consumables, e.g., tongue depressors, cotton swabs, hand sanitizer, disinfected gloves, acupuncture needles and more, for learning and practicing clinical skills and procedures free of charge.
The APR has nine beds and several types of acupuncture needles and moxibustions to teach needling practice to students. The APR is equipped with a video recording system and big-screen TVs to enlarge the instructors’ needling techniques and procedures. The PLMH allows students to examine the texture, taste, and smell of textbook-listed medical herbs and also has electric heating and boiling appliances, a distributor, a freeze dryer, a pill-making machine, and other items for practicing processing and boiling techniques.
There is a “Guidebook for Clinical Skills” for efficient implementation and management of clinical education, revised annually by the academic staffs. The Guidebook has 4 chapters of medical examination (26 modules), clinical tests and questionnaires (12 modules), clinical techniques (18 modules), and medical herbs (4 modules). In other words, it provides 60 modules of clinical skills (Table 2) with preparation, explanation of skills, references, supplementary checklists, and scoring criteria for self-directed preparation of clinical proficiency tests or CPT .
Development of clinical competencies in the clinical curriculum
Teaching and learning strategies
The evidence-based teaching on traditional medicine through the development of curriculum, class module, and teaching methods has been implemented in Korea [40,41,42,43,44], and the educational system of biomedicine with proven efficacy, e.g., integrated block lecture in clinical courses, PBL, OSCE and CPX, modified to include clinical modalities of traditional East-Asian medicine were adopted in PNU. Furthermore, issue-centered group debate programs, replication of previous clinical studies, and introductive courses using animation characters  have been developed to increase the quality and efficacy of traditional medicine education [5, 40, 46].
After completing the curriculum for medical theories and knowledge with didactic classes, a total of 24 (20 + 2 + 2) weeks of clinical education in affiliated hospitals are prepared for the clinical clerkship program and education of clinical skills and procedures (Table 1). The clinical skills and procedures education are pivotal for efficient training of medical professionals that would have effective and safe diagnosis and treatments, professional and humanistic communication and relationship with patients, decreased incidence of medical accidents, and maximized patient satisfaction [47, 48]. These are required as crucial competencies of primary care physicians, and medical students of traditional Korean medicine are learning clinical skills and procedures of both traditional medicine and biomedicine.
Ten weeks are allocated to the later part of the second semester of third grade and 14 weeks to the earlier part of the first semester of fourth grade. Twenty weeks are allocated for 56 clinical modules (Table 2), case reviews, and clinical observations on major diseases in 8 clinical departments of internal medicine, acupuncture and moxibustion, ear, nose and throat and dermatology, pediatrics, obstetrics, and gynecology, Sasang constitutional medicine, rehabilitation and neuropsychiatry at an affiliated traditional Korean medicine hospital. Two weeks are assigned for 4 clinical modules (Table 2) related to the processing of medical herbs, making a decoction, boiling, freeze-drying and manufacturing pills, and preparing pharmacopuncture solutions. Finally, 2 weeks are used for the research ethics and clinical research design at the affiliated clinical research center.
Clinical skills education is usually implemented by hospital staffs and residents at CSPC and/or an affiliated hospital. For example, clinical staff of the rehabilitation department at the affiliated hospital teach Chuna manual technique for posterior inferior ilium deviation during their lecture on physical examination of cervical and lumbar vertebrae. Generally, 4 h of class time are allocated for each clinical technique, and group or individual practice after school might be done at CSPC.
Sixty modules of clinical skills (Table 2) described in the guidebooks cover biomedicine (39 modules) and traditional medicine (21 modules) altogether. Thirty-nine biomedicine modules (Table 2) can be categorized into the medical examination (23 modules), clinical tests (6 modules), clinical techniques (10 modules), and 21 traditional medicine modules. (Table 2) includes medical examination (3 modules), clinical tests (6 modules), clinical techniques (8 modules), and medical herbs (4 modules).
There are clinical skill modules for traditional medicine, e.g., pulse diagnosis, tongue diagnosis, acupuncture needling, moxibustion, making and boiling herbal decoction, and preparing pharmacopuncture solution (Table 2), which might represent the characteristic features of traditional medical education. These are newly developed to achieve efficient and structured clinical education as biomedicine does.
The pulse diagnosis module makes the students learn the appropriate posture of body and position of fingers, and the tongue diagnosis module teaches shape and color of the tongue, presence of the white coat, degree of wetness as patterns, and profiles as used in clinics. The education of acupuncture techniques is provided by the department of acupuncture and moxibustion as five modules of filiform acupuncture needling, moxibustion treatment, cupping therapy, pharmacopuncture, and needle-embedding therapy (Table 2). These modules refer to previous didactic lectures on Clean Needle Technique , location and characteristics of acupuncture points, acupuncture therapies, and needling techniques. Unlike other clinical skill modules, four modules on medical herbs (Table 2) are provided by academic staffs of herbology and pharmacognosy for 2 weeks in PLMH. These are crucial techniques required for primary care focused on local clinic management .
Although the department of acupuncture and moxibustion provides training in treating effects of cerebrovascular disease, spinal and joint problems, and facial paralysis that requires specialized needling techniques, the acupuncture treatments of major diseases are provided by eight clinical departments during the 20-week clinical clerkship (Table 1). Medical students are required to observe the clinical practices of academic staffs and exercise clinical skills of acupuncture and moxibustion by themselves to be proficient [5, 50].
During the 24 weeks of clinical skill education, the medical students are trained to be proficient in clinical skills and exercise by themselves to be prepared for CPT using the “Guidebook for Clinical Skills” as a reference and manual. The OTKME might assign time slots for using CSPC, APR, and PLMH as a team or individually for the students’ afterschool practice.
Simulated clinical experience program with standardized patients
After completing 24 weeks of clinical skill education, 1 week of the Simulated Clinical Experience (SCE) program (Fig. 1) using simulated clinical setting and standardized patient provides an opportunity for medical students to learn and improve clinical procedures (Table 1). Standardized patients can provide simulated clinical situations with the desired level of difficulty at any time and any place. In addition, they also may express different types of physical and emotional responses to questions and attitudes of medical students, as well as provide objective feedback on students’ clinical proficiency [51, 52].
The SCE program consists of 15 modules, including dizziness, coughing, insomnia, low back pain, and more (Table 3), easily found in primary care clinics. In addition, the “Guidebook for Clinical Performance” also has corresponding 15 chapters containing history taking, physical examination procedures, differential diagnosis, syndrome identification, patient education, schemas for problem-solving, supplementary information, and references for each module .
Ten minutes at the CSSR are assigned to the SCE modules with the standardized patient, and students would have 6 occurrences of 15 SCE modules. The students would receive multidimensional feedback on their clinical performance from fellow students (peer perspective), standardized patients (doctor-patient perspective), and academic staffs (teaching/learning perspective), as well as practice by themselves to prepare for the CPT on 15 CSE modules with the help of the guidebook.
The standardized patients of the current SCE program are trained personnel who act as patients during the 15-h scenario training by OTKME; they can also participate in educational programs of other medical schools.
Assessment strategy and tools
Clinical performance test
The purpose of the two-day CPT program is to evaluate the clinical competency of medical students in clinical skills, techniques, and procedures after 25 weeks of clinical education (Table 1) which has 60 modules of clinical skills (Table 2) and 15 modules of clinical procedures (Table 3). If a student scores below 60 in CPT, he or she must take and pass the test next year.
One set of the test (Table 4) for six student examinees is composed of CPX (3 items, 10 min/item), OSCE (6 items, 5 min/item), acupuncture point location, and placing needles (2 items, 7 min/item), and preparation and processing of medical herbs (1 item, 10 min/item); it takes a total of 120 min including waiting time for each examinee.
There are 10 test rooms with an assigned academic staff for evaluation and observation from other medical schools; the test questions are posted on the doors to be checked by students before entering the room. The examinees may use pencils only and wear their name tags on their chests.
The examinee and examiner may request to stop the test when an emergency occurs, after which the process of the CPT program is paused until the issue or situation is resolved. Examinees with physical or mental disabilities would be assigned at the end of the CPT, and 50% more time would be provided for each test item.
The evaluation criteria and checklists for the CPT program were previously distributed as included in the “Guidebook for Clinical Skills” and the “Guidebook for Clinical Performance,” and the student examinees can prepare for the CPT program on their own with sufficient time. The range of points assigned for each CPT test item is 10 to 24 depending on their difficulty and complexity, and the evaluator scores 0–2 points to each predefined evaluation checklist element.
As for the evaluation checklist of the filiform acupuncture needling module, all processes are to be checked. These include explaining the treatment scheme to the patients, selecting proper acupuncture points for a specific symptom, Clean Needle Technique, placing the needle on acupuncture points, ensuring appropriate posture during the needling, manipulation techniques of reinforcing and reducing for getting deqi, and adequate disposal of used needles, as described in the guidebooks.
Clinical performance examination and objective structured clinical examination
The current CPT program uses six randomly selected items from 60 OSCE modules (Fig. 2) and three items from 15 CPX modules (Fig. 3) trained during clinical education. The CPX and OSCE were incorporated to substantiate the clinical competency of primary care practitioners in medical history taking, physical and clinical examination, clinical reasoning and diagnosis, and effective communication with patients.
The student examinee checks the clinical problem of the standardized patient or the specific clinical skill posted on the door of each test room (1 min before entering) and presents their required clinical competency (Fig. 2) using prearranged devices and consumables. There is the preparation alarm 2 min before the closing alarm which makes the examinee move to the next test room. The examinee can only leave the assigned test room after the closing alarm regardless of whether they have already completed the presentation.
Regarding the CPX, the examinee should obtain clinical information using a physical examination of biomedicine (Fig. 3) and/or four diagnostic methods of traditional medicine, make a correct diagnosis based on acquired clinical evidence, and provide the necessary explanation of the diagnosis to the patients.
As for the clinical information, the student examinee should perform the required number of examinations and get predefined clinical evidence for the standardized patient, which would be used for the scoring. However, as for physical examinations of biomedicine not available with a standardized patient, e.g., digital rectal examination and gynecological bimanual examination, the standardized patient hands over papers with test results when the examinee explains the diagnosis to the patient. Furthermore, the clinical information from tongue and pulse diagnoses of traditional East-Asian medicine will be given accordingly by the standardized patient when the examinee properly follows the clinical procedure.
The clinical skills of traditional medicine comprising acupuncture needling (Fig. 4) and medical herb handling are examined separately after completing the CPX and OSCE, as discussed in the next chapters.
Assessment of competence in acupuncture
Six student examinees are grouped into three same-sex subgroups, and each subgroup takes two assignments to attest their clinical competency in point location and acupuncture needling. A total of 15 min is allocated for the test in APR; 7 min would be used for each assignment, and 1 min for changing roles of the practitioner and patient between subgroup members (Table 4). The examinees use their subgroup members (Fig. 4-A) as patients for needling or a manikin (Fig. 4-B) in case of private location or possible bruising, e.g., perineum (CV1), abdomen (CV4), and face (ST2).
The academic staffs of the acupuncture department score the clinical skills, including point location, depth and angle of the needling, manipulation techniques, disposal of used needles, and the Clean Needle Technique . The assignments cover diverse areas, including standard treatment for common diseases, clinical characteristics of major points, and combination of points in Sa-am Acupuncture and Tae-Geuk Acupuncture, along with the modules listed in the “Guidebook for Clinical Skills.”
Assessment of competence in processing and preparation of medical herbs
Six student examinees are grouped into two subgroups; one subgroup takes a test to examine clinical competency in processing medical herbs and making decoctions, while the other subgroup waits outside. Each examinee would perform one of three assignments selected from four modules listed in the “Guidebook for Clinical Skills” during 10 min in the PLMH as shown in Table 4.
Academic staffs of herbology and pharmacognosy department evaluate examinees’ clinical knowledge and techniques. These include hand washing and wearing gloves for personal hygiene, safety rules to prevent accidents, cleaning of raw herbs and prevention of contamination, procedures for modifying clinical properties of medical herbs, as well as the use of appliances and devices, including boiling pots, the freeze-dryer, and the powder-maker.
Gaps in the curriculum
There are several gaps in the current clinical curriculum of traditional medicine. The lack of skill modules to be used in the clinical education of traditional medicine and the need to develop other CPX scenarios and modules for diseases commonly encountered in clinics should be recognized. Furthermore, the acquisition of clinical skills is crucial for students’ clinical competency, but patient-physician interaction (PPI) also requires sufficient time for practice. It is important not only to maintain the difficulty level of each station but also for the evaluators to evaluate the same student’s performance consistently. Finally, oral, informal, formal, descriptive, evaluative, peer, and self-assessed feedback and the currently written one should be considered for the quality improvement of clinical education.
In recent years, the epicenter of medical education has shifted from memorizing medical knowledge to fostering clinical competency and proficiency , and the education of traditional East-Asian medicine is vigorously trying to incorporate this trend . Education of traditional Korean medicine is currently considering a transfer from paper-based tests on memorized knowledge to smart device-based multidimensional tests on clinical competency . The inclusion of clinical skills and procedures assessment in the National Licensing Examination for traditional medicine is actively considered [54, 55]. Highly qualified medical professionals with the desired knowledge, skills, and attitudes are a particularly great concern of traditional East-Asian medicine, and experiences with elaborated medical education of traditional Korean medicine are valuable at this point [5, 17, 56].
In this context, we reviewed the clinical competency education system implemented at PNU using BPF in five steps. As for the governance, although the role of the OTKME was satisfactory, the absence of experts in the OTKME should be improved. For better CBME, experts qualified with research experience and research methodology for evidence-based teaching in medical education must be placed at OTKME.
This study systematically reviewed 24 weeks of clinical skills education with clinical clerkship, 1 week of focused training using simulated clinical setting, and a two-day CPT program for evaluating comprehensive clinical competency and proficiency in traditional Korean medicine education implemented a decade ago (Table 1). There were 75 essential clinical competencies covering biomedicine and traditional medicine, required for primary care traditional medical practitioners, and these were standardized as an academic module for clinical education (Tables 2 and 3). Furthermore, it was also revealed that the teaching and evaluation using OSCE and CPX were successfully installed for traditional medicine education [36, 57] with high satisfaction (4.2 and 4.3 out of 5) of medical students [17, 56], and other colleges of Korean medicine are now considering these as a reference.
Other colleges of traditional Korean medicine, unlike PNU with full establishments, are actively enhancing the education system, facilities, curriculum, and staff to improve clinical competency. The OSCE module is being developed by each clinical society, while the CPX module is being developed individually by each university. Eleven out of 12 Korean medical schools implement CPX, and six universities use standardized patients . Wonkwang University launched the Center for Clinical Skills (2014), and provides clinical training programs, e.g., writing medical charts, medical examinations using the virtual patient, and point location and acupuncture needling; this is accomplished during the hospital clerkship period which is limited to 3 months. Daejeon University has the Clinical Center for Clinical Skills and the Guidebook for Clinical Skills and simulated clinical training , but the CPT is not established. Wooseok University uses the Center for Clinical Skills (2014) for clinical skills education and evaluation; however, the education and evaluation on simulated clinical training is implemented only for OSCE .
The importance of clinical competency has been emphasized likewise in other East-Asian countries and nations with traditional medicine nationally recognized and included as public health, e.g., China, Taiwan and Japan have been encouraging clinical skills education in their traditional medicine.
China allegedly introduced the clinical skills test to the National Licensing Examination for traditional Chinese medicine in 1999, and several universities were reported to have clinical education using standardized patients since 2004 . The examination was designed to evaluate the clinical competency of medical professionals in five categories of differential diagnosis, acupuncture, cupping, tuina (Chuna), and clinical examination . However, detailed reports on clinical skills and procedures education in traditional Chinese medicine universities are not available for review.
Furthermore, Taiwan introduced OSCE to the Professional and Technical Exam for biomedicine doctors in 2013 and considered the same for traditional Chinese medicine. Taiwan aspires to be the first nation to introduce OSCE to the qualification exam of traditional medicine, even though only medical knowledge is appraised at present . The educational universities are using their own evaluation criteria to evaluate students’ clinical competency in traditional Chinese medicine.
As for Japan, the doctor of biomedicine can prescribe herbal medicine even with limited education on traditional Kampo medicine; 90% of medical schools have introductive courses with an average duration of 16.2 ± 8.8 h that might be compared to the 80 h of traditional Chinese medicine courses at Chinese biomedicine universities. Therefore, official clinical competency education for traditional medicine is not provided during the medical school years, and clinical proficiency may be acquired after graduation .
This study provided an educational program for competency-based clinical education, which would be the first step in developing a BPF, and there might be a plausible model for traditional medicine by exploring the stakeholder’s perspective and educational outcomes. This has not been achievable in the traditional medicine of other countries; however, with the experience in Korea, patients’ health might be improvement substantially.
Traditional Korean medicine is now preparing transition to competency- and outcome-based medical education . It is about to apply the new standard of a Korean medicine education evaluation and certification system called KAS2021, which strengthens clinical competency . Moreover, the National Licensing Examination of traditional medicine will implement clinical competency tests in the coming years. The clinical education of traditional Korean medicine systematically presented in the current study could serve as a valuable example to be considered as a reference for nations planning to inaugurate or refurbish their educational system of traditional medicine.
Considering the present status of traditional medicine, the clinical competency education program reviewed in the current study has worth establishing organized clinical competency education for East-Asian traditional medicine. However, there are also issues to be tackled for improving the quality of clinical competency education and filling the gaps.
First, the development of refined educational modules for diverse traditional medical modalities is required. The module for pulse diagnosis in the current study consists of simple checks on posture of body, the position of the finger, and simple rhythm of pulse , and should be upgraded to include the syndrome differentiation with pulsation using fingertips of student examinees. It would require considerable resources to develop and implement sophisticated and accurate instruments mimicking the human pulse wave [60,61,62]. In addition, clinical skills modules for unique Korean clinical modalities of Sa-am acupuncture  and Tae-Geuk acupuncture  would enhance the clinical competency of future medical professionals.
Second, more modules for clinical procedures are required for the clinical competency of students as primary care physicians . Clinical procedure modules for the traditional Korean Sasang typology using objective measures of the Questionnaire for Sasang Constitution Classification, Sasang Personality Questionnaire , Sasang Digestive Function Inventory , and Sasang Urination Defecation Inventory  would be beneficial for the clinicians. Likewise, clinical procedures with medical herbs and acupuncture for frequent diseases of primary care clinics would be needed .
Furthermore, since the student examinees focused only on the required activities and easily ignored the proper attitude toward the standardized patient (Fig. 3), the emphasis on the PPI along with clinical skills should be placed throughout education and evaluation .
Third, as for managing the CPT program, a training program for evaluators to increase inter-rater reliability is strongly required. The scoring of verbal communication, interview and patient teaching need skilled and experienced attention, unlike physical examination with distinctive evaluation criteria . At present, 5 and 10 min are uniformly (Table 4) allocated to OSCE and CPX modules, respectively, regardless of subject, complexity, and difficulty, and a more efficient and organized evaluation program might be achieved by rearranging test items and redistributing time allocation.
Fourth, retraining clinical procedures using more direct and objective feedback is required. The three types of feedback students receive in the SCE program enable them to evaluate their own clinical performance objectively. However, written feedback can be difficult to immediately improve clinical performance. More sophisticated corrections can be made if the professor and fellow students provide feedback while watching the student’s clinical performance video in a place dedicated to feedback, such as a debriefing room.
Last but not least, a contingency plan for sudden incidents and detailed preparation for disabled examinees should be prepared. The Korea Health Personnel Licensing Examination Institute, which currently governs clinical competency examination for biomedicine and would do the same for traditional medicine, provides an extension of time allocation and assistants during the clinical skills test in accordance with their guidelines for accommodation to examinee with disabilities . In our experience, there was a case in 2016 when a student examinee with prosthetic hand on one arm successfully completed the clinical skills test of point location and acupuncture needling with the help of assistant provided by OTKME.
The current study aimed at reviewing governance of the educational system, competency of the graduates, educational resources, assessment strategies and tools, and gaps in the curriculum in the established School of Korean Medicine, using BPF of clinical competency education which has not been reported previously. This study will be a reference or guide for other countries and colleges considering restoring and upgrading the clinical education system of their native traditional medicine.
Availability of data and materials
The datasets used during the current study available from the corresponding author on reasonable request.
Best Practice Framework
Competency-based medical education
Objective Structured Clinical Examination
Clinical Performance Examination
United States Medical Licensing Examination
Pusan National University
Office of Traditional Korean Medicine Education
Clinical Skill Practice Center
Clinical Skill Simulation Room
Acupuncture Practice Room
Practice Lab for Medical Herbs
Clinical Performance Test
Computer Based Test
Simulated Clinical Experience
Hodges BD. Sea monsters & whirlpools: Navigating between examination and reflection in medical education. Med Teach. 2015;37(3):261–6.
Miller GE. The assessment of clinical skills/competence/performance. Acad Med. 1990;65(9):S63–7.
Im SJ. Assessment in Outcome-Based Education. KMER. 2013;15(1):25–30.
Han JJ et al. An OSCE for summative assessment after clinical clerkship -experience in Ewha medical school. Korean J Med Educ. 2004;16(1):33–40.
Han SY, et al. The past, present, and future of traditional medicine education in Korea. Integr Med Res. 2016;5(2):73–82.
Kim SM, et al. Improvement in clinical performance of interns and residents through clinical skills assessment of the Korean Medical Licensing Examination. Korean J Med Educ. 2012;24(4):329–38.
Harden R, et al. Assessment of clinical competence using objective structured examination. Br Med J. 1975;1(5955):447–51.
Harden RM, Gleeson F. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ. 1979;13(1):39–54.
Kam B-S. Design and implementation of video feedback system to improve student ‘s perceptions about their clinical skills assessment. Pusan National University: Pusan; 2014.
Patricio MF, et al. Is the OSCE a feasible tool to assess competencies in undergraduate medical education? Med Teach. 2013;35(6):503–14.
Harden RM. Revisiting ‘Assessment of clinical competence using an objective structured clinical examination (OSCE)’. Med Educ. 2016;50(4):376–379.
Davis MH. OSCE: the Dundee experience. Med Teach. 2003;25(3):255–61.
Kim N-C. The standard setting of clinical performance examination (CPX) by modified angoff, bookmark, and item-descriptor matching(IDM) method. 2010, Ewha Women’s university Graduate School: Seoul.
Lee CA, et al. Standardized patient-narrated web-based learning modules improve students’ communication skills on a high-stakes clinical skills examination. J Gen Intern Med. 2011;26(11):1374–7.
Park S-M, et al. Impact of clinical performance examination on incoming interns’ clinical competency in differential diagnosis of headache. Korean J Fam Med. 2014;35(2):56–64.
Barrows HS. Problem-based, self-directed learning. JAMA. 1983;250(22):3077–80.
Sim SB, et al. Student satisfaction study of clinical skills training in Korean medical education. J Korean Med. 2013;34(3):37–53.
Martin IG, Jolly B. Predictive validity and estimated cut score of an objective structured clinical examination (OSCE) used as an assessment of clinical skills at the end of the first clinical year. Med Educ. 2002;36(5):418–25.
Dent J, Harden RM, Hunt D. A practical guide for medical teachers. 5th ed. 2017, Amsterdam: Elsevier Health Sciences.
Kam B, Lee SY, Im SJ. Level of third-year students’ competency and correlating curricular factors. Korean Med Educ Rev. 2013;15(2):87–92.
HwangBo M, Park J-H. A Study on the necessity of strengthening clinical practice education. J East-West Med. 2018;43(1):49–61.
Ahn HS. The experience of operating OSCE for clinical education evaluation. Seoul: Seoul National University Press; 1995.
Lee B-G. Current status of the standardized patient programs in Korea and plans to develop and improve the program. Korean J Med Educ. 2001;13(1):27–40.
Jun KA, Shin SY. Analysis of first clinical skills examination in the Korean medical licensing examination: focus on examinees’ experience in a medical school. Korean J Med Educ. 2011;23(3):203–7.
Keum DY. Development of CPX/OSCE curriculum for Medical License Examination. Keimyung Med J. 2009;28:63–74.
Lee YH, et al. The change of CPX scores according to repeated CPXs. Korean J Med Educ. 2011;23(3):193–202.
Park H. Clinical skills assessment in Korean Medical Licensing Examination. Korean J Med Educ. 2008;20(4):309–12.
Kang Y. A Study on the Improvement of the National Examination for the Competence Based Evaluation of Korean Medicine. Korea Health Personnel Licensing Examination Institute: Seoul; 2015.
Chen YL, et al. Educational efficacy of objective structured clinical examination on clinical training of traditional Chinese medicine - A qualitative study. Complement Ther Clin Pract. 2015;21(3):147–53.
Yoon C-H, Myung SJ, Park WB. Implementing competency-based medical education in internal medicine residency training program: the process and impact on residents’ satisfaction. J Korean Med Sci. 2019;34(29).
Fraser AB, Stodel EJ, Chaput AJ. Curriculum reform for residency training: competence, change, and opportunities for leadership. Can J Anesth. 2016;63(7):875–84.
Student Clinical Education Committee. Guidebook for Clinical Skills. Busan: Pusan National University School of Korean Medicine; 2016.
Student Clinical Education Committee. Guidebook for Clinical Performance. Busan: Pusan National University School of Korean Medicine; 2016.
Kweon JH, et al. Evaluation of the implementation of clinical performance examination in Korean medicine education. J Physiol Pathol Korean Med. 2018;32(1):51–61.
Min B. Clinical education strengthen capacity to meet primary medical care. The Korean Medicine Times.
Sebastian B, Nelms J. The effectiveness of emotional freedom techniques in the treatment of posttraumatic stress disorder: A meta-analysis. Explore. 2017;13(1):16–25.
Jo H-J and Min S-H. The current status and future operations of Clinical Performance Evaluation (CPX) in the nationwide colleges (graduate schools) of Traditional Korean Medicine JKMH. 2020;33(2):9–21.
Gray AC, Steel A, Adams J. A critical integrative review of complementary medicine education research: key issues and empirical gaps. BMC Complement Altern. Med. 2019;19(1):1–20.
Park J, Jee SY, HwangBo M. A study on the activation measures of clinical practice using clinical practice room. J East-West Med. 2019;44(1):17–27.
Lee SJ, et al. Development of experiment and practice curriculum for the traditional Korean psychobiology and Sasang medicine. J Physiol Pathol Korean Med. 2011;25(2):352–8.
Davies P. What is evidence-based education? Br J Educ Stud. 1999;47(2):108–21.
Jang YJ, et al. Analysis of effectiveness with therapeutic Qigong lecture: using the results of lecture assessment questionnaire. J Physiol Pathol Korean Med. 2013;27(4):471–480.
Hwang S-M, et al. Study on the prerequisite Chinese characters for the education of traditional Korean medicine. J Korean Med Class. 2011;24(5):147–58.
Lee B-R, et al. Study on the acupoints use in acupuncture & moxibustion textbook. J Acupunct Res. 2010;27(5):125–34.
Lee J, et al. Teaching Yin-Yang biopsychology using the animation "Pororo the Little Penguin". 2020;33:101037.
Lee S-J, et al. Development of issue-centered small-group debate program for the introduction to traditional Korean medicine. J Physiol Pathol Korean Med. 2011;25(2):326–33.
Hur Y, et al. Changes in medical students’ patient-centeredness attitudes by implementation of clinical performance examination. Korean J Med Educ. 2014;26(2):99–106.
Yang S-J, Park K-M, Cho S-H. The Analysis of Satisfaction with Clinical Training and the Related Factors in the Korean Medicine Obstetrics and Gynecology. J Korean Obstet Gynecol. 2020;33(1):116–27.
Koo ST, et al. Safety Guide for Acupuncture treatment. 1st ed. Seoul: Koonja; 2011.
Yearbook Publication Commission. 2015 Year Book of Traditional Korean Medicine. Seoul: The association of Korean Medicine; 2016.
Choi Y-H, et al. The use of standardized patients in medical education. Korean J Med Educ. 2000;12:353–61.
Blue AV, Chessman AW. Responding to patients’ emotions: important for standardized patient satisfaction. Fam Med. 2000;32(5):326–30.
Min B. The national licensing examination for KMD is changing in line with the global medical examinations. The Korean Medicine Times. 2016.
Hong C. The promotion of introduction of computer-based test using smart device. The Minjok Medicine News. 2014.
Min B. Korean Health Personnel Licensing Examination Institute developed app to practice the Table PC-based test. The Korean Medicine Times. 2016.
Cho H-W, et al. The analysis of satisfaction with clinical training and the related factors-especially in oriental rehabilitation medicine. J Soc Prev Korean Med. 2012;16(2):1–15.
Cho C-S. Student satisfaction study and interrater comparative study on patient-physician interaction score of clinical performance examination in Korean medical education. J Physiol Pathol Korean Med. 2015;29(2):152–9.
Myeong YS, Ahn SY, Son CG. Education for a traditional medicine in medical schools in Japan. Korean J Acupunct. 2016;33(1):12–7.
Jo N-Y, Jo H-J. Curating the Korean Medical Classics Curriculum with a Focus on Its Introductory Role to Clinical Korean Medicine. J. Korean Med. Class. 2021;34(2):1–22.
Min S, et al. A review on development trends of arterial pulse simulators. J Korea Instit Orient Med Diagn. 2012;16(2):1–10.
Kim K-S, et al. Study on pulse simulator of oriental medicine for Objective Structured Clinical Examination (OSCE). J Korean Med. 2011;32(1):1–11.
Heo H. A Study on Modeling of a Representative Pulse Quality and Development of Pulse Wave Simulator in Traditional Korean Medicine. Yonsei University: Seoul; 2016.
Lee SY, Youn HM, Lee IS. A Study on the basic forms and principles of Saam’s 5 Phases of acupuncture method. J Acupunct Res. 2007;24(1):39–47.
Chae H, et al. Personalized acupuncture treatment with Sasang typology. Integr Med Res. 2017;6(4):329–36.
Lee SJ, et al. Biopsychological traits of Sasang typology based on Sasang personality questionnaire and body mass index. BMC Complement Alternative Med. 2014;14(1):315.
Lee J, et al. Biopsychological and pathophysiological features of Cold-Heat subgroup of Sasang typology with Sasang Digestive Function Inventory, Sasang Personality Questionnaire and Body Mass Index. Integr Med Res. 2018;7(1):68–76.
Park YG, et al. Development and validation of Sasang Urination and Defecation Inventory (SUDI) for pathophysiological symptoms of Sasang typology. Integr Med Res. 2019;8(2):82–8.
Jo H-J, Jo N-Y. Developing a Standardized Patient Program using Internal Damage Fever Cases in Korean Medical Education. J. Korean Med. Class. 2020;33(4):33–56.
Wentzell DD, et al. Competency-based medical education in ophthalmology residency training: a review. Can. J. Ophthalmol. 2020;55(1):12–9.
Korea Health Personnel Licensing Examination Institute. Guidelines for the convenience of applicants with disabilities in medical examinations. Seoul: Korean Health Personnel Licensing Exam Institute; 2016.
All methods were performed in accordance with the Declaration of Helsinki.
This work was supported by a 2-Year Research Grant of Pusan National University.
Ethics approval and consent to participate
Not Applicable. Human participants, human material or human data were not involved in current study. For this reason, the informed consent is not required, and there is no need to be reviewed by the institutional review board.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Han, S.Y., Lee, SH. & Chae, H. Developing a best practice framework for clinical competency education in the traditional East-Asian medicine curriculum. BMC Med Educ 22, 352 (2022). https://doi.org/10.1186/s12909-022-03398-4
- Medical education
- Traditional East-Asian medicine
- Clinical competency
- Best practice framework (BPF)
- Objective Structured Clinical Examination (OSCE)
- Clinical performance examination (CPX)