What is the impact of the COVID-19 pandemic on emergency medicine residency training: an observational study
BMC Medical Education volume 20, Article number: 348 (2020)
The coronavirus disease 2019 (COVID-19) pandemic has engendered difficulties for health systems globally; however, the effect of the pandemic on emergency medicine (EM) residency training programs is unknown. The pandemic has caused reduced volumes of emergency department (ED) patients, except for those with COVID-19 infections, and this may reduce the case exposure of EM residents. The primary objective of this study was to compare the clinical exposure of EM residents between the prepandemic and pandemic periods.
This was a retrospective study of EM resident physicians’ training in a tertiary teaching hospital with two branch regional hospitals in Taiwan. We retrieved data regarding patients seen by EM residents in the ED between September 1, 2019, and April 30, 2020. The first confirmed COVID-19 case in Taiwan was reported on January 11, so the pandemic period in our study was defined as spanning from February 1, 2020, to April 30, 2020. The number and characteristics of patients seen by residents were recorded. We compared the data between the prepandemic and pandemic periods.
The mean number of patients per hour (PPH) seen by EM residents in the adult ED decreased in all three hospitals during the pandemic. The average PPH of critical area of medical ED was 1.68 in the pre-epidemic period and decreased to 1.33 in the epidemic period (p value < 0.001). The average number of patients managed by residents decreased from 1.24 to 0.82 in the trauma ED (p value = 0.01) and 1.56 to 0.51 in the pediatric ED (p value = 0.003) during the pandemic, respectively. The severity of patient illness did not change significantly between the periods.
The COVID-19 pandemic engendered a reduced ED volume and decreased EM residents’ clinical exposure. All portion of EM residency training were affected by the pandemic, with pediatric EM being the most affected. The patient volume reduction may persist and in turn reduce patients’ case exposure until the pandemic subsides. Adjustment of the training programs may be necessary and ancillary methods of learning should be used to ensure adequate EM residency training.
Coronavirus disease 2019 (COVID-19) is a novel viral disease that has spread rapidly and become a global pandemic. Health care systems worldwide have struggled to cope with the pandemic and prepare for a surge of patients with respiratory tract infections. In Taiwan, the emergency department (ED) patient volume has dropped with the progression of the pandemic. Similar situations have been noted in several countries in Europe and some states in the United States [1,2,3,4,5]. This drop can be attributed to people’s fear of being infected and being a burden on the health care system, as reported in multiple countries . Additionally, people staying at home due to the quarantine policy of government or fear of COVID-19 infection may lower the traffic accidents, non-COVID infectious diseases, sports injuries, etc. This also caused decreased ED volume.
Studies have reported the effect of the COVID-19 pandemic on residency training programs in urology, surgery, and ophthalmology [6,7,8,9]. The rapid decrease in clinical and surgical activities has posed challenges to residency training programs in several specialties. The pandemic has also affected the mental health of residents, which may further interfere with their clinical learning [10, 11]. Emergency physicians have been at the frontline of the pandemic; nevertheless, according to our review of the relevant literature, studies have yet to be conducted on the effect of the pandemic on emergency medicine (EM) residency training. The reduced ED volume caused by the pandemic may affect EM residents’ clinical case exposure, thus engendering insufficient clinical experience. The extent of case exposure reduction is unknown. To address this knowledge gap, the present study explored the effect of reduced ED volume on EM residency training; the findings may provide suggestions to EM educators regarding the change in the learning conditions of EM residents during the pandemic.
This was a retrospective study of EM resident physicians’ training during the COVID-19 pandemic. To evaluate the effect of the COVID-19 pandemic on EM residency training programs, we divided the study period into two periods: prepandemic and pandemic periods. The first confirmed COVID-19 case in Taiwan was reported on January 11, 2020, and the larger outbreak began in February 2020. The EM training rotation is structured by month; therefore, the pandemic period in our study was defined as spanning from February 1, 2020, to April 30, 2020. The EM training year began on September 1, 2019; hence, the prepandemic data were considered as those obtained between September 1, 2019, and January 31, 2020. The study was approved by our institutional review board (IRB no. 202000945B0).
Study setting and population
The study was conducted at a university-affiliated tertiary teaching hospital with a 3600-bed capacity and an estimated annual ED volume of 180,000 patient visits. Two branch hospitals with an estimated ED volume of 48,000 and 78,000 patient visits were also included. The three hospitals are located in three different cities in northern Taiwan.
The ED has 63 board-certified EM faculty members and conducts an EM training program for 7–10 resident physicians annually. The training residents rotate among the three hospitals—namely one general hospital in Linkou and two branch hospitals in Taipei and Keelung—on a monthly basis. The general hospital in Linkou is a tertiary medical center, and the branch in Keelung and that in Taipei are regional hospitals. Table 1 presents the patient groups seen by residents enrolled in different rotations. The general hospital has an adult ED and a pediatric ED. The adult ED includes a medical ED and trauma ED. The medical ED has care facilities for patients with triage acuity levels 1 and 2 and facilities for patients who require critical care. In the general hospital, residents see new patients in the medical ED critical care area, trauma ED, and pediatric ED according to their EM rotations. In branch hospitals, EM residents see adult patients with trauma or nontrauma conditions. At the time of study, the EM residency program involved 3.5 years of training, including 2-month trauma ED and 2-month pediatric ED rotations, in the general hospital, according to the criteria stipulated by the Taiwan Society of Emergency Medicine.
The study included data from September 1, 2019, to April 30, 2020. The electronic medical record system was queried, and a database with the following information was generated: patient gender, patient age, patient triage acuity level, the first physician seen, and disposition. Only the data of patients who were first seen by residents were included in the study. Resident shift schedules were reviewed, and working hours were calculated.
Data on new patients seen by residents during the prepandemic period were compared with those of patients seen by residents during the pandemic period. The main outcome was the average number of patients seen by residents per hour during the prepandemic and pandemic periods. The demographic characteristics and triage acuity levels of patients seen by residents were also compared. Data on different training courses were analyzed separately.
Data were analyzed using SPSS software (version 13.0 for Windows; SPSS Inc., Chicago, IL, USA). Regarding descriptive statistics, categorical variables are presented as numbers and percentages. The recorded patient visits during the prepandemic and pandemic periods were compared using the Mann–Whitney U test for continuous variables and Pearson’s chi-square or Fisher’s exact tests for categorical variables. A p value of < 0.05 was considered statistically significant.
The data collected from the three hospitals for the 8-month study period comprised more than 175,000 ED visits. A total of 51,337 patients were managed by 36 EM residents during the 8-month study period. Figure 1 presents the number of ED visits in each month. Figure 1a shows the patient volumes of the three hospitals. The ED volumes of the three hospitals exhibited similar trends, namely decreased volume since February 2020. We observed that the average patient volume per month decreased by more than 30% in all three hospitals during the pandemic period. The volumes of different EDs at the general hospital are presented in Fig. 1b; similarly, we noted a reduction in patient volumes. The patient volumes of the medical ED, trauma ED, and pediatric ED decreased clearly during the pandemic period. The patient volume during the pandemic period was nearly half and one-third of that during the prepandemic period in the trauma ED and pediatric ED, respectively.
In the adult EDs of the Taipei and Keelung branches, the mean number of patients seen by residents during the pandemic period decreased relative to that during the prepandemic period (Table 2). The patients per hour (PPH) seen by residents in the Taipei and Keelung branches differed significantly between the prepandemic and pandemic periods. The average PPH of Taipei branch was 2.32 in the pre-epidemic period and decreased to 1.77 in the epidemic period (p = 0.006). In the Keelung branch, the average PPH was 2.30 in the pre-epidemic period and dropped to 1.89 in the epidemic period (p < 0.001). We observed similar analysis results for the general hospital. The average PPH seen by residents in rotations in the medical ED critical care area (from 1.68 to 1.33, p < 0.001), trauma ED (from 1.24 to 0.82, p = 0.01), and pediatric ED (from 1.56 to 051, p = 0.003) during the pandemic period were significantly lower than those recorded during the prepandemic period.
The demographic characteristics of patients seen by residents in the Taipei and Keelung branches were analyzed. In Taipei branch, the percentage of patients with triage acuity levels 1 and 2 was higher during the pandemic period (4.88%) than it was during the prepandemic period (3.92%) (Table 3). A similar result was noted in Keelung branch, which the percentage of acuity 1 and 2 were 9.8 and 10.4% in pre-epidemic period and the epidemic period respectively. The admission rate during the pandemic period relative to that during the prepandemic period was substantially higher in the Keelung branch (from 22.86 to 26.21%) but only slightly higher (from 6.95 to 7.14%) in the Taipei branch. In the general hospital, the percentage of patients with triage acuity levels 1 and 2 did not differ between the two periods in the medical ED critical care area, but the admission rate increased from 56.84 to 61.31% (p < 0.001) during the pandemic period (Table 4). Similar results were obtained for such patients in the pediatric ED, which admission rate increased from 19.63 to 24.15% (p = 0.04). In the trauma ED, no significant difference was noted in the percentage of patients with either triage acuity level or the admission rate between the two periods.
The objective of EM residency training is to enhance residents’ knowledge and breadth of clinical experience. Specifically, the primary goal of EM residency training programs is to ensure that residents gain the required clinical experience to master the knowledge and clinical skills necessary to practice EM . Case exposure based on seeing a variety of patients with varying acuity levels, chief complaints, and diagnoses is crucial for the development of comprehensive experience [13,14,15]. Our study demonstrated that the decrease in ED volume caused by the COVID-19 pandemic significantly affected the case exposure of EM residents. Inadequate clinical exposure may hinder residents in attaining clinical competency and experiencing core EM diagnoses . The adequate patient volume recommended for EM residency training is unknown; nevertheless, previous studies have reported that 15,000 annual ED visits to a training hospital and 1.1–1.4 PPH on average for trainees are reasonable [14, 17, 18]. The PPH for residents in the adult ED decreased significantly during the pandemic period relative to that during the prepandemic period. However, if the pandemic persists, the long-term effect of the change in patient volume on resident training is unknown. Although the ED volume was lower during the pandemic period, the severity of illness in patients visiting the ED did not increase significantly as expected. Training in the management of critically ill patients is essential for emergency physicians, and the training would be affected by the number of patients seen during the pandemic period . Accordingly, a monitoring system for assessing residents’ case exposure regularly is necessary during the COVID-19 pandemic .
Our study revealed that the pediatric patient volume was most affected during the pandemic period. The volume of patients seen by residents during the pandemic period was less than half of that observed during the prepandemic period. The acuity level of patients remained unchanged during the pandemic period. Fear of having COVID-19 or getting infected by the virus in the hospital could be a reason for parents not bringing their children to the hospitals. The importance of pediatric training in EM residency programs has been mentioned in previous reports, but the sufficiency level of training is inconclusive [16, 20, 21]. Previous surveys have revealed that EM faculties perceived that they were less prepared to manage pediatric patients than they were for managing adult patients . Decreased pediatric case exposure in EM training during the pandemic period could exacerbate the issue of insufficient pediatric training of EM residents. Revising the EM training course to increase pediatric training time should be considered if the reduction in pediatric patient volume persists; however, such an adjustment may affect other portions of EM residency training programs. Ancillary methods, such as web-based learning and high-fidelity simulation, may help toward pediatric EM training during the pandemic period [23,24,25,26].
The volume of trauma patients also dropped during the pandemic period in our study. Possible reasons for this drop are people’s reduced frequency of leaving the house because of fear of COVID-19 and quarantining of high-risk groups. A decrease in trauma patient volume reduces the number of emergency procedures performed by residents and reduces residents’ experience in managing trauma patients, which can lead to poor educational outcomes of traumatology training . Although the magnitude of decrease in trauma patient volume was not as high as that observed for the volume of pediatric patients, close observation and evaluation by senior doctors are necessary to ensure that traumatology training is sufficient for EM residents.
At the time of writing, the COVID-19 pandemic continues to be a global health crisis. Reduced ED volumes are continuing to be noted in hospitals worldwide. Our study may serve to remind EM educators to evaluate their resident training programs during the pandemic. Along with addressing the pandemic and handling the surge of respiratory tract infection cases, regular EM residency training with other EM core diagnoses should be considered. Some study had proposed several innovative solutions may help sustain training for other subspecialty during the pandemic . It included the flipped classroom model, online practice questions, teleconferencing in place of in-person lectures, involving residents in telemedicine clinics, procedural simulation, and the facilitated use of videos. These methods may be used to maintain EM residency training. Adjusting training programs and adding ancillary training methods may be necessary to ensure adequate training for EM residents.
This study has several limitations. First, because our study was retrospective and was limited to three hospitals in a single country; hence, selection bias may exist and it may not be representative to situations in other hospitals worldwide. The effect of the COVID-19 pandemic may vary in different countries; additional data from other coun7tries are thus required to further evaluate EM education during the COVID-19 pandemic in other countries. Second, A so-called “wash-out period”, which indicates the transition period from pre-epidemic to epidemic condition, was not reflected in our study. Although the effect of wash-out period existed, it was difficult to define the actual date of this period and included into the study. Third, seasonal and temporal factors which may affect ED volume were not included in our study. These factors may cause some differences. Finally, our study mainly focused on the role of clinical exposure in EM residency training. For clinical exposure, the case diversity was also important. Our data did not include patient presentation, diagnosis, and prognosis, and comparison of these factors was not available and the effect was unknown. Although case exposure cannot be replaced by other ancillary methods, it is not the only measure of EM residency training., our study did not assess educational outcomes between the prepandemic and pandemic periods and did not investigate the effect of the reduced level of case exposure during the pandemic on residents’ learning. Further research is necessary to compare the two periods with respect to other indicators to derive a complete assessment of residents’ clinical training and performance.
The COVID-19 pandemic engendered reduced ED volume, thus reducing the clinical exposure of EM residents during their training. All portions of EM training were affected by the pandemic; the effect of the pandemic on pediatric EM was the most severe because of a profound decrease in pediatric patient volume. If the COVID-19 pandemic persists, its effect on residents’ training could lead to poorer EM educational outcomes compared with the outcomes observed during the prepandemic period. The learning conditions of EM residents must be regularly monitored and assessed. Adjustments to EM residency training programs may be necessary, and ancillary methods of EM learning would be helpful in the scenario of a prolonged pandemic.
Availability of data and materials
The dataset supporting the conclusions of this article is included within the article. The data in this study are available from the corresponding author upon reasonable request.
Coronavirus disease 2019
Patients per hour
Laura E, Wong JEH, Langness S, Murrell KL, Iris P, Sammann A. Where are all the patients? Addressing Covid-19 fear to encourage sick patients to seek emergency care. N Engl J Med. https://catalyst.nejm.org/doi/full/10.1056/CAT.20.0193.
Bjørnsen LP, Næss-Pleym LE, Dale J, Laugsand LE. Patient visits to an emergency department in anticipation of the COVID-19 pandemic. Tidsskr Nor Laegeforen. 2020;140(8). https://doi.org/10.4045/tidsskr.20.0277. Print 2020 May 26.
Daniele Coen CP, Cavazza M, Cervellin G, Bellone A, Perlini S, Casagranda I. Changing emergency department and hospital organization in response to a changing epidemic. Emerg Care J. 2020;16:8969.
Guo H, Zhou Y, Liu X, Tan J. The impact of the COVID-19 epidemic on the utilization of emergency dental services. J Dent Sci. 2020. online ahead of print.
COVID-19 Webinar: a unique insight in highly impacted countries. Sharing experiences of high COVID-19 impact countries. The European Society for Emergency Medicine. Available from: https://academy.eusem.org/eusem/2020/covid-19/290502/session.speakers.covid-19.webinar.a.unique.insight.in.highly.impacted.countries.html?fmenu=8*browseby=8*sortby=2*label=19798.
Mishra D, Nair AG, Gandhi RA, Gogate PJ, Mathur S, Bhushan P, et al. The impact of COVID-19 related lockdown on ophthalmology training programs in India - outcomes of a survey. Indian J Ophthalmol. 2020;68(6):999–1004.
Amparore D, Claps F, Cacciamani GE, Esperto F, Fiori C, Liguori G, et al. Impact of the COVID-19 pandemic on urology residency training in Italy. Minerva Urol Nefrol. 2020;72(4):505–9.
Chick RC, Clifton GT, Peace KM, Propper BW, Hale DF, Alseidi AA, et al. Using technology to maintain the education of residents during the COVID-19 pandemic. J Surg Educ. 2020;77(4):729–32.
Porpiglia F, Checcucci E, Amparore D, Verri P, Campi R, Claps F, et al. Slowdown of urology residents' learning curve during the COVID-19 emergency. BJU Int. 2020;125(6):E15–E17.
Khanna RC, Honavar SG, Metla AL, Bhattacharya A, Maulik PK. Psychological impact of COVID-19 on ophthalmologists-in-training and practising ophthalmologists in India. Indian J Ophthalmol. 2020;68(6):994–8.
Zhang Y, Ma ZF. Impact of the COVID-19 Pandemic on Mental Health and Quality of Life among Local Residents in Liaoning Province, China: A Cross-Sectional Study. Int J Environ Res Public Health. 2020;17(7):2381.
Douglass A, Yip K, Lumanauw D, Fleischman RJ, Jordan J, Tanen DA. Resident clinical experience in the emergency department: patient encounters by postgraduate year. AEM Educ Train. 2019;3(3):243–50.
Langdorf MI, Strange G, Macneil P. Computerized tracking of emergency medicine resident clinical experience. Ann Emerg Med. 1990;19(7):764–73.
DeBehnke D, O'Brien S, Leschke R. Emergency medicine resident work productivity in an academic emergency department. Acad Emerg Med. 2000;7(1):90–2.
Wadman MC, Fago B, Hoffman LH, Tran TP, Muelleman RL. A comparison of emergency medicine resident clinical experience in a rural versus urban emergency department. Rural Remote Health. 2010;10(2):1442.
Lewis RJ. The Society for Academic Emergency Medicine position on pediatric care in the emergency department. Acad Emerg Med. 2003;10(11):1299.
Deveau JP, Lorenz JE, Hughes MJ. Emergency medicine resident work productivity and procedural accomplishment. J Am Osteopath Assoc. 2003;103(6):291–6.
Reames J, Handel DA, Al-Assaf A, Hedges JR. Rural emergency medicine: patient volume and training opportunities. J Emerg Med. 2009;37(2):172–6.
Goldstein RS. Management of the critically ill patient in the emergency department: focus on safety issues. Crit Care Clin. 2005;21(1):81–9 viii-ix.
Counselman FL, Babu K, Edens MA, Gorgas DL, Hobgood C, Marco CA, et al. The 2016 model of the clinical practice of emergency medicine. J Emerg Med. 2017;52(6):846–9.
Ludwig S, Fleisher G, Henretig F, Ruddy R. Pediatric training in emergency medicine residency programs. Ann Emerg Med. 1982;11(4):170–3.
Langhan M, Keshavarz R, Richardson LD. How comfortable are emergency physicians with pediatric patients? J Emerg Med. 2004;26(4):465–9.
Chang TP, Pham PK, Sobolewski B, Doughty CB, Jamal N, Kwan KY, et al. Pediatric emergency medicine asynchronous e-learning: a multicenter randomized controlled Solomon four-group study. Acad Emerg Med. 2014;21(8):912–9.
Hindle A, Cheng J, Thabane L, Wong A. Web-based learning for emergency airway Management in Anesthesia Residency Training. Anesthesiol Res Pract. 2015;2015:971406.
Kornegay JG, Leone KA, Wallner C, Hansen M, Yarris LM. Development and implementation of an asynchronous emergency medicine residency curriculum using a web-based platform. Intern Emerg Med. 2016;11(8):1115–20.
Christian MR, Sergel MJ, Mycyk MB, Aks SE. Comparison of high-Fidelity medical simulation to short-answer written examination in the assessment of emergency medicine residents in medical toxicology. Mo Med. 2017;114(5):396–9.
Ahmed N, Devitt KS, Keshet I, Spicer J, Imrie K, Feldman L, et al. A systematic review of the effects of resident duty hour restrictions in surgery: impact on resident wellness, training, and patient outcomes. Ann Surg. 2014;259(6):1041–53.
This research received no funding and there are no conflicts of interest to declare. This research was supported by Chang-Gung Memorial Hospital. We are thankful to our colleagues who provided their expertise, which greatly assisted the research, although they may not agree with all the interpretations provided in this paper.
This research received no funding.
Ethics approval and consent to participate
The study was approved by the institutional review board of the Chang-Gung Memorial hospital, Taiwan (IRB no. 202000945B0).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: the authors deleted the Additional file 1.
About this article
Cite this article
Lo, HY., Lin, SC., Chaou, CH. et al. What is the impact of the COVID-19 pandemic on emergency medicine residency training: an observational study. BMC Med Educ 20, 348 (2020). https://doi.org/10.1186/s12909-020-02267-2
- Emergency medicine