Impact of simulation-based teamwork training on COVID-19 distress in healthcare professionals
BMC Medical Education volume 20, Article number: 515 (2020)
Non-technical skills such as leadership, communication, or situation awareness should lead to effective teamwork in a crisis. This study aimed to analyse the role of these skills in the emotional response of health professionals to the COVID-19 pandemic.
Before the COVID-19 outbreak, 48 doctors and 48 nurses participated in a simulation-based teamwork training program based on teaching non-technical skills through simulation. In May 2020, this group of professionals from a COVID-19 referral hospital was invited to participate in a survey exploring stress, anxiety, and depression, using the PSS-14 (Perceived Stress Scale) and the HADS (Hospital Anxiety and Depression Scale) measures. A control group that did not receive the training was included. We conducted a logistic regression to assess whether having attended a simulation-based teamwork training program modified the probability of presenting psychological distress (PSS-14 > 18 or HADS> 12).
A total of 141 healthcare professionals were included, 77 in the intervention group and 64 in the control group. Based on the PSS-14, 70.1% of the intervention group and 75% of the control group (p = 0.342) had symptoms of stress. Having contact with COVID-19 patients [OR 4.16(1.64–10.52)]; having minors in charge [OR 2.75 (1.15–6.53)]; working as a doctor [0.39(0.16–0.95)], and being a woman [OR 2.94(1.09–7.91)] were related with PSS14 symptoms. Based on the HADS, 54.6% of the intervention group and 42.2% of the control group (p = 0.346) had symptoms of anxiety or depression. Having contact with COVID-19 patients [OR 2.17(1.05–4.48)] and having minors in charge [OR 2.14(1.06–4.32)] were related to HADS symptoms. Healthcare professionals who attended COVID-19 patients showed higher levels of anxiety and depression [OR 2.56(1.03–6.36) (p = 0.043)].
Healthcare professionals trained in non-technical skills through simulation tended towards higher levels of anxiety and depression and fewer levels of stress, during the COVID-19 pandemic.
On March 11, 2020, the World Health Organization declared the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) outbreak a pandemic disease . Emotionally traumatic experiences such as this pandemic can cause stress-related disorders [2, 3]. Indeed, we previously reported that 65% of a Spanish sample of 5000 individuals reported anxiety or depressive symptoms during the COVID-19 outbreak .
Healthcare professionals (HP) are a high-risk population group since they have faced a huge challenge and psychological stress, anxiety, and depression from pandemics [5, 6]. Indeed, given the critical situation that we are experiencing, HP who are directly involved in the diagnosis, treatment, and care of COVID-19 patients may develop symptoms related to psychological suffering that can trigger other mental health symptoms.
The unique nature of intense working relationships in crises requires not only technical skills but also non-technical competencies related mainly to leadership, communication, and situation awareness . To prepare people for these scenarios, simulation-based teamwork training (SBTT) becomes an essential resource, since it should help to develop the skill and competency of HP to cope with the stress associated with emergencies and disasters . Contexts of education and professional practice have profound effects on the substance and quality of learning outcomes and on how professional competence is expressed clinically . SBTT offers learning in a safe container with a high-fidelity psychological environment, without repercussion on the patient. In addition to training non-technical skills, the acute stress responses in SBTT do not differ when comparing with real situations . Besides, it has been observed that in simulation scenarios, biological stress markers are detected  and that the performance of the team in stressful situations is a function of the non-technical skills of the leader . This suggests that simulation can be a powerful ally to prepare HP for better coping in stressful situations, even showing a decrease in work stress levels in nurses from intensive care units, keeping the positive effects at 6 months of follow-up .
COVID-19 has become the biggest health crisis in decades and has become a stressful context for HP. There is a lack of knowledge about the impact of an SBTT intervention on stress, anxiety, and depression levels in this health emergency. This work aims to study the effect of an SBTT program on stress, anxiety, and depression levels during the onset of the COVID-19 crisis in HP.
This was a prospective observational cohort study to determine the effect of having received an SBTT on stress, anxiety, and depression levels. The study was carried out in a single tertiary hospital. With the declaration of COVID-19 as a pandemic, our hospital became a COVID-19 reference centre, admitting more than 2700 patients during the first two months.
All HP who had received an SBTT, 48 doctors and 48 nurses from different medical specialties, were invited to participate in a psychological survey and were designated as the intervention group (IG). The control group (CG) was built by inviting to participate 134 HP who had no contact with simulation training.
The Vall Hebron Advanced Clinical Simulation centre (VHiSCA), has conducted three editions (from November 2019 to March 2020), of an SBTT instructor course, 32 HP having participated in each one. The course had a mixed design with a total of 25 h and was divided into online (13 h) and on-site practical part (12 h). As VHISCA has just started the formation with HP we had implemented it with medical practitioners and not with delegates yet. The main objectives were to provide basic knowledge on healthcare simulation, to provide skills to be a simulation instructor, to acquire non-technical skills management, and to master briefing and debriefing. From our SBTT instructor course database we know that only 9% of the participants had taken a simulation instructor course prior to the intervention.
Stress, anxiety and depression instrument
A Survey format was designed including two scales. The Hospital Anxiety and Depression Scale (HADS) [14, 15] was applied to assess the level of anxiety and depression. The HADS has been widely used in the clinical setting and has been validated for the Spanish population  and demonstrated an optimal internal consistency and test-retest reliability in the Spanish non-clinical population . It is composed of 14 items and evaluates 7 items for each dimension. In this study, scores > 12 were considered positive for anxiety and depression domain . A 12–15 cut-off could be appropriate for a non-clinical population  with a sensibility and specificity of over 70% . The Perceived Stress Scale-14 (PSS-14) [18, 19] was used to evaluate stress. This scale has 14 items that evaluate stress perceived in the last month. Both scales have already been used in studies with HP [20, 21] and responded with a four-point Likert scale. Based on previous literature [16, 18, 19] we analysed groups with cut-off scores, HADS> 12 and PSS14 > 18.
Data collection and ethical approval
After approval by the ethical committee of Vall d’Hebron University Hospital (PR (AG)261/2020), and within the third month of the pandemic, HP were invited to participate in the study through corporate email. Informed consent was asked, and data was obtained anonymously. The survey was first sent to the IG. To collect data for the CG, participants were asked to invite a co-worker with no experience in simulation to participate.
For the descriptive analysis, categorical data are shown as frequency and percentage, and differences between groups were analysed using the chi-square test. For continuous variables, normal distribution was tested by the Kolmogorov-Smirnov test; data following a normal distribution is shown as mean and standard deviation and differences were analysed using the Student’s t-test.
Effect sizes for continuous variables were analysed using the between-group mean difference (95% confidence interval). Logistic regression was used to assess whether having attended the simulation-based teamwork training program modified the probability of having stress, anxiety, or depressive symptoms. The effects of sex, age, working with COVID-19 positive patients, having minors in charge, being married and professional category were considered. Sub-analyses were performed based on exposure to COVID-19. The statistical significance level was set at p < 0.05. Statistical software packages STATA 15.1 was used for all data analyses.
A total of 141 HP completed the online survey, 77 (80.2%) in the IG, and 64 (47.8%) in the CG. The demographic characteristics of both groups are shown in Table 1.
In the IG, the HADS score mean was 14.23 (SD 7.41) and in the CG was 12.08 (SD 6.66), mean difference − 2.15 (95% CI -4.52 – 0.22). Based on the HADS, 54.6% of the IG and 42.2% of CG (p = 0.346) had symptoms of anxiety or depression. Significant differences were observed only in HP in contact with COVID-19 patients (p = 0.037) and having minors in charge (p = 0.033) (Table 2).
PSS-14 score mean was 23.92 (SD 8.65) in the IG and 24.33 (SD 9.00) in the CG, mean difference 0.41 (95% CI -2.54 – 3.36). Based on the PSS-14, 70.1% of the IG and 75% of the CG (p = 0.342) had symptoms of stress. Significant differences were observed in HF in contact with COVID-19 patients (p = 0.003), having minors in charge (p = 0.022), working as a doctor (p = 0.038), and being a woman (p = 0.033) (Table 2).
Based on previous results, we performed a sub-analysis only with HP who had attended COVID-19 patients (n = 88), 51 (58%) in the IG, and 37 (42%) in the CG Healthcare professionals that had attended COVID-19 patients showed higher levels of anxiety and depression [OR 2.56 (1.03–6.36) (p = 0.043)]. (Table 3).
This study provides results about the impact of an SBTT program on stress, anxiety, and depression in HP during a crisis. We found that in the IG when they were exposed to COVID-19 care patients, they suffered more anxiety and depression levels (HADS) than the HP who did not receive the education SBTT program. To our knowledge, this is the first study focusing on mental health symptomatology on SBTT participants.
HP taking care of patients with COVID-19 are at risk of developing psychological distress and other mental health symptoms . Numerous psychiatric or psychological departments, psychological counselling centres, and university psychology units have launched specialized programs to attend HP in hospitals, through telematics systems, telephone lines, and apps, to provide psychological treatment in crisis. In this context, we found that HP who have received an SBTT program presented more anxiety and depression when dealing with COVID-19 patients. Firstly, higher perception and awareness levels are observed after SBTT , and usually, these professionals are more involved and committed in education tasks in hospitals, entailing otherwise more responsibility tasks. Another study found similar results showing a relationship between awareness attitude, anxiety experience, and perceived mental health care needs in the community during the COVID19 pandemic . Secondly, collective efficacy was independently associated with flow in simulation practice, but no significant results were found for stress and self-esteem .
As in our study conducted in the general population , we observed that individuals with minors in charge and women had higher anxiety and depressive symptoms. Besides, we also found that HP who worked with COVID-19 patients had more symptoms of stress, anxiety, and depression, and women had more symptoms of stress probably related to the working environment, huge workload, long-term fatigue, infection threat, and frustration with the death of patients whom they care. There is evidence that healthcare simulation improves healthcare performance and degree of retention of what is learned when compared to all traditional teaching methods . Our study results show that the emergency together with the knowledge of these abilities by part of the entire working group may be determining factors for the psychological state of the skills previously trained by using SBTT.
Despite that, it is necessary to keep working on stress levels in HP during the simulation and in real settings. Simulation educators need to create scenarios that purposely change stress to enhance learning as it was found that psychological stress and anxiety is greater during simulation compared with hospital settings . The intervention used is a faculty training programme rather than a simulation based education programme for delegates. Subsequent research should focus on studying the degree of distress that students present in crisis situations based on the profile of the educator. Besides, health professions education programs must build student competencies in the affective domain of learning .
For this reason, it is crucial to be able to train professionals, promoting skills through SBTT that increases job security and reduces levels of distress generated in crises, both in technical aspects (performing cardiopulmonary resuscitation, placement of line or tube, tracheostomy, etc.) as in non-technical skills (communication, situational awareness, etc.) because stress triggers diseases and increases health resources.
Strengths and limitations
Study strengths are that it is the first study focus on stress, anxiety, and depression in simulation instructors after a pandemic, and it combined different new areas never studied before, such as professional’s health and simulation training after COVID-19.
We acknowledge that our survey has several limitations. Firstly, there is likely to have been a degree of selection bias in the CG. Secondly, the number surveyed varied greatly between the two groups. Thirdly, we cannot rule out the presence of residual confounders.
HP trained in non-technical skills as simulation instructor had a tendency towards higher levels of anxiety and depression and fewer levels of stress, during the COVID-19 pandemic, being significant in the case of anxiety and depression in HP who directly attended COVID-19 patients. Studies with structured interventions, randomized controlled trials, with larger homogeneous samples, can provide more information. Therefore, more studies with these characteristics should be done before being able to conclude the effectiveness of simulation-based techniques.
Availability of data and materials
The datasets used and/or analyzed the current study are available from the corresponding author on reasonable request.
Cucinotta D, Vanelli M. WHO declares COVID-19 a pandemic. Acta Biomed. 2020;91(1):157–60. https://doi.org/10.23750/abm.v91i1.9397.
Ćosić K, Popović S, Šarlija M, Kesedžić I. Impact of Human Disasters and COVID-19 Pandemic on Mental Health: Potential of Digital Psychiatry. Psychiatr Danub. 2020;32(1):25–31. https://doi.org/10.24869/psyd.2020.25.
World Health Organization; 1992. World Health Organization. Psychosocial consequences of disasters: Prevention and management.
Fullana MA, Hidalgo-Mazzei D, Vieta E, Radua J. Coping behaviors associated with decreased anxiety and depressive symptoms during the COVID-19 pandemic and lockdown. J Affect Disord. Published online 2020. https://doi.org/10.1016/j.jad.2020.06.027.
Lee SM, Kang WS, Cho AR, Kim T, Park JK. Psychological impact of the 2015 MERS outbreak on hospital workers and quarantined hemodialysis patients. Compr Psychiatry. 2018;87:123–7.
Zhang WR, Wang K, Yin L, Zhao WF, Xue Q, Peng M, Min BQ, Tian Q, Leng HX, Du JL, Chang H, Yang Y, Li W, Shangguan FF, Yan TY, Dong HQ, Han Y, Wang YP, Cosci F, Wang HX. Mental health and psychosocial problems of medical health workers during the COVID-19 epidemic in China. Psychother Psychosom. 2020;100053(45). https://doi.org/10.1159/000507639.
Hu X, Chen H, Yu M. Exploring the non-technical competencies for on-scene public health responders in chemical, biological, radiological, and nuclear emergencies: a qualitative study. Public Health. 2020;183:23–9. https://doi.org/10.1016/j.puhe.2020.04.015.
Shrestha R, Kanchan T, Krishan K. Simulation Training and Skill Assessment in Disaster Medicine. In: StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2020. Available from: https://www.ncbi.nlm.nih.gov/books/NBK551719/. [Updated 2019 Nov 28].
McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ. 2010;44(1):50–63. https://doi.org/10.1111/j.1365-2923.2009.03547.x.
Daglius Dias R, Scalabrini NA. Stress levels during emergency care: a comparison between reality and simulated scenarios. J Crit Care. 2016;33:8–13. https://doi.org/10.1016/j.jcrc.2016.02.010.
Valentin B, Grottke O, Skorning M, et al. Cortisol and alpha-amylase as stress response indicators during pre-hospital emergency medicine training with repetitive high-fidelity simulation and scenarios with standardized patients. Scand J Trauma Resusc Emerg Med. 2015;23(1):1–8. https://doi.org/10.1186/s13049-015-0110-6.
Krage R, Zwaan L. Tjon Soei Len L, et al. relationship between non-technical skills and technical performance during cardiopulmonary resuscitation: does stress have an influence? Emerg Med J. 2017;34(11):728–33. https://doi.org/10.1136/emermed-2016-205754.
El Khamali R, Mouaci A, Valera S, et al. Effects of a multimodal program including simulation on job strain among nurses working in intensive care units a randomized clinical trial. JAMA - J Am Med Assoc. 2018;320(19):1988–97. https://doi.org/10.1001/jama.2018.14284.
Zigmond A, Snalth R. The hospital anxiety and depression scale. Acta psychiatr. Scand. [revista en internet] 2014 [acceso 28 de noviembre de 2019]; 64(5): 361-370. Acta Psychiatr Scand. 1983;67(6):361–70. https://doi.org/10.1093/occmed/kqu024.
Terol-Cantero M, Cabrera-Perona V, Martín-Aragón M. Hospital anxiety and depression scale (HADS) review in Spanish samples. An Psicol. 2015;31(2):494–503. https://doi.org/10.6018/analesps.31.2.172701.
Terol MC, López-Roig S, Rodríguez-Marín J, Martín-Aragón M, Pastor MA, y Reig MT. Propiedades psicométricas de la Escala Hospitalaria de Ansiedad y Estrés (HAD) en población española. Ansiedad y Estrés. 2007;13(2–3):163–76.
Torres-lagunas MA, Vega-morales EG, Vinalay-carrillo I. Universitaria Validación psicométrica de escalas PSS-14 , AFA-R , HDRS , CES-D , EV. en puérperas mexicanas con y sin preeclamsia. 2015;12(3):122–33.
Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–96. https://doi.org/10.2307/2136404.
Trujillo HM, González-Cabrera JM. Psychometric properties of the Spanish version of the perceived stress scale (PSS). Psicol Conductual. 2007;15(3):457–77.
Franco JC. Reducción de los niveles de estrés y ansiedad en médicos de Atención Primaria mediante la aplicación de un programa de entrenamiento en conciencia plena (mindfulness). Aten Primaria. 2010;42(11):564–70. https://doi.org/10.1016/j.aprim.2009.10.020.
Paiva CE, Martins BP, Paiva BSR. Doctor, are you healthy? A cross-sectional investigation of oncologist burnout, depression, and anxiety and an investigation of their associated factors 11 medical and health sciences 1117 public health and health services 17 psychology and cognitive Scie. BMC Cancer. 2018;18(1):1–11. https://doi.org/10.1186/s12885-018-4964-7.
Neto MLR, Almeida HG, D’arc Esmeraldo J, Nobre CB, Pinheiro WR, de Oliveira CRT, da Costa Sousa I, Lima OMML, Lima NNR, Moreira MM, Lima CKT, Júnior JG, da Silva CCL. When health professionals look death in the eye: the mental health of professionals who deal daily with the 2019 coronavirus outbreak. Psychiatry Res. 2020;288(April):2–4 https://doi.org/10.1016/j.psychres.2020.112972.
Chang AL, Dym AA, Venegas-Borsellino C, Bangar M, Kazzi M, Lisenenkov D, Qadir N, Keene A, Eisen LA. Comparison between simulation-based training and lecture-based education in teaching situation awareness: a randomized controlled study. Ann Am Thoracic Soc. 2017;14(4):529–35 https://doi.org/10.1513/AnnalsATS.201612-950OC.
Roy D, Tripathy S, Kumar S, Sharma N. Study of knowledge, attitude, anxiety & perceived mental healthcare need in T Indian population during COVID-19 pandemic. Asian J Psychiatr. 2020;51:1–7 https://doi.org/10.1016/j.ajp.2020.102083.
Kim MY, Park S. Associations of stress, self-esteem, and collective efficacy with flow in simulation among nursing students: a descriptive cross-sectional study. Nurse Educ Today. 2018;71:193–7 https://doi.org/10.1016/j.nedt.2018.09.03.
Okuda Y, Bryson EO, DeMaria S Jr, et al. The utility of simulation in medical education: what is the evidence? Mt Sinai J Med. 2009;76:330–43.
Judd BK, Alison JA, Waters D, Gordon CJ. Comparison of psychophysiological stress in physiotherapy students undertaking simulation and hospital-based clinical education. Simul Healthc. 2016;11(4):271–7 https://doi.org/10.1097/SIH.0000000000000155.
Donlan P. Developing affective domain learning in health professions education. J Allied Health. 2018;47(4):289–95.
The authors are grateful to all the members of Teaching Department of Vall d’Hebron Hospital Universitari and all the members of Comissió Técnica Suport a la Simulació of Vall Hebron Advanced Clínical Simulation centre (VHiSCA), specially CR, TA, SC, EA, MJ, LM, AB, DL, MdN, MJ.
Authors have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
Ethics approval and consent to participate
This study was approved by the ethical committee of Vall d’Hebron University Hospital (PR (AG)261/2020). Informed consent was asked, and data was obtained anonymously.
Consent for publication
No additional financial or other affiliation relevant to the subject of this article is reported.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Beneria, A., Arnedo, M., Contreras, S. et al. Impact of simulation-based teamwork training on COVID-19 distress in healthcare professionals. BMC Med Educ 20, 515 (2020). https://doi.org/10.1186/s12909-020-02427-4