Skip to main content

Virtual reality simulation to enhance advanced trauma life support trainings – a randomized controlled trial

Abstract

Background

Advanced Trauma Life Support (ATLS) is the gold standard of initial assessment of trauma patients and therefore a widely used training program for medical professionals. Practical application of the knowledge taught can be challenging for medical students and inexperienced clinicians. Simulation-based training, including virtual reality (VR), has proven to be a valuable adjunct to real-world experiences in trauma education. Previous studies have demonstrated the effectiveness of VR simulations for surgical and technical skills training. However, there is limited evidence on VR simulation training specifically for trauma education, particularly within the ATLS curriculum. The purpose of this pilot study is to evaluate the feasibility, effectiveness, and acceptance of using a fully immersive VR trauma simulation to prepare medical students for the ATLS course.

Methods

This was a prospective randomised controlled pilot study on a convenience sample of advanced medical students (n = 56; intervention group with adjunct training using a commercially available semi-automated trauma VR simulation, n = 28, vs control group, n = 28) taking part in the ATLS course of the Military Physician Officer School.

Feasibility was assessed by evaluating factors related to technical factors of the VR training (e.g. rate of interruptions and premature termination). Objective and subjective effectiveness was assessed using confidence ratings at four pre-specified points in the curriculum, validated surveys, clinical scenario scores, multiple choice knowledge tests, and ATLS final clinical scenario and course pass rates. Acceptance was measured using validated instruments to assess variables of media use (Technology acceptance, usability, presence and immersion, workload, and user satisfaction).

Results

The feasibility assessment demonstrated that only one premature termination occurred and that all remaining participants in the intervention group correctly stabilised the patient. No significant differences between the two groups in terms of objective effectiveness were observed (p = 0.832 and p = 0.237 for the pretest and final knowledge test, respectively; p = 0.485 for the pass rates for the final clinical scenario on the first attempt; all participants passed the ATLS course). In terms of subjective effectiveness, the authors found significantly improved confidence post-VR intervention (p < .001) in providing emergency care using the ATLS principles. Perceived usefulness in the TEI was stated with a mean of 4 (SD 0.8; range 0–5). Overall acceptance and usability of the VR simulation was rated as positive (System Usability Scale total score mean 79.4 (SD 11.3, range 0–100).

Conclusions

The findings of this prospective pilot study indicate the potential of using VR trauma simulations as a feasible and acceptable supplementary tool for the ATLS training course. Where objective effectiveness regarding test and scenario scores remained unchanged, subjective effectiveness demonstrated improvement.

Future research should focus on identifying specific scenarios and domains where VR can outperform or enhance traditional learning methods in trauma simulation.

Peer Review reports

Background

Advanced Trauma Life Support (ATLS) stands as the cornerstone of medical trauma training. Developed by the American College of Surgeons and its Committee on Trauma, it offers a comprehensive, concise and safe framework for evaluating and treating victims of traumatic events, especially for medical personal who infrequently encounter trauma [1]. The impact of ATLS on participants' knowledge, clinical skills, organizational abilities, and prioritization approaches is substantiated by Level I evidence [2]. However, for medical students and inexperienced physicians, engaging with the course that teaches ATLS and its prerequisites poses challenges, as they usually do not have much experience in the care for severely injured patients. Furthermore, the ATLS trauma principles encompass many practical skills, that are best studied in a practical setting. Simulation-based training is a valuable modality to complement real-world clinical experiences because it enables control over the sequence of tasks offered to learners, provides opportunities to offer support and guidance to learners, prevents unsafe and dangerous situations, and creates tasks that rarely occur in the real world [3]. However, traditionally simulation-based trainings are highly resource-intensive, incurring personal costs, requiring specialized equipment, and necessitating specific locations. Moreover, adapting these trainings to accommodate an increasing number of students proves challenging. Current trauma education curricula often provide limited scenario practice opportunities, and there is a scarcity on training opportunities for undergraduates [3].

To avoid these problems, new methods of simulation-based education using innovative techniques such as virtual reality (VR) have emerged. VR is a technology that immerses the user in an artificial 3D environment with the use of a head-mounted device (VR headset) [4]. The virtual environment offers various modes of interaction, including handheld devices such as controllers or the innovative option of hand-tracking, allowing users to engage with the virtual world using their own hand movements.VR simulations have proven to be a useful and effective tool, mainly for training surgical and technical skills [4,5,6,7,8,9,10,11]. However, VR can also be used to train nontechnical skills [12].

The evidence of VR simulation training for trauma training is still scarce [3]. Furthermore, so far there is no study including VR simulation into the ATLS curriculum or using ATLS course evaluations as outcome.

VR simulation training has been effectively applied in the practicing the ABCDE (airway, breathing, circulation, disability, exposure) approach [13], which is a key concept also in ATLS. A proof of concept study on VR technology in trauma simulation demonstrated that a VR platform can be used to distinguish decision-making skill levels between novice and expert level providers using ATLS and that VR simulation technology is positively received by learners [14]. Recently, semi-autonomous VR trauma-simulations have been developed [15, 16], and proven non-inferior to conventional manikin-based simulation trauma training in medical students [17]. In a recent pilot study, another VR trauma simulator (TVRSim) was able to discern decision-making abilities among trainees with increasing experience with good learner satisfaction [18].

We are aiming to better prepare medical students for the ATLS training course using a fully immersive VR trauma simulation. To this end, we conducted a prospective randomized controlled pilot study. The feasibility of deployment of a VR trauma simulation as adjunct for preparation, objective and subjective effectiveness of the VR simulation for the ATLS training and the acceptance of the VR trauma simulation (usability, simulator sickness, sense of presence and of immersion, workload, user satisfaction, and technology acceptance) in medical students were investigated.

Methods

Study design, setting, and ethical approval

This was a prospective randomised controlled pilot study involving medical students. The study was conducted at the University Emergency Department (ED, Universitätsklinik für Notfallmedizin, UKN) at the Inselspital, University Hospital, Bern, Switzerland, and the Military Physician Officer School 41–1/22 and 41–2/22 (Militärarzt Offiziersschule 41–1/22 and 41–2/22) organized by the Swiss army in Moudon, Switzerland. The study took place from 09.05.2022 until 19.10.2022.

This study was classified as a quality evaluation study by the local institutional review board (Kantonale Ethikkommission Bern (Ethics Committee Bern), BASEC-No: Req-2022–00425) and thus exempt from full ethical review. Participants were pseudonymised to ensure privacy.

ATLS course settings

The ATLS program in Switzerland has been developed by the ATLS Switzerland Committee of the Swiss Surgical Society in accordance with the guidelines of the American College of Surgeons [19]. The purpose of this course is to orient the participants to the initial assessment and management of the trauma patient.

The ATLS student course teaches the concepts of primary and secondary patient assessment, identifies management priorities in a trauma situation and provides a clinical and surgical practice to develop the skills required for the initial assessment and management of patients with multiple injuries. The ATLS course is a mandatory part of the medical curriculum for future military physicians in Switzerland. The duration of the ATLS course is 2.5 days, consisting of 9 h theoretical and 12 h of practical training. The course consists of pre- and post-course tests, core content lectures, interactive case presentations, discussions, development of life-saving skills, practical skills stations, and a final performance proficiency evaluation using a clinical scenario. The preparation for an ATLS course consists of self-study of the course manual before commencement of the course [20]. A written knowledge pretest must be passed to enter the course (40 multiple choice questions with 5 answer options each; passing mark 75% correct answers). At the end of the ATLS course, all candidates take a test run in a training clinical scenario. To pass the whole course, a final knowledge test (40 multiple choice questions with 5 answer options each; passing mark 75% correct answers) and the final clinical scenario using simulated patients need to be passed. The final clinical scenario can be repeated once. The training clinical scenario and the final clinical scenario typically consist of a simulated patient (i.e. simulated wounds) who needs to be treated according to ATLS guidelines with the help of a nurse character.

Participants and eligibility criteria

We recruited a convenience sample of advanced medical students (mainly year 5 or 6 out of a 6-year curriculum) taking part in the ATLS course of the “Militärarzt Offiziersschule 41–1/22 / Military Physician Officer School 41–1/22” in May/June 2022 and the “Militärarzt Offiziersschule 41–2/22 / Military Physician Officer School 41–2/22” in September/October of the Swiss military corps.

Exclusion criteria were refusal to participate in the study, failure to obtain informed consent and participants who had previously been diagnosed with epilepsy.

The study investigators (RS and RW) informed the participants about the study aims, handed out the information form and ensured the absence of contraindications, responded to the participants' questions, and collected their free, informed and expressed written consent.

Baseline data

Sociodemographic data (gender, age, year of medical studies, need to wear eyeglasses, prior experience with VR), prior training and experience in trauma care (such as completion of Pre-Hospital Trauma Life Support (PHTLS) provider and/or refresher course [21], self-reported hours spent studying the ATLS course manual), as well as confidence in trauma care, and prior experience with VR, were collected in a survey.

Randomization

After pseudonymization and collection of baseline data, participants were randomized to control or intervention group by a study investigator (RS) using an Excel randomization function.

Intervention

The intervention consisted of the application of a fully immersive semi-automated VR trauma training scenario (by SimX Inc., San Francisco, California, United States of America) applying the ATLS principals on a polytraumatized virtual patient using a Meta Quest 2 (Meta Platforms, Inc.; Menlo Park, California, United States of America) headset and controllers. Neither company was involved in any aspects of the study. The hardware used for this study consisted of an OMEN laptop 15-dc0xxx by Hewlett-Packard (HP Inc, 1501 Page Mill Road, Palo Alto, California, 94,304, United States of America). The application was controlled by a study investigator (RW), who acted as a moderator, giving the appropriate prerecorded verbal responses, and initiating the appropriate physiological response (automated scenario progression) (Supplemental Materials Figure S1).

The participants in the intervention group completed their training in the VR simulation in coordination with their military obligations in a period of 5–7 days before the ATLS course. They did first undergo a guided 15-min orientation session with a specific task list to familiarize themselves with the VR environment with a peer tutor (RW) available for instructions as needed. Directly afterwards, the participants underwent the study simulation (patient suffering from a blunt polytrauma with tension pneumothorax and major hemorrhage in the pre-hospital setting). The management principles were based on ATLS principles. These included appropriate completion of the primary survey, responding to vital-monitor cues and recognizing life-threatening situations. If the underlying problem in breathing and circulation were not addressed in a timely manner, clinical deterioration (including cardiac arrest) occurred. Similarly, physiologic improvements occurred if correct and timely interventions took place. Typical actions and interventions included moving around in the ambulance and using equipment, attaching patient monitoring, clinical examination including pulse palpation (tactile feedback trough controllers), heart and lung auscultation, ultrasound (eFAST) evaluation (with review of images), placement of intravenous access and tourniquet, performing needle decompression of pneumothorax, placement of airway devices, administration of fluids and medications, or initiation of CPR (with the help of a nurse non-playable character).

In the VR simulation the participant had 45 min to complete the case or retry if case specific urgent actions had not been executed and led to worsening of the patient’s clinical condition. The scenario could be repeated as often as desired. A minimum number of runs was not specified. The training could be ended at any time. The participants' performance according to the ABCDE scheme during the VR simulation was evaluated by one of the study investigators (RW) using a global rating scale.

Outcome measures

To gain insights into the technical and operational feasibility of VR simulation training, the number of premature terminations, as well as interruptions of the simulation by the participants and the measurement of the time that the participants spend in the virtual environment were recorded. The number of participants who achieved correct stabilisation of the patient and time needed was recorded as a starting point for assessing the difficulty and associated feasibility of the simulation case.

The objective effectiveness of VR simulation was measured using three different approaches. First, all study participants were assessed in a clinical training scenario and a clinical test scenario using the usual ATLS assessment tools with the addition of a subjective global rating scale from 1 to 7 ("The participant correctly applied the ATLS principles"; 1 = strongly disagree to 7 = strongly agree) (comparison between VR and control group). Secondly, the objective effectiveness of the VR trauma simulation was analysed on the results of the pre-test and the final knowledge test, and thirdly, the pass rate of the ATLS course (yes/no) was recorded.

Subjective effectiveness of the VR trauma simulation was measured by the TEI (Training Evaluation Inventory), consisting of 17 statements regarding subjective enjoyment, perceived usefulness, perceived difficulty, subjective knowledge gain, attitudes towards training assessed on a five-point Likert scale (ranging from 1 = totally disagree to 5 = totally agree) [22]. Confidence in applying the ATLS principles was assessed four times during the course of the study: at baseline, after the training (for the VR group only), before, and after ATLS course curriculum (“I feel confident in applying the ATLS principles correctly” (Likert scale from 1 = totally disagree to 5 = totally agree).

The overall acceptance of the VR simulation was evaluated using six established questionnaires, which the participants in the intervention group completed directly after the VR simulation.

Technology acceptance was measured using the fast form of the Technology Acceptance Model (FF-TAM) [23, 24]. 12 items were assessed on a 7-point semantic differential scale (i.e. 1 = inefficient, 7 = efficient).

Usability was assessed using the System Usability Scale (SUS) [25], which is composed of 10 questions with a five-point Likert attitude scale (range 0–100, with an average score of 68; values above 70 are considered “good”); and the After-Scenario Questionnaire (ASQ) [26], which assesses the ease of task completion, satisfaction with completion time and satisfaction with supporting information on a 7-point Likert scale (total score ranges from 1 = full satisfaction to 7 = poor satisfaction).

“Visually-induced motion sickness” was assessed with four-items (The VR training caused nausea/ headache/ blurred vision/ dizziness) taken from the Simulator Sickness Questionnaire (SSQ) from Kennedy et al. (Likert scale from 1 = totally disagree to 5 = totally agree) [27].

Presence and immersion in the virtual world was determined according to the 6-item questionnaire developed by Slater-Usoh-Steed (total score ranges from 1 = no immersion to 7 = full immersion) [28].

Perceived subjective workload on a scale from 0 to 100 was assessed using the National Aeronautics and Space Administration (NASA) Task Load Index [29]. Overstraining is associated with a total score > 60, understraining with a total score of < 37 [30].

The User Satisfaction Evaluation Questionnaire (USEQ) has six questions with a five-point Likert scale to evaluate user satisfaction (total score ranges from 6 = poor satisfaction to 30 = excellent satisfaction) [31].

Statistical analysis

Data was analysed in Stata® 16.1 (StataCorp, The College Station, Texas, USA).

Baseline characteristics are presented as numbers and percentage or mean (standard deviation, SD) using descriptive statistics as appropriate. Comparisons between two independent groups (e.g. male vs. female; control vs. VR group) were carried out by Chi-square or Wilcoxon rank sum test depending on variable (categorial or continuous).

Pre- and post-simulation comparisons were performed with McNemars test or Wilcoxon signed rank test. Incomplete variables are indicated. No data were imputed. All calculations were intention-to-treat. Only complete data pairs could be evaluated. A p-value < 0.05 was considered significant.

Results

Sample characteristics

A total of n = 56 students were recruited for the study (n = 28 VR group, n = 28 control group; total eligible n = 58). The flowchart of the study is detailed in Fig. 1. One person did not complete the VR simulation.

Fig. 1
figure 1

Flowchart flowchart of the study. Abbreviations: ATLS = Advanced Trauma Life Support, VR = Virtual Reality

No significant differences were found regarding gender, mean age, educational level in medical school, need to wear glasses, previous experience with computer games, or previous experience with VR (Table 1). Likewise, previous education and experience regarding polytrauma care did not show any significant differences. All study participants were PHTLS (Pre-Hospital Trauma Life Support) certified.

Table 1 Baseline characteristics

Feasibility and VR simulation details

Table 2 presents the details of the VR simulation. One female participant withdrew from the VR intervention after completing the tutorial and did not partake in the VR simulation. The VR training without the tutorial lasted an average of 33.9 min (SD 7.9), and each participant completed an average of 2.4 trials (SD 0.6). All students were able to stabilize the patient at least once, and this took an average of 19.3 min (SD 8.2).

Table 2 VR simulation details

Objective and subjective effectiveness

Objective effectiveness

The outcomes of the objective effectiveness are displayed in Table 3. There were no significant differences observed between the two groups in terms of their mean scores for the pre- and final multiple choice knowledge tests (p = 0.832 and p = 0.237 respectively). Similarly, there was no significant difference in the pass rates for the final clinical scenario on the first attempt (p = 0.485). All participants ultimately passed the course due to the option to repeat the clinical scenario at the end of the ATLS program.

Table 3 Objective effectiveness

Subjective effectiveness

With regards to the subjective effectiveness of the VR training, the confidence of the intervention group significantly improved post-VR intervention In the first survey on confidence, 53.6% of the intervention group stated that they totally disagreed or disagreed with the statement "I feel confident in providing emergency care to a polytrauma patient". After the VR training, however, this figure was reduced to 25%. The Training Evaluation Inventory showed good results, particularly for subjective enjoyment (mean 4.6, SD 07). Perceived usefulness was rated with a mean of 4.0 (SD 0.8). Details of the confidence ratings are delineated in Fig. 2, while Table 4 illustrates the results of the Training Evaluation Inventory.

Fig. 2
figure 2

Subjective confidence in treating a polytrauma patient. Confidence in the applying the ATLS principles was assessed at baseline, after the VR training (for the VR group only), before and after ATLS course curriculum (“I feel confident in applying the ATLS principles correctly” (Likert scale from 1 = totally disagree to 5 = totally agree). The blue bars represent the control group and the orange bars the intervention group. Abbreviations: ATLS = Advanced Trauma Life Support, VR = Virtual Reality

Table 4 Training evaluation inventory

Acceptance of VR simulation

Results of the dimensions of VR simulation acceptance (usability, simulator sickness, sense of presence and immersion, workload, user satisfaction, and technology acceptance), for the entire sample and distributed by gender are compiled in Table 5. Overall, participants perceived the VR simulation experience positively. Usability as assessed by the SUS was good (mean SUS score 79.4 ± 11.3). The majority of the respondents experienced no to only mild symptoms of visually-induced motion sickness, except for two female participants who reported severe nausea. The average value of immersion according to the questionnaire by Slater-Usoh-Steed was 4.4 ± 1. NASA-Task Load Index total mean score was 49.2 ± 14.7 (range 0–100, 100 = high). User satisfaction was high (USEQ mean score 26.2 ± 3.1 (range 6 = poor satisfaction to 30 = excellent satisfaction). In general, technology acceptance was high (FF-TAM mean value 5.6 ± 0.9; range 1 = poor acceptance to 7 = high acceptance).

Table 5 Acceptance of VR simulation by gender

Discussion

In this prospective randomised controlled pilot study we found the deployment of a VR trauma simulation as adjunct for preparation for the ATLS training course for medical students to be feasible. We did not find any significant differences in objective performance measures after completion of the ATLS course program in the VR group. Subjectively, confidence in treating a polytrauma patient significantly increased after the VR training. The VR trauma simulation was generally well accepted, with good usability and workload, and few VR-associated side-effects.

Feasibility

Feasibility was confirmed, similar to the findings of Harrington et al. (2018) [14]. The setup using a laptop and stand-alone headset was straightforward, and the commercially available software ran smoothly without technical issues, not causing any interruptions due to technical problems. Participants quickly acclimated to the VR environment and managed the scenarios effectively after a short orientation session. Only one participant had to forgo the simulation due to visually induced motion sickness.

It should be noted that all participants in the intervention group achieved correct stabilisation of the patient. It can therefore be discussed whether the virtual emergency scenario was designed too easy and whether more difficult scenarios need to be programmed in the future.

Objective outcomes

The utilisation of objective ATLS course completion tests as evaluation markers for ATLS VR training has been demonstrated to be a valuable approach, offering a means of assessing the effectiveness of the training. As our simulation was developed to train practical skills, we did not expect this to influence scores in the multiple choice knowledge test. However, we also did not find a difference in objective outcomes regarding knowledge and solving the clinical scenario between the two groups. As a feasibility study, our study most likely would lack the power to show a small effect to the VR intervention. A large effect, on the other hand, seems unlikely comparing the small VR intervention with the 2.5 days ATLS training course and given, that all participants had previously completed a prehospital trauma training, possibly inducing a ceiling effect. Consequently, it will be the task of further research to evaluate the optimal integration of VR training into an ATLS training curriculum. Further research is necessary to explore the feasibility and effectiveness of incorporating repetitive VR simulations using different scenarios or even partially replacing some resource-intensive ATLS training scenarios with VR.

Our target audience consisted of advanced medical students, who were all PHTLS certified, thus familiar with the ABCDE concept and structured trauma care; however, previous studies suggest that VR training tends to be most beneficial for those in the early stages of their training [18]. While Harrington et al. demonstrated the ability of VR simulations to discern between different levels of expertise, this aspect was not applicable in our study, as we used a homogeneous sample of trainees [14].

Subjective outcomes

Whereas we found increased confidence after the VR training, we did not find significant differences in confidence after completion of the whole ATLS curriculum. However, given the exhaustive nature of the ATLS curriculum, possible differences induced by adding a 30 min VR simulation are likely to be overcome.

One might however speculate if the VR simulation enhanced motivation and understanding of the participants of preparing for the course and reading the course manual in self-study. One value of the VR simulation could also be to show students their gaps and thus motivate them for the ATLS course or even for self-study of the manual. These effects were not captured in our study.

Acceptance of VR simulation

The overall evaluation of the VR simulation indicated good usability. This is consistent with previously published studies on VR trauma simulations [14, 16,17,18]. Most participants found the interface to be simple and intuitive. The majority of respondents reported that the VR simulation was easy to use and did not pose significant difficulties.

Regarding simulator sickness, the majority of participants reported minimal or no symptoms. However, one candidate experienced severe simulator sickness, preventing her from continuing to use the VR simulation after the orientation tutorial. This finding suggests caution should be exercised when considering mandatory VR usage or its application as an assessment method, particularly for older individuals with known motion sickness [16].

The immersion level of the VR simulation was rated as moderate. However, it remains unclear what immersion level is appropriate for medical training or other specific applications. Further investigation is necessary to determine the optimal balance between immersion and usability.

The workload associated with using the VR simulation was comparable to mean scores in a large sample of VR studies [32]. There were no indications of participants being over- or understrained, indicating a good workload balance.

User satisfaction and acceptance were generally high. Participants expressed satisfaction with the VR simulation and had no major concerns. However, it is important to note the potential presence of a novelty effect, as VR technology is still relatively new, and our participants had little or no experience in VR. The novelty effect refers to a boost in the perceived usability of a technology based on its freshness, or the initial improvement in performance when implementing new technology. However, this improvement is not necessarily due to enhanced learning or achievement, but rather a result of heightened interest in the new technology. This effect should be considered when interpreting the results [33].

In terms of usability and simulator sickness, there were statistically significant gender differences in the acceptance of VR simulation. It appears that women are more susceptible to nausea and dizziness in VR simulations, in line with other studies, although the reasons are not perfectly understood [34].

Future applications of VR simulation for trauma training could include remote training and telemedicine, allowing medical professionals to access high-quality trauma training regardless of their geographical location, and continuous education and refresher training. Furthermore, VR simulations can be integrated into assessment processes for trauma training and certification, as automated evaluation methods in conventional trauma trainings are scarce [3]. VR simulations featuring multiplayer options can help to facilitate interdisciplinary training and also enhance communication and leadership skills. VR simulations can be further developed to focus on advanced trauma management skills, such as complex surgical procedures (i.e. resuscitative endovascular balloon occlusion of the aorta (REBOA) or other rare emergency scenarios, that are difficult to simulate in real life due to financial or personal resources or danger to the participants (e.g. mass casualty incidents) [35,36,37]. Furthermore, other international trauma courses, e.g. the European Trauma Course (ETC), an innovative 2.5 days life support course for training acute care of major trauma patients with a strong focus on team work and practical scenario training, might benefit just as well from adding VR scenario training [38].

Overall, the future applications of VR simulation in trauma training are vast and hold the potential to revolutionize how healthcare professionals are trained, assessed, and prepared to handle trauma cases effectively.

In conclusion, while VR should not be seen as a complete replacement for traditional training, future research endeavors should concentrate on outlining specific scenarios, learner populations and domains where VR surpasses or enhances traditional learning techniques. This approach will facilitate the development of tailored applications, hybrid approaches, and educational innovations that leverage the immersive and experiential benefits of VR to optimize learning outcomes.

Limitations

These results need to be interpreted with some reservations. First, this was a single tertiary care academic center study with a limited number of participants, that may be affected by selection bias, and thus have impact on generalizability. Since the participants were gathered from a military facility, the demographic composition was predominantly male. Nevertheless, there was an equal distribution between the control and intervention groups. As this was a single-user simulation, it lacks the ability to train team and communication skills, a key in effective trauma team leadership. However, in order to communicate effectively, the team leader must gain pattern recognition, knowledge and confidence which the VR simulation is designed to provide.

One might argue the choice of evaluation methods regarding objective outcomes (medical knowledge test using multiple choice questions, subjective global rating scale for the clinical scenario), however, these are the instruments officially used by the ATLS program.

Transfer to patient outcomes is not addressed in this study, but generally difficult to assess in educational studies.

Conclusion

This prospective pilot study suggests that the use of VR trauma simulations as an adjunct for the ATLS student course shows potential. While there was no improvement in objective knowledge and practical skills, likely due to limited time for VR intervention combined with weeks of theoretical preparation and a 2.5-day course duration, interesting subjective effects were observed. Participants reported increased confidence in taking care of trauma patients and found the VR training intervention to be usable and acceptable.

It is important to note that while VR simulations have the potential to be a valuable addition to traditional training methods, they should not be viewed as a complete substitute. Future research should therefore focus on identifying the most effective ways to integrate VR training with conventional practical simulation methods, with the aim of achieving the greatest possible benefits for learners.

Availability of data and materials

Data used in this study are available upon reasonable request from the corresponding author at the Emergency Department of the University Hospital Bern, Switzerland to researchers eligible under Swiss legislation to work with codified personal health care data. Eligibility will be determined by Cantonal ethics committee Bern.

Abbreviations

ASQ:

After-Scenario Questionnaire

ATLS:

Advanced Trauma Life Support

ED:

Emergency department

ETC:

European Trauma Course

FF-TAM:

Technology Acceptance Model

NASA:

National Aeronautics and Space Administration

PHTLS:

Pre-hospital Trauma Life Support

REBOA:

Resuscitative endovascular balloon occlusion of the aorta

SD:

Standard deviation

SUS:

System Usability Scale

SSQ:

Simulator Sickness Questionnaire

TEI:

Training Evaluation Inventory

USEQ:

User Satisfaction Evaluation Questionnaire

VR:

Virtual reality

References

  1. ACS. About Advanced Trauma Life Support. Available from: https://www.facs.org/quality-programs/trauma/education/advanced-trauma-life-support/about/. Cited 2022 Jul 5

  2. Mohammad A, Branicki F, Abu-Zidan FM. Educational and clinical Impact of Advanced Trauma Life Support (ATLS) courses: a systematic review. World J Surg. 2014;38(2):322–9.

    Article  Google Scholar 

  3. Larraga-García B, Quintana-Díaz M, Gutiérrez Á. Simulation-Based Education in Trauma Management: A Scoping Review. Int J Environ Res Public Health. 2022;19(20):13546.

    Article  Google Scholar 

  4. Wu TC, Ho CTB. A scoping review of metaverse in emergency medicine. Australas Emerg Care. 2023;26(1):75–83.

    Article  Google Scholar 

  5. Kyaw BM, Saxena N, Posadzki P, Vseteckova J, Nikolaou CK, George PP, et al. Virtual reality for health professions education: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res. 2019;21(1):e12959.

    Article  Google Scholar 

  6. Zhao G, Fan M, Yuan Y, Zhao F, Huang H. The comparison of teaching efficiency between virtual reality and traditional education in medical education: a systematic review and meta-analysis. Ann Transl Med. 2021;9(3):252–252.

    Article  Google Scholar 

  7. Tang YM, Chau KY, Kwok APK, Zhu T, Ma X. A systematic review of immersive technology applications for medical practice and education - Trends, application areas, recipients, teaching contents, evaluation methods, and performance. Educ Res Rev. 2022;35:100429.

    Article  Google Scholar 

  8. Barteit S, Lanfermann L, Bärnighausen T, Neuhann F, Beiersmann C. Augmented, Mixed, and Virtual Reality-Based Head-Mounted Devices for Medical Education: Systematic Review. JMIR Serious Games. 2021;9(3):e29080.

    Article  Google Scholar 

  9. Birrenbach T, Zbinden J, Papagiannakis G, Exadaktylos AK, Müller M, Hautz WE, et al. Effectiveness and Utility of Virtual Reality Simulation as an Educational Tool for Safe Performance of COVID-19 Diagnostics: Prospective, Randomized Pilot Trial. JMIR Serious Games. 2021;9(4):e29586.

    Article  Google Scholar 

  10. Mackenzie CF, Harris TE, Shipper AG, Elster E, Bowyer MW. Virtual reality and haptic interfaces for civilian and military open trauma surgery training: A systematic review. Injury. 2022;53(11):3575–85.

    Article  Google Scholar 

  11. Rickenbacher-Frey S, Adam S, Exadaktylos AK, Müller M, Sauter TC, Birrenbach T. Development and evaluation of a virtual reality training for emergency treatment of shortness of breath based on frameworks for serious games. 2023 Apr 17; Available from: https://www.egms.de/en/journals/zma/2023-40/zma001598.shtml. Cited 2023 Jul 11

  12. Bracq MS, Michinov E, Jannin P. Virtual Reality Simulation in Nontechnical Skills Training for Healthcare Professionals. Simul Healthc. 2019;14(3):188–94.

    Article  Google Scholar 

  13. Berg H, Steinsbekk A. Is individual practice in an immersive and interactive virtual reality application non-inferior to practicing with traditional equipment in learning systematic clinical observation? A randomized controlled trial. BMC Med Educ. 2020;20(1):123.

    Article  Google Scholar 

  14. Harrington CM, Kavanagh DO, Quinlan JF, Ryan D, Dicker P, O’Keeffe D, et al. Development and evaluation of a trauma decision-making simulator in Oculus virtual reality. Am J Surg. 2018;215(1):42–7.

    Article  Google Scholar 

  15. Couperus K, Young S, Walsh R, Kang C, Skinner C, Essendrop R, et al. Immersive Virtual Reality Medical Simulation: Autonomous Trauma Training Simulator. Cureus. 12(5):e8062.

  16. Lombardo R, Walther N, Young S, Gorbatkin C, Sletten Z, Kang C, et al. Ready Medic One: A Feasibility Study of a Semi-Autonomous Virtual Reality Trauma Simulator. Front Virtual Real. 2022;2. Available from: https://www.frontiersin.org/articles/https://doi.org/10.3389/frvir.2021.719656. Cited 2022 Jul 5

  17. Laņģe M, Balmaks R, Bērziņš A, Vasiļeņko D, Līce E, Stepens A. Evaluation of virtual reality in trauma training: randomized controlled trial: RSU Research week 2021: Knowledge for Use in Practice. In 2021. p. 535.

  18. Colonna AL, Robbins R, Stefanucci J, Creem-Regeh S, Patterson B, Engel BT, et al. Trauma Bay Virtual Reality – A Game Changer for ATLS Instruction and Assessment. J Trauma Acute Care Surg. 2022; Available from: https://journals.lww.com/jtrauma/Abstract/9000/Trauma_Bay_Virtual_Reality___A_Game_Changer_for.97144.aspx. Cited 2022 Jul 5

  19. ATLS Switzerland. Available from: https://www.atls.ch/index.php?id=3&lang=386. Cited 2022 Jul 5

  20. Advanced trauma life support. student course manual. 10th ed. Chicago, IL: American College of Surgeons; 2018.

    Google Scholar 

  21. Über PHTLS (Geschichte) | Training von NAEMT Switzerland. Naemt Switzerland - PHTLS. Available from: https://phtls.naemt.ch/uber-phtls/. Cited 2022 Jul 5

  22. Ritzmann S, Hagemann V, Kluge A. The Training Evaluation Inventory (TEI) - Evaluation of Training Design and Measurement of Training Outcomes for Predicting Training Success. Vocat Learn. 2014;7(1):41–73.

    Article  Google Scholar 

  23. Davis FD. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 1989;13(3):319.

    Article  Google Scholar 

  24. Chin, Johnson, Schwarz. A Fast Form Approach to Measuring Technology Acceptance and Other Constructs. MIS Q. 2008;32(4):687.

  25. Brooke J. SUS-A quick and dirty usability scale. In: Usability evaluation in industry. London: Taylor and Francis; 1996. p. 189–94.

  26. Lewis J. Psychometric evaluation of an after-scenario questionnaire for computer usability studies: The ASQ. SIGCHI Bull. 1991;23:78–81.

    Article  Google Scholar 

  27. Kennedy RS, Lane NE, Berbaum KS, Lilienthal MG. Simulator Sickness Questionnaire: An Enhanced Method for Quantifying Simulator Sickness. Int J Aviat Psychol. 1993;3(3):203–20.

    Article  Google Scholar 

  28. Usoh M, Catena E, Arman S, Slater M. https://doi.org/10.1162/105474600566989. MIT Press 238 Main St., Suite 500, Cambridge, MA 02142–1046 USA journals-info@mit.edu; 2006. Using Presence Questionnaires in Reality. Available from: https://www.mitpressjournals.org/x/abs/https://doi.org/10.1162/105474600566989. Cited 2020 Sep 23

  29. Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In: Hancock PA, Meshkati N, editors. Advances in Psychology. North-Holland; 1988. p. 139–83. (Human Mental Workload; vol. 52). Available from: http://www.sciencedirect.com/science/article/pii/S0166411508623869. Cited 2020 Sep 23.

  30. Grier RA. How High is High? A Meta-Analysis of NASA-TLX Global Workload Scores. Proc Hum Factors Ergon Soc Annu Meet. 2015;59(1):1727–31.

    Article  Google Scholar 

  31. Gil-Gómez JA, Manzano-Hernández P, Albiol-Pérez S, Aula-Valero C, Gil-Gómez H, Lozano-Quilis JA. USEQ: A Short Questionnaire for Satisfaction Evaluation of Virtual Rehabilitation Systems. Sensors. 2017;17(7):1589.

    Article  Google Scholar 

  32. Hertzum M. Reference values and subscale patterns for the task load index (TLX): a meta-analytic review. Ergonomics. 2021;64(7):869–78.

    Article  Google Scholar 

  33. Huang W, Roscoe R, Johnson M, Craig S, Arizona State University. Investigating the Novelty Effect in Virtual Reality on STEM Learning. In: ASU Electronic Theses and Dissertations. Arizona State University; 2020. Available from: http://hdl.handle.net/2286/R.I.57391. Cited 2021 Jun 2

  34. Stanney K, Fidopiastis C, Foster L. Virtual Reality Is Sexist: But It Does Not Have to Be. Front Robot AI. 2020;7:4.

    Article  Google Scholar 

  35. Baetzner AS, Wespi R, Hill Y, Gyllencreutz L, Sauter TC, Saveman BI, et al. Preparing medical first responders for crises: a systematic literature review of disaster training programs and their effectiveness. Scand J Trauma Resusc Emerg Med. 2022;30(1):76.

    Article  Google Scholar 

  36. Knapp J, Jakob DA, Haltmeier T, Lehmann B, Hautz WE. Resuscitative endovascular balloon occlusion of the aorta in severely injured patients in the emergency trauma room: a case series. Anaesthesiol. 2022;71(8):599–607.

    Article  Google Scholar 

  37. Birrenbach T, Wespi R, Hautz WE, Berger J, Schwab PR, Papagiannakis G, et al. Development and usability testing of a fully immersive VR simulation for REBOA training. Int J Emerg Med. 2023;16(1):67.

    Article  Google Scholar 

  38. Lott C, Araujo R, Cassar MR, Di Bartolomeo S, Driscoll P, Esposito I, et al. The European Trauma Course (ETC) and the team approach: Past, present and future. Resuscitation. 2009;80(10):1192–6.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the Touring Club Switzerland for their support of the emergency telemedicine at the University of Bern.

We thank the ATLS Instructors and National-Coordinators, Switzerland, for organizational support.

Furthermore, we thank Lt col EMG Alain Bozzini, Responsable EO/ESO méd mil E hôp 41, Département fédéral de la défense, de la protection de la population et des sports DDPS, Armée suisse, Commandement de l’instruction – Formation d'application de la logistique, Commandement des Ecoles hôpital 41, Caserne Moudon, Moudon, Switzerland.

Additionally, we thank Theda Ockenga, StellDirVor GmbH, München, Germany, and SimX Inc., San Francisco, CA, USA, for providing us with the VR scenario.

Registration as a clinical trial

This study is an educational quality evaluation study with participation of medical students according to Swiss law and NHS definition. The aim was not to understand health and disease, but rather how an additional educational intervention works within an established training course. Therefore, this study is not to be classified as a clinical trial and was not registered as a clinical trial.

Funding

No funding was provided for this trial.

Author information

Authors and Affiliations

Authors

Contributions

TB: conception, design, acquisition, analysis, interpretation, drafting and revising. RS: conception, design, acquisition, drafting and revising. CEM: conception, acquisition, revising. PMS: conception, revising. WEH: conception, interpretation, drafting and revising. AKE: conception, design, drafting and revising MM: design, analysis, drafting and revising. RW: conception, design, acquisition, drafting and revising. TCS: conception, design, acquisition, interpretation, drafting and revising. All authors read and approved the final manuscript. All authors have agreed both to be personally accountable for their own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature.

Corresponding author

Correspondence to Tanja Birrenbach.

Ethics declarations

Ethics approval and consent to participate

This study was approved as a quality evaluation study by the local institutional review board (Ethics Committee Bern, BASEC-No: Req-2022–00425). All methods were carried out in accordance with relevant guidelines and regulations. Informed consent was obtained from all subjects.

Consent for publication

Written informed consent for study participation and publication of study results was obtained from each participant. No individual details are revealed in the publication.

Competing interests

WEH has received research funding from the European Union, the Swiss National Science foundation, Zoll foundation, Dräger Medical Germany, Mundipharma Research UK, MDI International Australia, Roche Diagnostics Germany, all outside the submitted work. WEH has provided paid consultancies to AO foundation Switzerland, MDI International Australia, and SIWF, all outside the submitted work.WEH has received financial support for a congress he chaired from EBSCO Germany, Isabel Healthcare UK, Mundipharma Medical Switzerland, VisualDx USA, all outside the submitted work.MM has been funded by the Bangerter Foundation and the Swiss Academy of Medical Sciences through the "Young Talents in Clinical Research" (grant TCR 14/17) as well with an in-house grant of the Clinical Trial Unit and research grants from the Swiss heart foundation.TCS holds the endowed professorship of emergency telemedicine at the University of Bern sponsored by the Touring Club Switzerland. The sponsor has no influence on the research or decision to publish. The other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Birrenbach, T., Stuber, R., Müller, C.E. et al. Virtual reality simulation to enhance advanced trauma life support trainings – a randomized controlled trial. BMC Med Educ 24, 666 (2024). https://doi.org/10.1186/s12909-024-05645-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-024-05645-2

Keywords