Skip to main content
Download PDF

Comparative satisfaction and effectiveness of virtual simulation and usual supervised work for postpartum hemorrhage management: a crossover randomized controlled trial

BMC Medical Education volume 22, Article number: 709 (2022) Cite this article

Abstract

Background

Because virtual simulation promotes learning and cognitive skill development, it may be useful for teaching students to manage postpartum hemorrhage (PPH) and its complex decision algorithm.

Objective

This study aimed to compare the satisfaction and effectiveness of virtual simulation with usual supervised work in producing knowledge and satisfaction.

Methods

This two-center two-stage crossover randomized controlled trial included student midwives. One group underwent the virtual simulation intervention in the first period (January 2018) and the usual supervised classroom work in the second (May 2018); the other group followed the reverse chronology. Satisfaction was the primary outcome. The secondary outcome was knowledge of the PPH management algorithm, assessed by responses to a case vignette after each intervention session.

Results

The virtual simulation -supervised work (VS-SW) chronology was allocated to 48 students, and its inverse (SW-VS) to 47; Satisfaction was significantly higher for the virtual simulation for its overall grade (6.8 vs. 6.1, P = 0.009), engagingness (very good 82.1% vs. 24.3%, P < 0.001), and ease of use (very good 77.9% vs. 46.1%, P < 0.001). Knowledge did not differ between the two groups (respectively, 89.5% versus 83.5%, P = 0.3).

Conclusion

Satisfaction is higher with virtual simulation without lowering knowledge scores, which argues for the use of such innovative teaching strategies. This could lead to an increase in students’ motivation to learn.

Peer Review reports

Background

Simulation methods are increasingly used in clinical teaching to immerse students in the delivery room before they encounter real-life situations [1]. Among the methods included in simulation pedagogy, virtual environments, serious games, and gamification are emerging innovative technologies that may offer multiple advantages over more traditional approaches [2,3,4,5]. Virtual simulation promotes learning and cognitive skill development in a virtual environment (visual and verbal) that gives meaning to what is learned, but is also engaging and easy to use. It allows learners to make decisions and acquire experience in a safe environment [2]. Virtual simulation may be especially interesting for situations with a complex decision algorithm requiring learners to choose between different options. It may also increase motivation and engagement [6].

Postpartum hemorrhage (PPH) is a frequent obstetric event, occurring in 5 to 10% of deliveries [7, 8]; when severe, it is a leading cause of maternal morbidity and mortality worldwide [9]. Reports from confidential inquiries have shown that 67% of PPH-related deaths in the United States and 84% of those in France were preventable; they resulted from delayed or inadequate management [10,11,12]. Despite similar international guidelines [13,14,15], variations in practices between and within countries have shown that efforts to improve the quality of maternity care are still needed [16,17,18]. Their effectiveness is particularly essential in initial training, especially as obstetrics remains one of the highest risk specialties in health care [19].

We thus wondered whether a virtual simulation could be a useful pedagogical tool to help student midwives in their initial professional training to learn how to manage PPH.

The aim of this study was to assess student satisfaction with virtual simulation compared to usual supervised work in learning PPH management. Our secondary objective was to compare the students’ knowledge needed to manage PPH and degree of certainty using clinical vignettes after each intervention.

Methods

Study design

We conducted a two-center, two-stage, crossover, randomized controlled trial. Student midwives were randomized into 2 groups. One group underwent the virtual simulation intervention in the first period (January 2019) and the usual supervised classroom work in the second (May 2019) while the other group underwent the usual supervised classroom work in the first period and the virtual simulation intervention in the second. We followed the CONSORT statement about randomized controlled trials in reporting this trial.

In Fig. 1, the Consort flow diagram illustrates the participant flow during the different study stages. Flow for participants, withdrawals, and inclusion in analysis are described.

Fig. 1
figure 1

Consort flow diagram

Full size image

Participants

The participants included in the study were student midwives in the 4th year of maieutic sciences from the Midwifery department at Versailles-Saint-Quentin University and the Midwives School in Strasbourg. The additional inclusion criterion was having received theoretical instruction in the form of courses; the exclusion criteria were prior exposure to this virtual simulation intervention or repeating the 4th year of study.

In France, midwives have 5 years of specific medical education, certified by a state diploma considered equivalent to a Master’s degree. They diagnose, provide initial management of PPH, and prescribe some medications at the same time as they call the obstetrician, with whom they work closely.

Interventions

Virtual simulation intervention

The Perinatsims virtual simulation (Medusims SAS)[20] offers users several PPH scenarios in the delivery room, in a 3-D and timed environment (see supplementary Files 1). It automatically generates a debriefing based on French best practice recommendations. During the simulation, the midwife is represented by an avatar who can move around the delivery room, perform various procedures, administer medications, call other professionals (obstetricians, anesthesiologists), and talk to the patient. The patient reacts to the different elements of treatment, and the situation deteriorates according to the management offered and the scenario underway.

The virtual simulation session was organized for 90 min in groups of 4–5 student midwives on a virtual simulator, playing out the same 2 scenarios of an immediate PPH for each group. With the first scenario, the students learned to handle the tool, and each group managed the second scenario autonomously. This session was followed by a debriefing focused on the elements of decision-making at the beginning of the PPH management (i.e., alert team members, administer oxytocin, manual placental delivery if necessary, uterine massage) and organization of care. The same midwife instructor conducted these games in each center (AR, SV).

The cost of the license for this virtual simulation is $1800 for classroom use.

Usual supervised work

The same midwife in each center (AR, SV) supervised the standard classroom work, which also took 90 min and included half the usual full group of students (n = 15 or 16 rather than 30–32). In this specific session, based on a clinical situation, students were invited to discuss the case as part of analyzing the guidelines. Part of the discussion focused on the elements of decision-making at the beginning of the PPH management (i.e., alert team members, administer oxytocin, manual placental delivery, uterine massage) and organization of care. The classroom work did not contain hands-on components.

Method of evaluation

The primary outcome was satisfaction. Satisfaction was measured by two self-administered questionnaires after each training stage (T2 and T4) with three items corresponding to: (1) global satisfaction, by a Likert scale (between 0 and 10); (2) its engagingness and appeal, and (3) its affordability and ease of use. These last two items were evaluated with multiple-choice questions with adjectives: very good, good, adequate, inadequate, with corresponding emojis. The 10-point Likert scale was chosen to offer a higher degree of measurement precision and provide a better opportunity to detect changes and more power to explain a point of view [21].

The secondary outcome was knowledge and degree of certainty of the PPH management algorithm, evaluated during the four assessment sessions by responses to a clinical case vignette, that is, a short, pragmatic clinical case that allows participants to immerse themselves in a situation as real as possible and be questioned about the management they would perform. This method has been previously validated and used to evaluate clinical practices in the context of PPH [18, 22]. Vignettes comprised a partogram describing the medical history, labor, delivery, and PPH and asked participants how they would manage the emergency situation with closed-ended question: “What actions would you perform within the next 15 minutes?” Then they have to choose none, one, or more actions from the list of choices for each type of management: pharmacological (antibiotic, oxytocin, misoprostol, sulprostone, or other), non-pharmacological (uterine massage, torsion of the cervix, bladder catheterization, manual examination of the uterine cavity, cervical examination with speculum, intrauterine tamponade, selective arterial embolization, surgical treatment), and communication, monitoring and investigation (alert other members of the team, venipuncture for blood sampling, resuscitation, and monitoring). (see supplementary Files 2 and 3)

The binary secondary outcome was evaluated by a composite outcome including 4 items expected in response to the clinical vignette: alert other members of the team, administer oxytocin, manually deliver the placenta and/or examine the uterine cavity, and massage the uterus. These 4 items were selected by expert consensus in a preliminary study [18] and correspond to important procedures that the midwife is responsible for performing.

These assessments took place before the beginning and after the end of each training stage. There were therefore 4 assessment sessions: T1 before the first training session, T2 after it, T3 before the second training session and T4 after it. Each test used a slightly different clinical PPH vignette but expected the same responses each time. To reduce the risk of contamination we administered out the test immediately after the training session and asked the participants not to communicate among themselves about the training sessions.

Degree of certainty was measured four times, at each assessment, by a multiple-choice question after the vignette: “how sure are you?“ with the following choices: <50%, 50–70%, 70–90%, > 90%.

Sample size

We expected to see a 65% correct response rate to the supervised work (rate of appropriate oxytocin administration in the midwives’ survey [18]), and we were hoping for a higher rate after the virtual simulation (arbitrarily, 25% more), i.e., around 90%. If we assumed that the within-participant standard deviation of the response variable was 0.5 and that the probability that the study would detect a difference between the interventions was 80% at a two-sided 0.05 significance level, we would require a total of 90 students to participate in this two-intervention crossover study (45 in each arm).

Randomization

Randomization took place after verification of the inclusion criteria and after participants had provided written informed consent. We used R software to draw up a randomization list by student class at each school. The distribution within the virtual simulation groups was random.

Ethics

The National Data Protection Authority (‘Commission Nationale de l’Information et des Libertes’) approved this study on January 21, 2017 (CNIL number DN 17 − 01).

All study participants gave their written consent to take part. They were informed that they could withdraw their consent and/or their participation at any time.

Statistical analysis

Categorical variables were described with numbers and percentages, and continuous variables by their means, standard deviations, and medians.

The two interventions (VS and SW) were compared for the main and secondary outcomes by pooling the evaluations conducted at T2 and T4. For dichotomous variables, chi-2 and Fisher exact tests were used as appropriate to assess differences in outcomes between groups. Student’s t and nonparametric tests were used to compare continuous outcomes between the two groups.

All statistical tests were two sided, and P < 0.05 was defined as statistically significant. Statistical analysis was conducted with R 3.6.2.

Results

The virtual simulation-supervised work (VS-SW) chronology was allocated to 48 students, and its inverse (SW-VS) to 47. (Table 1) Four students in the second group were lost to follow-up. After the merger of T2 and T4 results for each method, we analyzed 95 students for the virtual simulation intervention and 91 for the usual supervised classroom work (Fig. 1).

Table 1 Students’ characteristics (N = 95)
Full size table

The primary outcome of satisfaction was significantly higher for the virtual simulation training (Table 2), in particular for the global satisfaction grade (mean ± SD, 6.8 ± 1.6 vs. 6.1 ± 1.1 respectively, P = 0.009). These means explain why the score was dichotomized at 6.

At the end of the training (T2 + T4), the secondary outcome, composite knowledge, did not differ between the pooled virtual simulation group (n = 85/95, 89.5%) and the pooled usual supervised work group (n = 76/91, 83.5%, P = 0.3). The details of the results compared by test and according to the pedagogical tool are available in the appendix (supplementary file 4).

Table 2 Satisfaction (N = 95)
Full size table

Similarly, degree of certainty did not differ significantly between these two modes of instruction, with T2 + T4 pooled (P = 0.1), as shown in Fig. 2.

Fig. 2
figure 2

Degree of certainty reported by student midwives

Full size image

Discussion

Main findings

Students found the virtual simulation significantly more satisfying overall (grade of 6.8 ± 1.6 versus 6.1 ± 1.1, P = 0.009), engaging (very good 82.1% versus 25.3%, P < 0.001) and easy to use (very good 77.9% versus 46.1%, P < 0.001). Furthermore, knowledge of the algorithm for PPH management did not differ shortly after instruction by a virtual simulation or by the usual supervised work (P = 0.3).

Degree of certainty did not differ significantly after the two types of instruction, although Fig. 2 shows an improvement in certainty over time (T2 versus T4) and a slight decrease between the 2 teaching periods (over the 4 months between T2 and T3).

Interpretation

The literature on the effects of virtual simulation remains mixed and of moderate methodological quality [23,24,25]. Nevertheless, several studies on their effectiveness have failed to show a difference in knowledge but did reveal higher satisfaction, in both initial and continuing medical education [5, 6, 26,27,28,29,30,31]. Gamification did not appear to enhance cognitive performance. The literature, like our study, shows that virtual simulation is more enjoyable and engaging, easier to use, and even has an effect on motivation. Students were more active during these simulations, immersed in a professional environment. Enjoyment is attractive to students and keeps them focused. This aspect was heightened in our study by the small size of the group (4–5) in the virtual simulation session, while the supervised work session included 15–16 students. The group may inhibit some students. Virtual simulation in small groups of students allow sociocentric learning, peer-to-peer.

Interactions between students and between students and the teacher also play an important role and may partly explain why knowledge levels did not differ between the virtual simulation and the supervised work. Moreover, both arms (VS and SW) used feedback and debriefing, helping to link the theoretical knowledge to its practical applications. Boeker et al.[32] showed that virtual simulation affected knowledge, but their script-based approach for their control group could not provide interactions. Virtual simulation can also be considered in team-based learning and even multiprofessional training. Team-based learning has proven effective in improving peer learning, teamwork, and communication skills [33, 34]. In our study, it is possible that the lack of difference in knowledge assessment between the virtual simulation and the supervised work is due to the close similarity of the two interventions, with only their formats different.

We observed a decrease in degree of certainty at time T3 (4 months after the first session). In their study of cardiac arrest, which included an assessment at 4 months, Drummond et al. [29] also suggested that some elements of management are only partially learned and retained. Several authors have shown that performance decreases 6 months after simulation training in learning resuscitation [35, 36]. Moreover, Raman et al. compared a dispersed (4 h spread out over four weeks) versus massed (one 4-hour half-day) course to promote better short and long-term retention [37]. They showed significantly better long-term knowledge through dispersed courses. These different results suggest that a regular use of virtual simulation would be useful for maintaining knowledge. The knowledge results at different times, especially at T3 (supplementary file 2 and 3 show the importance of repetition in knowledge retention. It seems that 2 trainings are not enough; an important advantage of virtual simulation is that students can perform it multiple times. Lack of time and resources prevent the repetition of supervised classroom work, but learners can replay virtual simulation independently, especially when they include integrated feedback, in both initial and continuing training, on the training site, the practice site or anywhere else. We could propose it as a distance learning alternative for students isolated due to their health condition or in cases of necessity, especially in situations such as the COVID-19 pandemic.

It has been shown that a “motivational dynamic model” increases engagement in training [38]. Motivation to learn is higher in students who see a benefit or usefulness in the activities they are asked to carry out (perception of the value of an educational activity). Virtual simulation seems to have a motivational potential due to the strong perception of engagingness. It should have positive effects on perceived self-efficacy, especially combined with other motivational strategies, such as encouraging success, promoting motivating assessments, and useful feedback.

Strengths and limitations

Our study had several strengths. First, it was randomized. Next, in accordance with the definition by Djaouti et al. [39], the virtual simulation we used has an objective, rules, a result to achieve (that the woman bleed as little as possible and that all elements of the debriefing are correct, as shown by green font), and a playful design. In addition, our secondary outcome was based on a solid methodological tool of case-vignettes, previously validated in the specific context of postpartum hemorrhage [18, 22]. Finally it took place at two separate centers and was reasonably large.

Nonetheless, it also had some limitations. In particular, it would have been interesting to have had a third control group without any intervention to measure the changes between T2 and T3 in both groups. During this period, the students were in internships and might have had to deal with PPH situations or reviewed some earlier instruction after the intervention, which would have affected their knowledge on the subject. We did not have the necessary power to take into account this bias related to the internships and experiences between T2 and T3 because of the number of students. Nevertheless, the results presented in the Appendix show poorer results at T3 than at T2 and T1, thus demonstrating that this bias has a moderate impact and reinforcing the importance of learning by repetition. In addition, we used clinical vignettes to show differences in knowledge. Perhaps a simulation or some other actual practice-oriented testing method might have detected smaller differences. Lastly, students performed the virtual simulation in a small group, whereas the evaluation of the primary outcome was individual. We cannot know if individual sessions would have led to better learning with more knowledge, decision-making ability, and recall. Nevertheless, the collective competition was as present in the virtual simulation group as in the supervised work group.

Conclusion

Satisfaction is higher with virtual simulation without lowering knowledge scores, which argues for the use of such innovative teaching strategies. Future studies should evaluate repeat use as self-stimulation alone or in teams to continue lifelong learning. Our results indicate that further studies should focus on analyzing the cost effectiveness of virtual reality teaching compared with traditional teaching.

Practice points

  • The virtual simulation is probably useful for learning how to manage postpartum hemorrhage because of its greater student satisfaction.

  • The virtual simulation did not produce knowledge of postpartum hemorrhage management better than that obtained with the usual supervised work.

  • Students’ degree of certainty increases over the course of learning but decreases between 2 learning sessions.

Data availability

The datasets used and analyzed during the current study are available from the corresponding author on request.

Abbreviations

PPH:

postpartum hemorrhage.

SW:

supervised work.

VS:

virtual simulation.

References

  1. Satin AJ. Simulation in Obstetrics. Obstet Gynecol. 2018 Jul;132(1):199–209. PMID:29889745.

    Article  Google Scholar 

  2. Akl EA, Sackett KM, Erdley WS, Mustafa RA, Fiander M, Gabriel C, Schünemann H. Educational games for health professionals. Cochrane Database Syst Rev 2013 Jan 31;(1):CD006411. PMID:23440807.

  3. Car J, Carlstedt-Duke J, Tudor Car L, Posadzki P, Whiting P, Zary N, Atun R, Majeed A, Campbell J. Digital Health Education Collaboration. Digital Education in Health Professions: The Need for Overarching Evidence Synthesis. J Med Internet Res 2019 Feb 14;21(2):e12913. PMID:30762583.

  4. Gentry SV, Gauthier A, L’Estrade Ehrstrom B, Wortley D, Lilienthal A, Tudor Car L, Dauwels-Okutsu S, Nikolaou CK, Zary N, Campbell J, Car J. Serious Gaming and Gamification Education in Health Professions: Systematic Review. J Med Internet Res 2019 Mar 28;21(3):e12994. PMID:30920375.

  5. Vermeir JF, White MJ, Johnson D, Crombez G, Van Ryckeghem DML. The Effects of Gamification on Computerized Cognitive Training: Systematic Review and Meta-Analysis. JMIR Serious Games 2020 Aug 10;8(3):e18644. PMID:32773374.

  6. Lumsden J, Edwards EA, Lawrence NS, Coyle D, Munafò MR. Gamification of Cognitive Assessment and Cognitive Training: A Systematic Review of Applications and Efficacy. JMIR Serious Games 2016 Jul 15;4(2):e11. PMID:27421244.

  7. Dupont C, Rudigoz R-C, Cortet M, Touzet S, Colin C, Rabilloud M, Lansac J, Harvey T, Tessier V, Chauleur C, Pennehouat G, Morin X, Bouvier-Colle M-H, Deneux-Tharaux C. Frequency, causes and risk factors of postpartum haemorrhage: a population-based study in 106 French maternity units. J Gynecol Obstet Biol Reprod (Paris). 2014 Mar;43(3):244–53. PMID:23790963.

    Article  Google Scholar 

  8. Sheldon WR, Blum J, Vogel JP, Souza JP, Gülmezoglu AM, Winikoff B, WHO Multicountry Survey on Maternal and Newborn Health Research Network. Postpartum haemorrhage management, risks, and maternal outcomes: findings from the World Health Organization Multicountry Survey on Maternal and Newborn Health. BJOG Int J Obstet Gynaecol. 2014 Mar;121(Suppl 1):5–13. PMID:24641530.

    Article  Google Scholar 

  9. Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, Gülmezoglu AM, Temmerman M, Alkema L. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014 Jun;2(6):e323–33. PMID:25103301.

    Article  Google Scholar 

  10. Geller SE, Koch AR, Martin NJ, Rosenberg D, Bigger HR, Illinois Department of Public Health Maternal Mortality Review Committee Working Group. Assessing preventability of maternal mortality in Illinois: 2002–2012. Am J Obstet Gynecol. 2014 Dec;211(6):698.e1–11. PMID:24956547.

    Article  Google Scholar 

  11. Petersen EE, Davis NL, Goodman D, Cox S, Mayes N, Johnston E, Syverson C, Seed K, Shapiro-Mendoza CK, Callaghan WM, Barfield W. Vital Signs: Pregnancy-Related Deaths, United States, 2011–2015, and Strategies for Prevention, 13 States, 2013–2017. MMWR Morb Mortal Wkly Rep 2019 May 10;68(18):423–429. PMID:31071074.

  12. Saucedo M, Deneux-Tharaux C. Pour le Comité National d’Experts sur la Mortalité Maternelle. [Maternal Mortality, Frequency, causes, women’s profile and preventability of deaths in France, 2013–2015]. Gynecol Obstet Fertil Senol. 2021 Jan;49(1):9–26. PMID:33161191.

    Google Scholar 

  13. American College of Obstetricians and Gynecologists. ACOG Practice Bulletin. Clinical Management Guidelines for Obstetrician-Gynecologists Number 76, October 2006: postpartum hemorrhage. Obstet Gynecol. 2006 Oct;108(4):1039–47. PMID:17012482.

    Google Scholar 

  14. RCOG. Prevention and Management of Postpartum Haemorrhage: Green-top Guideline No. 52. BJOG Int J Obstet Gynaecol 2017 Apr;124(5):e106–e149. [doi: https://doi.org/10.1111/1471-0528.14178].

  15. Sentilhes L, Vayssière C, Deneux-Tharaux C, Aya AG, Bayoumeu F, Bonnet M-P, Djoudi R, Dolley P, Dreyfus M, Ducroux-Schouwey C, Dupont C, François A, Gallot D, Haumonté J-B, Huissoud C, Kayem G, Keita H, Langer B, Mignon A, Morel O, Parant O, Pelage J-P, Phan E, Rossignol M, Tessier V, Mercier FJ, Goffinet F. Postpartum hemorrhage: guidelines for clinical practice from the French College of Gynaecologists and Obstetricians (CNGOF): in collaboration with the French Society of Anesthesiology and Intensive Care (SFAR). Eur J Obstet Gynecol Reprod Biol. 2016 Mar;198:12–21. PMID:26773243.

    Article  Google Scholar 

  16. Bouvier-Colle MH, Ould El Joud D, Varnoux N, Goffinet F, Alexander S, Bayoumeu F, Beaumont E, Fernandez H, Lansac J, Lévy G, Palot M. Evaluation of the quality of care for severe obstetrical haemorrhage in three French regions. BJOG Int J Obstet Gynaecol. 2001 Sep;108(9):898–903. PMID:11563457.

    Article  Google Scholar 

  17. Winter C, Macfarlane A, Deneux-Tharaux C, Zhang W-H, Alexander S, Brocklehurst P, Bouvier-Colle M-H, Prendiville W, Cararach V, van Roosmalen J, Berbik I, Klein M, Ayres-de-Campos D, Erkkola R, Chiechi LM, Langhoff-Roos J, Stray-Pedersen B, Troeger C. Variations in policies for management of the third stage of labour and the immediate management of postpartum haemorrhage in Europe. BJOG Int J Obstet Gynaecol. 2007 Jul;114(7):845–54. PMID:17567419.

    Article  Google Scholar 

  18. Rousseau A, Rozenberg P, Perrodeau E, Deneux-Tharaux C, Ravaud P. Variations in Postpartum Hemorrhage Management among Midwives: A National Vignette-Based Study. PLoS ONE. 2016;11(4):e0152863. PMID:27043439.

    Article  Google Scholar 

  19. Jena AB, Seabury S, Lakdawalla D, Chandra A. Malpractice risk according to physician specialty. N Engl J Med 2011 Aug 18;365(7):629–636. PMID:21848463.

  20. PERINATSIMS | L’outil e-training. des professionnels de la périnatalité [Internet]. MEDUSIMS. [cited 2021 May 11]. Available from: https://medusims.com/perinatsims/.

  21. Wittink DR, Bayer LR. The Measurement Imperative. Mark Res. 2003;15:19.

    Google Scholar 

  22. Rousseau A, Rozenberg P, Ravaud P. Assessing Complex Emergency Management with Clinical Case-Vignettes: A Validation Study. PLoS ONE. 2015;10(9):e0138663. PMID:26383261.

    Article  Google Scholar 

  23. de Wit-Zuurendonk LD, Oei SG. Serious gaming in women’s health care. BJOG Int J Obstet Gynaecol. 2011 Nov;118(Suppl 3):17–21. PMID:22039888.

    Article  Google Scholar 

  24. Wang R, DeMaria S, Goldberg A, Katz D. A Systematic Review of Serious Games in Training Health Care Professionals. Simul Healthc J Soc Simul Healthc. 2016 Feb;11(1):41–51. PMID:26536340.

    Article  Google Scholar 

  25. Gorbanev I, Agudelo-Londoño S, González RA, Cortes A, Pomares A, Delgadillo V, Yepes FJ, Muñoz Ó. A systematic review of serious games in medical education: quality of evidence and pedagogical strategy. Med Educ Online. 2018 Dec;23(1):1438718. PMID:29457760.

    Article  Google Scholar 

  26. O’Leary S, Diepenhorst L, Churley-Strom R, Magrane D. Educational games in an obstetrics and gynecology core curriculum. Am J Obstet Gynecol. 2005 Nov;193(5):1848–51. PMID:16260247.

    Article  Google Scholar 

  27. Moreno-Ger P, Torrente J, Bustamante J, Fernández-Galaz C, Fernández-Manjón B, Comas-Rengifo MD. Application of a low-cost web-based simulation to improve students’ practical skills in medical education. Int J Med Inf. 2010 Jun;79(6):459–67. PMID:20347383.

    Article  Google Scholar 

  28. Telner D, Bujas-Bobanovic M, Chan D, Chester B, Marlow B, Meuser J, Rothman A, Harvey B. Game-based versus traditional case-based learning: comparing effectiveness in stroke continuing medical education. Can Fam Physician Med Fam Can. 2010 Sep;56(9):e345–51. PMID:20841574.

    Google Scholar 

  29. Dankbaar MEW, Richters O, Kalkman CJ, Prins G, Ten Cate OTJ, van Merrienboer JJG, Schuit SCE. Comparative effectiveness of a serious game and an e-module to support patient safety knowledge and awareness. BMC Med Educ 2017 Feb 2;17(1):30. PMID:28148296.

  30. Drummond D, Delval P, Abdenouri S, Truchot J, Ceccaldi P-F, Plaisance P, Hadchouel A, Tesnière A. Serious game versus online course for pretraining medical students before a simulation-based mastery learning course on cardiopulmonary resuscitation: A randomised controlled study. Eur J Anaesthesiol. 2017 Dec;34(12):836–44. PMID:28731928.

    Article  Google Scholar 

  31. Alyami H, Alawami M, Lyndon M, Alyami M, Coomarasamy C, Henning M, Hill A, Sundram F. Impact of Using a 3D Visual Metaphor Serious Game to Teach History-Taking Content to Medical Students: Longitudinal Mixed Methods Pilot Study. JMIR Serious Games 2019 Sep 26;7(3):e13748. PMID:31573895.

  32. Boeker M, Andel P, Vach W, Frankenschmidt A. Game-based e-learning is more effective than a conventional instructional method: a randomized controlled trial with third-year medical students. PLoS ONE. 2013;8(12):e82328. PMID:24349257.

    Article  Google Scholar 

  33. Zgheib NK, Dimassi Z, Bou Akl I, Badr KF, Sabra R. The long-term impact of team-based learning on medical students’ team performance scores and on their peer evaluation scores. Med Teach. 2016 Oct;38(10):1017–24. PMID:27008548.

    Article  Google Scholar 

  34. Pires EMSG, Daniel-Filho DA, de Nooijer J, Dolmans DHJM. Collaborative learning: Elements encouraging and hindering deep approach to learning and use of elaboration strategies. Med Teach. 2020 Nov;42(11):1261–9. PMID:32780607.

    Article  Google Scholar 

  35. Ansquer R, Mesnier T, Farampour F, Oriot D, Ghazali DA. Long-term retention assessment after simulation-based-training of pediatric procedural skills among adult emergency physicians: a multicenter observational study. BMC Med Educ 2019 Sep 11;19(1):348. PMID:31510979.

  36. Jang TC, Ryoo HW, Moon S, Ahn JY, Lee DE, Lee WK, Kwak SG, Kim JH. Long-term benefits of chest compression-only cardiopulmonary resuscitation training using real-time visual feedback manikins: a randomized simulation study. Clin Exp Emerg Med 2020 Sep;7(3):206–212. PMID:33028064.

  37. Raman M, McLaughlin K, Violato C, Rostom A, Allard JP, Coderre S. Teaching in small portions dispersed over time enhances long-term knowledge retention. Med Teach. 2010;32(3):250–5. PMID:20218841.

    Article  Google Scholar 

  38. Pelaccia T, Viau R. Motivation in medical education. Med Teach. 2017;39:136–40.

    Article  Google Scholar 

  39. Djaouti D, Alvarez J, Jessel JP. Classifying Serious Game: the G/P/S model in P. In: Felicia. Handbook of Research on Improving Learning and Motivation through Educational Games. Multidisciplinary Approaches, IGI Global; 2011.

Download references

Acknowledgements

We thank Jo Ann Cahn for editing our English.

Funding

The authors received no specific funding for this work.

Author information

Authors and Affiliations

  1. Midwifery Department, CHRU Strasbourg, 67091, Strasbourg, France

    Sandrine Voillequin

  2. Department of Obstetrics and Gynecology, Poissy-Saint Germain Hospital, 78300, Poissy, France

    P. Rozenberg, K. Letutour & A. Rousseau

  3. Clinical Epidemiology, Paris Saclay University, CESP, UVSQ, Inserm, Team U1018, 78180, Montigny- le-Bretonneux, France

    P. Rozenberg & A. Rousseau

  4. Midwifery Department, UVSQ, 78180, Montigny-le-Bretonneux, France

    K. Letutour & A. Rousseau

Authors
  1. Sandrine Voillequin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. P. Rozenberg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. Letutour
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. A. Rousseau
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

Conceived and designed the experiments: AR, PR, SV. Performed the experiments: AR, SV. Analyzed the data: SV. Contributed reagents/materials/analysis tools: AR, SV, KL. Wrote the paper: SV, AR, PR, KL.

Corresponding author

Correspondence to Sandrine Voillequin.

Ethics declarations

Ethics approval and consent to participate

The approval of an ethics and protection of persons committee was not required, as this study was not a study involving the human person, according to article R1121–1 of the French Public Health Code and did not require registration with Registry of Clinical Trials. This study was declared and approved by the French National Commission of Informatics and Liberties on January 21, 2017 (CNIL number DN 17 − 01) according to the French laws. Randomization took place after verification of the inclusion criteria and after participants had provided written informed consent. All study participants could withdraw at any time. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable since no personal data are included in the manuscript.

Competing interests

The authors have declared that no competing interests exist.

This research did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Voillequin, S., Rozenberg, P., Letutour, K. et al. Comparative satisfaction and effectiveness of virtual simulation and usual supervised work for postpartum hemorrhage management: a crossover randomized controlled trial. BMC Med Educ 22, 709 (2022). https://doi.org/10.1186/s12909-022-03761-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03761-5

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us