Skip to main content
Download PDF

Use of web-based game in neonatal resuscitation - is it effective?

BMC Medical Education volume 20, Article number: 170 (2020) Cite this article

Abstract

Background

Knowledge and skills decline within months post simulation-based training in neonatal resuscitation. To empower ‘Millennial’ learners to take control of their own learning, a single-player, unguided web-based Neonatal Resuscitation Game was designed. The present study investigates the effectiveness of the game on retention of resuscitation knowledge and skills.

Methods

The study evaluated 162 healthcare professionals who attended simulation-based training in neonatal resuscitation. Following standard simulation-based training, participants were assigned to either a gaming group (Gamers) with access to the web-based Neonatal Resuscitation Game or a control group (Controls) with no access to the game. Although Gamers were given access, game utilization was completely voluntary and at will. Some Gamers chose to utilize the web-based game (Players) and others did not (Non-players). Knowledge and skills in neonatal resuscitation were assessed upon completion of training and 6 months post-training using a multiple-choice question test and a manikin-based skills test. Changes in scores were compared statistically between Gamers vs Controls, Players vs Controls, and Players vs Controls + Non-players using two-sample t-tests.

Results

At the final assessment, declines in knowledge scores were seen in all groups. Mean change from baseline in knowledge and skill performance scores at 6 months, adjusted for baseline skill performance and MCQ test scores, did not differ significantly between Players vs Controls and Players vs Controls + Non-players.

Conclusion

The web-based game in its current format may not be effective in facilitating retention of knowledge and technical skills in neonatal resuscitation.

Peer Review reports

Background

The first minute after the birth of a newborn, also termed the golden minute is a period of anxiety for parents and healthcare providers. The newborn undergoes rapid, significant physiological changes to adapt to the extra-uterine environment [1]. Most newborns go through the transition with minimal or no assistance and initiate spontaneous respiration within 10–30 s of birth. However, approximately 10% require drying and stimulation, 3% initiate respiration after positive pressure ventilation (PPV), 2% require intubation to support respiratory function and 0.1% require chest compressions and/or adrenalin [2,3,4]. Failure to provide the necessary assistance at this critical time could result in birth asphyxia, with long-term complications and even death [5].

Accessibility of neonatal resuscitation is essential in all clinical settings where babies are born and cared for. Although inexpensive and cost effective, studies indicate that the need for neonatal resuscitation may not be recognised or anticipated and hence not initiated, or the methods used are inadequate or wrong [6]. Training programs in neonatal resuscitation have shown positive changes toward anticipating and preparing for neonatal resuscitation and improved resuscitation performance [7, 8]. The introduction of standardised formal neonatal resuscitation training programs has resulted in reduced early neonatal mortality in low- and middle-income countries [9]. However, knowledge and skills acquired deteriorate with time, especially when learning attained is not used or exercised for extended periods of time [10]. Mosley and Shaw [11] report deterioration of skills within 3 to 5 months post attendance at a newborn life support course.

The challenge in resuscitation retraining is to find an effective and efficient way to provide practical, hands-on experience to ensure that essential knowledge and skills are sustained once attained by an individual and/or team. Studies in computer technology-based simulation in particular games have shown acceleration of learning, increments in motivation and support for development of higher order cognitive thinking skills [12, 13]. However, the role of computer simulated games supporting self-practice in neonatal resuscitation has not been studied. Computer-based simulated games allow learning by trial and error in a risk-free environment, while maintaining a high level of realism [14].

‘Serious games’ are defined by Bergeron [15] as “interactive computer applications, with or without significant hardware components, created for the purpose of imparting knowledge or skills (such as procedural techniques, decision-making, problem-solving etc.), and which incorporate an element of scoring as well as challenging goals and engaging design” (p.122). This instructional design is known to enjoy the same advantages as simulation in that it enhances patient safety, is adaptable to specific learning objectives, standardises training at reduced operating costs and has wide accessibility [16]. Through text, sounds and pictures incorporated into the game, learning occurs as the learner reflects on an outcome relative to decisions made, performs abstract conceptualization and participates in active experimentation of complex subject matter [13, 17, 18]. Learning is reinforced with gameplay repetition as learners develop mental reasoning skills to solve unprecedented problems [19].

The opportunity to rehearse using a web-based game can potentially improve patient safety without involving the use of high-fidelity manikins and expensive simulation laboratory facilities that increase the cost of training. Evidence of possible benefits of game-based learning in healthcare education and the lack of relevant games in neonatal resuscitation to facilitate self-practice in advanced neonatal resuscitation led us to develop a single-user, unguided web-based game in neonatal resuscitation. An evaluation was performed to assess the game’s effectiveness and suitability with respect to its designated purpose and application. By measuring learning outcomes, improvements in neonatal resuscitation knowledge and skills would assure users of game viability and convince learners of the value of a web-based game as a medium for self-practice. Educators and game developers may be guided by results of outcome measures in justifying and recommending web-based games as an effective training tool. This paper reports findings of a study on the effectiveness of a web-based game as an aid for retention of knowledge and technical skills in neonatal resuscitation subsequent to ‘standard’ simulation-based training in neonatal resuscitation.

Methods

The study is considered an educational audit and hence exempted from ethical review by the SingHealth Centralized Institutional Review Board (CIRB).

  1. A.

    Participant Selection and Intervention

  1. 1)

    Study Participants and Sampling: Participants who attended the Singapore Neonatal Resuscitation Course (SNRC) conducted at the Singapore General Hospital (SGH) and the KK Women's & Children’s Hospital (KKH) during the period of October 2016 to July 2017 were introduced to the study at the start of the workshop, and study information leaflets detailing the study purpose and structure were disseminated. Workshop participants from October 2016 to January 2017 who consented to participate constituted the control group (Controls), and participants who attended the workshop from April 2017 to July 2017 and consented to participate constituted the experimental group (Gamers). All study groups completed the same standard, simulation-based training.

Given the lack of prior data, a ‘medium’ effect size of 0.5 was targeted as a clinically meaningful difference between the comparative groups. A sample size of 64 per group was used, based on a two-sample t-test, to detect an effect size of 0.5 with 80% power at α = 0.05 [20].

 2) Interventions: Gamers received access to the web-based simulation game 3 months after completion of structured training. The timeframe was decided based on a report by Mosley & Shaw [11] which showed that knowledge and skills decline as early as 3 months post-training. A user-specific password was emailed to the participants in the experimental group (Gamers) and reminders to access the game were sent monthly via email. A revised edition of the game is available at https://resuscitation.i-maginary.eu/ and details on web-based game product is attached in Additional file 1: Appendix I.

  1. B.

    Outcomes Measurements and Data Collection

  1. 1)

    Outcome Measurements and Assessment Process: A study coordinator uninvolved in the data analysis monitored the assignment, frequency and duration of each gameplay and assisted in scheduling the follow-up assessments. Participants were not informed of the exact date of the follow-up assessment at enrolment. Email communication was made with Directors of the Clinical Departments and Nursing Division to excuse the respective study participants from their shift. To minimise disruption and inconvenience to all participants, arrangements were made in advance of the targeted test date(s). At assessments, participants complete a questionnaire detailing demographics, history of prior experience in resuscitation, and additional learning in resuscitation between training and evaluation.

A separate team of neonatal resuscitation workshop instructors not involved in the study methodology conducted the assessments. Knowledge in resuscitation was measured at two time-points using two different sets of multiple-choice questions: baseline, performed immediately post-training; and final assessment, conducted 6 months post-training. The scores from sixty MCQs were quantified and compared as a percentage of the total.

Evaluators blinded to group allocation attended standardization training on the steps, conduct and grading of the skill test prior to the start of the evaluation process. To evaluate the technical skills of neonatal resuscitation, participants were presented with a standardised scenario involving a term baby and performance in three basic key skills: 1) initial steps of resuscitation inclusive of airway manoeuvres, 2) bag-mask ventilation, and 3) chest compression were assessed using the Laerdal newborn task-trainer manikin (Laerdal Medical, Texas, USA). Baseline and final manikin-based skill tests were performed using different scenarios involving term infants. A checklist (Additional file 1: Appendixes IIa and IIb) was used to grade participants across the criteria required for the performance of key technical skills. The choice of appropriate equipment and the correct use of equipment were scored on a scale of 0 to 2. An incorrect choice or a persistently wrong application was scored as 0, and a correct choice or a consistently correction application received a score of 2. Tests were administered individually and in private by an evaluator.

2) Data Analysis: The baseline and final MCQ scores, and skill performance scores of Controls were collated and contrasted against that of Gamers and Players. Knowledge and skill retention was measured by differences between the mean percentage point change in MCQ scores and skill performance tests scores obtained at baseline and final assessments. Per-protocol analysis was performed to provide an estimate of efficacy of the web-based game intervention. In addition, an ‘as-assigned’ analysis comparing Players against pooled Controls and Non-players was performed.

Continuous variables were summarised as mean and standard deviation or median and range where data is skewed, and categorical variables as frequencies and percentages. In univariate analysis, mean or median values of continuous participant characteristics, MCQ and skill performance tests scores were compared between study groups using a two-sample t-test, and proportions were compared using Fisher’s exact test. Differences in MCQ and skill assessment scores were compared between Gamers and Controls after adjustment for baseline MCQ and skill performance test scores. Only participants who completed assessments at baseline and final testing were included in the final analyses. Statistical significance was set at p < 0.05. All analyses were performed using SAS v9.4 [21].

Results

  1. A.

    Study Enrolment

In all, 162 healthcare professionals attended the course over the period October 2016 to July 2017. Upon completion of the workshop training, 143 (88.3%) of course participants (74 controls, 69 gamers) consented to participate in the study and completed the baseline assessment. Fifty-three (71.6%) controls and 50 (72.5%) gamers completed the final full tests at 6 months ±2 weeks post-training. Of the 50 experimental participants, 27 (54%) visited the game website, of whom only 16 (32%) attempted the gameplay (Fig. 1).

  1. B.

    Participant Characteristics

  1. 1)

    Control vs intervention based on group assignment (Controls vs Gamers and Controls and Non-Players vs Players): There were no statistically significant differences between Controls vs Gamers and Controls + Non-Players vs Players relative to age, professional group, gender, place of work, duration of service, numbers of neonatal resuscitation attended per month or engagement in video gameplay. Of pre-existing factors that may have influenced outcomes, prior training in neonatal resuscitation - either as part of BCLS training and/or ad hoc in-house orientation at the start of their rotation, was significantly higher among Controls compared with Gamers (p = 0.004) (Table 1). Engagement in video games is statistically higher among Players than Controls and Non-Players (p = 0.001) (Table 1).

Fig. 1
figure 1

Flow diagram on enrolment of participants

Full size image
Table 1 Characteristics of Participants by Study Groups comparing Controls vs Gamers and Controls + Non-Players vs Players
Full size table
  1. 2)

    Intervention versus non-intervention based on actual study participation (Players vs Controls, and Players vs Controls and Non-players): In evaluating the effects of the gameplay intervention on knowledge and skill retention, a per protocol analysis comparing Players vs Controls was performed. In addition, an ‘as-assigned’ analysis comparing Players vs pooled Controls and Non-players was also performed. Characteristics of Players versus Controls + Non-players were similar with median age of 29.5 years for Players compared to 32.5 years for Controls + Non-players (p = NS). The mean (SD) number of gameplay sessions performed during the intervention period preceding the final tests was 7.5 (8.1) with range of 1 to 30.

  1. C.

    Baseline knowledge and skill performance of study participants: The mean (SD) baseline knowledge score for Controls was 78.6% (10.8%) compared with 81.3% (10.3%) among Gamers (p = 0.252). Similarly, there was no statistical difference in the baseline mean (SD) total skill performance scores between Controls and Gamers [72.1% (17.8%) versus 71.3% (16.7%)] respectively (p = 0.784). The Controls performed marginally better in the sub-skill of initial steps of resuscitation with a mean score of 67.1% compared to 59.4% for Gamers (p = 0.049), but no significant differences between groups were observed in the other sub-skills.

  2. D.

    Knowledge scores and skill performance at 6-months post-training: A consistent decline of 2.4 to 5.8 percentage points was observed at final assessment in the knowledge scores in all study groups. The smallest decline was observed for Players (p = 0.357) while declines for Controls and Non-players were statistically significant with p = 0.049 and p < 0.001, respectively (Fig. 2).

Fig. 2
figure 2

Bar Charts comparing baseline and final knowledge and skill performance test scores. Bar charts illustrates the mean knowledge, total skills and sub-skills scores at baseline and final test by study groups (Controls, Non-players and Players), p < 0.05 indicates significant difference in performance between baseline and final test in each study group

Full size image

Declines were observed in the skill performance scores for all study groups (Fig. 2). The most significant decline was observed for Players (p = 0.016) while Controls and Non-players showed smaller, non-significant decline with p = 0.079 and p = 0.449, respectively (Fig. 2). Chest compression exhibited a statistically significant decline even among Players (p = 0.012).

  1. E.

    Efficacy and effectiveness of web-based game on retention of knowledge and technical skills: Per-protocol analysis measures the efficacy of the web-based game on retention of knowledge and technical skills in neonatal resuscitation. The mean knowledge test scores for Players compared to Controls were higher (80.3 ± 7.8 vs 75.7 ± 11.3, p = 0.072) at final assessment but there was no difference in change in mean knowledge test scores from baseline to the final assessment (− 2.4 ± 10.1 vs − 2.6 ± 9.3, p = 0.949) for Players compared to Controls (Table 2). After adjusting for baseline knowledge level, a smaller non-significant decline in mean knowledge test scores was noted for Players compared to Controls (Table 2). At baseline assessment, the mean total skill performance scores of Players was higher at 77.8 + 15.8 compared with 71.7 + 17.3 in the Controls (p = 0.192), with statistically better performance at chest compression (85.7 + 14.8 vs 73.7 + 21.7, p = 0.016). The decline in total skill and sub-skills performance scores at final assessment was greater in the Players compared to Controls with respective declines of 9 to 16 versus 3 to 7 percentage points (Table 2). Adjusting for baseline skill levels, the decline in total skill and sub-skills performance scores from baseline to final assessment remained greater for Players compared with Controls (Table 2). Per-protocol analysis reflects a decline in technical skills of resuscitation in the Players but bias due to exclusion of participants who did not access gameplay cannot be ruled out. The ‘as-assigned’ analysis comparing Players vs Controls + Non-players yielded similar changes in knowledge, total skills and sub-skill performance from baseline to 6 months post-training (Table 3).

Table 2 Comparison of knowledge and skill performance scores at 6 months between Players vs Controls
Full size table
Table 3 Comparison of knowledge and skill performance scores at 6 months between Controls + Non-players vs Players
Full size table

Modified intention-to-treat analysis (ITT) including study participants who completed both the baseline and final tests showed that the use of web-based game resulted in no significant differences in the mean knowledge test scores and technical skill performance scores, both total and sub-skills at final assessment between the Gamers (Players and Non-players) and Controls (Table 4). After adjusting for baseline skill performance levels of participants, the change in total skill and sub-skill performance from baseline to 6 months post-training in both Controls and Gamers exhibited no statistically significant differences.

Table 4 Comparison of knowledge and skill performance scores at 6 months between Controls vs Gamers (Players + Non-players)
Full size table

Discussion

Our study demonstrated significant declines in both knowledge and technical skills at 6 months following a structured neonatal resuscitation course attended by participants assigned to control and web-based game intervention. In the control group, it was observed that technical skills encompassing total performance and sub-skills exhibited greater declines on average (− 3.1 to − 6.5 percentage points) than theoretical knowledge (− 2.6 percentage points) 6 months after standard simulation-based training. Dunn et al. [7] compared knowledge and skill levels in 166 nurses at initiation and after 6 months. At the 6-month follow-up, none of the participants in either groups, ‘controls’ or ‘trained’, passed the skill test, while 85% of the ‘trained’ group obtained a passing mark of 80% on MCQ tests, compared to 23% of the controls, suggesting faster deterioration in skills than in knowledge.

Our findings of diminished retention of knowledge and technical skills in all study groups over time are consistent with the literature. Although all studies differed with respect to the targeted population, the format of initial neonatal resuscitation training, and in measurements and analytical methods on outcomes studied, retention of knowledge and skills exhibited similar patterns of decline within 3 to 6 months after attendance of structured formal training. Differences in degree of decline in retention among studies can be explained by variation in study populations, differences in clinical practice among study populations post-training, and variation in criteria used at testing.

  1. A.

    Effect of web-based game on retention of knowledge

In our study, knowledge in all groups declined over the 6-month study period. Despite higher final mean knowledge scores for Players compared to Controls (p = 0.072), and Players compared to Controls + Non-players (p = 0.046), the changes in mean knowledge scores from baseline to final evaluation in the Players compared with (i) Controls and (ii) Controls + Non-players were not statistically different, suggesting that web-based game in its current format may not be efficacious for knowledge retention in resuscitation. The knowledge deterioration following initial learning plateaued with the introduction of gameplay. However, it is not clear if longer-term practice using the neonatal resuscitation web-based game can improve retention of knowledge in neonatal resuscitation.

There are no comparable serious games that teaches advanced neonatal resuscitation. Video games and VR games developed to reinforce theoretical and basic neonatal resuscitation skills have evaluated learner’s attitudes toward the game but report on educational and clinical outcome is lacking. Of 14 nursing students enrolled to e-baby, a computer-based game designed to teach the assessment of oxygenation in preterm babies for 2 weeks, 57% reported game to be easy to use with 72% motivated to use it for learning [22, 23]. Umoren, Bucher, Purkayastha, Kshatriya, & Avanigadda [24] evaluated the use of Electronic Helping Babies Breathe (eHBB), a computer game developed to practise knowledge in neonatal resuscitation and skills on administering PPV on 24 healthcare workers in resource-limited settings reported that game was educational, easy to use and enabled ‘learning without stress’. Umoren et al. [25] evaluated the use of NRP e-SIM, a simulator game developed to reinforce cognitive skills and the steps in neonatal resuscitation before a hands-on NRP course [26, 27] in a randomised trial involving 255 NRP providers. Findings showed better accuracy in the performance of several steps of the NRP algorithm in the group randomised to pre-NRP course preparation of e-SIM + NRP textbook compared to the textbook only group. However, there was no difference in time needed to perform key NRP steps inclusive of time to start PPV and chest compressions. The effect of repeated e-SIM practice on knowledge and or skill retention was not addressed in the study.

However, studies on the associations between hours of simulation-based practice in Paediatric cardiopulmonary resuscitation training and learning outcomes indicate a dose-response relationship, with more practice producing higher outcome gains and minor variation among learners in time required to achieve a level of mastery [28,29,30]. Findings showed that the percentage of healthcare provider performance rated ‘excellent’ increased from 26 to 65% with use of low dose, high frequency booster training [29]. A study that compared 6 min of monthly practice on a voice advisory manikin to no practice showed that monthly practices resulted in improved skills over baseline [30]. It is also unknown whether repeated tests over a longer duration of gameplay would have a longer-term impact.

The modified ITT analysis comparing final assessment scores showed no difference in change in mean knowledge score from baseline to 6 months for either Controls or Gamers (Players and Non-players), suggesting that the web-based game, as presented to the study participants may not be effective in motivating self-practice or increasing knowledge retention in neonatal resuscitation.

  1. B.

    Effect of web-based game on Skill Performance

In this study, the total skill performance and performance at chest compression were statistically significantly lower at final test for Players compared to Controls and compared to Controls + Non-players. Modified ITT analyses showed similar patterns of decline in performance scores in both total and sub-scales in both the Control and Gamers groups, with the larger decline from baseline to final test in the Players sub-group (p = NS). These tests were conducted using low-fidelity manikins, hence it may be more difficult for the participants to suspend disbelief compared to a real-life situation. However, both the baseline and final tests were done using similar manikins. A study by Campbell, Barozzino, Farrugia, & Sgro [31] that compared the use of low and high fidelity on knowledge and skill acquisition pre- and post-training showed a greater but statistically non-significant improvement in written test scores and shorter times to intubation in the group trained using the high-fidelity manikin. Hence, it remains unclear whether the use of a low-fidelity manikin influences scores in this study.

There is no comparative game in neonatal resuscitation, but a report on the use of MicroSim, a computer game that simulates medical emergencies and procedures designed to support retraining in Advanced Life Support showed no impact on retention of skills [32]. In the study, 20 % of participants elected not to use the intervention program during the one-year study and of those who accessed the MicroSim program, less than 50 % of the users completed the program. Study participants reported lack of social interaction and the lack of motivation to use the tool as reasons for the absence of a significant effect with the use of MicroSim.

Social interaction during training facilitates learning and sharing of resources [33], provides opportunities for learners to draw on their peers to fill gaps in their own knowledge [34], provides learners with emotional support, and makes learning more active and engaging [35, 36]. Our single-user, unguided web-based game provides no opportunity for collaborative interaction, hence missing in extrinsic motivation. Motivation has several effects on learning and learner behaviour. A motivated learner is more likely to initiate and persevere at a task, increasing effort for activities related to their goals [37] and better performance. Elements of fun, challenge, feedback, and rewards embedded in a web-based neonatal resuscitation game can entice and sustain users at gameplay repeatedly and for prolonged sessions, leading to better performance.

The significant decline in mean percentage scores in the total and sub-skill performance tests among participants who practiced using the web-based game suggest that not only is retention absent, but exposure to gameplay may have resulted in negative transfer of skills, hence interfered with skill performance at retest [38]. Negative transfer occurs when previous learning or experience inhibits or interferes with performance in a new context [39]. This may occur in a situation where differences or discontinuity in terms of spatial location and timing of movements between practice using web-based game scenario and the ‘real’ scenario occurs, and game users may modify their performance in a negative way. In addition, if game users have made a connection between skills viewed in the game and they differ from skills that are required in real life, the result will be negative transfer. These two factors can occur using games to train skills in resuscitation, hence accounting for the inappropriate transfer of skills associated with gameplay. In our study, negative transfer noted in the small cohort of 16 participants raises concern but in the absence of statistical significance, the results cannot not be generalised. Further investigation involving a larger sample size is needed.

  1. C.

    Study Limitations and Strengths

The use of controls, standardised MCQs and manikin-based tests, blinding of evaluators and standardisation of skill evaluation among evaluators strengthen the scientific and statistical validity of our study.

Although the demographics of the study groups are similar, unrecognised differences in clinical practice and variations in exposures to sentinel events involving newborn resuscitations among study participants between the two time-points (i.e. baseline and final evaluations) may occur leading to change in resuscitation practices, hence confounding outcomes measured.

The high drop-out rate of 28% in all study groups at final evaluation led to a reduction in sample size. With only 23% of the enrolled cohort accessing the game, the power of the study declined leading to risk of a type 2 error. Next, measuring the learning outcomes at a single time-point of 6 months post-training further restricted the observation on skill performance and MCQ tests. In addition, the MCQ tests and the checklist used were not formally validated. Factors such as learner motivation to train using this approach, variation in entry levels of participant skill in the use of computer-based technology and resource use that may interfere with the outcomes measured were also not evaluated in our study.

Conclusions

In summary, this study reaffirms results of previous studies that knowledge and technical skills associated with neonatal resuscitation decline 6 months post-training, hence practice and more frequent retraining is necessary to maintain knowledge and technical skills in neonatal resuscitation. The evaluation suggests that the game in its current format and making it available to learners 3 months after the standard simulation-based training on a voluntary basis may not be effective in supporting self-practice or in aiding retention of knowledge and technical skills in neonatal resuscitation. However, given the relatively low statistical power and internal validity concerns of the study, the statistical evidence supporting conclusions about the relationships between use of the web-based game and its effect on knowledge and skill retention is weak [40]. More evidence is needed for a complete evaluation of game effectiveness.

Availability of data and materials

The datasets generated and analysed during the study are not publicly available as approval is not currently available from the Health Service Research Unit of SingHealth, the local health cluster where study is conducted. However, datasets are available from the corresponding author on request.

Abbreviations

BCLS:

Basic Cardiac Life Support

BL:

Baseline

CIRB :

Centralized Institutional Review Board

ITT:

Intention-to-treat

MCQ:

Multiple-choice question

NICU:

Neonatal Intensive Care Unit

NNR:

Neonatal resuscitation

NRP:

Neonatal Resuscitation Program

NS:

Not significant

PPV:

Positive pressure ventilation

SCN:

Special Care Nursery

SD:

Standard deviation

References

  1. Hillman N, Kallapur SG, Jobe A. Physiology of transition from intrauterine to extra-uterine life. Clin Perinatol. 2012;39(4):769–83.

    Article  Google Scholar 

  2. Barber CA, Wyckoff MH. Use and efficacy of endotracheal versus intravenous epinephrine during neonatal cardiopulmonary resuscitation in the delivery room. Pediatrics. 2006;118:1028–34.

    Article  Google Scholar 

  3. Ersdal HL, Mduma E, Svensen E, Perlman JM. Early initiation of basic resuscitation interventions including facemask ventilation may reduce birth asphyxia related mortality in low-income countries: a prospective descriptive observational study. Resuscitation. 2012;83:869–73.

    Article  Google Scholar 

  4. Perlman JM, Risser R. Cardiopulmonary resuscitation in the delivery room. Associated clinical events. Arch Pediatr Adolesc Med. 1995;149:20–5.

    Article  Google Scholar 

  5. Patki A. Neonatal Resuscitation - Golden first minute Guidelines. 2015. http://www.fogsi.org/wp-content/uploads/2015/05/pdf/Golden_first_minute. Accessed 20 Oct 2016.

  6. Carlo WA, Wright LL, Chomba E, Mcclure EM, Carlo ME, Bann CM, et al. Educational impact of the neonatal resuscitation program in low-risk delivery centres in a developing country. J Pediatr. 2009;154:504–8.

    Article  Google Scholar 

  7. Dunn S, Niday P, Watters NE, McGrath P, Alcock D. The provision and evaluation of a neonatal resuscitation program. J Contin Educ Nurs. 1992;23:118–26.

    Google Scholar 

  8. Singhal N, McMillan DD, Lockyer JM. Attitudinal and resource change after a neonatal resuscitation training program. Neonatal Netw. 1990;9:35–9.

    Google Scholar 

  9. Pammi M, Dempsey EM, Ryan CA, Barrington KJ. Newborn resuscitation training programmes reduce early neonatal mortality. Neonatology. 2016;110:210–24. https://doi.org/10.1159/000443875.

    Article  Google Scholar 

  10. Kim JW, Ritter FE, Koubek RJ. An integrated theory for improved skill acquisition and retention in the three stages of learning. Theoretical Issues Ergonomics Sci. 2013;14(1):22–37. Available from: https://www.researchgate.net/publication/255950507_An_integrated_theory_ for_improved_skill_acquisition_and_retention_in_the_three_stages_of_learning [Accessed 10 June 2018].

    Article  Google Scholar 

  11. Mosley CMJ, Shaw BNJ. A longitudinal cohort study to investigate the retention of knowledge and skills following attendance on the newborn life support course. Arch Dis Child. 2013;98:582–6. https://doi.org/10.1136/archdischild-2012-303263.

    Article  Google Scholar 

  12. de Freitas S, Jarvis S. A framework for developing serious games to meet learner needs. Inter-service/Industry Training, Simulation, and Education Conference (I/ITSEC). 2006;2742:1–11.

  13. Garris R, Ahlers R, Driskell JE. Games, motivation, and learning, simulation and gaming; an interdisciplinary journal of theory. Practice Research (S&G). 2002;33(4):441–67. https://doi.org/10.1177/1046878102238607.

    Article  Google Scholar 

  14. Oblinger DG. The next generation of educational engagement. JIME. 2004;1(10). doi: https://doi.org/10.5334/2004-8-oblinger.

    Article  Google Scholar 

  15. Bergeron BP. Developing serious games, historical perspective. In: Developing Serious Games. Thompson Learning. 2006; p.122.

  16. Wang R, DeMaria S, Golberg A, Katz D. A systematic review of serious games in training health care professionals. Simul Healthc. 2016;11(1):41–51.

    Article  Google Scholar 

  17. Hereford J, Winn W. Non-speech sound in human-computer interaction: a review and design guidelines. J Educ Comput Res. 1994;11:211–33.

    Article  Google Scholar 

  18. Malone TW, Lepper MR. Making learning fun: a taxonomy of intrinsic motivations for learning. In R.E. Snow & M.J. Farr (Eds). Aptitude, learning and instructions: 1987;vol. 3. Conative and affective process analyses (p 223-253). Hillsdale, NJ: Lawrence Erlbaum.

  19. Bransford J, Franks J, Vye N, Sherwood R. New approaches to instructions: Because Wisdom Can’t be Told. In: Vosniadou S, Ornony A, editors. Similarity and Analogical Reasoning. New York: University Press; 1989.

    Google Scholar 

  20. PASS 14 Power Analysis and Sample Size Software (2015). NCSS, LLC. Kaysville, Utah, ncss.com/software/pass.

  21. SAS Institute Inc, SAS ver9.4, Cary: SAS Institute, 2013.

  22. Fonseca LM, Aredes ND, Dias DM, Scochi CG, Martins JC, Rodrigues MA. Serious game e-baby: nursing students’ perception on learning about preterm newborn clinical assessment. Rev Bras Enferm. 2015;68:9–14.

    Article  Google Scholar 

  23. Fonseca LM, Aredes ND, Fernandes AM, Batalha LM, Apostolo JM, Martins JC, et al. Computer and laboratory simulation in teaching of neonatal nursing: innovation and impact on learning. Rev Bras Enferm. 2016;24:e2808. https://doi.org/10.1590/1518-8345.1005.2808.

    Article  Google Scholar 

  24. Umoren RA, Bucher S, Purkayastha S, Kshatriya BSA, Avanigadda PC. eHBB/mHBS-DHIS2: mobile virtual reality provider training in helping babies breathe. Baltimore: Pediatric Academic Societies; 2019.

    Google Scholar 

  25. Umoren RA, Gray MM, Chitkara R, Josephsen J, Lee HC, Strand M, et al. Pre-Course Preparation with eSim™ Computer-based Simulation Improves NRP Provider Performance on Standardized Simulations. 2019 Pediatric academic societies conference. Baltimore, 2019.

  26. Weiner GM. Textbook of neonatal resuscitation (NRP). 7th ed. Illinois: ELK Grove Village; 2016.

    Google Scholar 

  27. Zaichkin J, McCarney L, Weiner G. Are you prepared? Neonatal Netw. 2016;35:184–91.

    Article  Google Scholar 

  28. Sutton RM, Niles D, Meaney PA, Aplenc R, French B, Abella BS, et al. “Booster” training: evaluation of instructor-led bedside cardiopulmonary resuscitation skill training and automated corrective feedback to improve cardiopulmonary resuscitation compliance of pediatric basic life support providers during simulated cardiac arrest. Pediatr Crit Care Med. 2011a;12(3):e116–21. https://doi.org/10.1097/PCC.0b013e3181e91271.

    Article  Google Scholar 

  29. Sutton RM, Niles D, Meaney PA, Aplenc R, French B, Abella BS, et al. Low-dose, high frequency CPR training improves skill retention of in-hospital pediatric providers. Pediatrics. 2011b;128(1):a145–51. https://doi.org/10.1542/peds.2010-2015.

    Article  Google Scholar 

  30. Oermann MH, Kardong-Edgren SE, Odom-Maryon T. Effects of monthly practice on nursing students’ CPR psychomotor skill performance. Resuscitation. 2011;83(4):447–53. https://doi.org/10.1016/j.resuscitation.2010.11.022.

    Article  Google Scholar 

  31. Campbell DM, Barozzino T, Farrugia M, Sgro M. High-fidelity simulation in neonatal resuscitation. Paediatr Child Health. 2009;14(1):19–23. https://doi.org/10.1093/pch/14.1.19.

    Article  Google Scholar 

  32. Jensen ML, Mondrup F, Lippert F, Ringsted C. Using e-learning for maintenance of ALS competence. Resuscitation. 2009;80(8):903–8. https://doi.org/10.1016/j.resuscitation.2009.06.005.

    Article  Google Scholar 

  33. Lovell B. “We are a tight community”: social groups and social identity in medical undergraduates. Med Educ. 2015;49:1016–27.

    Article  Google Scholar 

  34. Keren D, Lockyer J, Ellaway RH. Social studying and learning among medical students: a scoping review. Perspect Med Educ. 2017;6(5):311–8.

    Article  Google Scholar 

  35. Kingsbury M. Study groups in medical school: help or hindrance? Gap Medics 2014. http://www.gapmedics.com/blog/2014/02/15/study-groups-in-medical-school-help-or-hindrance/.

  36. Kingsbury M. How to study in medical school? Gap medics 2014. http://www.gapmedics.com/blog/2014/02/22/how-to-study-in-medical-school/.

    Google Scholar 

  37. Pintrich PR, Duncan T, Smith DAF, Mckeachie WJ. Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educ Psychol Meas. 1993;53(3):801–13. https://doi.org/10.1177/0013164493053003024.

    Article  Google Scholar 

  38. Healy AF, Wohldmann EL. Chapter six - specificity and transfer of learning. Psychol Learn Motiv. 2012;57:227–53. https://doi.org/10.1016/b978-0-12-394293-7-00006-6.

    Article  Google Scholar 

  39. Leberman S, Mcdonald L, Doyle S. The Transfer of Learning: Participants’ Perspectives of Adult Education and Training; 2006.

    Google Scholar 

  40. Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin; 2002.

    Google Scholar 

Download references

Acknowledgments

We like to thank the game developer, Vito Nitti and technical team, Imaginary srl for collaborating in the design and development of the game. We are grateful to Susan Phung for coordinating the evaluation and the study participants for their participation.

Funding

The web-based game was developed through the joint sponsorship of two private practitioners and Abbvie Pte Ltd. but the study on effectiveness of the web-based game was conducted with no financial support.

Author information

Authors and Affiliations

  1. Department of Neonatal and Developmental Medicine, Singapore General Hospital, Singapore 169608, Singapore

    Cheo Lian Yeo, Selina Kah Ying Ho, Vina Canlas Tagamolila, Sridhar Arunachalam, Srabani Samanta Bharadwaj, Woei Bing Poon, Mary Grace Tan, Priyantha Ebenezer Edison & Ereno Imelda Lustestica

  2. Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore

    Cheo Lian Yeo, Selina Kah Ying Ho, Sridhar Arunachalam, Srabani Samanta Bharadwaj, Woei Bing Poon, Wai Yan Yip, Abdul Alim Abdul Haium, Pooja Agarwal Jayagobi, Shrenik Jitendrakumar Vora & Simrita Kaur Khurana

  3. Duke-NUS Medical School, Singapore 169857, Singapore

    Cheo Lian Yeo, Selina Kah Ying Ho, Sridhar Arunachalam, Srabani Samanta Bharadwaj, Woei Bing Poon, Wai Yan Yip, Abdul Alim Abdul Haium, Pooja Agarwal Jayagobi, Shrenik Jitendrakumar Vora & John Carson Allen

  4. Lee Kong Chian School of Medicine, Singapore 308232, Singapore

    Cheo Lian Yeo, Selina Kah Ying Ho, Vina Canlas Tagamolila, Sridhar Arunachalam, Srabani Samanta Bharadwaj, Woei Bing Poon, Mary Grace Tan, Priyantha Ebenezer Edison, Wai Yan Yip, Abdul Alim Abdul Haium, Pooja Agarwal Jayagobi, Shrenik Jitendrakumar Vora, Simrita Kaur Khurana & Ereno Imelda Lustestica

  5. Department of Neonatology, KK Women’s & Children’s Hospital, Singapore 229899, Singapore

    Wai Yan Yip, Abdul Alim Abdul Haium, Pooja Agarwal Jayagobi, Shrenik Jitendrakumar Vora & Simrita Kaur Khurana

Authors
  1. Cheo Lian Yeo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Selina Kah Ying Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vina Canlas Tagamolila
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sridhar Arunachalam
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Srabani Samanta Bharadwaj
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Woei Bing Poon
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Mary Grace Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Priyantha Ebenezer Edison
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Wai Yan Yip
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Abdul Alim Abdul Haium
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Pooja Agarwal Jayagobi
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Shrenik Jitendrakumar Vora
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Simrita Kaur Khurana
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. John Carson Allen
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Ereno Imelda Lustestica
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CLY, EIL, VCT and SKYH contributed to the conception of the game scenarios. CLY wrote the initial draft of the evaluation protocol and the manuscript. The MCQs were prepared by CLY and SKYH. SKYH and SSB drafted the skill evaluation scenarios, prepared the checklist used in assessment of technical skills and conducted standardisation training for all evaluators involved in the assessment of technical skills. SA, SSB, WBP, MGT, PEE, WYY, AAAH, PAJ, SJV and SKK conducted the evaluations of technical skills. JCA provided statistical input and all authors revised the initial draft of the manuscript for important intellectual content and gave final approval of the manuscript submitted.

Corresponding author

Correspondence to Cheo Lian Yeo.

Ethics declarations

Ethics approval and consent to participate

The study is considered an educational audit and hence exempted from ethical review by the SingHealth Centralized Institutional Review Board (CIRB). However, workshop participants were introduced to the study at the start of the workshop, and study information leaflets detailing the study purpose and structure were disseminated. Written consent was obtained from participants who consented to participate in the study.

Consent for publication

Participant information leaflets detailing the purpose and structure, inclusive of publication of the research study were disseminated to all workshop participants. Hence, consent for publication is implied when participants signed the written consent to participate.

Competing interests

EIL is the chief author of the Neonatal Resuscitation Game. CLY, VCT and SKYH co-authored in the design and development of the game. However, they were not involved in the conduct of the assessments of the study participants. The authors declare that they have no competing interests. There is no immediate plan to market or distribute the neonatal resuscitation game as an educational tool.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Appendix I.

Details of Web-based Game Product. Appendix II a. Skills Assessment Checklist (Baseline Assessment). b. Skills Assessment Checklist (Final Assessment).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yeo, C.L., Ho, S.K.Y., Tagamolila, V.C. et al. Use of web-based game in neonatal resuscitation - is it effective?. BMC Med Educ 20, 170 (2020). https://doi.org/10.1186/s12909-020-02078-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-020-02078-5

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us