A process evaluation of PRONTO simulation training for obstetric and neonatal emergency response teams in Guatemala
BMC Medical Education volume 15, Article number: 117 (2015)
Despite expanding access to institutional birth in Guatemala, maternal mortality remains largely unchanged over the last ten years. Enhancing the quality of emergency obstetric and neonatal care is one important strategy to decrease mortality. An innovative, low-tech, simulation-based team training program (PRONTO) aims to optimize care provided during obstetric and neonatal emergencies in low-resource settings.
We conducted PRONTO simulation training between July 2012 and December 2012 in 15 clinics in Alta Verapaz, Huehuetenango, San Marcos, and Quiche, Guatemala. These clinics received PRONTO as part of a larger pair-matched cluster randomized trial of a comprehensive intervention package. Training participants were obstetric and neonatal care providers that completed pre- and post- training assessments for the two PRONTO training modules, which evaluated knowledge of evidence-based practice and self-efficacy in obstetric and neonatal topics. Part of the training included a session for trained teams to establish strategic goals to improve clinical practice. We utilized a pre/post-test design to evaluate the impact of the course on both knowledge and self-efficacy with longitudinal fixed effects linear regression with robust standard errors. Pearson correlation coefficients were used to assess the correlation between knowledge and self-efficacy. Poisson regression was used to assess the association between the number of goals achieved and knowledge, self-efficacy, and identified facility-level factors.
Knowledge and self-efficacy scores improved significantly in all areas of teaching. Scores were correlated for all topics overall at training completion. More than 60 % of goals set to improve clinic functioning and emergency care were achieved. No predictors of goal achievement were identified.
PRONTO training is effective at improving provider knowledge and self-efficacy in training areas. Further research is needed to evaluate the impact of the training on provider use of evidence-based practices and on maternal and neonatal health outcomes.
Access to a skilled birth attendant and quality emergency obstetric care are important factors that improve maternal and perinatal mortality [1–3]. Although the majority of maternal and perinatal deaths could be prevented with appropriate emergency obstetric care, not all women receive medical attention when needed [4–10]. There are many reasons why women do not have timely access to quality services, including the “three delays”: the delay in decision to seek care; delay in reaching appropriate care in time; and/or the delay in delivery of appropriate care once at a facility [4, 11].
In Guatemala, where neonatal mortality in 2012 was reported as 15 per 1000 live births and the 2010 adjusted maternal mortality was 120 deaths per 100,000 live births, only 51.5 % of women deliver with skilled care providers . This percentage is even lower in indigenous, impoverished areas . To address this problem, the Guatemalan government, with World Bank funding, opened clinics with 24-h labor and delivery care known as Centros de Atención Permanente (CAPs) throughout the country . However, despite these infrastructural developments, mortality remains largely unchanged over the last decade . If sustainable improvements are to be achieved in Guatemala, the complex nature of this problem demands an interdisciplinary, multilevel approach.
A multi-pronged intervention package was designed and implemented in northern Guatemala to address low utilization of clinic-based services, weak community-level linkages between traditional birth attendants (TBAs) and the formal health system, and inadequate provision of emergency obstetric care. The three intervention elements included: 1) community social marketing campaign promoting institutional delivery; 2) professional midwife liaisons working with TBAs; and 3) PRONTOSM (Programa de Rescate Obstétrico y Neonatal: Tratamiento Óptimo y Oportuno), a highly realistic simulation-based obstetric and neonatal emergency and team training program. The goal of this novel and unique training was to improve the quality of care provided in the facilities, and ultimately, perinatal mortality.
Traditional didactic approaches have been found to be of limited effectiveness in improving the management of obstetric emergencies . Simulation-based training has emerged as a key training modality for providers of emergency obstetric care as evidence shows it improves clinical practice, communication, and teamwork skills [17–19]. However, the majority of simulation training is resource-intensive, making its translation into limited-resource settings challenging [20, 21]. PRONTO was developed in Mexico in 2009 as an innovative low-cost, highly realistic, medical training solution for obstetric and neonatal interprofessional care teams , and it is thought that this novel program could improve practice in Guatemala, where no such training exists. PRONTO is the only in-situ, highly realistic simulation and team-training program for limited resource settings of its kind. This paper reports on the impact of the PRONTO on provider knowledge, self-efficacy, and clinic goal achievement. We hypothesize that PRONTO improves healthcare provider knowledge and self-efficacy and promotes achievement of team goals, important practice components that can improve care quality and outcomes in Guatemalan clinics.
Trial design and participants
The PRONTO training intervention was carried out between July and December 2012 at 15 intervention facilities in the four Northern Guatemalan districts of San Marcos, Alta Verapaz, Quiche, and Huehuetenango. These clinics received PRONTO training as part of a larger, pair-matched, cluster randomized controlled trial in 30 clinics with clinical training and community components. This report is limited to an analysis based on pre/post tests administered only to intervention clinics, as control clinics received no intervention and provider testing was not feasible at those sites.
Clinics were excluded from the study if they were not open 24-h, had an operating room, had fewer than an average of seven births per month (in the six months prior to the intervention), or if they were located more than six hours by vehicle to the district’s commercial center. All clinics were located in communities with TBAs and had basic equipment and personnel necessary for vaginal deliveries. In Guatemala, TBAs have no formal training and in recent years the government has encouraged incorporating TBAs into clinics as support staff and doulas. The PRONTO team encouraged clinics to invite community TBAs to participate in the training. Training participants were chosen by clinic directors from the medical personnel who care for women and babies during labor and birth or immediately postpartum and their roles in the simulations were based on their real scope of practice. Providers at the intervention clinics voluntarily participated in the training and received no compensation other than their typical salary, transportation and meals. All trainees were informed that they were in the intervention arm of the trial, and provided verbal informed consent to the use of their written evaluations for research purposes. The study was reviewed and approved by the World Health Organization (WHO) Research and Ethics Review committee, the Independent Latin Ethics Committee, the Guatemalan National Committee for Ethics in Health, Ministry of Public Health, and the University of Washington IRB, Seattle (Application # 41922). The trial is registered at the NIH Current Cluster Trial Registration database (http://www.clinicaltrials.gov; identifier: NCT01653626). The study setting and methods were published elsewhere .
The PRONTO training intervention utilizes highly realistic yet low-technology, low-cost simulation materials. Simulation scenarios take place within the actual clinic setting using only resources that are normally available on-site. PartoPants™, the hybrid simulator worn by a patient actress to simulate obstetric emergencies, were designed by the PRONTO team . PartoPants™ are made from recycled surgical scrub pants and are modified to have a vaginal opening and pocket to hold an IV bag with tubing for simulated blood. A cloth doll and placenta, delivered through the PartoPants™, are used to simulate the neonate and placenta during birth. The Laerdal NeoNatalie© is used for neonatal resuscitation scenarios.
PRONTO consists of two modules conducted two to three months apart that cover topics of teamwork, communication, intercultural fluency, obstetric hemorrhage, neonatal resuscitation, preeclampsia/eclampsia, and shoulder dystocia (Fig. 1). Training sessions have minimal formal didactics and are comprised of interactive team-building exercises, case-based learning, targeted skill sessions, simulation of obstetric and neonatal emergencies, video-guided debriefings and strategic planning sessions. Teamwork and communication concepts, adapted from Team STEPPS™ Training Program, are taught and reinforced throughout both modules [25, 26]. Evidence-based practices for physiologic birth and respectful, culturally humble care are also integral components. The curriculum is based upon WHO standards in maternal and newborn care, and was modified for use in Guatemala to meet the Guatemalan Ministry of Health guidelines . The training was specifically adapted to address common cultural and language barriers between the patient population and the facility providers in Northern Guatemala by addressing cultural humility and humanized birth training in the modules . Finally, during the strategic planning sessions, the provider teams identify actions aiming for clinical improvement based on weaknesses, they self-identify through the simulation and debriefs. No intervention took place at the control clinics.
The primary outcomes included average change in participant self-efficacy and knowledge scores for each training topic area. Training participants at each intervention clinic completed pre- and post- training questionnaires for Modules I and II, which evaluated knowledge of evidence-based practice and confidence in their own ability to perform key skills (self-efficacy). The questionnaires were adapted from instruments used in the PRONTO pilot and subsequent hospital-level controlled trial in Mexico. The Module I pretest and posttest included 58 questions, which assessed knowledge and self-efficacy of obstetric hemorrhage and neonatal resuscitation, and general obstetric emergency self-efficacy. The Module II pretest consisted of 36 questions to assess knowledge and self-efficacy on topics of preeclampsia/eclampsia and shoulder dystocia. The Module II post-test included 94 topical questions from all of the five topics covered throughout Module I and II and was administered at the end of the training intervention. Questionnaires were anonymous and participants were given a study ID to link the pre-post module answers. Knowledge for each topic area was assessed on a scale of 0–100 based on the percentage of correct questions answered. Answers left blank or incorrectly marked with multiple responses were coded as wrong. For each self-efficacy question, participants were asked to assess their level of confidence in performing an array of simple to complex practices related to obstetric and neonatal emergencies using scales of 0–100 based on Bandura’s model of self-efficacy [29, 30]. Scores for each topic area were averaged based on these scales.
Trainees worked in clinic-based teams to decide on goals for improving obstetric/neonatal care, teamwork, work processes, and infrastructure at their site at the end of Module I during a facilitated quality improvement planning session. We grouped goals into four broad categories (teamwork, training, healthcare systems change, and intercultural fluency). There was no stipulation on the number of goals clinics were asked to select. During a follow-up session at the beginning of Module II, trainers evaluated their teams’ achievement of set goals (yes/no). Goal achievement was self-reported, but when possible, system change goals were confirmed by direct observation by PRONTO training personnel. Ongoing research is underway to examine the extent of this intervention’s impact on practice improvement. However, for this phase of the study, clinical improvement goal achievement was used as a proxy measure of practice change.
We used descriptive statistics to characterize participating clinics and trainees. Knowledge and self-efficacy changes were assessed in the areas of obstetric hemorrhage, neonatal resuscitation, preeclampsia/eclampsia, and shoulder dystocia. Change in general obstetric emergency self-efficacy was also assessed. Variables for overall changes in knowledge/self-efficacy for Module I and for Module II were also created. A combined variable for overall knowledge change from the start of the training Module I until the conclusion of training Module II was created for obstetric hemorrhage and neonatal resuscitation. We estimated the impact of the training on test scores by fitting a longitudinal fixed-effects linear regression model with fixed effects at the individual level. The outcome variable was the test score of knowledge or self-efficacy and the dummy variables for time (pre/post training) served as independent variable. The model is represented by the equation:
Where Yi,t is the score for individual i at time t and Yi,0 is the score at baseline, t1 and t2are dummy variables for the first and second measurements and β1, β2 are the average differences in score relative to baseline, εi,t represents random variability at time t. The fixed-effects approach yields an estimate of the within-subject change in the outcome variables (knowledge and self-efficacy) . Robust standard errors with clustering were calculated to take into account within-facility correlation . A second set of models included a time*facility interaction term to test for possible between-facility heterogeneous effects of the training. To characterize the relationship between knowledge and self-efficacy score, the correlation between the two scores was calculated using Pearson’s correlation coefficient for both baseline and follow-up values. Finally, we used descriptive statistics to describe goal setting and achievement.
As a secondary exploratory analysis, we analyzed clinic-level factors possibly associated with goal achievement. To do this, we used Poisson regression with number of goals achieved as the response variable, controlling for number of goals set. Covariates tested for an association with total number of goals achieved were pre/post Module I average change in self-efficacy, pre/post Module I average change in knowledge, training site equipment availability, percent of overall staff attending training, and average age, sex, and profession of participating providers. These variables were selected for the plausibility of an association with success in achieving established goals.
All results are presented as overall and stratified by profession given a previous and reasonable learning differential for auxiliary nurses versus doctors/professional nurses. Significance was defined at p-value < 0.05, and all analyses were performed using STATA v. 12.0 .
We conducted seven complete trainings. Eight of the clinic teams attended training off-site at neighboring clinics. Overall, 219 providers from 15 clinics participated in the PRONTO training intervention, with on average 28 participants at each of the training sessions. Our analysis is limited to the participants (n = 207) who completed the questionnaires for Module I and/or Module II. Questionnaires were designed for doctors and nurses; however, one of the nine TBAs completed a questionnaire, which was included in the analysis. Clinics were on average 51.2 km away from the most used referral hospital and were staffed with 8.6 physicians and professional nurses and 13.5 auxiliary nurses (Table 1). An average 63.0 % of eligible providers were represented in the trainings.
Knowledge in all subject areas improved significantly (p < 0.001) following the training intervention (Table 2). Self-efficacy changes were similar to the knowledge improvements and were all significant at <0.001 (Table 2). A joint test of the time*facility interaction terms yielded no evidence of effect heterogeneity between facilities, except for the obstetric hemorrhage knowledge score, however, even in this case, only two clinics showed a significantly larger effect in the first follow-up evaluation (San Pedro and Tejutla) p < 0.01. For both knowledge and self-efficacy, improvements were similar for all personnel types, however, doctors and professional nurses had higher pre- and post- scores in all topics compared to auxiliary nurses. Knowledge and self-efficacy were found to be positively correlated for all topics at training completion (Table 3) as trainees with high self-efficacy were also found to have high knowledge scores. When stratified by profession, the correlation remained significant for auxiliary nurses only in obstetric hemorrhage and preeclampsia/eclampsia. Doctors and professional nurses, however, had no correlation between knowledge and self-efficacy topics except for shoulder dystocia post-training.
Overall, a total of 93 goals were identified following Module I strategic planning sessions. Types and examples of goals are described in Table 4. On average, each clinic set 5.5 goals and overall 66 % of all goals set were considered achieved at follow-up. Knowledge change, self-efficacy change, average participant age, proportion of males participating, proportion of all clinic staff attending the training, proportion of physicians and professional nurses attending, and the equipment index (composite indicator of the clinic’s supplies, equipment, and medications) were tested as possible indicators of the number of goals achieved. However, no potential predictors of goal achievement were statistically significant in either the crude or multivariate Poisson analysis.
PRONTO training improved knowledge and self-efficacy training topic scores and promoted achievement of goals designed for clinical improvement. The overall rate of goal achievement suggests that simulation training may promote team-based quality improvement and practice change. PRONTO training was considered “very important” for their clinic by 100 % of evaluation respondents, and 97 % (N = 181) of the responding providers (N = 186) said they would use the learning and teamwork concepts in their future work.
Previous evaluations of similar process indicators following PRONTO training in Mexico found comparable results [22, 34]. Other simulation-based training courses have also found that their courses improved provider knowledge, teamwork, communication, and neonatal or maternal outcomes [20, 35–41]. PRONTO, however, is the first course to integrate team training with simulation and care of the maternal-neonatal dyad in low-resource settings.
Several study limitations warrant discussion. While the clinics were randomly selected, individual participation was not random and data was missing from participants who did not complete a questionnaire. Thus there is the potential for selection bias. It was not feasible to administer questionnaires in control clinics due to logistical and resource constraints. Thus, as with any non-experimental pre/post study design, we are unable to account for potential historical, maturation, testing bias that could be responsible for some changes observed. Although the correct answers to the questionnaires were never provided explicitly, we cannot discount potential testing bias as the same test was administered as the pre and post- test. Also, it is likely that there is potential for self-reporting bias, particularly with regard to goal achievement. We did our best to limit this by verifying goals achieved in person whenever possible. We acknowledge that these results showing improved test scores does not necessarily translate into actual practice improvement as that cognitive knowledge does not necessarily translate into clinical ability.
While the questionnaire was utilized in two previous studies, it has not been officially validated due to limited time and resources. However, there has been consistency in the results obtained in varied settings (Mexico, Guatemala, Kenya). One recurrent mistake made by participants was selection of multiple answers when the answer specified to “select one”. This problem was more common on the post-test when participants are usually eager to leave and so, perhaps, reflects the rush of the test-taker. These multiple selected answers were coded as “wrong” for our analysis, which makes our results conservative. At completion of this study, the questionnaire was edited to ensure future clarity.
Our findings suggest that PRONTO training effectively improves provider knowledge and self-efficacy of evidenced-based practice in training topic areas, and promotes goal achievement. PRONTO is the only emergency obstetric and neonatal training, we are aware of, that combines in-situ simulation with team training, with evidence to support improvements in knowledge and self-efficacy among providers. Globally, with widespread recommendation for obstetric and neonatal simulation-based training, the feasibility of adapting PRONTO for implementation in additional low- and high resource settings should be assessed. Following the intervention, supported by our significant results and overwhelmingly positive response by participants and authorities, additional funding was sought and obtained to expand roll-out of the intervention packet in Huehuetenango and Alta Verapaz beyond the intervention facilities, which is now underway. There is ongoing interest in further roll-out in San Marcos and Quiche. More research is needed on the impact of these positive changes on actual maternal and perinatal morbidity and mortality measures, and our impact data is currently being analyzed.
Programa de Rescate Obstétrico y Neonatal: Tratamiento Óptimo y Oportuno (Obstetric and Neonatal Emergency Training for Optimal and Timely Treatment)
Traditional birth attendant
World Health Organization
Stanton C, Blanc AK, Croft T, Choi Y. Skilled care at birth in the developing world: progress to date and strategies for expanding coverage. J Biosoc Sci. 2007;39:109–20.
Garcés A, McClure EM, Hambidge M, Krebs NF, Mazariegos M, Wright LL, et al. Training traditional birth attendants on the WHO Essential Newborn Care reduces perinatal mortality. Acta Obs Gyn Scan. 2012;91:593–7.
Department of Reproductive Health Research. Making Pregnancy Safer: The Critical Role of the Skilled Attendant: A Joint Statement by WHO, ICM and FIGO. Geneva, Switzerland; 2004:24.
Victora CG, Rubens CE, GAPPS Review Group. Global report on preterm birth and stillbirth (4 of 7): delivery of interventions. BMC Pregnancy Childbirth. 2010;10 Suppl 1:S4.
Ronsmans C, Graham WJ. Maternal mortality: who, when, where, and why. Lancet. 2006;368:1189–200.
Bhutta ZA, Cabral S, Chan C-W, Keenan WJ. Reducing maternal, newborn, and infant mortality globally: an integrated action agenda. Int J Gynaecol Obs. 2012;119(119 Suppl):S13–7.
Khan KS, Wojdyla D, Say L, Gülmezoglu AM, Van Look PF A. WHO analysis of causes of maternal death: a systematic review. Lancet. 2006;367:1066–74.
Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO Multicountry Survey on Maternal and Newborn Health): a cross-sectional study. Lancet. 2013;381:1747–55.
Campbell OMR, Graham WJ. Strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368:1284–99.
Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379:2151–61.
Thaddeus S, Maine D. Too far to walk: Maternal mortality in context. Soc Sci Med. 1994;38:1091–110.
At a glance: Guatemala [http://www.unicef.org/infobycountry/guatemala_statistics.html]
MSPAS. National Study of Maternal Mortality. 2011. p. 122.
Guatemala Maternal and Infant Health and Nutrition PO77756 [http://www.worldbank.org/projects/P077756/guatemala-maternal-infant-health-nutrition?lang=en]
Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet. 2010;375:1609–23.
Daniels K, Arafeh J, Clark A, Waller S, Druzin M, Chueh J. Prospective randomized trial of simulation versus didactic teaching for obstetrical emergencies. Simul Heal. 2010;5:40–5.
Robertson B, Schumacher L, Gosman G, Kanfer R, Kelley M, DeVita M. Simulation-based crisis team training for multidisciplinary obstetric providers. Simul Heal. 2009;4:77–83.
Robertson B, Kaplan B, Atallah H, Higgins M, Lewitt MJ, Ander DS. The use of simulation and a modified TeamSTEPPS curriculum for medical and nursing student team training. Simul Heal. 2010;5:332–7.
Phipps MG, Lindquist DG, McConaughey E, O’Brien JA, Raker CA, Paglia MJ. Outcomes from a labor and delivery team training program with simulation component. Am J Obs Gynecol. 2012;206:3–9.
Hofmeyr GJ, Haws RA, Bergström S, Lee ACC, Okong P, Darmstadt GL, et al. Obstetric care in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obs. 2009;107(Suppl):S21–44. S44–5.
Kawaguchi A, Mori R. The In-Service Training for Health Professionals to Improve Care of the Seriously Ill Newborn or Child in Low- and Middle-Income Countries. Geneva: Switzerland; 2010.
Walker DM, Cohen SR, Estrada F, Monterroso ME, Jenny A, Fritz J, et al. PRONTO training for obstetric and neonatal emergencies in Mexico. Int J Gynaecol Obs. 2012;116:128–33.
Kestler E, Walker D, Bonvecchio A, de Tejada SS, Donner A. A matched pair cluster randomized implementation trail to measure the effectiveness of an intervention package aiming to decrease perinatal mortality and increase institution-based obstetric care among indigenous women in Guatemala: study protocol. BMC Pregnancy Childbirth. 2013;13:73.
Cohen SR, Cragin L, Rizk M, Hanberg A, Walker DM. PartoPantsTM: The High-Fidelity, Low-Tech Birth Simulator. Clin Simul Nurs. 2011;7:e11–8.
King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: Team Strategies and Tools to Enhance Performance and Patient Safety. 2008, 3:5–20.
Powell SM. TeamSTEPPS TM - Strategies and Tools to Enhance Performance and Patient Safety : A Collaborative Initiative for Improving Communication and Teamwork in Healthcare. 2006. Figure 1.
WHO. Standards for Maternal and Neonatal Care. 2006.
Fahey JO, Cohen SR, Holme F, Buttrick ES, Dettinger JC, Kestler E, et al. Promoting cultural humility during labor and birth: putting theory into action during PRONTO obstetric and neonatal emergency training. J Perinat Neonat Nurs. 2013;27:36–42.
Bandura A. Self-efficacy: Toward a unifying theory of behavioral change. Psychol Rev. 1977;2:191–215.
Bandura A. Guide for Constructing Self-Efficacy Scales. In Self-Efficacy Beliefs of Adolescents. Information Age Publishing; 2006:307–337.
Allison P. Fixed Effects Regression Models. Newbury Park, CA: Sage; 2009.
Rogers WH. Stata Technical Bulletin 13: Regression Standard Errors in Clustered Samples. 1993. p. 19–23.
StataCorp. STATA Statistical Software: Release12.0. 2011.
Walker D, Cohen S, Fritz J, Olvera M, Lamadrid-Figueroa H, Cowan J, et al. Team training in obstetric and neonatal emergencies using highly realistic simulation in Mexico: impact on process indicators. BMC Pregnancy Childbirth. 2014;14:367.
Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA. Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG. 2007;114:1534–41.
Reynolds A, Ayres-de-Campos D, Lobo M. Self-perceived impact of simulation-based training on the management of real-life obstetrical emergencies. Eur J Obs Gyn R B. 2011;159:72–6.
Crofts JF, Fox R, Draycott TJ, Winter C, Hunt LP, Akande VA. Retention of factual knowledge after practical training for intrapartum emergencies. Int J Gynaecol Obs. 2013;123:81–5.
Guise J-M, Segel S. Teamwork in obstetric critical care. Clin Obs Gynecol. 2008;22:937–51.
Deering S, Johnston LC, Colacchio K. Multidisciplinary teamwork and communication training. Semin Perinatol. 2011;35:89–96.
Draycott T, Sibanda T, Owen L, Akande V, Winter C, Reading S, et al. Does training in obstetric emergencies improve neonatal outcome? BJOG. 2006;113:177–82.
Siassakos D, Crofts JF, Winter C, Weiner CP, Draycott TJ. The active components of effective training in obstetric emergencies. BJOG. 2009;116:1028–32.
We would like acknowledge the Guatemalan program coordinator Marvin Franco De La Rosa and the PRONTO trainers who travelled from Mexico: Yuriana Zurita Salas, Alejandro Vázquez Alcántar and Romeo Cifuentes Pérez. We would also like to thank Monisha Sharma for her contributions, the health care providers who participated in PRONTO training, as well as the facility-level and provincial leadership for their support.
Authors Dilys Walker, Jenifer Fahey, and Susanna Cohen are on the board of PRONTO International, an NGO committed to education and research
All authors contributed to the critical revision of the article and approved of the final manuscript for publication. In addition, DW and FH made substantial contributions to the conception and design of the study and the acquisition and interpretation of data. SZ made substantial contributions to the acquisition, analysis and interpretation of data, and the drafting of the article. AR made substantial contributions to the acquisition, analysis, and interpretation of data. MO made substantial contributions to implementation and management of the study and the acquisition of data. J Fritz made substantial contributions to PRONTO trainings and the acquisition of data. SC and J Fahey made substantial contributions to the design of PRONTO and conception of the study. HL made substantial contributions to the analysis of data. EK made substantial contributions to the conception and design of the study and acquisition of data.
About this article
Cite this article
Walker, D.M., Holme, F., Zelek, S.T. et al. A process evaluation of PRONTO simulation training for obstetric and neonatal emergency response teams in Guatemala. BMC Med Educ 15, 117 (2015). https://doi.org/10.1186/s12909-015-0401-7