Skip to main content

A process evaluation of PRONTO simulation training for obstetric and neonatal emergency response teams in Guatemala

Abstract

Background

Despite expanding access to institutional birth in Guatemala, maternal mortality remains largely unchanged over the last ten years. Enhancing the quality of emergency obstetric and neonatal care is one important strategy to decrease mortality. An innovative, low-tech, simulation-based team training program (PRONTO) aims to optimize care provided during obstetric and neonatal emergencies in low-resource settings.

Methods

We conducted PRONTO simulation training between July 2012 and December 2012 in 15 clinics in Alta Verapaz, Huehuetenango, San Marcos, and Quiche, Guatemala. These clinics received PRONTO as part of a larger pair-matched cluster randomized trial of a comprehensive intervention package. Training participants were obstetric and neonatal care providers that completed pre- and post- training assessments for the two PRONTO training modules, which evaluated knowledge of evidence-based practice and self-efficacy in obstetric and neonatal topics. Part of the training included a session for trained teams to establish strategic goals to improve clinical practice. We utilized a pre/post-test design to evaluate the impact of the course on both knowledge and self-efficacy with longitudinal fixed effects linear regression with robust standard errors. Pearson correlation coefficients were used to assess the correlation between knowledge and self-efficacy. Poisson regression was used to assess the association between the number of goals achieved and knowledge, self-efficacy, and identified facility-level factors.

Results

Knowledge and self-efficacy scores improved significantly in all areas of teaching. Scores were correlated for all topics overall at training completion. More than 60 % of goals set to improve clinic functioning and emergency care were achieved. No predictors of goal achievement were identified.

Conclusions

PRONTO training is effective at improving provider knowledge and self-efficacy in training areas. Further research is needed to evaluate the impact of the training on provider use of evidence-based practices and on maternal and neonatal health outcomes.

Trial registration

NCT01653626

Peer Review reports

Background

Access to a skilled birth attendant and quality emergency obstetric care are important factors that improve maternal and perinatal mortality [13]. Although the majority of maternal and perinatal deaths could be prevented with appropriate emergency obstetric care, not all women receive medical attention when needed [410]. There are many reasons why women do not have timely access to quality services, including the “three delays”: the delay in decision to seek care; delay in reaching appropriate care in time; and/or the delay in delivery of appropriate care once at a facility [4, 11].

In Guatemala, where neonatal mortality in 2012 was reported as 15 per 1000 live births and the 2010 adjusted maternal mortality was 120 deaths per 100,000 live births, only 51.5 % of women deliver with skilled care providers [12]. This percentage is even lower in indigenous, impoverished areas [13]. To address this problem, the Guatemalan government, with World Bank funding, opened clinics with 24-h labor and delivery care known as Centros de Atención Permanente (CAPs) throughout the country [14]. However, despite these infrastructural developments, mortality remains largely unchanged over the last decade [15]. If sustainable improvements are to be achieved in Guatemala, the complex nature of this problem demands an interdisciplinary, multilevel approach.

A multi-pronged intervention package was designed and implemented in northern Guatemala to address low utilization of clinic-based services, weak community-level linkages between traditional birth attendants (TBAs) and the formal health system, and inadequate provision of emergency obstetric care. The three intervention elements included: 1) community social marketing campaign promoting institutional delivery; 2) professional midwife liaisons working with TBAs; and 3) PRONTOSM (Programa de Rescate Obstétrico y Neonatal: Tratamiento Óptimo y Oportuno), a highly realistic simulation-based obstetric and neonatal emergency and team training program. The goal of this novel and unique training was to improve the quality of care provided in the facilities, and ultimately, perinatal mortality.

Traditional didactic approaches have been found to be of limited effectiveness in improving the management of obstetric emergencies [16]. Simulation-based training has emerged as a key training modality for providers of emergency obstetric care as evidence shows it improves clinical practice, communication, and teamwork skills [1719]. However, the majority of simulation training is resource-intensive, making its translation into limited-resource settings challenging [20, 21]. PRONTO was developed in Mexico in 2009 as an innovative low-cost, highly realistic, medical training solution for obstetric and neonatal interprofessional care teams [22], and it is thought that this novel program could improve practice in Guatemala, where no such training exists. PRONTO is the only in-situ, highly realistic simulation and team-training program for limited resource settings of its kind. This paper reports on the impact of the PRONTO on provider knowledge, self-efficacy, and clinic goal achievement. We hypothesize that PRONTO improves healthcare provider knowledge and self-efficacy and promotes achievement of team goals, important practice components that can improve care quality and outcomes in Guatemalan clinics.

Methods

Trial design and participants

The PRONTO training intervention was carried out between July and December 2012 at 15 intervention facilities in the four Northern Guatemalan districts of San Marcos, Alta Verapaz, Quiche, and Huehuetenango. These clinics received PRONTO training as part of a larger, pair-matched, cluster randomized controlled trial in 30 clinics with clinical training and community components. This report is limited to an analysis based on pre/post tests administered only to intervention clinics, as control clinics received no intervention and provider testing was not feasible at those sites.

Clinics were excluded from the study if they were not open 24-h, had an operating room, had fewer than an average of seven births per month (in the six months prior to the intervention), or if they were located more than six hours by vehicle to the district’s commercial center. All clinics were located in communities with TBAs and had basic equipment and personnel necessary for vaginal deliveries. In Guatemala, TBAs have no formal training and in recent years the government has encouraged incorporating TBAs into clinics as support staff and doulas. The PRONTO team encouraged clinics to invite community TBAs to participate in the training. Training participants were chosen by clinic directors from the medical personnel who care for women and babies during labor and birth or immediately postpartum and their roles in the simulations were based on their real scope of practice. Providers at the intervention clinics voluntarily participated in the training and received no compensation other than their typical salary, transportation and meals. All trainees were informed that they were in the intervention arm of the trial, and provided verbal informed consent to the use of their written evaluations for research purposes. The study was reviewed and approved by the World Health Organization (WHO) Research and Ethics Review committee, the Independent Latin Ethics Committee, the Guatemalan National Committee for Ethics in Health, Ministry of Public Health, and the University of Washington IRB, Seattle (Application # 41922). The trial is registered at the NIH Current Cluster Trial Registration database (http://www.clinicaltrials.gov; identifier: NCT01653626). The study setting and methods were published elsewhere [23].

Intervention

The PRONTO training intervention utilizes highly realistic yet low-technology, low-cost simulation materials. Simulation scenarios take place within the actual clinic setting using only resources that are normally available on-site. PartoPants™, the hybrid simulator worn by a patient actress to simulate obstetric emergencies, were designed by the PRONTO team [24]. PartoPants™ are made from recycled surgical scrub pants and are modified to have a vaginal opening and pocket to hold an IV bag with tubing for simulated blood. A cloth doll and placenta, delivered through the PartoPants™, are used to simulate the neonate and placenta during birth. The Laerdal NeoNatalie© is used for neonatal resuscitation scenarios.

PRONTO consists of two modules conducted two to three months apart that cover topics of teamwork, communication, intercultural fluency, obstetric hemorrhage, neonatal resuscitation, preeclampsia/eclampsia, and shoulder dystocia (Fig. 1). Training sessions have minimal formal didactics and are comprised of interactive team-building exercises, case-based learning, targeted skill sessions, simulation of obstetric and neonatal emergencies, video-guided debriefings and strategic planning sessions. Teamwork and communication concepts, adapted from Team STEPPS™ Training Program, are taught and reinforced throughout both modules [25, 26]. Evidence-based practices for physiologic birth and respectful, culturally humble care are also integral components. The curriculum is based upon WHO standards in maternal and newborn care, and was modified for use in Guatemala to meet the Guatemalan Ministry of Health guidelines [27]. The training was specifically adapted to address common cultural and language barriers between the patient population and the facility providers in Northern Guatemala by addressing cultural humility and humanized birth training in the modules [28]. Finally, during the strategic planning sessions, the provider teams identify actions aiming for clinical improvement based on weaknesses, they self-identify through the simulation and debriefs. No intervention took place at the control clinics.

Fig. 1
figure 1

Timeline and components of PRONTO training intervention in Guatemala

Outcome measures

The primary outcomes included average change in participant self-efficacy and knowledge scores for each training topic area. Training participants at each intervention clinic completed pre- and post- training questionnaires for Modules I and II, which evaluated knowledge of evidence-based practice and confidence in their own ability to perform key skills (self-efficacy). The questionnaires were adapted from instruments used in the PRONTO pilot and subsequent hospital-level controlled trial in Mexico. The Module I pretest and posttest included 58 questions, which assessed knowledge and self-efficacy of obstetric hemorrhage and neonatal resuscitation, and general obstetric emergency self-efficacy. The Module II pretest consisted of 36 questions to assess knowledge and self-efficacy on topics of preeclampsia/eclampsia and shoulder dystocia. The Module II post-test included 94 topical questions from all of the five topics covered throughout Module I and II and was administered at the end of the training intervention. Questionnaires were anonymous and participants were given a study ID to link the pre-post module answers. Knowledge for each topic area was assessed on a scale of 0–100 based on the percentage of correct questions answered. Answers left blank or incorrectly marked with multiple responses were coded as wrong. For each self-efficacy question, participants were asked to assess their level of confidence in performing an array of simple to complex practices related to obstetric and neonatal emergencies using scales of 0–100 based on Bandura’s model of self-efficacy [29, 30]. Scores for each topic area were averaged based on these scales.

Trainees worked in clinic-based teams to decide on goals for improving obstetric/neonatal care, teamwork, work processes, and infrastructure at their site at the end of Module I during a facilitated quality improvement planning session. We grouped goals into four broad categories (teamwork, training, healthcare systems change, and intercultural fluency). There was no stipulation on the number of goals clinics were asked to select. During a follow-up session at the beginning of Module II, trainers evaluated their teams’ achievement of set goals (yes/no). Goal achievement was self-reported, but when possible, system change goals were confirmed by direct observation by PRONTO training personnel. Ongoing research is underway to examine the extent of this intervention’s impact on practice improvement. However, for this phase of the study, clinical improvement goal achievement was used as a proxy measure of practice change.

Statistical analysis

We used descriptive statistics to characterize participating clinics and trainees. Knowledge and self-efficacy changes were assessed in the areas of obstetric hemorrhage, neonatal resuscitation, preeclampsia/eclampsia, and shoulder dystocia. Change in general obstetric emergency self-efficacy was also assessed. Variables for overall changes in knowledge/self-efficacy for Module I and for Module II were also created. A combined variable for overall knowledge change from the start of the training Module I until the conclusion of training Module II was created for obstetric hemorrhage and neonatal resuscitation. We estimated the impact of the training on test scores by fitting a longitudinal fixed-effects linear regression model with fixed effects at the individual level. The outcome variable was the test score of knowledge or self-efficacy and the dummy variables for time (pre/post training) served as independent variable. The model is represented by the equation:

$$ {Y}_{i,t}-{Y}_{i,0}={\beta}_1{t}_1+{\beta}_2{t}_2+\left({\varepsilon}_{i,t}-{\varepsilon}_{i,0}\right) $$

Where Yi,t is the score for individual i at time t and Yi,0 is the score at baseline, t1 and t2are dummy variables for the first and second measurements and β1β2 are the average differences in score relative to baseline, εi,t represents random variability at time t. The fixed-effects approach yields an estimate of the within-subject change in the outcome variables (knowledge and self-efficacy) [31]. Robust standard errors with clustering were calculated to take into account within-facility correlation [32]. A second set of models included a time*facility interaction term to test for possible between-facility heterogeneous effects of the training. To characterize the relationship between knowledge and self-efficacy score, the correlation between the two scores was calculated using Pearson’s correlation coefficient for both baseline and follow-up values. Finally, we used descriptive statistics to describe goal setting and achievement.

As a secondary exploratory analysis, we analyzed clinic-level factors possibly associated with goal achievement. To do this, we used Poisson regression with number of goals achieved as the response variable, controlling for number of goals set. Covariates tested for an association with total number of goals achieved were pre/post Module I average change in self-efficacy, pre/post Module I average change in knowledge, training site equipment availability, percent of overall staff attending training, and average age, sex, and profession of participating providers. These variables were selected for the plausibility of an association with success in achieving established goals.

All results are presented as overall and stratified by profession given a previous and reasonable learning differential for auxiliary nurses versus doctors/professional nurses. Significance was defined at p-value < 0.05, and all analyses were performed using STATA v. 12.0 [33].

Results

We conducted seven complete trainings. Eight of the clinic teams attended training off-site at neighboring clinics. Overall, 219 providers from 15 clinics participated in the PRONTO training intervention, with on average 28 participants at each of the training sessions. Our analysis is limited to the participants (n = 207) who completed the questionnaires for Module I and/or Module II. Questionnaires were designed for doctors and nurses; however, one of the nine TBAs completed a questionnaire, which was included in the analysis. Clinics were on average 51.2 km away from the most used referral hospital and were staffed with 8.6 physicians and professional nurses and 13.5 auxiliary nurses (Table 1). An average 63.0 % of eligible providers were represented in the trainings.

Table 1 PRONTO training facility and participant characteristics at intervention hospitals

Knowledge in all subject areas improved significantly (p < 0.001) following the training intervention (Table 2). Self-efficacy changes were similar to the knowledge improvements and were all significant at <0.001 (Table 2). A joint test of the time*facility interaction terms yielded no evidence of effect heterogeneity between facilities, except for the obstetric hemorrhage knowledge score, however, even in this case, only two clinics showed a significantly larger effect in the first follow-up evaluation (San Pedro and Tejutla) p < 0.01. For both knowledge and self-efficacy, improvements were similar for all personnel types, however, doctors and professional nurses had higher pre- and post- scores in all topics compared to auxiliary nurses. Knowledge and self-efficacy were found to be positively correlated for all topics at training completion (Table 3) as trainees with high self-efficacy were also found to have high knowledge scores. When stratified by profession, the correlation remained significant for auxiliary nurses only in obstetric hemorrhage and preeclampsia/eclampsia. Doctors and professional nurses, however, had no correlation between knowledge and self-efficacy topics except for shoulder dystocia post-training.

Table 2 Change in knowledge and self-efficacy scores by profession for management of obstetric and neonatal emergenciesa
Table 3 Correlation between knowledge and self-efficacy by topic and stratified by profession using Pearson’s correlation coefficients

Overall, a total of 93 goals were identified following Module I strategic planning sessions. Types and examples of goals are described in Table 4. On average, each clinic set 5.5 goals and overall 66 % of all goals set were considered achieved at follow-up. Knowledge change, self-efficacy change, average participant age, proportion of males participating, proportion of all clinic staff attending the training, proportion of physicians and professional nurses attending, and the equipment index (composite indicator of the clinic’s supplies, equipment, and medications) were tested as possible indicators of the number of goals achieved. However, no potential predictors of goal achievement were statistically significant in either the crude or multivariate Poisson analysis.

Table 4 Examples of strategic goals achieved and unachieved by category

Discussion

PRONTO training improved knowledge and self-efficacy training topic scores and promoted achievement of goals designed for clinical improvement. The overall rate of goal achievement suggests that simulation training may promote team-based quality improvement and practice change. PRONTO training was considered “very important” for their clinic by 100 % of evaluation respondents, and 97 % (N = 181) of the responding providers (N = 186) said they would use the learning and teamwork concepts in their future work.

Previous evaluations of similar process indicators following PRONTO training in Mexico found comparable results [22, 34]. Other simulation-based training courses have also found that their courses improved provider knowledge, teamwork, communication, and neonatal or maternal outcomes [20, 3541]. PRONTO, however, is the first course to integrate team training with simulation and care of the maternal-neonatal dyad in low-resource settings.

Several study limitations warrant discussion. While the clinics were randomly selected, individual participation was not random and data was missing from participants who did not complete a questionnaire. Thus there is the potential for selection bias. It was not feasible to administer questionnaires in control clinics due to logistical and resource constraints. Thus, as with any non-experimental pre/post study design, we are unable to account for potential historical, maturation, testing bias that could be responsible for some changes observed. Although the correct answers to the questionnaires were never provided explicitly, we cannot discount potential testing bias as the same test was administered as the pre and post- test. Also, it is likely that there is potential for self-reporting bias, particularly with regard to goal achievement. We did our best to limit this by verifying goals achieved in person whenever possible. We acknowledge that these results showing improved test scores does not necessarily translate into actual practice improvement as that cognitive knowledge does not necessarily translate into clinical ability.

While the questionnaire was utilized in two previous studies, it has not been officially validated due to limited time and resources. However, there has been consistency in the results obtained in varied settings (Mexico, Guatemala, Kenya). One recurrent mistake made by participants was selection of multiple answers when the answer specified to “select one”. This problem was more common on the post-test when participants are usually eager to leave and so, perhaps, reflects the rush of the test-taker. These multiple selected answers were coded as “wrong” for our analysis, which makes our results conservative. At completion of this study, the questionnaire was edited to ensure future clarity.

Conclusions

Our findings suggest that PRONTO training effectively improves provider knowledge and self-efficacy of evidenced-based practice in training topic areas, and promotes goal achievement. PRONTO is the only emergency obstetric and neonatal training, we are aware of, that combines in-situ simulation with team training, with evidence to support improvements in knowledge and self-efficacy among providers. Globally, with widespread recommendation for obstetric and neonatal simulation-based training, the feasibility of adapting PRONTO for implementation in additional low- and high resource settings should be assessed. Following the intervention, supported by our significant results and overwhelmingly positive response by participants and authorities, additional funding was sought and obtained to expand roll-out of the intervention packet in Huehuetenango and Alta Verapaz beyond the intervention facilities, which is now underway. There is ongoing interest in further roll-out in San Marcos and Quiche. More research is needed on the impact of these positive changes on actual maternal and perinatal morbidity and mortality measures, and our impact data is currently being analyzed.

Abbreviations

PRONTO:

Programa de Rescate Obstétrico y Neonatal: Tratamiento Óptimo y Oportuno (Obstetric and Neonatal Emergency Training for Optimal and Timely Treatment)

TBA:

Traditional birth attendant

WHO:

World Health Organization

References

  1. Stanton C, Blanc AK, Croft T, Choi Y. Skilled care at birth in the developing world: progress to date and strategies for expanding coverage. J Biosoc Sci. 2007;39:109–20.

    Article  Google Scholar 

  2. Garcés A, McClure EM, Hambidge M, Krebs NF, Mazariegos M, Wright LL, et al. Training traditional birth attendants on the WHO Essential Newborn Care reduces perinatal mortality. Acta Obs Gyn Scan. 2012;91:593–7.

    Article  Google Scholar 

  3. Department of Reproductive Health Research. Making Pregnancy Safer: The Critical Role of the Skilled Attendant: A Joint Statement by WHO, ICM and FIGO. Geneva, Switzerland; 2004:24.

  4. Victora CG, Rubens CE, GAPPS Review Group. Global report on preterm birth and stillbirth (4 of 7): delivery of interventions. BMC Pregnancy Childbirth. 2010;10 Suppl 1:S4.

    Article  Google Scholar 

  5. Ronsmans C, Graham WJ. Maternal mortality: who, when, where, and why. Lancet. 2006;368:1189–200.

    Article  Google Scholar 

  6. Bhutta ZA, Cabral S, Chan C-W, Keenan WJ. Reducing maternal, newborn, and infant mortality globally: an integrated action agenda. Int J Gynaecol Obs. 2012;119(119 Suppl):S13–7.

    Article  Google Scholar 

  7. Khan KS, Wojdyla D, Say L, Gülmezoglu AM, Van Look PF A. WHO analysis of causes of maternal death: a systematic review. Lancet. 2006;367:1066–74.

    Article  Google Scholar 

  8. Souza JP, Gülmezoglu AM, Vogel J, Carroli G, Lumbiganon P, Qureshi Z, et al. Moving beyond essential interventions for reduction of maternal mortality (the WHO Multicountry Survey on Maternal and Newborn Health): a cross-sectional study. Lancet. 2013;381:1747–55.

    Article  Google Scholar 

  9. Campbell OMR, Graham WJ. Strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368:1284–99.

    Article  Google Scholar 

  10. Liu L, Johnson HL, Cousens S, Perin J, Scott S, Lawn JE, et al. Global, regional, and national causes of child mortality: an updated systematic analysis for 2010 with time trends since 2000. Lancet. 2012;379:2151–61.

    Article  Google Scholar 

  11. Thaddeus S, Maine D. Too far to walk: Maternal mortality in context. Soc Sci Med. 1994;38:1091–110.

    Article  Google Scholar 

  12. At a glance: Guatemala [http://www.unicef.org/infobycountry/guatemala_statistics.html]

  13. MSPAS. National Study of Maternal Mortality. 2011. p. 122.

    Google Scholar 

  14. Guatemala Maternal and Infant Health and Nutrition PO77756 [http://www.worldbank.org/projects/P077756/guatemala-maternal-infant-health-nutrition?lang=en]

  15. Hogan MC, Foreman KJ, Naghavi M, Ahn SY, Wang M, Makela SM, et al. Maternal mortality for 181 countries, 1980–2008: a systematic analysis of progress towards Millennium Development Goal 5. Lancet. 2010;375:1609–23.

    Article  Google Scholar 

  16. Daniels K, Arafeh J, Clark A, Waller S, Druzin M, Chueh J. Prospective randomized trial of simulation versus didactic teaching for obstetrical emergencies. Simul Heal. 2010;5:40–5.

    Article  Google Scholar 

  17. Robertson B, Schumacher L, Gosman G, Kanfer R, Kelley M, DeVita M. Simulation-based crisis team training for multidisciplinary obstetric providers. Simul Heal. 2009;4:77–83.

    Article  Google Scholar 

  18. Robertson B, Kaplan B, Atallah H, Higgins M, Lewitt MJ, Ander DS. The use of simulation and a modified TeamSTEPPS curriculum for medical and nursing student team training. Simul Heal. 2010;5:332–7.

    Article  Google Scholar 

  19. Phipps MG, Lindquist DG, McConaughey E, O’Brien JA, Raker CA, Paglia MJ. Outcomes from a labor and delivery team training program with simulation component. Am J Obs Gynecol. 2012;206:3–9.

    Article  Google Scholar 

  20. Hofmeyr GJ, Haws RA, Bergström S, Lee ACC, Okong P, Darmstadt GL, et al. Obstetric care in low-resource settings: what, who, and how to overcome challenges to scale up? Int J Gynaecol Obs. 2009;107(Suppl):S21–44. S44–5.

    Article  Google Scholar 

  21. Kawaguchi A, Mori R. The In-Service Training for Health Professionals to Improve Care of the Seriously Ill Newborn or Child in Low- and Middle-Income Countries. Geneva: Switzerland; 2010.

    Google Scholar 

  22. Walker DM, Cohen SR, Estrada F, Monterroso ME, Jenny A, Fritz J, et al. PRONTO training for obstetric and neonatal emergencies in Mexico. Int J Gynaecol Obs. 2012;116:128–33.

    Article  Google Scholar 

  23. Kestler E, Walker D, Bonvecchio A, de Tejada SS, Donner A. A matched pair cluster randomized implementation trail to measure the effectiveness of an intervention package aiming to decrease perinatal mortality and increase institution-based obstetric care among indigenous women in Guatemala: study protocol. BMC Pregnancy Childbirth. 2013;13:73.

    Article  Google Scholar 

  24. Cohen SR, Cragin L, Rizk M, Hanberg A, Walker DM. PartoPantsTM: The High-Fidelity, Low-Tech Birth Simulator. Clin Simul Nurs. 2011;7:e11–8.

    Article  Google Scholar 

  25. King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: Team Strategies and Tools to Enhance Performance and Patient Safety. 2008, 3:5–20.

  26. Powell SM. TeamSTEPPS TM - Strategies and Tools to Enhance Performance and Patient Safety : A Collaborative Initiative for Improving Communication and Teamwork in Healthcare. 2006. Figure 1.

    Google Scholar 

  27. WHO. Standards for Maternal and Neonatal Care. 2006.

    Google Scholar 

  28. Fahey JO, Cohen SR, Holme F, Buttrick ES, Dettinger JC, Kestler E, et al. Promoting cultural humility during labor and birth: putting theory into action during PRONTO obstetric and neonatal emergency training. J Perinat Neonat Nurs. 2013;27:36–42.

    Article  Google Scholar 

  29. Bandura A. Self-efficacy: Toward a unifying theory of behavioral change. Psychol Rev. 1977;2:191–215.

    Article  Google Scholar 

  30. Bandura A. Guide for Constructing Self-Efficacy Scales. In Self-Efficacy Beliefs of Adolescents. Information Age Publishing; 2006:307–337.

  31. Allison P. Fixed Effects Regression Models. Newbury Park, CA: Sage; 2009.

    Book  Google Scholar 

  32. Rogers WH. Stata Technical Bulletin 13: Regression Standard Errors in Clustered Samples. 1993. p. 19–23.

    Google Scholar 

  33. StataCorp. STATA Statistical Software: Release12.0. 2011.

    Google Scholar 

  34. Walker D, Cohen S, Fritz J, Olvera M, Lamadrid-Figueroa H, Cowan J, et al. Team training in obstetric and neonatal emergencies using highly realistic simulation in Mexico: impact on process indicators. BMC Pregnancy Childbirth. 2014;14:367.

    Article  Google Scholar 

  35. Crofts JF, Ellis D, Draycott TJ, Winter C, Hunt LP, Akande VA. Change in knowledge of midwives and obstetricians following obstetric emergency training: a randomised controlled trial of local hospital, simulation centre and teamwork training. BJOG. 2007;114:1534–41.

    Article  Google Scholar 

  36. Reynolds A, Ayres-de-Campos D, Lobo M. Self-perceived impact of simulation-based training on the management of real-life obstetrical emergencies. Eur J Obs Gyn R B. 2011;159:72–6.

    Article  Google Scholar 

  37. Crofts JF, Fox R, Draycott TJ, Winter C, Hunt LP, Akande VA. Retention of factual knowledge after practical training for intrapartum emergencies. Int J Gynaecol Obs. 2013;123:81–5.

    Article  Google Scholar 

  38. Guise J-M, Segel S. Teamwork in obstetric critical care. Clin Obs Gynecol. 2008;22:937–51.

    Google Scholar 

  39. Deering S, Johnston LC, Colacchio K. Multidisciplinary teamwork and communication training. Semin Perinatol. 2011;35:89–96.

    Article  Google Scholar 

  40. Draycott T, Sibanda T, Owen L, Akande V, Winter C, Reading S, et al. Does training in obstetric emergencies improve neonatal outcome? BJOG. 2006;113:177–82.

    Article  Google Scholar 

  41. Siassakos D, Crofts JF, Winter C, Weiner CP, Draycott TJ. The active components of effective training in obstetric emergencies. BJOG. 2009;116:1028–32.

    Article  Google Scholar 

Download references

Acknowledgements

We would like acknowledge the Guatemalan program coordinator Marvin Franco De La Rosa and the PRONTO trainers who travelled from Mexico: Yuriana Zurita Salas, Alejandro Vázquez Alcántar and Romeo Cifuentes Pérez. We would also like to thank Monisha Sharma for her contributions, the health care providers who participated in PRONTO training, as well as the facility-level and provincial leadership for their support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sarah T. Zelek.

Additional information

Competing interests

Authors Dilys Walker, Jenifer Fahey, and Susanna Cohen are on the board of PRONTO International, an NGO committed to education and research

Authors’ contributions

All authors contributed to the critical revision of the article and approved of the final manuscript for publication. In addition, DW and FH made substantial contributions to the conception and design of the study and the acquisition and interpretation of data. SZ made substantial contributions to the acquisition, analysis and interpretation of data, and the drafting of the article. AR made substantial contributions to the acquisition, analysis, and interpretation of data. MO made substantial contributions to implementation and management of the study and the acquisition of data. J Fritz made substantial contributions to PRONTO trainings and the acquisition of data. SC and J Fahey made substantial contributions to the design of PRONTO and conception of the study. HL made substantial contributions to the analysis of data. EK made substantial contributions to the conception and design of the study and acquisition of data.

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Walker, D.M., Holme, F., Zelek, S.T. et al. A process evaluation of PRONTO simulation training for obstetric and neonatal emergency response teams in Guatemala. BMC Med Educ 15, 117 (2015). https://doi.org/10.1186/s12909-015-0401-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-015-0401-7

Keywords