Skip to main content

Evaluations of reproductive health programs in humanitarian settings: a systematic review

Abstract

Provision of reproductive health (RH) services is a minimum standard of health care in humanitarian settings; however access to these services is often limited. This systematic review, one component of a global evaluation of RH in humanitarian settings, sought to explore the evidence regarding RH services provided in humanitarian settings and to determine if programs are being evaluated. In addition, the review explored which RH services receive more attention based on program evaluations and descriptive data. Peer-reviewed papers published between 2004 and 2013 were identified via the Ovid MEDLINE database, followed by a PubMed search. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data, implemented in conflict and natural disaster settings, were included. Of 5,669 papers identified in the initial search, 36 papers describing 30 programs met inclusion criteria. Twenty-five papers described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered family planning), six on family planning, three on sexual violence, 20 on HIV and other sexually transmitted infections and two on general RH topics. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear. Program evaluation and implementation science should be incorporated into more programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation, and the results must be shared. The papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality.

Introduction

Increased attention to the reproductive health (RH) needs of people affected by armed conflict or natural disaster began in the mid-1990s with a few key events. The Lancet published an editorial identifying family planning as a complete gap in services for refugees [1]. The groundbreaking report Refugee Women and Reproductive Health Care: Reassessing Priorities highlighted how the health of refugee women fleeing war was further threatened by near absence of reproductive health services [2]. The 1994 International Conference on Population and Development in Cairo specifically recognized the rights of displaced populations to RH [3]. This led to the formation in 1995 of the Inter-Agency Working Group on RH in Crisis (IAWG), a consortium of non-governmental organizations (NGO), donors and United Nations (UN) agencies, to advance RH services in humanitarian settings. In 1999, the IAWG developed the Inter-Agency field manual on reproductive health in humanitarian settings to provide technical and program guidance to field staff [4].

In 2004, the IAWG completed a global evaluation of RH in humanitarian settings at field, agency and global levels. The evaluation found that more RH services were available than a decade earlier, although major gaps remained in most of the technical areas, with gender-based violence as the least developed technical area. Although RH services were somewhat more available for refugees living in camps, they were largely absent for internally displaced (IDP) and non-camp populations [5]. Adolescents were underserved, and safe abortion was not even assessed. The global evaluation identified a need to improve RH data collection to ensure that useful data were collected and properly interpreted, as well as for more rigorous program evaluations.

From 2012-2014, another ten years on, the IAWG conducted a second global evaluation of RH in humanitarian settings. This systematic review, one component of the 2014 global review, sought to explore the evidence regarding RH services provided in humanitarian settings. Are RH programs in these settings being evaluated? Do the programs work? What is the quality of the evaluations? Which RH services receive more programmatic and financial attention based on program evaluations and descriptive data?

Methods

Search strategy

This literature review summarized peer-reviewed papers published since the last global evaluation (between 2004 and 2013) that were identified via the Ovid MEDLINE database, followed by a PubMed search to pick up more recent papers not currently indexed. In addition, references for included papers were cross-checked to ensure that all relevant literature was identified and included. A combination of terms describing conflict and natural disasters were used with terms describing RH under the broad categories from the Inter-agency field manual on reproductive health in humanitarian settings of maternal and newborn health, family planning (FP), gender-based violence (GBV), HIV/AIDS and other sexually transmitted infections (STIs), safe abortion and adolescent reproductive health. Searches were limited to papers published in English. This initial search was broad and intended to capture all papers on RH in humanitarian settings. Papers on quantitative evaluations of RH programs, including experimental and non-experimental designs that reported outcome data were included. Descriptive quantitative studies with no specific health intervention identified and no outcomes or outputs reported (e.g., studies that reported only descriptive or baseline data) as well as purely qualitative papers were excluded. Studies were not excluded on the basis of their quality. Other inclusion and exclusion criteria are detailed in Table 1. Papers excluded under these criteria but that reported descriptive or prevalence data were logged to permit comparison of the sectoral spread of evaluation papers (the focus here) and broader prevalence or descriptive papers.

Table 1 Inclusion/exclusion criteria

Quality assessment of the papers

The quality of each included study was assessed using criteria from the STROBE checklist for observational studies or the CONSORT checklist for clinical trials [6, 7]. Papers were assigned a rating of high, medium or low quality based on the number of met criteria in a list adapted from these checklists.

Results

The search strategy yielded 5,669 papers after duplicates were removed; 5,310 were excluded based on a review of the title. Of the 359 papers for which abstract or full-text review was conducted, 323 papers were excluded, leaving 36 papers describing 30 programs (Figure 1). Of the 36 papers, 25 described programs in sub-Saharan Africa, six in Asia, two in Haiti and three reported data from multiple countries and continents. Some RH technical areas were better represented than others: seven papers reported on maternal and newborn health (including two that also covered FP), six on FP, three on GBV, 20 on HIV and other STIs and two on general RH topics (Table 2). None of the papers described safe abortion or post-abortion care programs, and five of the papers described HIV prevention programs targeting adolescents. Only six papers were classified as high quality while the majority was classified as medium quality or low quality. Fewer than half (16) of the papers reported comparison data, either in the form of pre- and post-intervention measures or intervention and comparison groups. Table 3 provides a summary of the included papers.

Figure 1
figure 1

Systematic review flow chart

Table 2 Number of papers by RH technical component
Table 3 Description of papers included in the review

Of the 323 papers reviewed and excluded, 93 papers reported descriptive or prevalence data on RH in crisis settings. Again, some RH technical areas were better represented than others: 20 papers on maternal and newborn health (including one that also reported on FP and one that also looked at GBV), four on FP, 32 on GBV, 27 on HIV or other STIs (only six of which mentioned other STIs), seven papers on general RH and five on adolescent RH (specifically HIV, GBV or FP) (Table 2).

Maternal and newborn health

Seven of the 36 papers described evaluations of maternal and newborn health programs, including two programs that also addressed family planning. The papers covered a range of topics including emergency obstetric and newborn care (EmONC), antenatal care (ANC) and the training of traditional birth attendants or community health workers (CHWs) to improve maternal health outcomes.

Two papers described the outcomes of programs to improve EmONC services, the first for Afghan refugees in Pakistan [8] and the second in humanitarian settings in nine countries [9]. Although not all supported facilities met the WHO criteria of fully functional EmONC facilities [10], the papers reported greater availability post-intervention of EmONC services 24 hours a day and subsequent increased use of those services in most facilities. The authors of both papers described challenges in calculating the UN process indicators for EmONCa at baseline [10], primarily due to the absence of key data from delivery registers; however, both reported these indicators at endline.

Other program approaches to improve maternal and newborn health involved training mobile health workers to provide elements of basic EmONC plus blood transfusion and ANC in eastern Burma [11]; seconding refugee health workers to health facilities serving the refugee population and training refugee women to promote RH in the community in Guinea [12]; and training CHWs in Afghanistan to strengthen the link between the community and formal health services [13]. All three papers reported increased use of skilled birth attendants post-intervention. The Afghanistan study, however, found that only the presence of a female CHW was associated with increased skilled birth attendance; the association was absent with male CHWs. One paper assessing the effectiveness of baby tents (clean spaces to support mothers to practice healthy infant feeding) established in Haiti found that 70% of babies less than six months old were exclusively breastfed and 10% of non-exclusively breastfed infants moved to exclusive breastfeeding while enrolled [14]. Finally, an evaluation of a home-based lifesaving skills training for traditional midwives in Liberia found that midwives’ knowledge improved from pre to post training and remained stable one year later [15].

Family planning (FP)

Six papers described FP programs, including two that also described maternal and newborn health outcomes. Programs used different strategies to improve FP use: providing the full range of FP methods, including long-acting and permanent methods, via mobile clinics and strengthening health centers’ provision of short- and long-acting FP in northern Uganda [16]; training mobile health workers to provide short-acting methods in eastern Burma [11]; seconding refugee providers to health facilities serving refugees to provide FP and training female CHWs to promote FP use in Guinea [17]; and training CHWs to conduct FP education and provide short acting methods in Afghanistan [18]. All four papers reported that contraceptive prevalence increased from baseline or was higher than national levels. Additional papers found that the presence of a female CHW was associated with higher FP use in Afghanistan [13], and that contraceptive use was higher among Afghan refugee women in Pakistan who received subsidized health services than among those with access to un-subsidized services [19].

Gender-based violence (GBV)

Although the literature search included broader terms related to GBV, all three included papers focused specifically on care for survivors of rape. Two papers reviewed the effectiveness of psychosocial interventions for survivors. A randomized controlled trial in the Democratic Republic of the Congo (DRC) on the effectiveness of group cognitive processing therapy versus individual support to female survivors of rape found that those who received group psychotherapy showed greater improvement in depression, anxiety and post-traumatic stress disorder (PTSD) symptoms six months after treatment compared to those in the control group [20]. The second paper found that the global functioning of survivors in the Republic of Congo improved following post-rape psychological care, and improvement was maintained one to two years later although high loss to follow up weakened these results [21]. The third paper reviewed the effects of a multi-media training tool for clinical care for rape survivors on the knowledge, attitudes and practices of health providers in four conflict settings [22]. The authors found that although negative attitudes towards survivors did not significantly change, respect for patient rights increased and provider practice improved from pre-training to three months post-training.

HIV and other sexually transmitted infections (STIs)

More papers (20) focused on HIV and other STIs than any other RH component; however only three of these reported on STIs other than HIV. Three papers reported results of retrospective record reviews to evaluate programs to prevent mother to child transmission of HIV (PMTCT), two in northern Uganda and one in a refugee camp in Tanzania. One program found that higher proportions of HIV-positive pregnant women identified in ANC used anti-retroviral prophylaxis in northern Uganda compared with the national average [23]. The other two programs reported high numbers lost to follow-up before completing infant HIV testing at 18 months. In one study, this was primarily due to a lack of understanding of its importance and infant death; incomplete or no ARV prophylaxis, early weaning and prolonged breastfeeding were associated with increased risk of loss to follow-up and infant death [24]. In the final study, more than two-thirds of the HIV-infected women were repatriated to their home country before delivery; among those who delivered in the camp, nevirapine uptake was 98% [25].

Eight papers reported the outcomes of anti-retroviral therapy (ART) programs for HIV-positive adults or children in East Africa, Haiti and globally. Three papers found that ART patients in northern Uganda had mortality rates and adherence comparable to or better than ART patients in stable settings or who were not displaced [26–28]. Similarly, a review of the data from 24 ART programs in conflict or post-conflict settings found that patient outcomes were comparable to those in stable settings [29]. Five papers examined the effect of a crisis on ART programs: the post-election violence in Kenya in early 2008 [30–32], acute conflict in DRC in 2004 [33] and the earthquake in Haiti in 2010 [34]. Notably, although the papers found higher rates of treatment interruption immediately post-disaster, generally services were quickly re-established and patient attendance and adherence rebounded soon after.

Eight papers reported HIV and/or STI knowledge, attitudes and behavior results following HIV prevention programs. Two papers reported on a group randomized controlled trial to evaluate the impact of an evidence-based HIV prevention intervention on sexual risk behaviors of in-school 6th graders in Liberia [35, 36], and six used post-intervention surveys to assess program effectiveness in four African countries [37–42]. All of the papers reported mixed results of their prevention programs regarding some elements of knowledge and behavior change; however, the four that follow reported more positive results. A comparison of pre- and post-intervention survey data in Sierra Leone found that HIV-related knowledge and condom use increased among adolescents [37], commercial sex workers and military personnel [38] following an HIV prevention program including intensive IEC activities and distribution of free condoms. Two papers on refugee camps in Guinea reported that exposure to program peer educators was associated with improved HIV and STI knowledge and changed behavior to prevent HIV [39, 40].

General RH

Two papers reported on unique efforts related to reproductive health. A program to improve and measure the quality of RH services at a clinic serving Burmese refugees and migrant workers on the Thailand-Burma border improved the quality of care, and also increased staff skills and motivation to collect and use data to make program decisions [43]. An evaluation of a literacy program that used RH content in Guinea found that refugee women who completed the program reported high knowledge on maternal and newborn health, HIV and STIs; increased use of FP; and a marked increase in feelings of empowerment [44].

Discussion

This review found that some RH programs in crisis settings have been evaluated although most evaluations were medium in quality, suggesting limitations in study design and analysis. Most of the papers reported generally positive results suggesting that these programs are likely well-designed and reasonably well-implemented. The papers demonstrated both that RH programs can be implemented in these challenging settings and that women and men will use RH services when they are of reasonable quality. In comparison to the program evaluation papers identified, three times as many papers were found that reported RH descriptive or prevalence data in humanitarian settings. While data demonstrating the magnitude of the problem are crucial and were previously lacking, the need for RH services and for evaluations to measure their effectiveness is clear [45, 46]. It is critical to more directly link research to interventions and increase the evidence base for RH service delivery strategies in humanitarian settings. This includes not only the research but also publication and sharing of results. An increased focus on implementation science is needed to explore how best to improve delivery and use of RH services as well as the use of research to improve practice [47].

Although published articles are not representative of RH programs implemented in humanitarian settings as most programs do not publish their results, they may reflect relative attention, both programmatic and financial, to particular areas. A preponderance of papers reported on HIV/AIDS programs although few mentioned other STIs. While GBV was under-represented among program evaluations, one-third (32) of the descriptive papers reported prevalence and types of sexual violence perpetrated in humanitarian settings. This suggests that GBV does, in fact, receive attention in research, although perhaps less in programming which when implemented may be only rarely evaluated. FP, on the other hand, was under-represented among both program evaluations and descriptive papers suggesting that FP overall receives less attention than the other RH components. Adolescents often face additional barriers to meeting their RH needs [48], but only four HIV prevention programs targeted adolescents and no papers evaluated adolescent-friendly RH services. No papers mentioned safe abortion which remains virtually unavailable in humanitarian settings [49], nor post-abortion care.

Programs requiring long-term follow-up faced specific challenges introduced by the instability of crisis settings and associated population movements. Some of these challenges, such as brief interruptions to treatment that arose during incidents of crisis, can and should be managed or prevented with planning, as demonstrated in the response to post-election violence in Kenya [30, 32] and an upswing in violence in DRC [33]. Training refugee or IDP health workers, who would likely move with their community, may be a potential strategy for ensuring continued access to care for displaced people after they return home. Additional challenges to the implementation of RH programs were identified in the papers. For example, highly trained health workers are needed to provide RH services, and they may require updated competency-based training, particularly for EmONC, long-acting and permanent FP and clinical care for survivors of rape. The evaluation of a training tool for providers suggested that although attitudes are challenging to change, care for survivors of rape can be improved [22].

Proven evidenced-based strategies should be adapted and implemented in humanitarian settings. For example, EmONC is crucial to reduce maternal morbidity and mortality, and is thus a component of the minimum standard in humanitarian RH service delivery (the Minimum Initial Service Package) [4]. Yet, only three of the seven maternal and newborn health programs that were evaluated aimed to improve the availability of these critical services. Only one of the evaluated programs improved the availability of long-acting or permanent FP methods; the other programs were generally limited to short-acting methods, despite evidence that a broad choice of methods is an essential component of good FP programming and also associated with increased use [50–52]. Although a foundation in social change theory has been shown to be important for behavior change [53], only one of the HIV prevention programs appears to have had such a base [35, 36]. Behavior change communication efforts implemented in humanitarian settings should adapt such proven evidence-based strategies. Moreover, it is critical that best practices be shared across the humanitarian and development fields. While the humanitarian field has adapted strategies that have been successful in development settings for many RH components, response to sexual violence is one area where the humanitarian field may be in advance of the development field, and it is crucial that these programs be implemented, rigorously evaluated and published. Further, it would be useful for programs (and journals) to publish results of programs that were unsuccessful so others may learn from those experiences.

Fewer than half of the papers used any kind of comparison, either between pre- and post- measures or between intervention and comparison groups. This is not a call for more randomized controlled trials, however, since randomizing clients is not often appropriate, due to the fundamental principle of client choice in FP and GBV programming [54]. Evaluations using pre- and post-intervention measures or quasi-experimental designs may be appropriate, particularly where a program strategy is implemented in phases and a group that has not yet received the intervention serves as a comparison for a group in an earlier phase of the program. In addition, the challenges to collecting data in humanitarian settings are well-recognized [55, 56], and population-based surveys may be particularly challenging in these unstable and insecure settings [57]. Therefore, other rigorous measures of program quality that are feasible to collect should be explored. For example, the UN process indicators of EmONC were developed to monitor interventions proven to reduce maternal mortality without the limitations and expense of a maternal mortality survey by using information available at health facilities [10, 58]. What similar practical approximations could be used to measure the success of FP and GBV programs? It is plausible that evaluations of clinical HIV programs were in the majority because program quality could be measured using clinical data (patient adherence and outcomes) that were routinely collected. Challenges to collecting appropriate data have been noted [5, 9]; increased effort should be put into routine data collection to ensure that good quality data to measure standard indicators are collected, and shared. This may mean adapting registers to capture data on, for example, obstetric complications or to record new, continuing and switching FP clients.

Limitations of this review include its restriction to quantitative methodologies and to papers published in English, which may have excluded relevant publications. The selected search parameters may have missed papers that did not explicitly refer to conflict or humanitarian settings or natural disasters, or the general RH topics that were searched in the title, abstract or key words. While the included papers may be representative of peer-reviewed published literature, they are not representative of RH programming in humanitarian settings: humanitarian agency staff may not have time to write up results for publication and negative or null findings may be difficult to publish.

Program evaluation and implementation science should be incorporated into programs to determine the best ways to serve the RH needs of people affected by conflict or natural disaster. Standard program design should include rigorous program evaluation [59] and improved routine data collection. The results must be shared so that proven evidence-based strategies for RH are implemented in humanitarian settings. These papers demonstrated both that RH programs can be implemented in these challenging settings, and that women and men will use RH services when they are of reasonable quality.

Authors’ information

The author is a member of the Steering Committee of the Inter-Agency Working Group on RH in Crises.

Endnotes

aThe eight UN process indicators for EmONC were developed to monitor progress in the prevention of maternal and perinatal deaths:

1. Availability of EmONC: at least 5 EmONC facilities (including at least one comprehensive facility) for every 500,000 population

2. Geographical distribution of EmONC facilities

3. Proportion of all births in EmONC facilities

4. Met need for emergency obstetric care: proportion of women with major direct obstetric complications who are treated in EmONC facilities (acceptable level is 100%)

5. Caesarean sections as a proportion of all births (acceptable level between 5 and 15%)

6. Direct obstetric case fatality rate (acceptable level is less than 1%)

7. Intrapartum and very early neonatal death rate

8. Proportion of maternal deaths due to indirect causes in emergency obstetric care facilities

Abbreviations

ANC:

antenatal care

ART:

anti-retroviral therapy

CHW:

community health worker

DRC:

Democratic Republic of the Congo

EmONC:

emergency obstetric and newborn care

FP:

family planning

GBV:

gender-based violence

IAWG:

Inter-Agency Working Group on Reproductive Health in Crisis

NGO:

nongovernmental organization

PMTCT:

prevention of mother to child transmission of HIV

PTSD:

post-traumatic stress disorder

RH:

Reproductive health

STIs:

sexually transmitted infections

UN:

United Nations.

References

  1. Reproductive freedom for refugees. The Lancet. 1993, 341: 929-930.

  2. Wulf D: Refugee Women and Reproductive Health Care: Reassessing Priorities. 1994, New York: Women's Commission for Refugee Women and Children, [http://www.womensrefugeecommission.org/resources/document/583-refugee-women-and-reproductive-health-care-reassessing-priorities]

    Google Scholar 

  3. Programme of Action of the International Conference on Population and Development. 1994, Cairo, [http://www.un.org/popin/icpd/conference/offeng/poa.html]

  4. Inter-agency Working Group on Reproductive Health in Crises: Inter-agency field manual on reproductive health in humanitarian settings. 2010, Geneva, [http://www.iawg.net/resources/field_manual.html]

    Google Scholar 

  5. Inter-Agency Working Group on Reproductive Health in Refugee Situations: Report of an Inter-Agency Global Evaluation of Reproductive Health Services for Refugees and Internally Displaced Persons. 2004, Geneva, [http://www.iawg.net/resources/2004_global_eval]

    Google Scholar 

  6. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, for the SI: The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. PLoS medicine. 2007, 4: e296-10.1371/journal.pmed.0040296.

    Article  PubMed Central  PubMed  Google Scholar 

  7. Schulz KF, Altman DG, Moher D, for the CG: CONSORT 2010 Statement: Updated Guidelines for Reporting Parallel Group Randomised Trials. PLoS medicine. 2010, 7: e1000251-10.1371/journal.pmed.1000251.

    Article  PubMed Central  PubMed  Google Scholar 

  8. Purdin S, Khan T, Saucier R: Reducing maternal mortality among Afghan refugees in Pakistan. International journal of gynaecology and obstetrics. 2009, 105: 82-85. 10.1016/j.ijgo.2008.12.021.

    Article  PubMed  Google Scholar 

  9. Krause SK, Meyers JL, Friedlander E: Improving the availability of emergency obstetric care in conflict-affected settings. Global public health. 2006, 1: 205-228. 10.1080/17441690600679939.

    Article  CAS  PubMed  Google Scholar 

  10. WHO, UNFPA, UNICEF, Averting Maternal Death and Disability Program Columbia University: Monitoring emergency obstetric care: a handbook. 2009, Geneva: World Health Organization, [http://www.who.int/reproductivehealth/publications/monitoring/9789241547734/en/]

    Google Scholar 

  11. Mullany LC, Lee TJ, Yone L, Lee CI, Teela KC, Paw P, Shwe Oo EK, Maung C, Kuiper H, Masenior NF, Beyrer C: Impact of Community-Based Maternal Health Workers on Coverage of Essential Maternal Health Interventions among Internally Displaced Communities in Eastern Burma: The MOM Project. PLoS medicine. 2010, 7: e1000317-10.1371/journal.pmed.1000317.

    Article  PubMed Central  PubMed  Google Scholar 

  12. Howard N, Woodward A, Souare Y, Kollie S, Blankhart D, von Roenne A, Borchert M: Reproductive health for refugees by refugees in Guinea III: maternal health. Conflict and health. 2011, 5: 5-10.1186/1752-1505-5-5.

    Article  PubMed Central  PubMed  Google Scholar 

  13. Viswanathan K, Hansen PM, Rahman MH, Steinhardt L, Edward A, Arwal SH, Peters DH, Burnham G: Can community health workers increase coverage of reproductive health services?. Journal of epidemiology and community health. 2012, 66: 894-900. 10.1136/jech-2011-200275.

    Article  PubMed  Google Scholar 

  14. Ayoya MA, Golden K, Teta IN, Moreaux M, Mamadoultaibou A, Koo L, Boyd E, Beauliere JM, Lesavre C, Marhone JP: Protecting and improving breastfeeding practices during a major emergency: lessons learnt from the baby tents in Haiti. Bulletin of the World Health Organization. 2013, 91: 612-617. 10.2471/BLT.12.113936.

    Article  PubMed Central  PubMed  Google Scholar 

  15. Lori JR, Majszak CM, Martyn KK: Home-based life-saving skills in Liberia: acquisition and retention of skills and knowledge. Journal of midwifery & women's health. 2010, 55: 370-377. 10.1016/j.jmwh.2009.09.016.

    Article  Google Scholar 

  16. Casey SE, McNab SE, Tanton C, Odong J, Testa AC, Lee-Jones L: Availability of long-acting and permanent family-planning methods leads to increase in use in conflict-affected northern Uganda: Evidence from cross-sectional baseline and endline cluster surveys. Global public health. 2013, 8: 284-297. 10.1080/17441692.2012.758302.

    Article  PubMed Central  PubMed  Google Scholar 

  17. Howard N, Kollie S, Souare Y, von Roenne A, Blankhart D, Newey C, Chen MI, Borchert M: Reproductive health services for refugees by refugees in Guinea I: family planning. Conflict and health. 2008, 2: 12-10.1186/1752-1505-2-12.

    Article  PubMed Central  PubMed  Google Scholar 

  18. Huber D, Saeedi N, Samadi AK: Achieving success with family planning in rural Afghanistan. Bulletin of the World Health Organization. 2010, 88: 227-231. 10.2471/BLT.08.059410.

    Article  PubMed Central  PubMed  Google Scholar 

  19. Raheel H, Karim MS, Saleem S, Bharwani S: Knowledge, attitudes and practices of contraception among Afghan refugee women in Pakistan: a cross-sectional study. PloS one. 2012, 7: e48760-10.1371/journal.pone.0048760.

    Article  PubMed Central  CAS  PubMed  Google Scholar 

  20. Bass JK, Annan J, McIvor Murray S, Kaysen D, Griffiths S, Cetinoglu T, Wachter K, Murray LK, Bolton PA: Controlled Trial of Psychotherapy for Congolese Survivors of Sexual Violence. New England Journal of Medicine. 2013, 368: 2182-2191. 10.1056/NEJMoa1211853.

    Article  CAS  PubMed  Google Scholar 

  21. Hustache S, Moro MR, Roptin J, Souza R, Gansou GM, Mbemba A, Roederer T, Grais RF, Gaboulaud V, Baubet T: Evaluation of psychological support for victims of sexual violence in a conflict setting: results from Brazzaville, Congo. Int J Ment Health Syst. 2009, 3: 7-10.1186/1752-4458-3-7.

    Article  PubMed Central  PubMed  Google Scholar 

  22. Smith J, Ho L, Langston A, Mankani N, Shivshanker A, Perera D: Clinical care for sexual assault survivors multimedia training: a mixed-methods study of effect on healthcare providers' attitudes, knowledge, confidence, and practice in humanitarian settings. Conflict and health. 2013, 7: 14-10.1186/1752-1505-7-14.

    Article  PubMed Central  PubMed  Google Scholar 

  23. Bannink-Mbazzi F, Lowicki-Zucca M, Ojom L, Kabasomi SV, Esiru G, Homsy J: High PMTCT program uptake and coverage of mothers, their partners and babies in Northern Uganda: Achievements and lessons learned over 10 years of implementation (2002-2011). J Acquir Immune Defic Syndr. 2013

    Google Scholar 

  24. Ahoua L, Ayikoru H, Gnauck K, Odaru G, Odar E, Ondoa–Onama C, Pinoges L, Balkan S, Olson D, Pujades-Rodríguez M: Evaluation of a 5-year Programme to Prevent Mother-to-child Transmission of HIV Infection in Northern Uganda. Journal of Tropical Pediatrics. 2010, 56: 43-52. 10.1093/tropej/fmp054.

    Article  PubMed  Google Scholar 

  25. Rutta E, Gongo R, Mwansasu A, Mutasingwa D, Rwegasira V, Kishumbu S, Tabayi J, Masini T, Ramadhani H: Prevention of mother-to-child transmission of HIV in a refugee camp setting in Tanzania. Global public health. 2008, 3: 62-76. 10.1080/17441690601111924.

    Article  CAS  PubMed  Google Scholar 

  26. Garang PG, Odoi RA, Kalyango JN: Adherence to antiretroviral therapy in conflict areas: a study among patients receiving treatment from Lacor Hospital, Uganda. AIDS patient care and STDs. 2009, 23: 743-747. 10.1089/apc.2009.0073.

    Article  PubMed  Google Scholar 

  27. Kiboneka A, Nyatia RJ, Nabiryo C, Anema A, Cooper CL, Fernandes KA, Montaner JS, Mills EJ: Combination antiretroviral therapy in population affected by conflict: outcomes from large cohort in northern Uganda. BMJ. 2009, Clinical research ed, 338-b201.

    Google Scholar 

  28. Kiboneka A, Nyatia RJ, Nabiryo C, Olupot-Olupot P, Anema A, Cooper C, Mills E: Pediatric HIV therapy in armed conflict. AIDS. 2008, London, England, 22: 1097-1098. 10.1097/QAD.0b013e32830163c0.

    Google Scholar 

  29. O'Brien DP, Venis S, Greig J, Shanks L, Ellman T, Sabapathy K, Frigati L, Mills C: Provision of antiretroviral treatment in conflict settings: the experience of Medecins Sans Frontieres. Conflict and health. 2010, 4: 12-10.1186/1752-1505-4-12.

    Article  PubMed Central  PubMed  Google Scholar 

  30. Pyne-Mercier LD, John-Stewart GC, Richardson BA, Kagondu NL, Thiga J, Noshy H, Kist N, Chung MH: The consequences of post-election violence on antiretroviral HIV therapy in Kenya. AIDS care. 2011, 23: 562-568. 10.1080/09540121.2010.525615.

    Article  PubMed Central  PubMed  Google Scholar 

  31. Vreeman RC, Nyandiko WM, Sang E, Musick BS, Braitstein P, Wiehe SE: Impact of the Kenya post-election crisis on clinic attendance and medication adherence for HIV-infected children in western Kenya. Conflict and health. 2009, 3: 5-10.1186/1752-1505-3-5.

    Article  PubMed Central  PubMed  Google Scholar 

  32. Yoder R, Nyandiko W, Vreeman R, Ayaya S, Gisore P, Braitstein P, Wiehe S: Long-term impact of the Kenya postelection crisis on clinic attendance and medication adherence for HIV-infected children in western Kenya. J Acquir Immune Defic Syndr. 2012, 59: 199-206. 10.1097/QAI.0b013e31823b4448.

    Article  PubMed  Google Scholar 

  33. Culbert H, Tu D, O'Brien DP, Ellman T, Mills C, Ford N, Amisi T, Chan K, Venis S, Medecins Sans F, et al: HIV treatment in a conflict setting: outcomes and experiences from Bukavu, Democratic Republic of the Congo. PLoS Medicine / Public Library of Science. 2007, 4: e129-

    Google Scholar 

  34. Walldorf JA, Joseph P, Valles JS, Sabatier JF, Marston BJ, Jean-Charles K, Louissant E, Tappero JW: Recovery of HIV service provision post-earthquake. AIDS and behavior. 2012, 26: 1431-1436.

    Article  Google Scholar 

  35. Atwood KA, Kennedy SB, Shamblen S, Tegli J, Garber S, Fahnbulleh PW, Korvah PM, Kolubah M, Mulbah-Kamara C, Fulton S: Impact of school-based HIV prevention program in post-conflict Liberia. AIDS Educ Prev. 2012, 24: 68-77. 10.1521/aeap.2012.24.1.68.

    Article  PubMed Central  PubMed  Google Scholar 

  36. Atwood KA, Kennedy SB, Shamblen S, Taylor CH, Quaqua M, Bee EM, Gobeh ME, Woods DV, Dennis B: Reducing sexual risk taking behaviors among adolescents who engage in transactional sex in post-conflict Liberia. Vulnerable children and youth studies. 2012, 7: 55-65. 10.1080/17450128.2011.647773.

    Article  PubMed Central  PubMed  Google Scholar 

  37. Casey SE, Larsen MM, McGinn T, Sartie M, Dauda M, Lahai P: Changes in HIV/AIDS/STI knowledge, attitudes, and behaviours among the youth in Port Loko, Sierra Leone. Global public health. 2006, 1: 249-263. 10.1080/17441690600668106.

    Article  CAS  PubMed  Google Scholar 

  38. Larsen MM, Sartie MT, Musa T, Casey SE, Tommy J, Saldinger M: Changes in HIV/AIDS/STI knowledge, attitudes and practices among commercial sex workers and military forces in Port Loko, Sierra Leone. Disasters. 2004, 28: 239-254. 10.1111/j.0361-3666.2004.00256.x.

    Article  PubMed  Google Scholar 

  39. Chen MI, von Roenne A, Souare Y, von Roenne F, Ekirapa A: Reproductive health for refugees by refugees in Guinea II: sexually transmitted infections. Conflict and health. 2008, 2: 1-7. 10.1186/1752-1505-2-1.

    Article  Google Scholar 

  40. Woodward A, Howard N, Souare Y, Kollie S, von Roenne A, Borchert M: Reproductive health for refugees by refugees in Guinea IV: Peer education and HIV knowledge, attitudes, and reported practices. Conflict and health. 2011, 5: 10-10.1186/1752-1505-5-10.

    Article  PubMed Central  PubMed  Google Scholar 

  41. Ciccio L, Sera D: Assessing the knowledge and behavior towards HIV/AIDS among youth in Northern Uganda: A cross-sectional survey. Biornale Italiano di Medicina Tropicale. 2010, 15: 29-34. [http://numat.jsi.com/Resources/Docs/NUMATAbstract_Ciccio_vol15_1.pdf]

    Google Scholar 

  42. Tanaka Y, Kunii O, Hatano T, Wakai S: Knowledge, attitude, and practice (KAP) of HIV prevention and HIV infection risks among Congolese refugees in Tanzania. Health & place. 2008, 14: 434-452. 10.1016/j.healthplace.2007.07.005.

    Article  Google Scholar 

  43. Sullivan TM, Sophia N, Maung C: Using evidence to improve reproductive health quality along the Thailand-Burma border. Disasters. 2004, 28: 255-268. 10.1111/j.0361-3666.2004.00257.x.

    Article  PubMed  Google Scholar 

  44. McGinn T, Allen K: Improving refugees' reproductive health through literacy in Guinea. Global public health. 2006, 1: 229-248. 10.1080/17441690600680002.

    Article  CAS  PubMed  Google Scholar 

  45. McGinn T: Reproductive Health of War-Affected Populations: What Do We Know?. International Family Planning Perspectives. 2000, 26: 174-180. 10.2307/2648255.

    Article  Google Scholar 

  46. O'Heir J: Section 1: Review of literature. Reproductive health services for refugees and internally displaced persons: report of an inter-agency global evaluation 2004. Edited by: IAWG: UNHCR. 2004, [http://www.iawg.net/resources/2004_global_eval/documents/REPORT/report-sec-1.pdf]

    Google Scholar 

  47. Madon T, Hofman KJ, Kupfer L, Glass RI: Implementation Science. Science. 2007, 318: 1728-1729. 10.1126/science.1150009.

    Article  CAS  PubMed  Google Scholar 

  48. UNFPA, Save the Children: Adolescent sexual and reproductive health toolkit for humanitarian settings: A companion to the Inter-agency field manual on reproductive health in humanitarian settings. 2009, New York: UNFPA, [http://www.unfpa.org/publications/adolescent-sexual-and-reproductive-health-toolkit-humanitarian-settings]

    Google Scholar 

  49. McGinn T: Reducing death and disability from unsafe abortion. Routledge Handbook of Global Public Health. Edited by: Parker R, Sommer M. 2011, New York: Routledge, 191-198.

    Google Scholar 

  50. Cleland J, Bernstein S, Ezeh A, Faundes A, Glasier A, Innis J: Family planning: the unfinished agenda. Lancet. 2006, 368: 1810-1827. 10.1016/S0140-6736(06)69480-4.

    Article  PubMed  Google Scholar 

  51. Ross J, Hardee K, Mumford E, Eid S: Contraceptive Method Choice in Developing Countries. International Family Planning Perspectives. 2002, 28: 32-40. 10.2307/3088273.

    Article  Google Scholar 

  52. Ross J, Stover J: Use of modern contraception increases when more methods become available: analysis of evidence from 1982–2009. Global Health: Science and Practice. 2013, 1: 203-212. 10.9745/GHSP-D-13-00010.

    Google Scholar 

  53. Briscoe C, Aboud F: Behaviour change communication targeting four health behaviours in developing countries: A review of change techniques. Social Science & Medicine. 2012, 75: 612-621. 10.1016/j.socscimed.2012.03.016.

    Article  Google Scholar 

  54. Habicht JP, Victora CG, Vaughan JP: Evaluation designs for adequacy, plausibility and probability of public health programme performance and impact. Int J Epidemiol. 1999, 28: 10-18. 10.1093/ije/28.1.10.

    Article  CAS  PubMed  Google Scholar 

  55. Ford N, Mills E, Zachariah R, Upshur R: Ethics of conducting research in conflict settings. Conflict and health. 2009, 3: 7-10.1186/1752-1505-3-7.

    Article  PubMed Central  PubMed  Google Scholar 

  56. Thoms O, Ron J: Public health, conflict and human rights: toward a collaborative research agenda. Conflict and health. 2007, 1: 11-10.1186/1752-1505-1-11.

    Article  PubMed Central  PubMed  Google Scholar 

  57. Spiegel PB: Who should be undertaking population-based surveys in humanitarian emergencies?. Emerg Themes Epidemiol. 2007, 4: 12-10.1186/1742-7622-4-12.

    Article  PubMed Central  PubMed  Google Scholar 

  58. McGinn T: Monitoring and evaluation of PMM efforts: what have we learned?. International journal of gynaecology and obstetrics. 1997, 59: S245-S251.

    Article  PubMed  Google Scholar 

  59. Rossi PH, Lipsey WM, Freeman HE: Evaluation: A systematic approach. 2004, Thousand Oaks, CA: SAGE, 7

    Google Scholar 

Download references

Acknowledgements

I gratefully acknowledge the valuable support and advice of Therese McGinn throughout the review.

Declarations

This article has been published as part of Conflict and Health Volume 9 Supplement 1, 2015: Taking Stock of Reproductive Health in Humanitarian Settings: 2012-2014 Inter-agency Working Group on Reproductive Health in Crises' Global Review. The full contents of the supplement are available online at http://www.conflictandhealth.com/supplements/9/S1. Funding for this supplement was provided by the MacArthur Foundation.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sara E Casey.

Additional information

Competing interests

The author declares that she has no competing interests.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Casey, S.E. Evaluations of reproductive health programs in humanitarian settings: a systematic review. Confl Health 9 (Suppl 1), S1 (2015). https://doi.org/10.1186/1752-1505-9-S1-S1

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1752-1505-9-S1-S1

Keywords