Article Text

Download PDFPDF

Estimating the incidence of abortion: a comparison of five approaches in Ghana
  1. Sarah C Keogh1,
  2. Easmon Otupiri2,
  3. Doris W Chiu1,
  4. Chelsea B Polis1,3,
  5. Rubina Hussain1,
  6. Suzanne O Bell4,
  7. Emmanuel K Nakua5,
  8. Roderick Larsen-Reindorf2
  1. 1Guttmacher Institute, New York, New York, USA
  2. 2Department of Population, Family and Reproductive Health, School of Public Health, Kwame Nkrumah University of Science and Technology, Kumasi, Ghana
  3. 3Department of Epidemiology, Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland, USA
  4. 4Department of Population, Family and Reproductive Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, USA
  5. 5Department of Epidemiology and Biostatistics, Kwame Nkrumah University of Science and Technology, Kumasi, Ashanti, Ghana
  1. Correspondence to Dr Sarah C Keogh; skeogh{at}guttmacher.org

Abstract

Introduction Induced abortion estimates are critical for reproductive health programming. In countries like Ghana where abortion is somewhat legally restricted and highly stigmatised, official records are incomplete and different approaches are needed to measure abortion incidence. We conducted a study in Ghana to test five methodologies for estimating incidence: direct reporting, the list experiment, the confidante method, the Abortion Incidence Complications Method (AICM) and a modified AICM.

Methods The direct reporting, list experiment and confidante method were implemented through a nationally representative community-based survey (CBS) of 4722 women. The AICM used data from a nationally representative health facilities survey (HFS) and a knowledgeable informant survey. The modified AICM combined CBS and HFS data. For each approach, we calculated abortion incidence nationally and for Ghana’s three ecological zones and conducted checks to determine the most internally valid approaches.

Results National incidence estimates ranged from 27 per 1000 (AICM) to 61 (confidante method). The Northern zone displayed lower rates than the other two zones for all approaches. Validity and reliability checks found that the list experiment was invalid. The approaches that stood up to the internal validity checks and were most reliable were the direct reporting, confidante method and modified AICM. These approaches provide lower and upper bound estimates for the abortion rate, and the mean of the estimates from the three approaches yields a final abortion rate of 44 per 1000 and an unintended pregnancy rate of 103 per 1000.

Conclusions Comparing five approaches to estimating abortion enabled cross-validation of findings and highlighted strengths, pitfalls and requirements of each approach that can inform abortion estimation in other settings.

  • epidemiology
  • medical demography
  • public health
  • community-based survey
  • maternal health
http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Key questions

What is already known?

  • The two most common approaches to estimating abortion (direct questioning and the Abortion Incidence Complications Method (AICM)) suffer from under-reporting and heavy reliance on expert opinions, respectively.

  • The List Experiment has yielded mixed results, whereas network approaches such as the Best Friend approach and the Anonymous Third-Party Reporting have yielded promising results.

What are the new findings?

  • This is the first study to test more than four approaches in one population, including two newly proposed methodologies (the modified AICM and the confidante method).

  • By cross-validating components of the estimates against each other, we identified the most internally valid approaches (modified AICM, direct reporting and confidante method), which together yielded a national abortion incidence rate of 44 per 1000 and a pregnancy rate of 194 per 1000.

What do the new findings imply?

  • Implementing the confidante method as a precursor to direct questioning may help increase self-reporting, regardless of the reliability of the network-based estimate.

  • If reliable postabortion care caseloads can be collected alongside community-based survey data, then the modified AICM can provide a more robust estimate than methodologies based on experts’ opinions but is only recommended if abortion stigma makes direct reporting and network-based approaches unreliable.

  • The approach yielding the most robust and internally valid estimates will likely vary according to the cultural and legal context, the information women share among themselves, literacy and numeracy, and abortion stigma.

Introduction

Estimating induced abortion incidence is critical for designing appropriate reproductive health policies and programmes and measuring other outcomes such as unintended pregnancy rates. Yet in countries where induced abortion is legally restricted or highly stigmatised, reliable estimates of abortion incidence are often lacking.1 In Ghana, although abortion is legal under several circumstances, many women are unaware of the law and obtain clandestine abortions.2 Thus, many abortions are not captured in official records, necessitating other measurement approaches. We conducted a study in Ghana testing the five methodologies we thought to be most promising for estimating abortion incidence in countries where abortion is either legally restricted or highly stigmatised.3

One common approach, used previously in Ghana,4–7 directly asks women if they have had an abortion. Given the reluctance to disclose abortion, direct reporting underestimates incidence.8 However, it provides a useful minimum estimate, and we therefore included it in this study (approach #1). Variations of direct reporting that preserve anonymity9 10 have not been shown to consistently outperform face-to-face questionnaires9 11 and are unsuitable for low-literacy populations.

The Abortion Incidence Complications Method (AICM)12 (approach #2) is an indirect approach that aims to circumvent the under-reporting inherent in direct reporting; it is the prevailing approach in abortion incidence estimation. In the standard AICM, researchers estimate the number of abortions as the number of women receiving postabortion care (PAC) in a nationally representative survey of health facilities, multiplied by an adjustment factor, or multiplier, that accounts for all the abortions that do not lead to facility-based treatment (obtained from a survey of knowledgeable informants).13 Due to the complexity of the AICM when applied to Ghana, we describe the methodology and results in a separate paper.2 The AICM has limitations,3 12 including reliance on expert opinion to estimate the proportion of abortions receiving treatment. To address this, we propose a modified version of the AICM (approach #3), in which we calculate the multiplier using information collected from women directly.3

The List Experiment, which investigators have used to estimate abortion in Liberia14 and Rajasthan,15 involves presenting a list of non-sensitive events and asking respondents how many (but not which ones) they have experienced. In half of the sample (the treatment group), abortion is added to the list. Abortion incidence is the difference between the mean number of events in each list. To increase power and minimise list effects, the Double List Experiment (approach #4)14 16 includes two lists (A and B); each respondent receives the treatment version of one list and the control version of the other.3 A recent commentary reviewed considerations relevant to the List Experiment for abortion estimation17 and while the approach has yielded mixed results,14 15 we determined its strengths3 18 justified inclusion in this study.

Finally, social network-based approaches ask respondents about abortions among their female friends and relatives based on the assumption that women are less likely to under-report others’ abortions.19–22 We propose the confidante method (approach #5) in which respondents are asked questions about up to three of their closest female confidantes, blending the Best Friend approach20 and the Anonymous Third Party Reporting19 to capitalise on the strengths of each.3

Other approaches to estimating abortion incidence have been proposed, but have yielded inconsistent results.11 We selected the five approaches compared in this paper because we deemed them to be the most promising for low-resource settings with unreliable official statistics.3 Including the two prevailing approaches to measuring abortion (direct reporting, AICM) enables assessment of how more novel approaches compare. More details on the strengths and weaknesses of each approach and considerations around validity and precision are available elsewhere.3 A small number of studies have compared multiple methods for estimating abortion incidence9 15 18 23 24; this is the first to test over four approaches, including both female survey-based and indirect facility-based methodologies, and to propose two new approaches.

Methods

Data collection

The List Experiment, confidante method and direct reporting use data from a nationally representative community-based survey (CBS) of women. The AICM uses data from two surveys: a nationally representative health facilities survey (HFS) collecting annual caseloads of PAC and induced abortions; and a knowledgeable informant survey (KIS) estimating the proportion of abortions treated for complications in facilities. The modified AICM uses data from the HFS and CBS.

We describe the HFS and KIS elsewhere.2 We drew the CBS sample using a two-stage stratified cluster design with probability proportional to size sampling. First, 100 enumeration areas (EAs) were selected, stratified by urban/rural residence and region. Following household mapping, we randomly selected 42 households from each EA and conducted household surveys to gather socioeconomic information and identify eligible female respondents (aged 15–49 years) whom we invited to participate in the CBS. On obtaining informed consent, a trained interviewer administered a structured questionnaire face-to-face using an Android smartphone enabled with the Open Data Kit electronic data collection software, in a private place. Interviewers lived locally and were familiar with the language and culture. We conducted interviews in English or the respondent’s local language. As there are 49 official languages in Ghana (many unwritten), survey questions were translated orally by the interviewer using translations agreed on during interviewer training.

Kwame Nkrumah University of Science and Technology (KNUST) conducted the fieldwork between May and July 2018, with technical support from the Guttmacher Institute and the Performance Monitoring and Accountability team at the Johns Hopkins Bloomberg School of Public Health. Ethical approval was obtained from the Institutional Review Boards of the Guttmacher Institute (IRB00002197) and the Johns Hopkins Bloomberg School of Public Health (00008463), and from the KNUST Committee on Human Research, Publication and Ethics (CHRPE/AP/210/18).

To improve the validity of responses, we placed abortion-related modules in a particular order, starting with the List Experiment (so respondents did not know which list events we were interested in), followed by the confidante method (because talking about friends’ abortions may encourage later self-disclosure of abortion), and ending with direct reports. Below, we describe how each of the five estimation approaches was implemented.

List Experiment

For the Double List Experiment, we created two lists (A and B) of four non-sensitive events related to health or reproduction (eg, taking an ambulance, having a period) and asked respondents how many of these events they had experienced in the last 12 months. We randomly allocated respondents to two equal-sized groups (1 and 2). We added abortion as a fifth item to list A for group 1 and list B for group 2. Group 1 received list A with the abortion item, followed by list B without abortion, whereas group 2 received list B with abortion followed by list A without abortion. To validate this approach, we also included a practice list that asked about a non-sensitive event (having eaten koose, a local food, in the past week), and compared the estimate derived from the practice list with the estimate from a direct question at the end of the questionnaire.

Confidante method

We asked each respondent to think about up to three confidantes aged 15–49 years who share private and confidential information with her and with whom she also shares such information. We collected information on each confidante’s sociodemographic characteristics, contraceptive use, abortion experience (and timing) within the past 5 years, existence of complications and receipt of treatment. One of the key assumptions for the confidante method is that respondents are selecting confidantes independently of the confidante’s likelihood of having had an abortion. To minimise the risk of respondents’ thinking about abortion when selecting their confidantes, we placed the confidante module before direct questions about abortion and ensured that the confidante-generating question did not mention abortion. Nonetheless, the module had to be placed after the List Experiment, and our Institutional Review Board required inclusion of the term ‘abortion’ in the consent form, so respondents may have been primed to think about confidantes who had an abortion. To help determine whether this was the case, we conducted a phone follow-up of 406 randomly selected respondents to enquire about whether they were thinking about abortion when selecting confidantes.

Direct reporting

Respondents were asked whether they had abortions in the past 5 years and the timing of each abortion. Additionally, some women may take action to bring back a late period without necessarily knowing whether they are pregnant or considering it an abortion. To test whether self-reporting could be improved by including these events, before the direct question about abortion, we asked respondents if they had done anything to bring back a late period and classified these events as abortions if the respondent believed that she was pregnant at the time and if her period was at least 7 days late. We call these events menstrual regulations (MR) for short.

AICM and modified AICM

Data collection for the standard AICM is described in Polis et al.2 For the modified AICM, we estimated PAC caseloads from the HFS (as in the standard AICM) but estimated the multiplier from women’s self-reported abortions (instead of the KIS). We asked women who reported an abortion in the past 3 years whether they had experienced complications and if so, whether and where they had sought treatment. This enabled us to calculate the proportion of all abortions that resulted in complications treated in a health facility (the inverse of the multiplier).

Patient and public involvement

We did not directly involve identified abortion patients in study planning, but we sought guidance for study planning and results dissemination from our Technical Advisory Committee, which included community representatives and technical experts.

Data analysis

The project and analysis plans were pre-registered on the Open Science Framework (https://osf.io/285ew). We used Stata 15 for data cleaning and analysis. We used Stata’s svyset command to account for the complex survey design of the CBS. Although the CBS sample was drawn to be nationally and zonally representative, the weighted sample characteristics differed significantly on zone and union status from the 2017 Ghana Maternal Health Survey (GMHS) population distributions (which we viewed as more accurate due to the substantially larger sample size) (online supplementary appendix A). To ensure the CBS was representative, we used the GMHS to produce poststratification weights. We similarly weighted the confidante data to ensure that it was representative and accounted for clustering by the respondent. Estimates of abortion incidence (number of abortions per 1000 women aged 15–49 per year) from each methodology are computed nationally and for each of Ghana’s three ecological zones (Coastal, Middle and Northern). For each rate, we calculate 95% CIs. We then use these CIs to determine whether the rates from the different approaches differ significantly or not: if the CIs from two approaches do not overlap, the rates are significantly different.25

Supplemental material

For direct reporting and the confidante method, we first calculated annual abortion rates for each of the past 5 years to check for potential telescoping (ie, temporal displacement) or attrition (in knowledge of confidantes’ abortions or reporting) over time (figure 1). As we do not expect any secular changes in abortion rates over the past 5 years, a higher rate in the past year followed by a sudden drop in the second year would indicate telescoping of abortion events to the past year, whereas gradual decreases in rates from year 2 to 5 would indicate attrition in reporting. Both these patterns can be observed in figure 1. Given considerable telescoping to the past year and some attrition over time in both approaches, we present direct report and confidante estimates as annualised rates over the past 3 years (mid-2015 to mid-2018). Estimates for the AICM and the modified AICM are for the year 2017 (the timeframe for which the HFS caseloads were collected), and estimates for the List Experiment are for the past year (mid-2017 to mid-2018). As we do not expect secular changes in abortion rates between these overlapping periods, these slight differences in time frames should not hinder the comparison of rates from the different approaches.

Figure 1

MR or action to bring back a late period without necessarily knowing whether one is pregnant. ‘All confidantes’ estimates were calculated by pooling all confidantes, giving equal weight to each. MR, menstrual regulation.

For the confidante estimates, we made two adjustments to counteract potential biases from ‘missing’ confidantes who may have different abortion behaviours, and non-disclosure of some confidantes’ abortions to the respondent (transmission bias; see table 1 for more details).

Table 1

Abortion incidence rates from direct reporting (respondents) and confidante method, annualised over the past 3 years

Table 2

Computation of abortion incidence using the List Experiment

We compared the five estimates with respect to compliance with assumptions, consistency across subgroups, reliability and precision.3 We also estimated zonal and national numbers of unintended pregnancies; see the online supplementary appendix B for methodological details.

Supplemental material

Results

The List Experiment yielded two very different national estimates for each list: 14 per 1000 (list A; table 2) vs 57 (list B). The lack of consistency between the two rates, and their wide 95% CIs suggest the estimates are unreliable. Moreover, the Northern zone had a negative rate of −2 per 1000, which is invalid. The practice list measuring the incidence of eating koose in the past week did not yield accurate results either as it gave an estimate of 29%, whereas the ‘true’ prevalence obtained from the direct question was 43%, and CIs for the two estimates did not overlap, making the estimates significantly different (data not shown). These findings suggest the list experiment (as implemented in both the practice list and the real list) was poorly understood and calls into question its validity in this setting. Therefore, we exclude it from subsequent comparisons.

The 3-year annualised rate from the confidante approach (adjusted for the ‘missing’ confidantes but not for transmission bias) was 38 per 1000 nationally (95% CI: 35 to 41), ranging from 18 (Northern zone) to 43 (Coastal zone; table 1). Adjusting for transmission bias resulted in a national rate of 61 per 1000, ranging from 34 (Northern zone) to 71 (Coastal zone).

The 3-year annualised abortion incidence rate from direct reporting on abortion (including menstrual regulation (MR)) was 30 per 1000 nationally (95% CI: 24 to 37), with zonal estimates ranging from 10 (Northern zone) to 37 (Coastal zone; table 1). Asking about MR increased abortion reporting as the estimate excluding MRs was 20 per 1000 women nationally (95% CI: 16 to 25). However, we do not know what proportion of MRs would have been reported as abortions had the MR question not been asked first, so the estimate excluding MR should not be considered complete. For both the direct reporting and the confidante estimates, patterns across zones were similar, with rates in the Northern zone being significantly lower than in the Middle and Coastal zones.

The AICM yielded an abortion incidence rate of 27 per 1000 nationally (95% CI: 22 to 32), with zonal estimates ranging from 19 (Northern zone) to 30 (Middle zone).2 For the modified AICM (table 3), the national abortion rate was 41 per 1000 (95% CI: 36 to 47); zonal rates were similar for the Northern zone (27) and Coastal zone (28) and significantly higher for the Middle zone (60).

Table 3

Components of modified AICM abortion incidence calculation

We summarise abortion incidence rates for the confidante method, direct reports, AICM and modified AICM nationally and for each zone (table 4). We compared them using several criteria discussed at greater length elsewhere.3 Key decision points are summarised below.

Table 4

Abortion incidence rates from direct reporting, confidante method, AICM and modified AICM

We tested the accuracy of the direct report estimate by comparing the PAC treatment rate among respondents (number of treated abortion complications per 1000 women 15–49) with that based on HFS caseloads (assumed to be reliable, although they may be overestimated if some abortions were misclassified as PAC due to stigma). Respondent PAC treatment rates were lower than HFS treatment rates nationally and in the Middle and Northern zones (table 5). Although women may under-report untreated abortions, we assume they are less likely to under-report the proportion of abortions that get treated (the first component of calculating treatment rates). This suggests that the lower treatment rate in the CBS is due to respondents under-reporting their abortions (second component of calculating treatment rates) and not to an invalid multiplier (inverse of the proportion of abortions that get treated). In the Coastal zone, the respondent treatment rate is similar to the HFS rate, possibly because lower stigma in the capital city means less under-reporting of abortions in the CBS, as well as less misclassification of abortion as PAC in the HFS.

Table 5

Postabortion care treatment rates calculated from the CBS and HFS

As explained in the methods section, for the confidante method to generate valid estimates, confidantes should be selected independently of their likelihood of having had an abortion. In the phone follow-up of 406 randomly selected respondents enquiring about whether they were thinking about abortion when selecting confidantes, 10% said yes, and 39% of these specifically said they selected a confidante because she had had an abortion. We might expect most of this bias to operate in selection of the first confidante, translating to an overinflated abortion rate for the first confidante and a drop-off for confidantes 2 and 3 (although selection of confidantes 2 and 3 could also be subject to this bias). Rates did drop slightly from confidante #1 (41 per 1000) to confidante #2 (36) and confidante #3 (30), but these non-significant differences (table 1) could be caused by more limited knowledge of confidantes’ abortions as respondents were asked to name confidantes in order of closeness. The transmission bias adjustment attempts to address this attrition but could lead to overinflation if the first confidante rate is overestimated.

To further test the accuracy of the confidante estimate, we calculated the PAC treatment rate among confidantes (based on an unadjusted number of abortions and proportion treated in facilities for complications) and compared it with that from the HFS. However, this rests on the assumption that respondents know if and where confidantes’ abortions were treated and should thus be interpreted cautiously. The confidante PAC treatment rate was much higher (9.6 vs 5.7 per 1000 women; table 5), suggesting (under the assumption that HFS caseloads are accurate) overestimation of either the confidante abortion rate or the proportion of abortions treated. Although respondents may be more likely to know about confidantes’ treated abortions (resulting in an overestimate of the proportion that got treated), this would be accompanied by an underestimation of the overall abortion rate and would not affect the final PAC treatment rate. It is unlikely that respondents would accurately report confidantes’ abortions and over-report the proportion treated, providing further tentative evidence that the confidante abortion rate may be overestimated.

Comparing the AICM versus the modified AICM requires consideration of the two multipliers: the KIS multiplier for the AICM and the CBS multiplier for the modified AICM. Having ascertained the validity of the CBS multiplier previously, we considered it more reliable than the KIS multiplier, as it is based on respondents’ direct reports of their behaviour, versus KIS experts’ informed opinions. Both multipliers may be underestimated if respondents were more likely to report (CBS) or know about (KIS) complicated abortions that received treatment. Although multipliers cannot be directly compared as the KIS multiplier only applies to illegal abortions,2 the fact that the CBS multiplier (7.3) is higher than the KIS multiplier (3.9) suggests less under-reporting of untreated abortions in the CBS, and confers additional validity to the CBS multiplier. A similar pattern was found in a study in Burkina Faso.23

Based on available evidence, the approaches that met the basic criteria for validity and reliability in Ghana were the direct reports, the confidante method, and the modified AICM. The data do not allow us to determine which of these rates is the most accurate as we are estimating a hidden behaviour for which there is no gold standard. We therefore provide a range for the true abortion rate, with the lowest and highest estimates from the three approaches (direct, modified AICM and confidante) as the lower and upper bounds. In cases where a final point estimate of abortion incidence in Ghana is needed for policy and programmatic purposes, we suggest using the mean of the estimates from the three approaches, which yields a national abortion incidence rate of 44 per 1000 (range: 30–61). Zonal rates are 24 (range: 10–34) for the Northern zone, 51 (range: 29–63) for the Middle zone and 45 (range: 28–71) for the Coastal zone.

Based on these final abortion estimates, the estimated national pregnancy rate was 194 pregnancies per 1000 women aged 15–49 years, and the unintended pregnancy rate was 103 per 1000; this varied by zone (online supplementary appendix B, table B1). Of all pregnancies, an estimated 53% were unintended, and 23% ended in induced abortion (online supplementary appendix B, figure B1).

Discussion

This study contributes significantly to the field of abortion incidence measurement—and sensitive behaviour measurement more broadly—by providing a rigorous investigation of five methodologies using data collected contemporaneously. Our findings do not reveal one approach that performed best. Furthermore, the performance of the approaches we tested is likely dependent on contextual factors like culture, stigma, abortion legality and literacy, so the approaches may perform differently elsewhere. For example, in countries where women tend to share less intimate information with friends, the confidante method may be inappropriate.23 In countries where abortion laws are more restrictive and stigma is higher, direct reporting would likely perform poorly, but the confidante method may perform well if women rely on their social networks to learn about and access care.19 23 In countries where women may not share much intimate information but where abortion is broadly legal and less stigmatised, direct reporting may perform better than network-based approaches, as in Rajasthan.24 In Ghana, abortion is broadly legal but stigma persists.26 27 Thus, our direct report estimate is likely an underestimate of the true abortion rate, despite being higher than the 2017 GMHS estimate of 13 per 1000 (based on the GMHS finding that 6.7% of women had abortions in the past 5 years, assuming rates remained constant over those 5 years and not accounting for multiple abortions to the same person).7 Asking respondents about bringing back their period increased reporting and asking about confidantes’ abortions earlier in the survey may have helped respondents feel more comfortable disclosing their abortions. This may be a reason to ask about confidantes’ abortions in surveys, even if not utilising the method to calculate incidence.

Ensuring that confidantes are selected independently of their probability of abortion may be difficult if abortion is mentioned in the informed consent or a preceding question. If priming is a concern, the best friend approach20 may be superior as identifying one’s best friend is likely less subject to interviewer influence than identifying women ‘with whom one shares confidential information’. The main advantage of the confidante method over the best friend approach is the larger sample of confidantes. In Ghana, only 16% of women had more than one confidante; implementing the best friend approach would have reduced the confidante sample size from 3930 to 3040. Thus, the suitability of each approach depends on the respondent sample size and the size of women’s close networks; future studies might conduct formative research to determine women’s average number of confidantes prior to survey design.

The failure of the List Experiment in Ghana seems primarily due to poor understanding of the questions or insufficient directions on how to respond as the practice list also yielded an inaccurate estimate. The List Experiment performance is also sensitive to the nature of the other list items, which should meet certain criteria.16 While we endeavoured to fulfil these criteria, it is possible that small deviations contributed to the inconsistency in rates between lists A and B, although this would not explain negative rates. The list experiment performed poorly in other low-resource countries15 and may not be appropriate in settings with low numeracy. The Northern zone (where the negative rate was found) has the lowest female literacy rate in Ghana (35 per 1000 vs 55 nationally).28

Although the modified AICM multiplier appeared to be valid in this setting, in countries where abortion reporting is lower due to stigma or illegality, or if the sample size is smaller, the number of self-reported abortion complications may be too low to calculate robust multipliers, making this approach inappropriate. In Ghana, the legality of abortion may complicate the implementation of AICM-based approaches, since the HFS PAC count may include some legal abortions reported as PAC due to stigma.

This was the first study to test more than four approaches to measuring abortion incidence in one population. We cross-validated various components of the estimates against each other and proposed several improvements to survey instruments, such as asking about bringing back a period and preceding direct reporting with questions about confidantes. In terms of limitations, the confidante estimates do not take into account multiple abortions to one woman, which may have contributed to the observed decline in rates over time. Moreover, we did not explicitly ask respondents about MR among their confidantes, which further complicates the comparability of the confidante and direct reporting estimates. Although we made adjustments to confidante data to account for biases around knowledge transmission and confidante sample selection, the validity of our final estimates rely on these adjustments being accurate. Limitations of the AICM are discussed elsewhere.2

Other factors merit consideration in determining the best use of limited resources to measure abortion incidence. To compare estimates across diverse settings, it may be important to select methodologies that do not rely on extensive sharing of intimate information between friends, or that perform well in low-literacy contexts. Other considerations include the level of anonymity retained by respondents in high stigma contexts, cost relative to the desired precision of estimates, and the potential for collecting contextual information on abortion (which can be of great policy relevance). Ultimately, it might be appropriate to employ more than one methodology to measure abortion incidence. For example, the confidante method might help improve direct reporting, whereas direct reporting is required for the modified AICM and can provide contextual information on abortion, even if not used for incidence estimation. Budget allowing, triangulating findings from different methodologies may yield the most robust estimate of this hidden and difficult to measure behaviour.

Acknowledgments

The authors are grateful to our fielding team and all study participants. They are also grateful to Joe Flack for programming our questionnaires in ODK, Philicia Castillo for analytic support on the AICM component, and Marjorie Crowell and Ernest Ekutor for research assistance at various stages of the project. This study was made possible by UK Aid from the UK Government and a grant from the Dutch Ministry of Foreign Affairs.

References

Footnotes

  • Handling editor Sanni Yaya

  • Twitter @cbpolis

  • Contributors Contributions to the AICM component of this study are detailed elsewhere. SCK, EO, CBP, SOB, EKN and RL-R: led the conceptualisation of the project. SCK, EO, DWC, RH, CBP and SOB: participated in developing aspects of the methodological approach used. SCK, DWC, RH and SOB: participated in programming and implementing computer code for the analysis. SCK, DWC and RH: verified the overall reproducibility of research outputs. SCK, DWC and RH: conducted the formal analysis. EO, EKN and RL-R: led the data collection efforts. SCK, EO, DWC, RH, CBP, SOB and EKN: provided resources in terms of study materials, contact with respondents, and computing resources. SCK, DWC, RH, SOB and EKN: performed data curation to manage and clean data. SCK wrote the original draft of the manuscript. SCK, EO, DWC, RH, CBP, SOB, EKN and RL-R: participated in reviewing and editing the draft. SCK, CBP, EO and SOB: had oversight and leadership responsibility for research activity planning and execution, including mentorship external to the core team. SCK, EO, DWC, RH, CBP, SOB and EKN: were responsible for managing and coordinating research activity planning and execution. SCK and CBP: were responsible for acquisition of the funding support for the project, leading to this publication.

  • Funding UK Aid from the UK Government, and Dutch Ministry of Foreign Affairs.

  • Disclaimer The views expressed are those of the authors and do not necessarily reflect the positions and policies of the donors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.

  • Patient consent for publication Not required.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement Data are available upon request. De-identified versions of the raw Community-Based Survey, Health Facilities Survey and Knowledgeable Informants Survey datasets collected by the authors and used in this analysis are available from the Guttmacher Institute upon reasonable request to researchers who wish to use the data for scholarly analysis. To discuss obtaining copies of these datasets, please contact popcenter@guttmacher.org with the detailed protocol for your proposed study, and information about the funding and resources you have to carry out the study.