Skip to main content

Main menu

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
      • Local Voices Webinar
      • Connecting Creators and Users of Knowledge
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers

User menu

  • My Alerts

Search

  • Advanced search
Global Health: Science and Practice
  • My Alerts

Global Health: Science and Practice

Dedicated to what works in global health programs

Advanced Search

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers
  • Alerts
  • Find GHSP on LinkedIn
  • Visit GHSP on Facebook
  • RSS
ORIGINAL ARTICLE
Open Access

Can We Use Routine Data for Strategic Decision Making? A Time Trend Comparison Between Survey and Routine Data in Mali

Talata Sawadogo-Lewis, Youssouf Keita, Emily Wilson, Souleymane Sawadogo, Ibrahim Téréra, Hamadoun Sangho and Melinda Munos
Global Health: Science and Practice December 2021, 9(4):869-880; https://doi.org/10.9745/GHSP-D-21-00281
Talata Sawadogo-Lewis
aInstitute for International Programs, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: tsawado1@jhu.edu
Youssouf Keita
bInstitute for International Programs, Johns Hopkins Bloomberg School of Public Health, Bamako, Mali.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Emily Wilson
aInstitute for International Programs, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Souleymane Sawadogo
cAgence Nationale de Télésanté et d'Informatique Médicale, Bamako, Mali.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Ibrahim Téréra
dInstitut National de la Santé Publique (INSP), Bamako, Mali.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hamadoun Sangho
dInstitut National de la Santé Publique (INSP), Bamako, Mali.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Melinda Munos
aInstitute for International Programs, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
PreviousNext
  • Article
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF
Loading

Key Findings

  • The direction and magnitude of the time trends of contraceptive prevalence rate, institutional delivery, and 3 doses of the diphtheria, pertussis, and tetanus (DPT3) vaccine from 2001 to 2012 were similar at the national level between data sources.

  • At the regional level, routine data tended to overestimate DPT3 coverage, and underestimate institutional delivery and contraceptive prevalence relative to survey data.

  • Routine data are appropriate for use for program planning. However, it does not seem to be appropriate for use for impact evaluations, particularly at the regional level.

Key Implications

  • Program planners and evaluators can continue to use routine data to detect overall trends but until the quality of routine data is improved, they should refrain from using it for impact evaluations.

ABSTRACT

Background:

Countries with scarce resources need timely and high-quality data on coverage of health interventions to make strategic decisions about where to allocate investments in health. Household survey data are generally regarded as “gold standard,” high-quality data. This study assessed the comparability of intervention coverage time trends from routine and survey data at national and subnational levels in Mali.

Methods:

We compared 3 coverage indicators: contraceptive prevalence rate, institutional delivery, and 3 doses of diphtheria, pertussis, and tetanus (DPT3) vaccine, using 3 Mali Demographic and Health Surveys (DHS 2001, 2006, and 2012–2013) and routine health system data covering 2001–2012. For routine data, we used local health information system (HIS) annual reports and an HIS database. To compare time trends between the data sources, we calculated the percentage point change and 95% confidence interval from 2001–2006 and 2006–2012. We then computed the absolute and relative differences between the 2 data sources for each indicator over time at national and regional levels and assessed their level of significance.

Results:

The direction and magnitude of the time trends of contraceptive prevalence rate, institutional delivery, and DPT3 vaccine from 2001 to 2012 were similar at the national level between data sources. At the regional level, there were significant differences in the magnitude and direction of time trends for institutional delivery and the DPT3 vaccine; contraceptive prevalence trends were more consistent. Routine data tended to overestimate DPT3 coverage, and underestimate institutional delivery and contraceptive prevalence relative to survey data.

Conclusion:

Routine data in Mali—particularly at the national level—appear to be appropriate for use to inform program planning and prioritization, but routine time trends should be interpreted with caution at the subnational level. For program evaluations, routine data may not be appropriate to draw accurate inferences about program impact.

Résumé en français à la fin de l'article.

BACKGROUND

All countries, especially those with scarce resources, need to make strategic decisions about where to allocate investments in health. Timely, high-quality, population-based data on coverage of key health interventions are necessary to evaluate project or program impact and thus guide future efforts. Household survey data—including from U.S. Agency for International Development-funded Demographic and Health Surveys or United Nations Children's Fund-funded Multiple Indicator Cluster Surveys—are generally considered to use “gold standard” methods and, therefore, to produce high-quality population-based data.1,2 These data are publicly available and free to access. However, because the surveys are expensive to conduct, they are conducted relatively infrequently. Country decision makers must make frequent programmatic decisions and adjustments, and survey data, typically available every 3 to 5 years, cannot be used for this purpose. In addition, while survey data are typically available at the subnational level (e.g., regional level), they are usually not available for smaller geographic areas such as districts.1

To overcome these limitations, country-level planners often turn to routine data sources to fill these data gaps. Routine data collected by the health system are typically available on a monthly or quarterly basis. If properly collected and managed, they allow stakeholders to observe changes in coverage from year to year that can be important for time-sensitive decision making. At the district health facility level, they serve as an appropriate source for operational decision making. Because they are collected and managed by national staff from the health system, their collection is more sustainable. Finally, routine data are relatively inexpensive to collect.2

Health information systems (HIS), which rely on routine data, can have significant limitations. Although many countries publish annual reports based on HIS data,3 it can be difficult to access the data underlying the reports.4 Some indicators of interest are not collected or are not aggregated in the HIS; when indicators are available, the data are sometimes of poor quality.1,5,6 In many countries, the HIS is limited to data from public health facilities; data from private facilities are not included. For intervention coverage measures, the denominators—the estimates of the population in need —are often based on census projections. The accuracy of these projections can be affected by factors like the time since the last census and internal population movements.

Despite these well-documented limitations, routine data are often the de facto data source used for programmatic planning in low- and middle-income countries, particularly where no recent household survey exists. Within the context of the Global Affairs Canada-funded National Evaluation Platform—dedicated to improving evidence-based decision making7-10—a team of Malian researchers found that at least 5 major maternal, newborn, and child health and nutrition (MNCHN) programs rely on HIS data as their source of coverage indicator data in Mali.11 A 2013 evaluation of Mali's HIS concluded that it had poor data quality in general, due in large part to poor data archiving and uneven record keeping. Regional HIS data were also found to be of generally higher quality than district-level data.12 Reducing maternal, newborn, and under-5 mortality is a priority for the Government of Mali, and data are needed to inform this work. Mali's decennial plan for health and social development (Plan Décennal de Développement Sanitaire et Social 2014–2023) recognizes the need to increase routine data quality, timeliness, and use for decision making at all levels.13

Given that routine data are widely used for planning and evaluation and to fill the gaps in between household surveys in Mali, it is of interest to decision makers to understand the comparability of these data. While some differences in the levels of coverage indicators between the 2 data sources are expected (because routine data are limited to the public health sector and because of some differences in indicator definitions), it would be useful to know whether the HIS captures the same time trends as population-based surveys. To answer this question, we compared time trends in routine and household survey data from 2001 to 2012 in Mali for 3 indicators to inform the use of routine data by decision makers in Mali.

Because routine data are widely used for planning and evaluation and to fill the gaps in between household surveys in Mali, decision makers seek to understand the comparability of these data.

METHODS

This analysis focused on 3 indicators: modern and traditional contraceptive prevalence rate (CPR), 3 doses of diphtheria, pertussis, and tetanus vaccine (DPT3), and institutional delivery. We focused on these because they were the most complete indicators across regions and years in the HIS and represented a range of services across the continuum of care.

Data Sources and Quality Assessment

We used DHS data collected in 2001,14 2006,15 and 2012–201316 in Mali. Data were collected in all regions and the district of Bamako in 2001 and 2006. In 2012, the regions of Tombouctou, Gao, and Kidal, and 3 districts in the Mopti region (Douentza, Ténenkou, and Youwarou) were excluded due to security concerns.

For routine data, coverage estimates were obtained from HIS-validated annual reports. Numerators and denominators were double extracted in a standardized format for each indicator, year, region, and at the national level from 2001 to 2012. For each indicator, the numerator as reported in the HIS (e.g., number of institutional deliveries) was independently extracted from the electronic database by 2 different individuals and then compared. Cases of discordance were discussed and verified by returning to the HIS database (Développement Sanitaire du Mali) until consensus was reached among the data extractors. Access to data was facilitated by the fact that the authors carrying out this work were part of Mali's National Evaluation Platform, as Keita et al describe.7 This group of researchers includes members at the Cellule de Planification et de la Statistique, where HIS data are stored.

Table 1 compares HIS and DHS definitions of the 3 indicators, and Table 2 shows changes in indicator definitions in the routine HIS data over time.

View this table:
  • View inline
  • View popup
TABLE 1.

Indicators Definition According to Routine and Survey Data, Mali 2012

View this table:
  • View inline
  • View popup
TABLE 2.

Routine Indicator Availability and Definition Change Over Time, 2001–2012, Mali

Data Analysis

We calculated cluster-stratified survey-weighted coverage estimates and standard errors using DHS data for each indicator and survey at national and regional levels. To calculate estimates for routine data, we divided the numerator as reported in the HIS by the estimated population denominator (using population projections from the 2009 national census)17 at national and regional levels. We also calculated the standard errors for the survey and routine coverage estimates.

Because we had 3 survey estimates available, we defined 2 time intervals for comparison: 2001–2006 and 2006–2012. We visualized survey and routine coverage estimates with their 95% confidence intervals and compared the direction of the time trends in each interval.

To assess whether time trends from routine and survey data differed significantly from 2001 to 2006 or from 2006 to 2012, we standardized the difference of differences by subtracting the difference between 2001 and 2006 for survey data from the difference between 2001 and 2006 for routine data and dividing this quantity by the square root of the sum of survey and routine variance. Assuming a Gaussian distribution with mean 0, and standard deviation 1, we calculated the probability of a difference as or more extreme than the one we observed between survey and routine data. We reported P values for each comparison, aware that there is a 5% chance that a random observation from a Gaussian distribution will have a significant p-value, based on chance alone. We did not adjust P values for multiple comparisons.

Analyses were conducted using R version 3.5.1. All analysis files are publicly available: https://doi.org/10.5281/zenodo.5649508.

RESULTS

Data Availability

We were able to obtain coverage estimates from the routine reports and databases for the national level and all regions for the 3 indicators we examined from 2001 to 2012.

National-Level Time Trends

Figures 1, 2, and 3 show time trends in CPR, DPT3, and institutional delivery, respectively, at national and regional levels using routine and survey data. Figure 4 shows the percentage point change for survey versus routine data. Based on survey data, time trends for CPR were essentially flat from 2001 to 2012, DPT3 increased sharply from 2001 to 2006 and declined slightly from 2006 to 2012, and institutional delivery increased slowly from 2001 to 2012. At the national level, the direction of the time trends was consistent between routine and survey data for all indicators and time periods. Notably, both routine and survey data identified a slightly negative trend in DPT3 coverage from 2006 to 2012. However, the magnitude of the time trends was significantly different between routine and survey data for institutional delivery, and, for 1 time period, for DPT3 (Tables 3 and 4). In addition, there were large differences between the point estimates from routine and survey data; routine data underestimated coverage of CPR and institutional delivery and overestimated DPT3 coverage relative to survey data.

FIGURE 1
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 1

Contraceptive Prevalence Rate Time Trends by Survey and Routine Data, at National and Regional Levels From 2001 to 2012, Mali

FIGURE 2
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 2

Diphtheria, Pertussis, and Tetanus Vaccine Coverage Time Trends at National and Regional Levels According to Routine and Survey Data From 2001 to 2012, Mali

Abbreviation: DPT, diphtheria, pertussis, tetanus.

FIGURE 3
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 3

Institutional Delivery Rate Time Trends at National and Regional Levels According to Routine and Survey Data From 2001 to 2012, Mali

FIGURE 4
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE 4

Prediction of Routine Annual Average Change for 3 Indicators by Survey Data, Comparing 2 Time Intervals and at Regional and National Levels, Malia

aEach dot represents the difference, from time 1 to time 2, in estimated proportion coverage, divided by the number of years in the time period.

View this table:
  • View inline
  • View popup
TABLE 3.

National Level Time Trend Change in Proportion Indicator Coverage According to DHS and Routine Data, 2001–2006, Mali

View this table:
  • View inline
  • View popup
TABLE 4.

National Level Time Trend Change in Proportion Indicator Coverage According to DHS and Routine Data, 2006–2012, Mali

Regional-Level Time Trends

Time trends for all 3 indicators varied widely between regions, particularly for DPT3 and institutional delivery using routine data, and there was far less consistency between survey and routine time trends, relative to national estimates (Figures 1, 2, and 3). All regions had at least 1 statistically significant difference between routine and survey time trends except Tombouctou from 2001 to 2006 and Koulikoro from 2006 to 2012 (Tables 5 and 6).

View this table:
  • View inline
  • View popup
TABLE 5.

Regional Level Time Trend Change in Proportion Indicator Coverage According to DHS and Routine Data, 2001–2006, Mali

View this table:
  • View inline
  • View popup
TABLE 6.

Regional Level Time Trend Change in Proportion Indicator Coverage According to DHS and Routine Data, 2006–2012, Mali

CPR time trends at the regional level were not significantly different between routine and survey data; the only exceptions were Gao (2001–2006), and Ségou (2006–2012) (Tables 5 and 6). In addition, the direction of the CPR trends was consistent between routine and survey data except for Kidal and Tombouctou (2001–2006), although in both cases the difference between the routine and survey estimates was very small.

DPT3 trends were significantly different for 4 of 9 regions from 2001 to 2006 and 5 of 6 regions from 2006 to 2012 (Tables 5 and 6). In addition, the direction of the DPT3 time trend was different between routine and survey data for all 6 regions from 2006 to 2012. Similarly, institutional delivery time trends were significantly different between routine and survey data for 6 of 9 regions from 2001 to 2006 and 3 of 6 regions from 2006 to 12. The direction of time trends for institutional delivery was mostly consistent between routine and survey data, with 1 exception in 2001–2006 and 2 exceptions in 2006–2012.

DISCUSSION

We aimed to compare routine and survey data trends over approximately 10 years at national and regional levels in Mali. We found that time trends for CPR, DPT3, and institutional delivery indicators in Mali were broadly similar between routine and survey data at the national level but were much more inconsistent at the regional level. This comparison is relevant to country and global stakeholders for several reasons. First, although household surveys are the preferred source for population-based measures of coverage, they are only available intermittently—every 3–5 years or even more infrequently— and therefore are of limited utility to support regular decision making.18 Second, routine data are available at low levels of disaggregation and would be a more granular alternative to survey data. Third, in Mali, researchers and planners already rely heavily on routine data.3 Given that the HIS is managed by Ministry of Health staff and that sense of country ownership over these data is high, routine data are more sustainable than externally coordinated and funded household surveys. However, it is important to understand to what extent these data may capture population changes in intervention coverage.

Previous studies have reported poor quality of routine data,1,5,6 but there have been limited assessments of external validity. Other analyses have found differences between routine and survey data with respect to point estimates,18 and some have found few identifiable patterns.19 We note that there were differences in indicator definition between survey and routine data (Table 5). This is frequently the case with survey and routine data because the data sources capture different kinds of data and may in part explain the differences we observed. However, routine data are often used to proxy survey data, so comparing the 2 data sources remains relevant. We focused primarily on the comparability of time trends rather than specific indicator levels, as both the direction and magnitude of time trends are often used by stakeholders to make decisions about which interventions or geographic areas to prioritize.

We focused primarily on the comparability of time trends rather than specific indicator levels, as both the direction and magnitude of time trends are often used by stakeholders to make decisions about which interventions or geographic areas to prioritize.

We found that national-level time trends were more comparable than regional-level trends, which may be due to the denominators used for the routine coverage estimates. Denominators for coverage indicators in routine data are typically based on projections from the most recent census. Internal migration—which would affect regional and district denominators but not national denominators—is often not captured in census projections. Depending on how recent these data are, the accuracy of the denominator may be affected.20 The most recent census available in Mali at the time of the analysis was held in 2009.17 An alternate approach for groups looking to replicate this analysis could be to use DHS-derived denominators for this analysis which would capture the distribution of women of reproductive age, births, and children by region.

The comparability of survey and routine data was generally better for CPR than for DPT3 and institutional delivery. This may be related to the fact that CPR changed very little from 2001 to 2012. In addition, the denominator for CPR, all women aged 15 to 49, is broader than the denominator for the other 2 indicators (pregnant women, and children aged 12–23 months) and may be less subject to error in census projections.21

We found that at the national level, routine data overestimated vaccine coverage but under-estimated CPR and institutional delivery. Women (and men) may access contraceptives outside of health facilities (e.g., private pharmacies), which may account for the underestimation of CPR. Similarly, women may give birth at private clinics, and these births are generally not captured in the routine HIS. Vaccination is generally delivered through the public health system, and overestimation of vaccination coverage in routine data is well-documented.20,22

Data extraction and cleaning for this analysis was a time- and labor-intensive process that required meticulous processing. Changes in district boundaries and indicator definition further complicated the process. Doing this rigorous, detail-oriented endeavor regularly is not realistically feasible. However, we note that at the time of analysis, Mali did not have the District Health Information System, version 2 (https://www.dhis2.org/) (DHIS2) in place.23 It is likely that the time and effort burden required for this process would have been considerably lighter if such a platform had already been established.19 With additional investments in building both more robust reporting systems18,20,22,24 and strong data use capacity including regular data quality assessments,8,25,26 routine data quality is likely to improve and this level of 1-time, in-depth data cleaning may not be necessary.

With the introduction of DHIS2 in Mali, more standardized indicator definitions will be used. The capacity of this platform to produce data visualizations at more granular levels (i.e., health facility or district level) and to increase detection of data quality issues at that level can lead to improved quality of aggregated data at the regional or national level. Building an information culture whereby managers are incentivized to use the data collected to make concrete changes in their health facility or district is a way to ensure that HIS data quality continues to improve.27 In a case study from Ethiopia, integrated supportive supervision— where managers aim to work with staff to review data and find solutions rather than adopting a punitive approach— has led to more accurate data being recorded and to data being used for decision making.28 While our findings currently do not support using routine data for impact evaluations, initiatives such as these could eventually result in data of sufficient quality to be appropriate for this purpose.

Limitations

Because DHSs were conducted only every 5–6 years, we were not able to look at more granular time trends. Additionally, the 2012 DHS excluded 3 regions and several districts due to the security situation in these areas at the time of data collection. Because of this, we were unable to assess if our findings held true from 2006 to 2012 in excluded regions.

Furthermore, since household survey data are generally assumed to be of higher quality than routine data, we assumed that the DHS data represented “truth.” We recognize, however, that household survey data has its own set of data quality issues,29,30 and some household survey estimates may have substantial nonsampling error. In addition, regional estimates in the Mali DHS had wide confidence bounds due to relatively small sample sizes that may have limited our ability to detect significant differences between survey and routine data at the regional level.

We focused only on the external consistency of routine data and did not look at other data quality metrics, namely completeness, timeliness, internal consistency, and representativeness. Assessing these metrics may have led to a more complete picture of where data quality gaps exist and how they could be addressed. Taken together, these limitations may limit the validity of our findings if, for example, the DHS results did indeed have significant data quality issues or if other dimensions of data quality not explored in this article were of low quality.

CONCLUSION

Given the frequent use of routine data in maternal, newborn, and child health programs in Mali, we aimed to assess the difference between indicator time trends from routine and household survey data to guide decision makers in Mali. Improving the data quality and accessibility of routine data is a high priority in many LMICs, and as part of this effort, it is important to assess the quality and usability of routine data in their current state. Trends in routine data appeared comparable to trends in household survey data at the national level and therefore may be appropriate for use at that level, but time trends in routine data should be interpreted with caution at the subnational level.

Given these findings, routine coverage data in Mali may not be suitable for impact evaluations, as evaluators need precise, accurate estimates of change to understand the extent to which a program is working. However, these data might be useful for planning and prioritization, if stakeholders keep in mind the potential error associated with subnational estimates. Given the potential for routine data to be a sustainable and timely source of appropriately disaggregated data, the push for improving the quality of routine data through exercises such as these should continue to be prioritized.

Acknowledgments

We would like to acknowledge members of the National Evaluation Platform's Mali Technical Task Team for their support in this work. We also thank Jonathan Alcazar for his support in formatting this manuscript.

Funding

This work was funded by the “National Evaluation Platform Approach for Accountability in Women's and Children's Health” project (grant number 7059904) from Global Affairs Canada to the Institute for International Programs at the Johns Hopkins Bloomberg School of Public Health.

Author contributions

MKM, YK, SS, IT, and EW designed the analysis plan. EW, IT, SS conducted the analysis. TSL, MKM, YK, HS, and EW wrote the first draft and edited additional versions. All authors approved the final manuscript.

Competing interests

None declared.

Footnotes

  • ↵* Co-first authors.

Translation

En Français

Peut-on utiliser les données de routine pour la prise de décision stratégique? Une comparaison des tendances temporelles entre les données d'enquête et de routine au Mali

Contexte: Les pays aux ressources limitées ont besoin de données actualisées et de haute qualité sur la couverture des interventions de santé pour prendre des décisions stratégiques sur l'affectation des investissements dans la santé. Les données d'enquêtes auprès des ménages sont généralement considérées comme des données de références, de haute qualité. Cependant, les enquêtes sont coûteuses et menées infréquemment, alors que les décisions et les ajustements en matière de programmes et d'investissement doivent être prises beaucoup plus fréquemment. Cette étude a évalué la comparabilité des tendances temporelles de la couverture des interventions à partir des données de routine et d'enquête aux niveaux national et infranational au Mali.

Méthodes: Nous avons comparé 3 indicateurs de couverture: taux de prévalence contraceptive, accouchement médicalisé et 3 doses de vaccin contre la diphtérie, coqueluche et tétanos (DTC3), à l'aide de 3 Enquêtes Démographiques et de Santé du Mali (EDS 2001, 2006, et 2012–2013) et des données de routine du système de santé couvrant la période 2001–2012. Pour les données de routine, nous avons utilisé les rapports annuels du système local d'information sanitaire (SIS) et une base de données SIS pour extraire les données de chaque indicateur. Pour comparer les tendances temporelles entre les sources de données, nous avons calculé la variation en points de pourcentage et l'intervalle de confiance à 95% entre 2001–2006 et 2006–2012. Nous avons ensuite calculé les différences absolues et relatives entre les 2 sources de données pour chaque indicateur au fil du temps aux niveaux national et régional et évalué s'ils étaient statistiques significatifs.

Résultats: Nous avons constaté que la direction et l'ampleur des tendances temporelles du taux de prévalence contraceptive, de l'accouchement médicalisé et du vaccin DTC3 de 2001 à 2012 étaient similaires au niveau national entre les sources de données. Cependant, au niveau régional, il y avait des différences significatives dans l'ampleur et la direction des tendances temporelles pour l'accouchement en établissement et le vaccin DTC3, tandis que les tendances de la prévalence contraceptive étaient plus cohérentes. Les données de routine avaient tendance à surestimer la couverture du DTC3 et à sous-estimer l'accouchement médicalisé et la prévalence contraceptive par rapport aux données d'enquête.

Conclusion: Les données de routine au Mali – – en particulier au niveau national – – semblent appropriées pour être utilisées pour guider la planification et la hiérarchisation des programmes, mais les tendances temporelles de routine doivent être interprétées avec prudence au niveau sous-national. Cependant, pour les évaluations de programme, les données de routine peuvent ne pas être appropriées pour tirer des conclusions précises sur l'impact du programme.

Peer Reviewed

First published online: November 30, 2021.

Cite this article as: Sawadogo-Lewis T, Keita Y, Wilson E, et al. Can we use routine data for strategic decision making? A time trend comparison between survey and routine data in Mali. Glob Health Sci Pract. 2021;9(4):869-880. https://doi.org/10.9745/GHSP-D-21-00281

  • Received: May 3, 2021.
  • Accepted: September 22, 2021.
  • Published: December 31, 2021.
  • © Sawadogo-Lewis et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit https://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-21-00281

REFERENCES

  1. 1.↵
    1. Bryce J,
    2. Arnold F,
    3. Blanc A,
    4. et al
    . Measuring coverage in MNCH: new findings, new strategies, and recommendations for action. PLoS Med. 2013;10(5):e1001423. doi:10.1371/journal.pmed.1001423. pmid:23667340
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Hancioglu A,
    2. Arnold F
    . Measuring coverage in MNCH: tracking progress in health for women and children using DHS and MICS household surveys. PLoS Med. 2013;10(5):e1001391. doi:10.1371/journal.pmed.1001391. pmid:23667333
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Wagenaar BH,
    2. Sherr K,
    3. Fernandes Q,
    4. Wagenaar AC
    . Using routine health information systems for well-designed health evaluations in low- and middle-income countries. Health Policy Plan. 2016;31(1):129–135. doi:10.1093/heapol/czv029. pmid:25887561
    OpenUrlCrossRefPubMed
  4. 4.↵
    Countdown to 2015 & Health Metrics Network. Monitoring Maternal, Newborn and Child Health: Understanding Key Progress Indicators. World Health Organization; 2011. Accessed October 29, 2021. https://apps.who.int/iris/handle/10665/44770
  5. 5.↵
    1. Marchant T,
    2. Bryce J,
    3. Victora C,
    4. et al
    . Improved measurement for mothers, newborns and children in the era of the Sustainable Development Goals. J Glob Health. 2016;6(1):010506. doi:10.7189/jogh.06.010506. pmid:27418960
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Moran A,
    2. Marchant T
    . Measuring coverage of essential maternal and newborn care interventions: an unfinished agenda to define the data matrix for action in maternal and newborn health. J Glob Health. 2017;7(2):020307. doi:10.7189/jogh.07.020307. pmid:29423176
    OpenUrlCrossRefPubMed
  7. 7.↵
    1. Keita Y,
    2. Diawara N,
    3. Diarra B,
    4. et al
    . A multi-institutional approach to data-driven decision-making: National Evaluation Platform in Mali. J Glob Health. 2019;9(1):010315. doi:10.7189/jogh.09.010315. pmid:31285820
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Sawadogo-Lewis T,
    2. Vignola E,
    3. Aung T,
    4. Heidkamp R
    . Developing data use capacity in the maternal, newborn, child health and nutrition sector in Malawi, Mali, Mozambique and Tanzania: an evolving strategy. J Glob Health. 2019;9(1):010309. doi:10.7189/jogh.09.010309. pmid:31217951
    OpenUrlCrossRefPubMed
  9. 9.
    1. Heidkamp R
    ; NEP Working Group. The National Evaluation Platform for Maternal, Newborn, and Child Health, and Nutrition: from idea to implementation. J Glob Health. 2017;7(2):020305. doi:10.7189/jogh.07.020305. pmid:29302313
    OpenUrlCrossRefPubMed
  10. 10.
    1. Keita Y,
    2. Sangho H,
    3. Roberton T,
    4. Vignola E,
    5. Traoré M,
    6. Munos M
    . Using the Lives Saved Tool to aid country planning in meeting mortality targets: a case study from Mali. BMC Public Health. 2017;17(S4)(Suppl 4):777. doi:10.1186/s12889-017-4749-y. pmid:29302313
    OpenUrlCrossRefPubMed
  11. 11.↵
    Groupe Technique de Travail de la NEP (GTT-NEP). Rapport du cycle 1 de la NEP au Mali. GTT-NEP; 2015.
  12. 12.↵
    MEASURE Evaluation. Evaluation du Système Local d'Information Sanitaire (SLIS) avec les Outils PRISM: Rapport. MEASURE Evaluation; 2014. Accessed October 29, 2021. https://www.measureevaluation.org/resources/publications/tr-14-104-fr
  13. 13.↵
    Ministère de la Santé et de l'Hygiène Publique, Ministère du Travail et des Affaires Sociales et Humanitaires, Ministère de la Promotion de la Femme, de la Famille et de l'Enfant. Plan Decennal de Developpement Sanitaire et Social (PDDSS) 2014-2023. Ministère de la Santé et de l'Hygiène Publique, Ministère du Travail et des Affaires Sociales et Humanitaires, Ministère de la Promotion de la Femme, de la Famille et de l'Enfant; 2014. Accessed October 29, 2021. http://www.ilo.org/dyn/natlex/natlex4.detail?p_lang=en&p_isn=111110&p_country=MLI&p_classification=01.08
  14. 14.↵
    Cellule de Planification et de Statistique du Ministere de la Santè (CPS/MS) [Mali], Direction Nationale de la Statistique et de l'Informatique (DNSI) [Mali], and ORC Macro. Mali Demographic and Health Survey 2001. CPS/MS, DNSI, ORC Macro; 2002. Accessed October 29, 2021. https://dhsprogram.com/methodology/survey/survey-display-159.cfm
  15. 15.↵
    Cellule de Planification et de Statistique du Ministere de la Santè (CPS/MS) [Mali], Direction Nationale de la Statistique et de l'Informatique du Ministere de l'Economie, de l'Industrie et du Commerce (DNSI/MEIC) [Mali], and Macro International Inc. Mali Demographic and Health Survey 2006. CPS/MS, DNSI, Macro International; 2007. Accessed October 29, 2021. https://dhsprogram.com/methodology/survey/survey-display-276.cfm
  16. 16.↵
    Cellule de Planification et de Statistiques (CPS/SSDSPF), Institut National de la Statistique (INSTAT/MPATP), and INFO-STAT. Enquête Démographique et de Santé du Mali 2012-2013. CPS/SSDSPF, INSTAT/MPATP, INFO-STAT, ICF International; 2014. Accessed October 29, 2021. https://dhsprogram.com/publications/publication-fr286-dhs-final-reports.cfm
  17. 17.↵
    Direction Nationale de la Statistique et de l'Informatique (DNSI), Ministère de l'Economie, du Plan et de l'Intégration. Recensement Général de la Population et de l'Habitat 2009. DNSI; 2009. Accessed October 29, 2021. https://catalog.ihsn.org/catalog/4569/study-description#metadata-disclaimer_copyright
  18. 18.↵
    1. Maina I,
    2. Wanjala P,
    3. Soti D,
    4. Kipruto H,
    5. Droti B,
    6. Boerma T
    . Using health-facility data to assess subnational coverage of maternal and child health indicators, Kenya. Bull World Health Organ. 2017;95(10):683–694. doi:10.2471/BLT.17.194399. pmid:29147041
    OpenUrlCrossRefPubMed
  19. 19.↵
    1. Bhattacharya AA,
    2. Umar N,
    3. Audu A,
    4. et al
    . Quality of routine facility data for monitoring priority maternal and newborn indicators in DHIS2: a case study from Gombe State, Nigeria. PLoS One. 2019;14(1):e0211265. doi:10.1371/journal.pone.0211265. pmid:30682130
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Lim SS,
    2. Stein DB,
    3. Charrow A,
    4. Murray CJL
    . Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analysis of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008;372(9655):2031–2046. doi:10.1016/S0140-6736(08)61869-3. pmid:19070738
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Brown DW,
    2. Burton AH,
    3. Dobo MG,
    4. Mihigo R
    . Proportionate target population estimates used by national immunization programmes in sub-Saharan Africa and comparison with values from an external source. World J Vaccines. 2014;04(03):147–156. doi:10.4236/wjv.2014.43017
    OpenUrlCrossRef
  22. 22.↵
    1. Cutts FT,
    2. Claquin P,
    3. Danovaro-Holliday MC,
    4. Rhoda DA
    . Monitoring vaccination coverage: defining the role of surveys. Vaccine. 2016;34(35):4103–4109. doi:10.1016/j.vaccine.2016.06.053. pmid:27349841
    OpenUrlCrossRefPubMed
  23. 23.↵
    DHIS 2. Accessed October 25, 2021. https://www.dhis2.org/
  24. 24.↵
    1. Hazel E,
    2. Wilson E,
    3. Anifalaje A,
    4. Sawadogo-Lewis T,
    5. Heidkamp R
    . Building integrated data systems for health and nutrition program evaluations: lessons learned from a multi-country implementation of a DHIS 2-based system. J Glob Health. 2018;8(2):020307. doi:10.7189/jogh.08.020307. pmid:30356499
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Braa J,
    2. Heywood A,
    3. Sahay S
    . Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012;90(5):379–384. doi:10.2471/BLT.11.099580. pmid:22589572
    OpenUrlCrossRefPubMed
  26. 26.↵
    1. Gimbel S,
    2. Micek M,
    3. Lambdin B,
    4. et al
    . An assessment of routine primary care health information system data quality in Sofala Province, Mozambique. Popul Health Metr. 2011;9(1):12. doi:10.1186/1478-7954-9-12. pmid:21569533
    OpenUrlCrossRefPubMed
  27. 27.↵
    1. Lippeveld T
    . Routine health facility and community information systems: creating an information use culture. Glob Health Sci Pract. 2017;5(3):338–340. doi:10.9745/GHSP-D-17-00319. pmid:28963169
    OpenUrlFREE Full Text
  28. 28.↵
    Integrated Family Health Program (IFHP). Integrated Family Health Program (IFHP) 2008-2016: Selected Stories From the Field. IFHP; 2016. doi:10.13140/RG.2.2.29304.96003
    OpenUrlCrossRef
  29. 29.↵
    1. Eisele TP,
    2. Rhoda DA,
    3. Cutts FT,
    4. et al
    . Measuring coverage in MNCH: total survey error and the interpretation of intervention coverage estimates from household surveys. PLoS Med. 2013;10(5):e1001386. doi:10.1371/journal.pmed.1001386. pmid:23667331
    OpenUrlCrossRefPubMed
  30. 30.↵
    1. Munos MK,
    2. Stanton CK,
    3. Bryce J
    . Improving coverage measurement for reproductive, maternal, neonatal and child health: gaps and opportunities. J Glob Health. 2017;7(1):010801. doi:10.7189/jogh.07.010801. pmid:28607675
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

Global Health: Science and Practice: 9 (4)
Global Health: Science and Practice
Vol. 9, No. 4
December 31, 2021
  • Table of Contents
  • About the Cover
  • Index by Author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about Global Health: Science and Practice.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Can We Use Routine Data for Strategic Decision Making? A Time Trend Comparison Between Survey and Routine Data in Mali
(Your Name) has forwarded a page to you from Global Health: Science and Practice
(Your Name) thought you would like to see this page from the Global Health: Science and Practice web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Can We Use Routine Data for Strategic Decision Making? A Time Trend Comparison Between Survey and Routine Data in Mali
Talata Sawadogo-Lewis, Youssouf Keita, Emily Wilson, Souleymane Sawadogo, Ibrahim Téréra, Hamadoun Sangho, Melinda Munos
Global Health: Science and Practice Dec 2021, 9 (4) 869-880; DOI: 10.9745/GHSP-D-21-00281

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Can We Use Routine Data for Strategic Decision Making? A Time Trend Comparison Between Survey and Routine Data in Mali
Talata Sawadogo-Lewis, Youssouf Keita, Emily Wilson, Souleymane Sawadogo, Ibrahim Téréra, Hamadoun Sangho, Melinda Munos
Global Health: Science and Practice Dec 2021, 9 (4) 869-880; DOI: 10.9745/GHSP-D-21-00281
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Statistics from Altmetric.com

Jump to section

  • Article
    • ABSTRACT
    • BACKGROUND
    • METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSION
    • Acknowledgments
    • Funding
    • Author contributions
    • Competing interests
    • Footnotes
    • Translation
    • REFERENCES
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Quality of routine data for monitoring nutrition and diarrhoea indicators of children under 5 in Mozambique: an ecological study over a 5-year period
  • Google Scholar

More in this TOC Section

  • People that Deliver Theory of Change for Building Human Resources for Supply Chain Management: Applications in sub-Saharan Africa and Southeast Asia
  • Exploring the Role of Gender in the Public Health Supply Chain Workforce in Low- and Middle-Income Countries
  • Applying a Theory of Change for Human Resources Development in Public Health Supply Chains in Rwanda
Show more ORIGINAL ARTICLE

Similar Articles

Subjects

  • Cross-Cutting Topics
    • Health Systems
Johns Hopkins Center for Communication Programs

Follow Us On

  • LinkedIn
  • Facebook
  • RSS

Articles

  • Current Issue
  • Advance Access Articles
  • Past Issues
  • Topic Collections
  • Most Read Articles
  • Supplements

More Information

  • Submit a Paper
  • Instructions for Authors
  • Instructions for Reviewers

About

  • About GHSP
  • Advisory Board
  • FAQs
  • Privacy Policy
  • Contact Us

© 2025 Creative Commons Attribution 4.0 International License. ISSN: 2169-575X

Powered by HighWire