INTRODUCTION
Child survival has improved dramatically over the past 2 decades through a variety of targeted interventions.1,2 Yet, for 54 countries, achieving the Sustainable Development Goal (SDG) for mortality among children aged younger than 5 years of at least as low as 25 deaths per 1,000 live births by 2030 remains out of reach. Meanwhile, for other countries that have achieved the goal, the child health agenda has shifted from survival to areas such as early childhood development, injuries, and noncommunicable diseases.3 The divide between countries that are meeting survival targets and those left behind has prompted a reevaluation of approaches to improving child health and well-being, including monitoring and measurement efforts.3–5 The diverse programming needs of countries have produced a steady increase in the number of organizations collecting and reporting on data to monitor child health and well-being.3 Although these efforts have helped raise the visibility of child health, they have inadvertently contributed to nonstandard data collection approaches and widespread use of inconsistently defined indicators, which has made tracking the global progress of child health over time and within and across countries challenging.6
Advocacy for better understanding and use of data, as well as improving data availability and quality, has been an ongoing refrain in the maternal, newborn, child, and adolescent health space over the years.3–9 In support of improving data availability, core indicator sets have been defined for many health and well-being outcomes and impacts.4,10 These indicator sets balance the conflicting needs for comprehensive but succinct information on child health outcomes that are relevant to all countries and feasible to collect in a timely manner and at a reasonable cost.5 We take this opportunity to reinforce the call for a systematic response to measuring child health outcomes at the global level in which national governments, international organizations, and donors work together to standardize reporting on child health and well-being outcomes through global accountability mechanisms like the SDGs. Making better use of harmonized indicators to monitor child health and well-being at the global level will avoid duplicative monitoring and evaluation (M&E) exercises, improve evidence-based programming, and preserve resources that can be used to improve the quality of national data collection platforms. We describe the strengths and limitations of different data types for indicators to track progress toward global targets for child health and well-being and make recommendations for how to best use existing harmonized indicators for global monitoring.
Making better use of harmonized indicators to monitor child health and well-being at the global level will avoid duplicative M&E exercises, improve evidence-based programming, and preserve resources that can be used to improve the quality of national data collection platforms.
GLOBAL ACCOUNTABILITY MECHANISMS FOR IMPROVING CHILD HEALTH AND WELL-BEING
The SDGs and the Global Strategy for Women's, Children's and Adolescents' Health (2016–2030) have broad agendas for improving health and well-being.4,11 These include using a life course approach to monitor changes in health outcomes and reemphasizing primary health care as well as universal health coverage.11 The SDGs and their targets were set with the idea of empowering countries to report on their progress using strengthened national information systems. However, in an era where global donors demand immediate measurement results, regardless of data quality challenges, many countries struggle with collecting and analyzing data across multiple program areas. Multiple donor initiatives, often focused on specific diseases, have left some countries with fragmented health information systems and workforces overburdened due to reporting pressures. We suggest that a set of well-defined priority indicators that are feasible to measure should be used for global monitoring and for comparing progress across countries and time.
To aid global efforts to measure progress in child survival, development, and well-being consistently, the World Health Organization and UNICEF jointly convened the Child Health Accountability Tracking (CHAT) Technical Advisory Group in 2018. Children aged 1 month to 9 years have been the focus of CHAT's measurement efforts. Over its first years, CHAT mapped the child health and well-being indicators included in global accountability initiatives, prioritized a core set of standard indicators on child health and well-being, and proposed a research agenda to address identified gaps.12 The 26 recommended indicators (Tables 1 and 2) relate to the leading causes of child death, disease, disability, or injury within the age range of 1 month to 9 years and have global consensus around definitions and data collection methods.12 These indicators are not new; they have been discussed and promoted in numerous fora and are notable for being feasible (i.e., most countries have a way to capture the data) and their definitions stable so that trends can be tracked over time. We argue that these indicators can be used universally by all global and some national measurement efforts with the aim of making child health impact and outcome monitoring more rigorous and systematic over time. A standard set of harmonized indicators to monitor child health outcomes becomes a powerful tool for assessing global and country progress and for capturing when a country achieves survival goals, signaling the need to focus on other aspects of child health and well-being.
Tables 1 and 2 list the CHAT prioritized indicators with their data sources, reporting cycles, and uses at national and international levels to illustrate where data are coming from, how they are being used, and how national-level information systems are included in these measurement activities. Most low- and middle-income countries that use population-based surveys (i.e., Demographic and Health Surveys, Multiple Indicator Cluster Surveys) have data for multiple years for these indicators; alignment around this core set can improve health policy decision-making.
INDICATORS CAPTURE DIFFERENT TYPES AND LEVELS OF INFORMATION AND SHOULD BE USED ACCORDINGLY
Improving the adoption and use of child health indicators for global monitoring requires a comprehensive understanding of the global data landscape and how country-level data come together to provide global and national values for an indicator at a given point in time. Table 3 presents the data collections used for reporting on the core indicators presented in Tables 1 and 2, along with the reporting cycles, sources, population coverage, strengths, and limitations of each. Each data collection captures different kinds of information—some representative of the national population and others specific to health facilities or specific disease/condition registries. Each has its strengths and weaknesses. For example, population-based surveys provide a snapshot of the results for indicators describing certain health outcomes, which are difficult to capture in routine health information systems. However, the long lag time of their reporting cycles means that current data are reflective only of past efforts. By contrast, routine health information systems provide country-level data that are continuously available from service and individual records systems for program monitoring, providing real-time data on the performance of health programs relative to population-based surveys. However, routine health information systems are only representative of the services provided at health facilities and the individuals who have access to these services. In addition, these systems suffer from data quality challenges and do not cover the whole health system.13 Notable gaps include private sector and community providers, making the data useful mainly for improving the quality of the services reporting into the system.10
At an even higher level, country-comparable estimated values (e.g., estimates produced by the United Nations Inter-Agency Group on Child Mortality Estimation) derived from a variety of in-country data sources are a useful tool for global monitoring. They make it possible to compare outcomes and impact indicators across countries and over time. However, they are less useful locally or at a subnational level.14 Nonetheless, country-comparable estimates have become popular in the SDG era of target monitoring and are supported by global donors who use these to set their own funding agendas.7,8 Common concerns about estimated values include a lack of methodological transparency for some estimation efforts and the inclusion of input data of questionable quality or imputation methods based on assumptions that may not be valid.14 All of the data collection approaches in Table 3, taken together and used with full knowledge of their strengths and limitations, complement each other; they can be used to triangulate information on child health and well-being outcomes and monitor the impact of national and international efforts to improve primary health care and universal health coverage.
FRAGMENTED M&E SYSTEMS REMAIN DESPITE SOME PROGRESS
Historically, vertical funding initiatives often resulted in parallel monitoring systems within a country, detracting from the ability of a country to assess the results of its overall health programming.9 M&E systems remain fragmented, with many focused on single disease programs (i.e., HIV, TB, immunization, or nutrition), legacies of past donor largesse. However, similarly to the integrated management of childhood illness movement that revolutionized management of the sick child in low- and middle-income countries, there is an opportunity to create health information management systems that cover all dimensions of child health and well-being in an integrated manner.
Those disease-specific programs that have been well funded enough to invest in data for their own M&E, use approaches that could be adapted for integrated M&E of child health outcomes through efforts to make better use of national data sources; provide training to national workforce; and promote transparency about data analysis methods, reporting cycles, limitations, and key uses in national and global platforms (Box 1).9,15,16 Furthermore, some initiatives that initially addressed single diseases have already taken steps toward integrating other areas, including reproductive, maternal, newborn, child, and adolescent health, leveraging United Nations agency and donor support to improve monitoring of health outcomes in an integrated manner (Box 2).17
HIV/AIDS: Building Country Data Collections in the Service of Global Monitoring of the HIV Epidemic Annually
Every year, the Joint United Nations Programme on HIV/AIDS (UNAIDS) provides revised global, regional, and country-specific modeled estimates using the best available epidemiological and programmatic data to track the HIV epidemic, including for children and adolescents. The data come mainly from country teams who use UNAIDS-supported software to develop estimates annually. The country teams, comprising national monitoring and evaluation specialists, program officers, epidemiologists, demographers, and others from ministries of health and national AIDS organizations, are trained by UNAIDS to use the Spectrum software (developed by Avenir Health) and its AIDS Impact Model to produce and collate their estimates.
The UNAIDS Reference Group on Estimates, Modelling and Projections provides technical guidance on the development of the HIV component of the AIDS Impact Model module. Other partners support the process by providing facilitators to country workshops, contributing data and ideas, and contributing to the costs of the workshops and capacity-building in countries.16 This united response to improving data on HIV/AIDS is a model for how the partnerships involved in child health could work together to strengthen data on childhood illness.
Moving From a Single Disease Focus to Integrated Monitoring for Improved Accountability for Reproductive, Maternal, Newborn, Child, and Adolescent Health in Countries and Globally
In 2009, the African Leaders Malaria Alliance, representing a coalition of African Union heads of state, came together to fight malaria. By 2011, African Leaders Malaria Alliance recognized the need for a scorecard to help monitor progress and strengthen accountability for malaria control and elimination. The scorecard accountability tool was updated quarterly with key indicators of country performance in controlling malaria for 46 malaria-endemic countries.17 The scorecards and quarterly reports were disseminated directly to heads of state and ministries of health and finance. This proved to be a popular tool for taking action against malaria. In 2012, the tools expanded their scope to support the development of reproductive, maternal, newborn, child, and adolescent health indicators and a neglected tropical disease tracer indicator. By 2020, 29 RMNCAH scorecards have been developed. These are updated annually and integrated into existing national management and decision-making processes. Quarterly scorecards can be downloaded here: https://alma2030.org/scorecard-tools/country-scorecards.
The primary aim of the scorecards is to strengthen national health information systems and improve accountability at the country level. A secondary result is improved reporting at the global level through better quality data aggregated to the national data for reporting on global targets. A sustainable method of producing annual or biannual child health and well-being scorecards for all countries off track to meet the Sustainable Development Goal child survival targets by 2030 would support countries in monitoring their progress.
RECOMMENDATIONS FOR FUTURE GLOBAL MONITORING OF CHILD HEALTH AND WELL-BEING
Indicators, like those recommended by the CHAT (Tables 1 and 2), are often used in M&E systems based on a theory of change or logic framework. As a result of development frameworks that include targets and indicators for assessing progress—starting with the Millennium Development Goals and continuing with the SDGs—donors, governments, and international organizations have become more sophisticated and better at using indicators to report the results of their actions. M&E exercises are more integrated across diseases and conditions than in the past, making use of advances in technology and computing resources to capture information from multiple sources and for common risk factors.9
Many global initiatives could use existing data better to plan, implement, and monitor programs to improve child health and well-being. Given the opportunities to align investments and harmonize child health M&E approaches, we recommend that program managers and donor organizations make use of the dashboards and tools that are based on standard definitions and measurement approaches and created through consultative process (e.g., those generated by United Nations agencies like the World Health Organization and UNICEF and reviewed by technical advisory groups)2 to fully understand the wealth of data and associated indicators that have been validated and are currently in use for child health measurement.
Many global initiatives could use existing data better to plan, implement, and monitor programs to improve child health and well-being.
Over time, there will be a need for new and even revised indicators, particularly where measurement gaps exist and for areas of emerging concern. New indicators will be important for monitoring the Global Strategy for Women's, Children's and Adolescents' Health areas of “thrive” and “transform,” which measure child well-being, development, and how society is being transformed for the better by improvements in health and other sectors. Such indicators are multifaceted, often combining data from different sources. Effective coverage of interventions is an example of such an area that combines monitoring data from different sources to arrive at a fuller picture of how well children are able to access quality health services.18,19 Developing strong quality-of-care indicators for pediatric services while making better use of existing service coverage indicators will help us to transition from crude coverage measurement to effective coverage measurement to improve the quality and equity of service delivery.18
Although global measurement gaps are being tackled in multiple ways, national data collection and use needs further support. To improve country data collection, management, analysis, and use as the foundation of health system strengthening, we suggest the following 3 principles be applied to child health and well-being M&E frameworks going forward.
Avoid vertical child health M&E approaches because these can distort the prioritization of health issues at the country level and also make it difficult for national governments to allocate resources efficiently and effectively. Instead, promote integration of M&E systems at a country level so that there can be clear monitoring of overall progress on child health and well-being.
When developing national M&E systems to monitor and report on child health and well-being, use standard indicators that have been validated and recommended by normative agencies and are appropriate for the level of monitoring required.
Focus on building country capacity to improve child health data collection and analysis, thereby reducing reliance on estimation exercises to produce country-comparable estimates from multiple data sources. The use of estimates detracts funding and attention away from country efforts to improve M&E and data systems.
For monitoring at the outcome and impact levels, we have a validated collection of robust indicators that can be used for a variety of monitoring activities at the global and national level.4,13,20 In many cases, there is no need to develop more indicators in well-covered areas. Appropriate use of these current indicators—as signs of the need to gather more comprehensive information about a problem area and implement solutions—will go a long way toward improving child health and well-being. Quality, affordable, and equitably distributed health care will, in turn, help children develop into healthy adolescents and adults, well able to provide for the next generation.
Acknowledgments
Many thanks to Theresa Diaz for providing guidance on the original draft of the article. Elizabeth Westley supported the meetings of Child Health Accountability Tracking Technical Advisory Group during the drafting process.
Funding
The Child Health Accountability Tracking Technical Advisory Group is funded by a grant to the World Health Organization from the U.S. Agency for International Development.
Author contributions
KS and JR were co-convenors of the Child Health Accountability Tracking (CHAT) Technical Advisory Group at the time of drafting this article. SB and MM are co-chairs of the CHAT Technical Advisory Group. KS and JR: conceptualization; KS: writing–original draft; JR, SB, JS, MM, ML, AA, CP, SH, AM, RW, ZJ, MB, FA, and ES: writing–review and editing.
Competing interests
None declared.
Footnotes
↵* Co-first authors.
Notes
Peer Reviewed
First published online: December 6, 2023.
Cite this article as: Strong K, Requejo JH, Billah SM, et al. Advocacy for better integration and use of child health indicators for global monitoring. Glob Health Sci Pract. 2023;11(6):e2300181. https://doi.org/10.9745/GHSP-D-23-00181
- Received: April 26, 2023.
- Accepted: November 15, 2023.
- Published: December 22, 2023.
- © Strong et al.
This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit https://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-23-00181