Skip to main content

Main menu

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
      • Local Voices Webinar
      • Connecting Creators and Users of Knowledge
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers

User menu

  • My Alerts

Search

  • Advanced search
Global Health: Science and Practice
  • My Alerts

Global Health: Science and Practice

Dedicated to what works in global health programs

Advanced Search

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers
  • Alerts
  • Find GHSP on LinkedIn
  • Visit GHSP on Facebook
  • RSS
FIELD ACTION REPORT
Open Access

Lessons Learned From the Capacity-Building and Mentorship Program to Improve Health Information Systems in 11 Districts of Ethiopia

Hiwot Belay, Afrah Mohammedsanni, Abebaw Gebeyehu, Hibret Alemu, Naod Wendrad, Biruk Abate, Wubshet Denboba, Frehiwot Mulugeta, Shemsedin Omer and Barbara Knittel
Global Health: Science and Practice September 2022, 10(Supplement 1):e2100690; https://doi.org/10.9745/GHSP-D-21-00690
Hiwot Belay
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: hiwot_belay@jsi.com
Afrah Mohammedsanni
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Abebaw Gebeyehu
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hibret Alemu
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Naod Wendrad
bEthiopia Ministry of Health, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Biruk Abate
bEthiopia Ministry of Health, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wubshet Denboba
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Frehiwot Mulugeta
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Shemsedin Omer
aJohn Snow, Inc., Ethiopia Data Use Partnership, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Barbara Knittel
cJohn Snow, Inc., Arlington, VA, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
PreviousNext
  • Article
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF
Loading

Key Findings

  • As part of a collaborative capacity-building and mentorship program between 6 universities and the Ministry of Health, health facilities observed an improvement in the quality and use of health information system data across several tracer indicators.

  • Establishing performance monitoring team meetings encouraged a data use culture for reviewing performance, identifying and solving problems, planning, and setting targets.

  • Engaging a diverse group of experts from academia, regional health bureaus, and district health offices to build health worker capacity through training and mentorship was beneficial for improving the quality and use of health data.

Key Implication

  • An academic-government collaborative capacity building and mentorship program is a promising approach to improving health information systems performance at the point of health care delivery. Building local ownership of the program, creating local mentors within the existing health system structure, and strengthening HIS expertise at universities are all essential for sustaining and expanding this model to other districts.

ABSTRACT

Introduction:

Health information systems (HIS) performance in Ethiopia is currently insufficient, and improvements are required to ensure that decision making is data driven. We share our experiences from the early-stage implementation of a package of HIS capacity-strengthening interventions as part of an innovative academic-government collaboration that addresses challenges in HIS performance.

Methods:

We used routine program data to assess HIS performance using the Performance of Routine Information System Management (PRISM) assessment tools. The assessment employed a pre-post design and was conducted in a total of 24 selected health facilities (6 hospitals and 18 health centers) from 11 districts in Ethiopia at project baseline (2018) and midline (2020).

Results:

Source document completeness rate reached less than 80% for the majority of the assessed data elements. Improvements were observed in quarterly report completeness (26% vs. 83%) and timeliness (17% vs. 48%). Though data inaccuracies are noted for all assessed data elements in 2020, the majority (83%) of skilled birth attendance and HIV reports (68%) fall within the acceptable range of reporting accuracy. The identification of performance-related problems, using performance monitoring team (PMT) meetings, improved between 2018 and 2020 (67% vs 89%). Similar improvements were also observed in developing action plans to solve identified problems via the PMT (52% in 2018 vs. 89% in 2020). Data use for planning and target setting (65% in 2018 vs. 90% in 2020), reviewing performance (58% in 2018 vs. 60% in 2020), and supervision (51% in 2018 vs. 53% in 2020) all improved among assessed health facilities.

Discussion:

This study showed that a capacity-building and mentorship program that engages experts from multiple disciplines and sectors can improve the quality and use of health data. This partnership enabled engagement between government and academic stakeholders and allowed for a more robust exchange of resources and expertise toward HIS improvement.

INTRODUCTION

Global priority agendas have identified strengthening health systems as a way to achieve universal health coverage.1 Strong health systems rely on the generation and use of relevant, timely, and accurate health data at all levels.2 Health sector leaders need quality data to maximize the efficient use of scarce resources to improve performance and track progress towards goals.2 Inadequate data quality limits the confidence and value that decision makers place on data and diminishes future demand for data in decision-making processes.3,4 Many health systems fail to fully link evidence to decisions and suffer from an inadequate ability to respond to priority health needs.2,5,6 The systematic use of data for decision making is critical, as it contributes to the quality and equity of health care delivery and maximizes operational efficiencies.3

Over the past 20 years, tremendous efforts have been made to strengthen health information systems (HIS) in low- and middle-income countries (LMICs).4 Since 2008, the Ethiopian Ministry of Health (MOH) has undertaken a series of HIS reforms aimed to standardize and improve health data monitoring in the public health sector.

Recognizing the potential of routine health information to guide improvements in quality health care delivery, in 2016, the Government of Ethiopia launched the Information Revolution (IR) Roadmap as a core strategy of the Health Sector Transformation Plan (HSTP).7,8 The IR focuses on cultivating an information culture by digitizing and scaling up priority HIS interventions and strengthening HIS governance. Under the IR, the MOH has worked to standardize and digitize indicators, data collection, and transmission tools, as well as processes that facilitate data generation, handling, and use at the point of care and in management settings.7–9 As a result, the country has made important strides toward establishing an effective, simplified, and harmonized HIS.

To further translate this IR into action, in 2016, the MOH introduced the Connected Woreda Strategy (CWS).10 This strategy aims to transform the data use culture and improve data quality through a tiered pathway, directing data use interventions toward primary health facilities and districts (known as “woreda” in Ethiopia).10 A seminal activity under the CWS is the Capacity Building and Mentorship Program (CBMP), an academic-government partnership that began implementation in 2017. Under the CBMP, local universities provide regional health bureaus (RHBs) and zonal health departments (ZHDs) with opportunities to build their data quality and use capacities, following up with technical assistance. The universities also support the RHBs in implementing a package of capacity-building interventions at the health facility and district levels to improve HIS performance and advance health facilities and districts toward “model” status (Box).

BOX

The Connected Woreda Strategy

The Connected Woreda is a strategy that provides a tiered pathway to achieve the highest levels of data quality and use at health facility and district levels. The strategy begins by evaluating and scoring facilities against a common set of criteria related to HIS structure and resources (30%), data quality (30%), and data use (40%). Facilities that score less than 65% are categorized as “emerging,” those between 65% and 90% are categorized as “candidate,” and those above 90% are accredited as a “model facility.” The grading process is followed by the development and implementation of action plans tailored to address identified barriers to data quality and use.

Under the CBMP, local universities provide RHBs and ZHDs with opportunities to build their data quality and use capacities, following up with technical assistance.

To support the MOH in addressing HIS challenges at a national scale, since 2016, the Ethiopia Data Use Partnership (DUP)—a consortium of technical partners committed to improving the collection and use of high-quality routine information in the health sector—has partnered with the MOH to advance the IR’s data use goals. The DUP supports HIS digitization, improves governance, enhances implementation research and knowledge management, and addresses other aspects of engendering a culture of health systems data use. DUP supports this work while stressing country leadership, ownership, and strong coordination among stakeholders from multiple disciplines and sectors. In partnership with 6 local universities, DUP is also supporting the implementation of the CBMP across Ethiopia.

We provide experiences and lessons learned from the initial implementation of the CBMP at the health facility and district levels in Ethiopia to inform program improvements, optimize implementation of the IR agenda, and maximize its impact.

CBMP INTERVENTION DESCRIPTION

The CBMP is currently being implemented in 187 public primary health centers and hospitals in 36 districts and 3 subcities located across all regions in Ethiopia. Under the CBMP, 6 universities (Addis Ababa University, Haramaya University, Hawassa University, Jimma University, Mekelle University, and the University of Gondar) are supporting RHBs as they roll out a package of capacity-building interventions at district and facility levels. The package includes supportive supervision; on-site coaching and mentorship; training in data quality, analysis, visualization, and use; cross-site experience sharing; quality improvement initiatives, such as using performance monitoring teams (PMTs); and other activities designed to develop the skills and knowledge base of health workers and managers in data quality and information use. Interventions were adapted and tailored to each site based on ongoing monitoring via a routine (quarterly) needs assessment.

The partnership with local universities also serves to progress organizational capacity building by linking academia to program implementation. University collaborators engaged in evidence generation and publication on themes related to the CWS implementation and, to date, have provided 81 Master’s and 8 PhD students the opportunity to conduct their theses on these topics. Moreover, the universities also conduct research within these sites to explore effective ways of implementing HIS interventions and improving HIS performance.

Learning and Demonstration Sites

A subset of 74 CBMP program sites were selected by DUP partners and RHB collaborators to become “learning and demonstration sites.” These sites received additional resources and more intensive capacity-building support to develop and implement site-specific HIS strengthening plans. They also received more frequent and structured mentorship visits (i.e., every 2 months) and on-site needs-based trainings focused on improving HIS capacity and competency among staff. As an initial step of a long-term strategy to diffuse learnings to other districts and health facilities across the regions, these sites served as incubation and testing locations for data use interventions.

METHODS

Study Design

This study assesses the effect of the more intensive CBMP HIS intervention package implemented in the learning and demonstration sites on HIS performance at the primary facility level. We measured HIS performance at 24 learning and demonstration sites in 2018, then compared these indicators against the same measures at the same sites in 2020. The 24 sites (6 hospitals and 18 health centers) were randomly selected from the 74 CBMP learning and demonstration sites. The selected sites represent 1 district within each of the 11 regions in Ethiopia.

The Performance of Routine Information System Management (PRISM) tools11 were used to measure the effect of the CBMP intervention package on HIS performance in selected study sites. Specifically, the following PRISM assessment tools were adapted to the local context and used for this study: District Routine Health Information System (RHIS) Performance Diagnostic Tool; Facility Level RHIS Performance Diagnostic Tool; Management Assessment Tool; and Facility/Office Checklist. The PRISM tools provide a structured way to assess RHIS data quality and information use in health facilities and support the identification of strengths and weaknesses in these areas that can inform intervention refinements.12

The data collection team received an intensive 5-day training, guided by a structured training manual, led by experts who were familiar with the Ethiopian health system and PRISM tools. Data were collected using tablets loaded with SurveyCTO, an Android-based mobile data collection platform, by data collectors who had experience in similar activities and were familiar with the Ethiopian health system. Internal data quality validation rules were programmed in SurveyCTO to minimize data collection errors. The data were uploaded in real time and managed on a cloud server. Regular data checks were administered throughout data collection to ensure quality.

Data Analysis

In line with the World Health Organization’s (WHO) data quality assessment guideline, 7 tracer indicators were selected by the MOH to assess HIS data quality over a 3-month period in 2018 and 2020: (1) number of births attended by skilled birth attendant, (2) number of new and repeat contraceptive acceptors, (3) children younger than age 1 year who have received a third dose of the pentavalent vaccine (penta 3), (4) number of clients who tested positive for HIV, (5) number of children younger than age 5 years with pneumonia who received treatment (U5 pneumonia), (6) number of confirmed malaria cases using microscopy or rapid diagnostic testing, and (7) number of all forms of TB cases (Table 1).11,13 The PRISM tools measure HIS data quality in 3 dimensions: (1) data completeness, (2) reporting timeliness, and (3) data accuracy.

View this table:
  • View inline
  • View popup
TABLE 1.

Facility-Level Tracer Indicators Selected by the Ministry of Health to Assess HIS Data Quality, Ethiopia

  1. Data completeness

    • Source document completeness (facility level): Number of facilities that completed primary source documents (e.g., registers and tally sheets).

    • Reporting completeness (district level): Number of expected reports compared to the number of reports actually submitted to the district health office.

  2. Reporting timeliness (district level): Number of facility reports received by the district health office by the predetermined deadline.

Data accuracy: Numerical consistency between the data recorded in facility source documents and the data aggregated in monthly reports submitted to the district health office. Report accuracy was assessed among facilities providing services associated with the 7 tracer indicators (Table 1) reviewed in this study. In this article, we used the MOH and WHO’s “acceptability tolerance range” for discrepancies in data accuracy (i.e., within ±10%).11,13

The PRISM tools were also used to assess HIS performance related to information use by measuring the use of data for planning and target setting; performance review and evidence-based decision-making; production of analytic reports; and data dissemination. The PRISM tools were also applied to assess the status of HIS data management and processing related to data quality assurance practices, data analysis and visualization, supervision, and feedback mechanisms.

Data were cleaned and analyzed using Stata version 14.0 and are presented as descriptive statistics based on MEASURE Evaluation’s PRISM analysis guideline.14

Ethics Approval

Ethical approval was sought from and granted by the Ethiopian Public Health Association EPHA/OG/203/20.

RESULTS

HIS Data Quality

Source Document Completeness

The overall source document completeness rate (i.e., facilities with complete source documents for all 3 assessed months) increased from 67.9% to 75.3% between 2018 and 2020. The proportion of health facilities with complete source documents increased from 2018 to 2020 across most tracer indicators: penta 3 (73% to 81%), contraceptive acceptors (67% to 87%), U5 pneumonia (58% to 83%), and TB (79% to 83%) (Table 2).

View this table:
  • View inline
  • View popup
TABLE 2.

Changes in Facility-Level Completeness of Data Elements in Source Documents Between 2018 and 2020, by Tracer Indicator, Ethiopia

By 2020, HIS data quality improved in source document completeness, reporting completeness and timeliness, and reporting accuracy.

Reporting Completeness and Timeliness

Reporting completeness and timeliness for each report type that facilities were expected to submit (i.e., service reports, outpatient department visits, and quarterly reports) improved between 2018 and 2020 across all assessed report types (Figure). Improvements in completeness and timeliness were most notable for quarterly reports, which improved from 26% to 83% and 17% to 48%, respectively.

FIGURE
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE

Changes in Reporting Completeness and Timeliness of Health Facilities Between 2018 and 2020, by Report Type, Ethiopia

Abbreviation: OPD, outpatient department.

Reporting Accuracy

During the 2-year study period, the percentage of health facilities that fell within the acceptable data accuracy tolerance improved (Table 3) for nearly all trace indicators. Positive changes in data accuracy were most notable for contraceptive acceptors (48% to 63%), clients who tested positive for HIV (68% to 83%), and confirmed malaria cases (55% to 73%).

View this table:
  • View inline
  • View popup
TABLE 3.

Changes in Reporting Data Accuracya for Health Facilities From 2018 to 2020, by Tracer Indicator, Ethiopia

PMT Functionality

All health facilities assessed in this study had PMTs established in 2018 (Table 4). However, only two-thirds of the facilities reported conducting regular PMT meetings (e.g., 1 or more meetings per month), which stayed relatively consistent between 2018 and 2020. The results show improvements from 2018 to 2020 in routine data use for identifying performance-related issues (67% to 89%), conducting performance root cause analyses (62% to 72%), and developing action plans to solve the identified issues (52% to 89%).

View this table:
  • View inline
  • View popup
TABLE 4.

Changes in PMT Functionality in Health Facilities Between 2018 and 2020, Ethiopia

Use of Information at the Health Facility Level

Similarly, improvements at health facilities were observed in using routine data for planning, target setting, quality improvement, and service delivery performance review (Table 5). The practice of using data for planning and target setting increased among most health facilities (65% in 2018 vs. 90% in 2020), while a slight change was observed in health facilities using data for analytical report production (33.3% in 2018 to 37.5% in 2020) and for supervision (51% in 2018 vs. 53% in 2020).

View this table:
  • View inline
  • View popup
TABLE 5.

Changes in Information Use and Dissemination Status in Health Facilities Between 2018 and 2020, Ethiopia

Data Management and Processing

As Table 6 indicates, there were only slight improvements in data management and processing between 2018 and 2020. The most notable increase was in the use of data visualization (75% to 87.5%), while the use of data quality assurance mechanisms showed a slight reduction.

View this table:
  • View inline
  • View popup
TABLE 6.

Changes in Composite Indicators for Data Management and Processing in Health Facilities Between 2018 and 2020, Ethiopia

LESSONS LEARNED

The CBMP partnership has created opportunities for actors from disciplines previously excluded from HIS development to contribute to ongoing improvement efforts at district and facility levels. This program promotes HIS strengthening through implementing regular gap assessments and need-based training paired with mentorship and supportive supervision visits, regular review meetings, and experience-sharing and best practice dissemination. This program also focuses on applying implementation research to learn from and improve program activities. As echoed in the literature, focusing on these types of interventions leads to HIS performance improvement. Studies conducted in Ethiopia stress the importance of providing continual in-service data management training, supportive supervision, and feedback to health workers at the primary health care unit.15,16 A study conducted in sub-Saharan Africa also revealed that capacity-building activities such as training, on-site mentoring, supportive supervision, and feedback mechanisms enhance knowledge, skills, and value for data, all of which contribute to behavioral change.5

The CBMP partnership has created opportunities for actors from disciplines previously excluded from HIS development to contribute to ongoing improvement efforts at district and facility levels.

Changes in Data Quality

For consistent information use to occur, data need to be of good quality so that users are confident that the data they consume are complete, accurate, and available in a timely manner.17 Findings from this study indicate improvements in the generation and use of quality data over the 2-year intervention period. The percentage of health facilities that have a data accuracy ratio within the accepted tolerance range (±10%) improved across most tracer indicators.13 While encouraging, there is room for further improvement in data accuracy across all tracer indicators to ensure quality data are consistently available in the HIS. The inadequate data quality control practices and gaps in source document completeness that we observed have implications on health facility reporting accuracy. These findings are consistent with similar research conducted in other parts of Ethiopia, indicating poor quality assurance mechanisms in the country.15,16,18,19 Data quality assurance mechanisms succeed when they are accompanied by continual feedback, which increases the visibility of any issues and builds health workers’ capacity in addressing them.20 The results highlight the need for the CBMP to further build these necessary skills through tailored and targeted training, supervision, and mentorship activities. To address this gap, the program intends to institutionalize multiple levels of quality checks and feedback loops through the lot quality assurance sampling technique, routine data quality assessment, data quality desk review, and behavioral interventions that foster sustainable change in health facilities and districts.

The study results show improvements in primary health care facilities reporting aggregated routine service and disease data to higher-level facilities. Following the nationwide transition from a fragmented electronic health management information system (HMIS) to a unified, web-based District Health Information System 2 (DHIS2), intensive trainings were provided to health workers on HMIS indicator definition, data capturing, and reporting.9,21 The deployment of a standardized electronic data aggregation and reporting system and accompanying capacity-building activities have facilitated observed improvements in reporting completeness. Other studies have also shown that data reporting improves after an electronic, web-based HMIS platform is introduced in-country. For example, evidence from Uganda and Bangladesh showed improvement in the reporting of certain health indicators after DHIS2 implementation.22,23 The DHIS2 implementation in Uganda improved outpatient and inpatient reporting, as well as the reporting of health service coverage (e.g., penta 3, pregnant women who attended at least 4 antenatal care visits, and birth with a skilled birth attendant). As DHIS2 is further integrated throughout Ethiopia, we expect to see continued improvement in the reporting of health facilities within the CBMP areas.

Transforming to an Information Use Culture in Health Facilities

We observed both positive and negative changes in the development of a data use culture during the 2-year study period. PMT meetings are one of the data use platforms institutionalized at district health offices and primary health care unit levels in Ethiopia. Findings from this study indicate that PMTs are generally used to promote the use of routine data to track performance, identify performance-related problems, and create action plans to address issues that arise. The importance of such review forums to strengthen HIS activities has been highlighted in other studies.20,24 While our findings show that PMTs have been established in health facilities, regular monthly PMT meetings declined over the 2-year study period. The need for social distancing because of the coronavirus disease (COVID-19) pandemic, poor Internet access to conduct meetings virtually, and shifting priorities to respond to COVID-19 may have contributed to this. For those facilities that were able to conduct meetings, encouraging progress was observed in the use of data for discussing and reviewing performance, problem identification, target setting, and planning.

Encouraging progress was observed during PMT meetings in the use of data for discussing and reviewing performance, problem identification, target setting, and planning.

This study also revealed improvements in data use for planning and target setting at health facilities. After 2 years of implementing activities under the CBMP, the use of routine health information for data presentation, root cause analysis, and action planning increased at the health facility level. This change was observed in the health facilities at the time of supervision and from success stories documented by some health facilities.25,26 This indicates that progress toward a data use culture among health care administrators and providers may be unfolding over time, which could contribute to improved health service provision if it continues. Classroom training is not enough to effect change, since it is not expected that all staff will apply what they learned during the training. The practical nature of mentorship coupled with trainings generated more attention and capacity to use data for action.

A culture of supportive supervision is also necessary to promote data quality and support information use at all levels of the health system. This study acknowledges the inadequacy of HIS supportive supervision practices and use of data for supervision at the primary health care level. Supportive supervision practices must be enforced to ensure higher levels of data engagement and data quality across the health system. Strengthening existing supportive supervision (in terms of frequency, quality, and approaches) can contribute to improving health workers’ capabilities by encouraging their adherence to data quality assurance practices and use of data to address problems and service delivery issues.16,27,28

Data Management and Processing in Health Facilities

HIS data management and processes are also crucial to the production and use of quality data. The study revealed that some HIS processes, such as feedback loops and data visualization, are already in place at the health facility level. For managers to effectively apply facility data for the daily planning and management of primary health care delivery, the data must be processed into a meaningful format through analysis. However, results indicate that data analysis practices are weak at the health facility level. These findings are consistent with previous studies’ observations of the limited data analysis, interpretation, and problem-solving skills among health workers and how this, in turn, hinders information use at the point of care.17,21,28 This implies that capacity-building interventions are needed to improve the analytical skills of health workers and health facility managers. Integrating simple digital data analysis tools and dashboards as part of the CBMP intervention package, along with targeted skill development, would help address this gap.

The quarterly IR status assessment conducted by the university partners helped identify strengths and areas of improvement. Interventions were tailored based on the gaps in the assessment; behavioral interventions were also integrated, contributing to the improvements we observed. Moving forward, continual assessment and site-specific modifications are essential to further improve the effectiveness of the CBMP.

These study findings underscore the importance of maintaining regular coordination and review meetings with CBMP partners, providing focused support to facilities and district health offices, and establishing mechanisms for routine HIS improvement monitoring. Furthermore, the findings suggest that mentorship decentralization, particularly by creating and using a pool of local mentors, could increase the impact and sustainability of HIS strengthening interventions.

Limitations

Our results should be interpreted with caution because of certain study limitations. These include the pre-post design, which lacks a control group, and the small sample size, which limits its statistical power and generalizability. While we acknowledge that our sample size is relatively small and only represents 1 district per region, sharing the results is crucial to imparting lessons learned from implementation. A more rigorous statistical evaluation of the CBMP, which will not be beset by this limitation, is forthcoming.

CONCLUSION AND RECOMMENDATIONS

This study showed that a program focused on building health worker capacity via training and mentorship, which engages a diverse group of experts from academia and staff from various levels of government, can improve the quality and use of health data. The CBMP partnership brought together untapped expertise from local universities to contribute to the national HIS improvement efforts. Linkages between academic and implementing institutions played an enormous role in in-service training, evidence generation through collaborative research, and capacity building. Expanding this model to other settings requires clearly defining intervention packages, building the HIS expertise of the universities, and fostering partnerships between academia and districts to create local mentors. This experience can be adapted to other health sector programs as well.

Acknowledgments

We acknowledge the strong leadership support and active participation of the Ministry of Health (MOH), regional health bureaus, and CBMP partner universities, whose involvement was critical in conducting the PRISM baseline assessment in Ethiopia. We would like to extend our gratitude to the Policy, Plan, Monitoring & Evaluation Directorate (PPMED) staff for providing overall leadership and supervising the quality of the assessment. Our expression of gratitude is extended from senior MOH leaders to health workers in the woredas/subcities where surveys were conducted. The survey would have not been completed on time without the excellent work of the core team, consisting of staff from PPMED and Data Use Partnership (DUP) technical staff. The core team’s hard work, attention to detail, and quality assurance are demonstrated in the consistency of the data collected and reported in this assessment.

Funding

This study is made possible through the financial support of the Doris Duke Charitable Foundation under grant number 2017187. The mission of the Doris Duke Charitable Foundation is to improve the quality of people’s lives through grants supporting the performing arts, environmental conservation, medical research, and child well-being, and through preservation of the cultural and environmental legacy of Doris Duke’s properties.

Author contributions

HB, AM, BK, AG, HA, BA, WD, FM, and SO participated in the designing, assessment, and analysis; HB and AM wrote the first draft of the manuscript; and AG, HA, BK, and NW revised the manuscript. All authors contributed to the refinement of the study and approved the final manuscript.

Competing interests

None declared.

Notes

Peer Reviewed

Cite this article as: Belay H, Mohammedsanni A, Gebeyehu A, et al. Lessons learned from the Capacity-Building and Mentorship Program to improve health information systems in 11 districts of Ethiopia. Glob Health Sci Pract. 2022;10(Suppl 1): e2100690. https://doi.org/10.9745/GHSP-D-21-00690

  • Received: November 3, 2021.
  • Accepted: May 20, 2022.
  • Published: September 15, 2022.
  • © Belay et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit https://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-21-00690

REFERENCES

  1. 1.↵
    1. Kieny MP,
    2. Bekedam H,
    3. Dovlo D,
    4. et al
    . Strengthening health systems for universal health coverage and sustainable development. Bull World Health Organ. 2017;95(7):537539. pmid:28670019
    OpenUrlPubMed
  2. 2.↵
    1. Aqil A,
    2. Lippeveld T,
    3. Hozumi D
    . PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24(3):217–228. doi:10.1093/heapol/czp010. pmid:19304786
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Kruk ME,
    2. Gage AD,
    3. Arsenault C,
    4. et al
    . High-quality health systems in the Sustainable Development Goals era: time for a revolution [published correction appears in Lancet Glob Health. 2018 Sep 18;:] [published correction appears in Lancet Glob Health. 2018 Nov;6(11):e1162] [published correction appears in Lancet Glob Health. 2021 Aug;9(8):e1067]. Lancet Glob Health. 2018;6(11):e1196–e1252. doi:10.1016/S2214-109X(18)30386-3. pmid:30196093
    OpenUrlCrossRefPubMed
  4. 4.↵
    Vital Wave Consulting. Health Information Systems in Developing Countries: A Landscape Analysis. Vital Wave Consulting; 2009. Accessed June 10, 2022. https://vitalwave.com/wp-content/uploads/2015/09/Gates-Foundation-HIS-Analysis-2009.pdf
  5. 5.↵
    1. Lemma S,
    2. Janson A,
    3. Persson LÅ,
    4. Wickremasinghe D,
    5. Källestål C
    . Improving quality and use of routine health information system data in low- and middle-income countries: a scoping review. PLoS One. 2020;15(10):e0239683. doi:10.1371/journal.pone.0239683. pmid:33031406
    OpenUrlCrossRefPubMed
  6. 6.↵
    1. Nutley T,
    2. Li M
    . Conceptualizing and Measuring Data Use: A Review of Assessments and Tools. Working paper. MEASURE Evaluation; 2018. Accessed June 10, 2022. https://www.measureevaluation.org/resources/publications/wp-18-214
  7. 7.↵
    Federal Democratic Republic of Ethiopia. Ministry of Health. HSTP: Health Sector Transformation Plan. 2015/16 – 2019/20 (2008–2012 EFY). MOH; 2015. Accessed June 10, 2022. https://www.globalfinancingfacility.org/sites/gff_new/files/Ethiopia-health-system-transformation-plan.pdf
  8. 8.↵
    Federal Democratic Republic of Ethiopia. Ministry of Health (MOH). Information Revolution Roadmap 2016/17–2020/21. MOH; 2016.
  9. 9.↵
    Federal Democratic Republic of Ethiopia. Ministry of Health (MOH). Ethiopia’s Health Sector Transformation Plan (HSTP1) – (2015/16 GC or 2008 – 2012 Ethiopian Fiscal Year): Comprehensive Report Mid-Term Review. MOH; 2018.
  10. 10.↵
    Federal Democratic Republic of Ethiopia. Ministry of Health (MOH). Connected Woreda Implementation Strategy. MOH; 2016.
  11. 11.↵
    MEASURE Evaluation. Performance of Routine Information System Management (PRISM) User’s Kit: Preparing and Conducting a PRISM Assessment. MEASURE Evaluation; 2018. Accessed June 10, 2022. https://www.measureevaluation.org/resources/publications/ms-18-140.html
  12. 12.↵
    1. Hotchkiss DR,
    2. Aqil A,
    3. Lippeveld T,
    4. Mukooyo E
    . Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda. BMC Health Serv Res. 2010;10:188. doi:10.1186/1472-6963-10-188. pmid:20598151
    OpenUrlCrossRefPubMed
  13. 13.↵
    World Health Organization (WHO). Data Quality Review: A Toolkit for Facility Data Quality Assessment. Module 3. Data Verification and System Assessment. WHO; 2017. Accessed June 10, 2022. http://apps.who.int/iris/bitstream/handle/10665/259226/9789241512749-eng.pdf
  14. 14.↵
    MEASURE Evaluation. Performance of Routine Information System Management (PRISM) User's Kit: Analyzing Data from a PRISM Assessment. MEASURE Evaluation; 2019. Accessed June 10, 2022. https://www.measureevaluation.org/resources/publications/ms-18-141.html
  15. 15.↵
    1. Endriyas M,
    2. Alano A,
    3. Mekonnen E,
    4. et al
    . Understanding performance data: health management information system data accuracy in Southern Nations Nationalities and People’s Region, Ethiopia. BMC Health Serv Res. 2019;19(1):175. doi:10.1186/s12913-019-3991-7. pmid:30885204
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Kebede M,
    2. Adeba E,
    3. Chego M,
    4. Chego M
    . Evaluation of quality and use of health management information system in primary health care units of east Wollega zone, Oromia regional state, Ethiopia. BMC Med Inform Decis Mak. 2020;20(1):107. doi:10.1186/s12911-020-01148-4. pmid:32532256
    OpenUrlCrossRefPubMed
  17. 17.↵
    1. Nutley T,
    2. Reynolds HW
    . Improving the use of health data for health system strengthening. Glob Health Action. 2013;6:20001. doi:10.3402/gha.v6i0.20001. pmid:23406921
    OpenUrlCrossRefPubMed
  18. 18.↵
    1. Mesfin G,
    2. Mohamed H,
    3. Tesfaye H,
    4. Worku N,
    5. Mamo D,
    6. Fatoumata NT
    . Data quality and information use: a systematic review to improve evidence, Ethiopia. Afr Health Monit. 2012;14(2012):53–60.
    OpenUrl
  19. 19.↵
    1. Kassa MD,
    2. Grace JM
    . A mixed-method study of quality, availability and timeliness of non-communicable disease (NCD) related data and its link to NCD prevention: perceptions of health care workers in Ethiopia. Health Inf Manag. 2019;48(3):135–143. doi:10.1177/1833358318786313. pmid:30126291
    OpenUrlCrossRefPubMed
  20. 20.↵
    PATH. Immunization Data: Evidence for Action. A Realist Review of What Works to Improve Data Use for Immunization: Evidence From Low-and Middle-Income Countries. PATH/PAHO; 2019. Accessed June 10, 2022. https://media.path.org/documents/PATH_IDEA_Precis_R1.pdf
  21. 21.↵
    1. Busza J,
    2. Lemma S,
    3. Janson A,
    4. et al
    . Strengthening routine health data analysis in Ethiopia: the Operational Research and Coaching for Analysts (ORCA) experience. Glob Health Action. 2021;14(1):1901390. doi:10.1080/16549716.2021.1901390. pmid:33789545
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Kiberu VM,
    2. Matovu JK,
    3. Makumbi F,
    4. Kyozira C,
    5. Mukooyo E,
    6. Wanyenze RK
    . Strengthening district-based health reporting through the district health management information software system: the Ugandan experience. BMC Med Inform Decis Mak. 2014;14:40. doi:10.1186/1472-6947-14-40. pmid:24886567
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Begum T,
    2. Khan SM,
    3. Ferdous J,
    4. et al
    . Using DHIS 2 Software to Collect Health Data in Bangladesh. Working paper. MEASURE Evaluation; 2019. Accessed June 10, 2022. https://www.measureevaluation.org/resources/publications/wp-19-226.html
  24. 24.↵
    1. Abera WS,
    2. Halallo BA,
    3. Beshir IA,
    4. Desta BF,
    5. Argaw MD
    . A strategy that improves the culture of information use at primary health care units in Ethiopia. Research Square. Preprint posted online January 21, 2021. doi:10.21203/rs.3.rs-151176/v1
    OpenUrlCrossRef
  25. 25.↵
    1. Ejeta B
    . The ambassadors of mothers: how information recasts a problem into a local innovative solution. JSI. June 18, 2019. Accessed June 10, 2022. https://www.jsi.com/the-ambassadors-of-mothers/
  26. 26.↵
    Data-powered decisions: how an Ethiopian health center improved antenatal care. JSI. December 30, 2019. Accessed June 10, 2022. https://www.jsi.com/data-powered-decisions-how-an-ethiopian-health-center-improved-antenatal-care/
  27. 27.↵
    1. Mekonnen BD,
    2. Gebeyehu SB
    . Routine health information utilization and associated factors among health care workers in Ethiopia: a systematic review and meta-analysis. PLoS One. 2021;16(7):e0254230. doi:10.1371/journal.pone.0254230. pmid:34234370
    OpenUrlCrossRefPubMed
  28. 28.↵
    1. Tulu G,
    2. Demie TG,
    3. Tessema TT
    . Barriers and associated factors to the use of routine health information for decision-making among managers working at public hospitals in North Shewa Zone of Oromia Regional State, Ethiopia: a mixed-method study. J Healthc Leadersh. 2021;13:157–167. doi:10.2147/JHL.S314833. pmid:34285623
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

Global Health: Science and Practice: 10 (Supplement 1)
Global Health: Science and Practice
Vol. 10, No. Supplement 1
September 15, 2022
  • Table of Contents
  • About the Cover
  • Index by Author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about Global Health: Science and Practice.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Lessons Learned From the Capacity-Building and Mentorship Program to Improve Health Information Systems in 11 Districts of Ethiopia
(Your Name) has forwarded a page to you from Global Health: Science and Practice
(Your Name) thought you would like to see this page from the Global Health: Science and Practice web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Lessons Learned From the Capacity-Building and Mentorship Program to Improve Health Information Systems in 11 Districts of Ethiopia
Hiwot Belay, Afrah Mohammedsanni, Abebaw Gebeyehu, Hibret Alemu, Naod Wendrad, Biruk Abate, Wubshet Denboba, Frehiwot Mulugeta, Shemsedin Omer, Barbara Knittel
Global Health: Science and Practice Sep 2022, 10 (Supplement 1) e2100690; DOI: 10.9745/GHSP-D-21-00690

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Lessons Learned From the Capacity-Building and Mentorship Program to Improve Health Information Systems in 11 Districts of Ethiopia
Hiwot Belay, Afrah Mohammedsanni, Abebaw Gebeyehu, Hibret Alemu, Naod Wendrad, Biruk Abate, Wubshet Denboba, Frehiwot Mulugeta, Shemsedin Omer, Barbara Knittel
Global Health: Science and Practice Sep 2022, 10 (Supplement 1) e2100690; DOI: 10.9745/GHSP-D-21-00690
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Statistics from Altmetric.com

Jump to section

  • Article
    • ABSTRACT
    • INTRODUCTION
    • CBMP INTERVENTION DESCRIPTION
    • METHODS
    • RESULTS
    • LESSONS LEARNED
    • CONCLUSION AND RECOMMENDATIONS
    • Acknowledgments
    • Funding
    • Author contributions
    • Competing interests
    • Notes
    • REFERENCES
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Early Effects of Information Revolution Interventions on Health Information System Performance in Ethiopia
  • Learning Health Systems to Bridge the Evidence-Policy-Practice Gap in Primary Health Care: Lessons From the African Health Initiative
  • Google Scholar

More in this TOC Section

  • Early Effects of Information Revolution Interventions on Health Information System Performance in Ethiopia
  • Early Outcomes of Mental Health Screening Integrated Into Routine HIV Care in Malawi
  • Promoting Male Involvement in Family Planning: Insights From the No-Scalpel Vasectomy Program of Davao City, Philippines
Show more FIELD ACTION REPORT

Similar Articles

Johns Hopkins Center for Communication Programs

Follow Us On

  • LinkedIn
  • Facebook
  • RSS

Articles

  • Current Issue
  • Advance Access Articles
  • Past Issues
  • Topic Collections
  • Most Read Articles
  • Supplements

More Information

  • Submit a Paper
  • Instructions for Authors
  • Instructions for Reviewers

About

  • About GHSP
  • Advisory Board
  • FAQs
  • Privacy Policy
  • Contact Us

© 2025 Creative Commons Attribution 4.0 International License. ISSN: 2169-575X

Powered by HighWire