Skip to main content

Main menu

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
      • The Challenge Initiative Platform
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers
  • Webinars
    • Local Voices Webinar
    • Connecting Creators and Users of Knowledge
    • Publishing About Programs in GHSP
  • Other Useful Sites
    • GH eLearning
    • GHJournal Search

User menu

  • My Alerts

Search

  • Advanced search
Global Health: Science and Practice
  • Other Useful Sites
    • GH eLearning
    • GHJournal Search
  • My Alerts

Global Health: Science and Practice

Dedicated to what works in global health programs

Advanced Search

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers
  • Webinars
    • Local Voices Webinar
    • Connecting Creators and Users of Knowledge
    • Publishing About Programs in GHSP
  • Alerts
  • Visit GHSP on Facebook
  • Follow GHSP on Twitter
  • RSS
  • Find GHSP on LinkedIn
ORIGINAL ARTICLE
Open Access

Strengthening Delivery of Health Services Using Digital Devices

Maeghan Orton, Smisha Agarwal, Pierre Muhoza, Lavanya Vasudevan and Alexander Vu
Global Health: Science and Practice October 2018, 6(Supplement 1):S61-S71; https://doi.org/10.9745/GHSP-D-18-00229
Maeghan Orton
aDepartment of Reproductive Health and Research, World Health Organization, Geneva, Switzerland.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Smisha Agarwal
bJohns Hopkins Global Digital Health Initiative, Baltimore, MD, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Pierre Muhoza
cJohns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lavanya Vasudevan
dDepartment of Community and Family Medicine, Duke University School of Medicine, Durham, NC, USA.
eCenter for Health Policy and Inequalities Research, Duke Global Health Institute, Durham, NC, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: Lavanya.vasude@gmail.com
Alexander Vu
cJohns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA.
fJohns Hopkins School of Medicine, Baltimore, MD, USA.
gSchool of Medicine, American University of Beirut, Beirut, Lebanon.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
PreviousNext
  • Article
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF
Loading

Delivery of high-quality efficient health services is a cornerstone of the global agenda to achieve universal health coverage. Digital health interventions for service delivery, such as digital health-enhanced referral coordination and mobile clinical decision support systems, demonstrate considerable potential to improve the quality and comprehensiveness of care received by patients but require greater standardization and engagement of health workers at different levels of the health system for effective scale up.

ABSTRACT

Background: Delivery of high-quality efficient health services is a cornerstone of the global agenda to achieve universal health coverage. According to the World Health Organization, health service delivery is considered good when equitable access to a comprehensive range of high-quality health services is ensured within an integrated and person-centered continuum of care. However, good health service delivery can be challenging in low-resource settings. In this review, we summarize and discuss key advances in health service delivery, particularly in the context of using digital health strategies for mitigating human resource constraints.

Methods: The review updates the foundational systematic review conducted by Agarwal et al. in 2015. We used PubMed, EMBASE, and CINAHL to find relevant English-language peer-reviewed articles published 2018. Our search strategy for MEDLINE was based on MeSH (medical subject headings) terms and text words of key articles that we identified a priori. Our search identified 92 articles. After screening, we selected 24 articles for abstract review, of which only 6 met the eligibility criteria and were ultimately included in this review.

Results: Despite encouraging advances in the evidence base on digital strategies for health service delivery, the current body of evidence is still quite limited in 3 main areas: the effectiveness of interventions on health outcomes, improvement in health system efficiencies for service delivery, and the human capacity required to implement and support digital health strategies at scale. Two particular areas, digital health-enhanced referral coordination and mobile clinical decision support systems, demonstrate considerable potential to improve the quality and comprehensiveness of care received by patients, but they require a greater level of standardization and an expanded scope of health worker engagement across the health system in order to scale them up effectively.

Conclusions: Additional research is urgently needed to inform the effectiveness of interventions on health outcomes, improvement in health system efficiencies, and cost-effectiveness of service delivery. In particular, more documentation and research on ways to standardize and engage health workers in digital referral and clinical decision support systems can provide the foundation needed to scale these promising approaches in low- and middle-income settings.

INTRODUCTION

Delivery of high-quality efficient health services is a cornerstone of the global agenda to achieve universal health coverage. According to the World Health Organization (WHO) framework of health system building blocks, health service delivery is considered to function well when equitable access to a comprehensive range of high-quality health services is ensured within an integrated and person-centered continuum of care.1 However, good health service delivery can be challenging in settings where human and health system resources are scarce. For instance, health workers in low-resource settings may be faced with inadequate access to training and reference materials, poor-quality communication systems for feedback from experts or supervisors in the diagnosis and management of complex cases, and difficulty maintaining patients within the continuum of care through follow-up visits or referrals, thereby impacting the quality of health services they can deliver.2

Similarly, accessing health services, according to individuals' needs and preferences, at the various levels of the health system may be challenging due to logistical and financial barriers. In recent years, the considerable mobile-cellular infrastructure has been leveraged to mitigate some of these challenges in health service delivery, for instance, by facilitating task shifting of health service delivery from facility-based providers to frontline health workers.3 In these task-shifting applications, mobile devices have been used to provide training content on-demand, enable communication between different cadres of health workers, implement clinical decision support systems, and provide work-planning and scheduling tools. There is growing evidence that such ‘digital health’ strategies can help improve access to and quality of health service delivery, which, in turn, can improve health outcomes for otherwise underserved populations.4 Although rural–urban differences in access to and uptake of mobile technology remain, significant progress toward increasing universal access has been made. For instance, it is estimated that global mobile–broadband subscription growth rates grew more than 20% annually in the last 5 years and are expected to reach 4.3 billion by the end of 2017.5

In this review, we summarize and discuss key advances in health service delivery, particularly in the context of using digital health strategies for mitigating human resource constraints. We focus the discussion on clinical decision tools and digital referral systems and how recent innovations within these areas have contributed to improvements in health service delivery. We also analyze and discuss gaps in the current evidence base on the effectiveness of the digital health service delivery interventions on health care use, efficiency, and outcomes. Finally, we provide recommendations for and highlight challenges in scaling up digital health service delivery strategies within health systems.

METHODS

The purpose of this literature review is not to serve as a comprehensive systematic review of all relevant published articles but rather to identify important new evidence on digital strategies for health service delivery that may advance the current body of knowledge and practice. The scope of the review was based on the framework on integrated patient-centered health services.6 This framework includes 5 potential areas of strategic focus.6 Digital health interventions, which support a model of care (strategy 3, mobile clinical decision support systems) and coordination of health services (strategy 4, digital referral systems), are discussed in this review. Other reviews in this supplement describe digital health interventions for demand generation (strategy 1) and governance (strategy 2). For this review, we included peer-reviewed studies from high-, middle-, and low-income countries, which described implementation and evaluation of digital strategies for improving health service delivery (Figure).

The scope of the literature review was based on 5 potential areas for strategic focus from the WHO framework of integrated patient-centered services.

Our review is based on the foundational systematic review done by Agarwal et al. in 2015.7 Our search strategy incorporated the key search terms from the Agarwal et al. review, which included variations and combinations of terms for mHealth (mobile, phone, cell phones, information and communication technology, cellular phone, mobile device, SMS, text message, interactive voice response) and health workers (frontline worker, health worker, community health worker, traditional birth attendants, lay worker, village health worker, midwife, health auxiliary, peer health worker, medical auxiliary, health provider, lay advisor, lay counselor, lady health worker, and lay educator).7 To this, we added variations and combinations of key search terms for service delivery (health service, service availability, service readiness, health facilities, service quality, service coverage, service coordination). We then updated the review via a literature search using the databases on PubMed, EMBASE, and CINAHL for relevant publications published between 2015 and 2018. We restricted our searches to studies published in English and developed a search strategy for MEDLINE based on MeSH (medical subject headings) terms and text words of key articles that we identified a priori.

The updated search resulted in 92 peer-reviewed articles. One of the authors screened the articles and identified 24 abstracts for final review. Two of the authors worked independently and in duplicate to review titles, abstracts, and full-text versions of the identified articles. The inter-rater agreement was 92%. The discrepancy was with 2 articles. After a face-to-face discussion, the reviewers agreed that the 2 studies should be excluded because the studies reported on feasibility and pilot study protocols that did not add to the body of evidence about health care delivery using digital health. Only 6 articles met the eligibility criteria for the review.

RESULTS AND DISCUSSION

Landscape of State of Evidence on Digital Strategies for Health Service Delivery

There are a number of published studies with rigorous study designs and reporting (i.e., randomized controlled trials, prospective cohort studies, and detailed study protocols), diversity of intervention strategies tested, and selection of appropriate evaluation indicators. Interventions described in these studies cover the spectrum of health service delivery, and include education (training in use of mobile phones for health delivery),8–15 diagnosis and management of diseases (mobile clinical decision support systems and referral coordination),16–29 communication between health care providers,30–35 and communication between provider and health care consumers (appointment reminders and test-result notification).36–40 While this is not a comprehensive review, notable landmark articles on the use of digital strategies for health service delivery are described and referenced below:

  • Several studies reported effective ways to use mobile phones to collect and report data from frontline health workers to health delivery teams, thus bypassing the need for in-person communication for data transfer. Client data were then used by the health delivery team to engage direct patient care by, for example, sending clients health messages or reminders to their mobile phones with the aim of improving health education and behavior change communication.41,42

  • Lori et al.12 conducted a study on the training of trainers to train community midwives on the use of short messaging service (SMS) messages for real-time remote data collection in rural Liberia. The study reported a significant increase in overall knowledge and skill acquisition among the 99 traditional midwives who used mobile technology for SMS-based data collection.12

  • Zurovac et al.29 conducted a cluster-randomized trial on the effects of SMS message reminders on health workers in Kenya. The results showed that health workers who received SMS message reminders had significantly improved (23.7%) adherence to malaria treatment guidelines compared to the control group who did not receive SMS message support.29

  • Kim et al.43 used SMS and web-based systems to achieve glycemic control with significantly improved glycated hemoglobin (HbA1c) in the intervention group compared to the control group in a randomized controlled clinical trial in Korea.43

  • Similarly, Goodarzi et al.44 conducted a randomized controlled clinical trial in Iran using SMS messages to educate patients with diabetes about exercise, diet, medication compliance, and self-monitoring of blood glucose. Results showed statistically significant improvement in HbA1c levels, diet, physical activity, knowledge, and self-efficacy among the intervention group compared to the control.44

  • Mitchell et al.24 showed digital decision-making tools significantly improved adherence to the Integrated Management of Childhood Illness (IMCI) protocol among health providers who used electronic decision-support tools in Tanzania. A few other studies yielded similar promising results, suggesting that mHealth can improve communication and supervision of health workers and evaluate health workers' performance.26,42,45

The results of the updated literature search revealed additional noteworthy high-quality studies with greater use of objective measures and rigorous research methodology:

  • Lim et al.46 conducted a randomized controlled clinical trial in Korea to achieve glycemic control using a clinical decision support system and physical activity monitoring device and dietary feedback among patients with type 2 diabetes. After 6 months, HbA1c levels were substantially improved, with a significantly improved decrease in caloric intake and increase in exercise among the intervention compared to the control group.46

  • Agboola et al.47 conducted a randomized controlled clinical trial and used SMS messages to coach and monitor patients with type 2 diabetes with HbA1c levels of >7 to achieve physical activity goals. There was no significant difference in change of HbA1c levels or monthly step counts in the 6-month follow-up between the intervention compared to the control group.47 Arora et al.48 and Capozza et al.49 also used SMS in randomized controlled clinical trials to educate, motivate, and achieve glycemic control, however they showed no statistical improvement in HbA1c. All of these studies were conducted in high-income countries.

  • Daher et al.50 conducted a systematic review and meta-analysis of 99 studies published from 1996 to 2017, and found that SMS interventions improved antiretroviral therapy adherence with pooled odds ratio (OR) of 2.15 (95% confidence interval [CI], 1.18 to 3.91) and clinic attendance rates with pooled OR of 1.76 (95% CI, 1.28 to 2.42). However, the authors did acknowledge that misclassification bias and recall bias were high (58% bias among randomized controlled trials and 64% among quasi-randomized trials) and raised concern regarding the quality of studies included in the meta-analysis.50

Despite these encouraging advances in the evidence base on digital strategies for health service delivery, much of the literature is still focused on descriptive data or intervention potential. A substantial number of current studies used self-reported outcomes related to health behaviors, management, or service delivery or use. Only a few studies used objective measures of health or health service delivery.7,43,44,46–49,51–53

Despite encouraging advances in the evidence base on digital strategies for health service delivery, much of the literature remains focused on the use of descriptive data or intervention potential rather than objective measures.

Mobile Clinical Decision Support Systems

As described previously, health providers from low-resource settings face multiple barriers to the delivery of high-quality efficient health services. These barriers may include: health care providers' limited access to timely and relevant health information; a shortfall of appropriately trained health care workers, especially in rural and remote areas; and the consequential transfer of responsibility for primary health care service delivery to lay health care workers who have little to no health service-related training.54 Even in settings where health care workers may have adequate training, it may be difficult for them to learn of new evidence and apply it consistently and correctly across a range of disease groups. Mobile clinical decision support systems (CDSS) have potential to mitigate these barriers. CDSS is an “electronic system” designed to aid directly in clinical decision making, in which the characteristics of individual patients are used to generate patient-specific assessments or recommendations that are then presented to clinicians for consideration.55 The concept behind CDSS is not novel. Clinical decision support tools have been used in hospital-based settings with varying levels of sophistication in high-income countries for several decades.56 However, employing CDSS on mobile devices can provide opportunities for such tools to become available in areas with limited infrastructure and outside of hospital- or clinic-based settings. As task shifting from a higher cadre of trained providers to lay health workers is increasingly supported, mobile CDSS (mCDSS) can provide novel opportunities to continually train and support these lay health workers.

Providing CDSS on mobile phones may serve a range of functions, including guiding health care providers through process algorithms using if…then rules based on evidence-based protocols, providing a checklist based on extant clinical protocols, or providing step-by-step guidance to screen clients by risk status using predetermined models. An mCDSS application may be stand-alone—to be used at a single point in time to deliver services—or may be integrated with a longitudinal health record, where any information that is entered into the system at a single point in time can be retrieved and used for making decisions during a follow-up visit. Systems that combine mCDSS with health records can facilitate long-term care and support the appropriate referral of clients at different levels of the health system. For example, an intervention developed in partnership with the Tanzanian Ministry of Health and Social Welfare provided community health workers with a mobile job aid to counsel, screen, and provide health-facility referrals to women at the community level for pregnancy, sexually transmitted infections, and family planning services. The data collected during these routine community-level service-provision visits were stored in electronic forms and sent to a central server that could be accessed by district-level health staff.57 This type of intervention improves not only the quality and comprehensiveness of services provided by lay health workers at the community level but also facilitates appropriate linkages to care and management at the facility level.

mCDSS can guide health care providers through process algorithms, provide a checklist based on extant clinical protocols, or provide step-by-step guidance to screen clients by risk status.

The evidence in support of the use of mCDSS is slowly emerging. A before–after cluster trial in Tanzania provided frontline health workers with a mobile electronic decision-support tool to assess sick children according to IMCI protocols. The study reported a significant improvement in the providers' ability to adhere to 10 critical IMCI items.24 Most studies conducted in low-income settings focus on the feasibility of such interventions and lack a high level of rigor to assess the impact of mCDSS on the quality of health services and health outcomes.7,58 However, some conclusions may be drawn from interventions conducted in high-income countries. A review conducted by Free et al.51 identified 7 trials that provided mobile support in clinical diagnosis and management to providers across 25 outcomes. Of the 25 outcomes, 19 showed benefits, of which 11 were statistically significant. The remaining 6 outcomes showed negative effects related to increased time for clinical processes or errors in data. However, none of the trials were assessed to have a low risk of bias.51

While mCDSS tools are promising, the challenge of transitioning from paper-based health records and decision-support tools to digital systems must not be underestimated. Despite efforts to make the mCDSS user-interface accessible and user friendly, the learning curve to adopt digital systems is often steep and requires ongoing training and support. To function well, such systems need to be iteratively developed, take into account user feedback, and align closely with existing clinical protocols.

The learning curve to adopt digital systems can often be steep and requires ongoing training and support.

The broader challenge of long-term adoption and scale up is how to ensure digital records are considered official records by ministries of health. As digital systems are tested, managers of health systems are often reluctant to dispose of existing paper systems. The result is that health care workers are then required to enter the same information in both paper and digital systems, adding to the responsibilities of the already overworked frontline health workers. Appropriate efforts must be undertaken to prove that digital records are as or more accurate than paper records. While mCDSS may be promising, the adoption of digital systems relies on understanding whether these systems can work in their specific context or environment, and if the systems can be effectively rolled out at scale.

Digital Referral Systems

Digital referral systems enable client health needs to be managed in a comprehensive manner using resources beyond those available at the patient's initial access to care. When referral activities are delivered effectively, patients are able to receive the full scope of care that is available from their health system, regardless of their geographic location.59,60 In practice, referral management and coordination include the following activities:

  1. Identifying the signs during a clinical encounter that a referral is needed

  2. Preparing the client for this referral

  3. Arranging logistics to transport the client to the location of referral

  4. Ensuring receipt of health services according to client need at the referral facility

  5. Managing receipt of the client at the returning facility where relevant

Digital referral systems enable client health needs to be managed in a comprehensive manner using resources beyond those available at the patient's initial access to care.

It is important to note that referral management and coordination is not an isolated process. It is embedded within the context of proper diagnosis, patient support, and post-treatment follow up.59,60 When these related processes are inadequate, they can impact the effectiveness of referral systems. In health systems that are still reliant on paper-based data collection systems, there is a limitation to the degree in which patient referrals can truly be coordinated: paper referral forms can get lost, delays in paper-based information arriving at the right level of care may occur, and low levels of literacy can create challenges in comprehension.61 Furthermore, the failure of patients to complete the full care plan in line with their initial diagnosis can often be attributed to a breakdown of referral processes.62,63 The reasons behind these breakdowns can be complex and multifactorial: referrals to clinic may not account for distance clients need to travel, clients may not be able to afford the means to travel to the clinic, clients may not be able to afford taking time off from work or have child care arrangements to be able to follow up with the clinic, and the client or caregiver may not understand the referral instructions. Enhancing referral coordination activities with digital health systems can help overcome substantial barriers to strengthening referral services.

Within the body of research included in this review is a wide array of digital health referral coordination systems that focus on health domains ranging from maternal and child care to noncommunicable diseases and dental care. The primary users of the digital referral systems in these studies included community health workers, clinical officers, nurses, and medical doctors. Several articles describe the improved effectiveness of digital referral systems over the standard of care. For instance, in Zambia, researchers reported a marked improvement in referrals for patients as a result of using coordinated digital health referral coordination systems.62 In addition, the digital referral system removed barriers to arranging referrals faced by health care providers by improving the providers' ability to communicate with others, preparing patients for care, and changing plans for referral activities quickly, if needed. Similarly, in Zanzibar, the authors noted that an increased proportion of women completed the recommended 4 antenatal care visits, leading researchers to believe that digital health interventions could contribute toward the overall improvement of maternal health.64 These findings present a strong case to assess the feasibility of scaling referral system.

Even with the implementation of digital referral systems, several challenges related to data completeness remain that limit our ability to assess the effectiveness of these systems. Standard reporting formats typically provide a limited assessment of referrals as a health performance indicator. For instance, referrals are often recorded based on their status (e.g., as complete or incomplete), without providing the details of the nature of the referral, completion of the counter referral, or outcome for the patient. The lack of detailed information prevents an accurate assessment of the quality of health service delivery to the patient. In other cases, referral data may be binary, only counting referrals made, and, occasionally, referrals completed. These types of data sets fail to provide the information required to understand the impact of digital referral systems on improving service delivery, health outcomes, and, importantly, health systems strengthening activities aimed at achieving universal health coverage.

Binary referral data fail to provide the information required to understand the impact of digital referral systems on improving service delivery, health outcomes, and health systems strengthening activities.

The limited choice of available software and lack of standardization, in terms of data collection and integration, also poses a significant challenge to scaling digital referral systems.62 The studies in this review deployed referral systems using different and noncompatible digital health software, and none of the systems collected data in the same format.62,64–68 In some cases, these divergent approaches were implemented in the same country, resulting in unnecessary duplication and limiting opportunities for integration and scale up. Additionally, the literature review revealed gaps related to how referral systems engage patients along the full continuum of care—from the point of initial contact to treatment and management. Two studies included in this review focused on community health workers as the primary referral points for patients and tracked whether patients arrived for treatment at the next level of the health system.62,68 However, they provided limited to no information about whether the health workers at the next level of care received the patient successfully or whether the treatment was provided to the patient as intended. For example, in Uganda, researchers conducted a detailed review of the number of children who were referred for treatment for malnutrition. The study's metric for success was the overall number of referrals completed during the duration of the study.62,68 These metrics, however, failed to capture a clear picture of the patient's engagement with the health system. Hence, future implementers and evaluators of digital referral systems must consider how to generate data that are beneficial for quality improvement and not limit themselves to proximal indicators in the pathway to care.

Despite the increased proliferation of mobile phones and affordability of mobile broadband technology in low- and middle-income countries, only about 30% of the global rural population currently has mobile phone access, compared to approximately 90% of the urban population,69 and this level of unique mobile-cellular subscriptions is insufficient to support universal access. These trends are particularly important to note when considering the delivery of health services through digital health programs. Ultimately, for digital health strategies to be instrumental in the achievement of universal health coverage goals, a better understanding and stronger emphasis on how they can be used to deliver large-scale, timely, and comprehensive health services to both rural and urban populations will be required.70 The Table summarizes key published articles that discuss digital referral systems and mobile clinical decision support systems.

For digital health strategies to be instrumental in the achievement of universal health coverage goals, we need to better understand how they can be used to deliver large-scale, timely, and comprehensive health services to both rural and urban populations.

Conclusions

The current body of evidence on digital strategies for health service delivery is still quite limited in 3 main areas: the effectiveness of interventions on health outcomes, the improvement of health system efficiencies for service delivery, and the level and type of human capacity required to implement and support digital health strategies at scale.7,51 Additional research is urgently needed to inform these gaps and to show the cost-effectiveness of digital health interventions to provide and support service delivery. Digital health interventions for service delivery, such as digital health-enhanced referral coordination and mCDSS, demonstrate major potential to improve the quality and comprehensiveness of care received by patients. However, these digital health interventions require a greater level of standardization to prepare for scale and an expanded scope of health worker engagement to include more levels of health service delivery. These specific enhancements, if researched and documented, can provide the foundation needed to scale effective digital referral coordination and decision support systems within low- and middle-income settings.

FIGURE
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE

Strategic Focus Areas of the Integrated Patient-Centered Health Services Framework

View this table:
  • View inline
  • View popup
TABLE.

Major Findings and Limitations of Published Studies on Digital Referral Systems and Mobile Clinical Decision Support Systems

Notes

Peer Reviewed

Competing Interests: None declared.

Funding: This work was made possible by a grant from the Aetna Foundation, with support from the World Health Organization and The Johns Hopkins University Global mHealth Initiative. In addition, Vasudevan's effort on this publication was supported in part by the National Center for Advancing Translational Sciences of the National Institutes of Health under Award Number 1KL2TR002554.

Disclaimer: The content is solely the responsibility of the authors and does not necessarily represent the official views of the World Health Organization, Duke University, The Johns Hopkins University, or The American University of Beirut.

Cite this article as: Orton M, Agarwal S, Muhoza P, Vasudevan L, Vu A. Strengthening delivery of health services using digital devices. Glob Health Sci Pract. 2018;6(suppl 1):S61-S71. https://doi.org/10.9745/GHSP-D-18-00229

  • Received: 2018 Jun 23.
  • Accepted: 2018 Aug 29.
  • Published: 2018 Oct 10.
  • © Orton et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit http://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-18-00229

REFERENCES

  1. 1.↵
    World Health Organization (WHO). Monitoring the Building Blocks of Health Systems: A Handbook of Indicators and Their Measurement Strategies. Geneva: WHO; 2010. http://www.who.int/healthinfo/systems/WHO_MBHSS_2010_full_web.pdf. Accessed September 6, 2018.
  2. 2.↵
    1. Bogan M,
    2. Mushi C,
    3. Esch J,
    4. et al
    . Improving Standards of Care with Mobile Applications in Tanzania. Paper presented at: W3C Workshop on the Role of Mobile Technologies in Fostering Social and Economic Development in Africa; April 1, 2009; Maputo, Mozambique. https://www.w3.org/2008/10/MW4D_WS/papers/dtree.pdf. Accessed September 6, 2018.
  3. 3.↵
    1. Campanella N,
    2. Morosini P,
    3. Sampaolo G,
    4. et al
    . Medical teleconsultation to general practitioners reduces the medical error vulnerability of internal medicine patients. Eur J Intern Med. 2015;26(9):675–679. pmid:26329761
    OpenUrlPubMed
  4. 4.↵
    Interactive Research and Development (IRD), Stop TB Partnership. mHealth to Improve TB Care. Karachi, Pakistan: IRD; 2012. http://www.stoptb.org/assets/documents/resources/publications/acsm/mHealth%20to%20Improve%20TB%20Care.pdf. Accessed September 6, 2018.
  5. 5.↵
    International Telecommunication Union (ITU). ICT Facts Figures 2017. Geneva: ITU; 2017. https://www.itu.int/en/ITU-D/Statistics/Documents/facts/ICTFactsFigures2017.pdf. Accessed September 6, 2018.
  6. 6.↵
    World Health Organization. Framework on integrated people-centred health services. Report by the Secretariat. 69th World Health Assembly provisional agenda item 16.1. A69/39. http://www.who.int/servicedeliverysafety/areas/people-centred-care/framework/en/. Published April 15, 2016. Accessed September 6, 2018.
  7. 7.↵
    1. Agarwal S,
    2. Perry HB,
    3. Long LA,
    4. Labrique AB
    . Evidence on feasibility and effective use of mHealth strategies by frontline health workers in developing countries: systematic review. Trop Med Int Health. 2015;20(8):1003–1014. https://onlinelibrary.wiley.com/doi/abs/10.1111/tmi.12525. pmid:25881735
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. Barrington J,
    2. Wereko-Brobby O,
    3. Ward P,
    4. Mwafongo W,
    5. Kungulwe S
    . SMS for Life: a pilot project to improve anti-malarial drug supply management in rural Tanzania using standard technology. Malar J. 2010;9:298. https://malariajournal.biomedcentral.com/articles/10.1186/1475-2875-9-298. pmid:20979633
    OpenUrlCrossRefPubMed
  9. 9.
    1. Farrell MJ,
    2. Rose L
    . Use of mobile handheld computers in clinical nursing education. J Nurs Educ. 2008;47(1):13–19. pmid:18232610
    OpenUrlCrossRefPubMed
  10. 10.
    1. Goldsworthy S,
    2. Lawrence N,
    3. Goodman W
    . The use of personal digital assistants at the point of care in an undergraduate nursing program. Comput Inform Nurs. 2006;24(3):138–143. pmid:16707943
    OpenUrlCrossRefPubMed
  11. 11.
    1. Leung GM,
    2. Johnston JM,
    3. Tin KY,
    4. et al
    . Randomised controlled trial of clinical decision support tools to improve learning of evidence based medicine in medical students. BMJ. 2003;327(7423):1090. https://www.bmj.com/content/327/7423/1090.long. pmid:14604933
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Lori JR,
    2. Munro ML,
    3. Boyd CJ,
    4. Andreatta P
    . Cell phones to collect pregnancy data from remote areas in Liberia. J Nursing Scholarsh. 2012;44(3):294–301. https://sigmapubs.onlinelibrary.wiley.com/doi/abs/10.1111/j.1547-5069.2012.01451.x. pmid:22672157
    OpenUrlPubMed
  13. 13.
    1. Mcleod TG,
    2. McNaughton DA,
    3. Hanson GJ,
    4. Cha SS
    . Educational effectiveness of a personal digital assistant-based geriatric assessment tool. Med Teach. 2009;31(5):409–414. pmid:18937094
    OpenUrlPubMed
  14. 14.
    1. Strayer SM,
    2. Pelletier SL,
    3. Martindale JR,
    4. Rais S,
    5. Powell J,
    6. Schorling JB
    . A PDA-based counseling tool for improving medical student smoking cessation counseling. Fam Med. 2010;42(5):350–357. http://www.stfm.org/fmhub/fm2010/May/Scott350.pdf. pmid:20461567
    OpenUrlPubMed
  15. 15.↵
    1. Tempelhof MW,
    2. Garman KS,
    3. Langman MK,
    4. Adams MB
    . Leveraging time and learning style, iPod vs. realtime attendance at a series of medicine residents conferences: a randomised controlled trial. Inform Prim Care. 2009;17(2):87–94. doi:10.14236/jhi.v17i2.720. pmid:19807950
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Berner ES,
    2. Houston TK,
    3. Ray MN,
    4. et al
    . Improving ambulatory prescribing safety with a handheld decision support system: a randomized controlled trial. J Am Med Inform Assoc. 2006;13(2):171–179. https://academic.oup.com/jamia/article/13/2/171/730423. pmid:16357350
    OpenUrlCrossRefPubMed
  17. 17.
    1. Blaivas M,
    2. Lyon M,
    3. Duggal S
    . Ultrasound image transmission via camera phones for overreading. Am J Emerg Med. 2005;23(4):433–438. doi:10.1016/j.ajem.2004.09.037. pmid:16032606
    OpenUrlCrossRefPubMed
  18. 18.
    1. Andersen SK,
    2. Klein GO,
    3. Schultz A,
    4. Aarts J,
    5. Mazzoleni MC
    1. Bürkle T,
    2. Beisig A,
    3. Ganslmayer M,
    4. Prokosch HU
    A randomized controlled trial to evaluate an electronic scoring tool in the ICU. In: Andersen SK, Klein GO, Schultz A, Aarts J, Mazzoleni MC, eds. Health Beyond the Horizon – Get IT There. Studies in Health Technology and Informatics Series. 2008;136:279–284. http://ebooks.iospress.nl/publication/11591. pmid:18487744
    OpenUrlPubMed
  19. 19.
    1. Chaiyachati KH,
    2. Loveday M,
    3. Lorenz S,
    4. et al
    . A pilot study of an mHealth application for healthcare workers: poor uptake despite high reported acceptability at a rural South African community-based MDR-TB treatment program. PLoS One. 2013;8(5):e64662. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0064662. pmid:23724075
    OpenUrlCrossRefPubMed
  20. 20.
    1. Cole-Ceesay R,
    2. Cherian M,
    3. Sonko A,
    4. et al
    . Strengthening the emergency healthcare system for mothers and children in The Gambia. Reprod Health. 2010;7:21. https://reproductive-health-journal.biomedcentral.com/articles/10.1186/1742-4755-7-21. pmid:20718979
    OpenUrlCrossRefPubMed
  21. 21.
    1. Coopmans VC,
    2. Biddle C
    . CRNA performance using a handheld, computerized, decision-making aid during critical events in a simulated environment: a methodologic inquiry. AANA J. 2008;76(1):29–35. pmid:18323317
    OpenUrlPubMed
  22. 22.
    1. Greenfield S
    . Medication error reduction and the use of PDA technology. J Nurs Educ. 2007;46(3):127–131. pmid:17396552
    OpenUrlPubMed
  23. 23.
    1. Jayaraman C,
    2. Kennedy P,
    3. Dutu G,
    4. Lawrenson R
    . Use of mobile phone cameras for after-hours triage in primary care. J Telemed Telecare. 2008;14(5):271–274. doi:10.1258/jtt.2008.080303. pmid:18633004
    OpenUrlCrossRefPubMed
  24. 24.↵
    1. Mitchell M,
    2. Hedt-Gauthier BL,
    3. Msellemu D,
    4. Nkaka M,
    5. Lesh N
    . Using electronic technology to improve clinical care – results from a before-after cluster trial to evaluate assessment and classification of sick children according to Integrated Management of Childhood Illness (IMCI) protocol in Tanzania. BMC Med Inform Decis Mak. 2013;13:95. doi:10.1186/1472-6947-13-95. pmid:23981292
    OpenUrlCrossRefPubMed
  25. 25.
    1. Kuhn KA,
    2. Warren JR,
    3. Leong T-Y
    1. Momtahan KL,
    2. Burns CM,
    3. Sherrard H,
    4. Mesana T,
    5. Labinaz M
    Using personal digital assistants and patient care algorithms to improve access to cardiac care best practices. In: Kuhn KA, Warren JR, Leong T-Y, eds. MEDINFO 2007. Studies in Health Technology and Informatics Series. 2007;129(Pt 1):117–121. http://ebooks.iospress.nl/publication/10946. pmid:17911690
    OpenUrlPubMed
  26. 26.↵
    1. Ngabo F,
    2. Nguimfack J,
    3. Nwaigwe F,
    4. et al
    . Designing and implementing an innovative SMS-based alert system (RapidSMS-MCH) to monitor pregnancy and reduce maternal and child deaths in Rwanda. Pan Afr Med J. 2012;13:31. http://www.panafrican-med-journal.com/content/article/13/31/full/. pmid:23330022
    OpenUrlPubMed
  27. 27.
    1. Prytherch DR,
    2. Smith GB,
    3. Schmidt P,
    4. et al
    . Calculating early warning scores—a classroom comparison of pen and paper and hand-held computer methods. Resuscitation. 2006;70(2):173–178. doi:10.1016/j.resuscitation.2005.12.002. pmid:16806641
    OpenUrlCrossRefPubMed
  28. 28.
    1. Rudkin SE,
    2. Langdorf MI,
    3. Macias D,
    4. Oman JA,
    5. Kazzi AA
    . Personal digital assistants change management more often than paper texts and foster patient confidence. Eur J Emerg Med. 2006;13(2):92–96. pmid:16525237
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. Zurovac D,
    2. Sudoi RK,
    3. Akhwale WS,
    4. et al
    . The effect of mobile phone text-message reminders on Kenyan health workers' adherence to malaria treatment guidelines: a cluster randomised trial. Lancet. 2011;378(9793):795–803. https://linkinghub.elsevier.com/retrieve/pii/S0140-6736(11)60783-6. pmid:21820166
    OpenUrlCrossRefPubMed
  30. 30.↵
    1. Chandhanayingyong C,
    2. Tangtrakulwanich B,
    3. Kiriratnikom T
    . Teleconsultation for emergency orthopaedic patients using the multimedia messaging service via mobile phones. J Telemed Telecare. 2007;13(4):193–196. doi:10.1258/135763307780908049. pmid:17565775
    OpenUrlCrossRefPubMed
  31. 31.
    1. Eze N,
    2. Lo S,
    3. Bray D,
    4. Toma AG
    . The use of camera mobile phone to assess emergency ENT radiological investigations. Clin Otolaryngol. 2005;30(3):230–233; discussion 233. doi:10.1111/j.1365-2273.2005.00982.x. pmid:16111418
    OpenUrlCrossRefPubMed
  32. 32.
    1. Westwood JD,
    2. Haluck RS,
    3. Hoffman HM,
    4. et al.
    1. Gandsas A,
    2. McIntire K,
    3. Montgomery K,
    4. Bumgardner C,
    5. Rice L
    The personal digital assistant (PDA) as a tool for telementoring endoscopic procedures. In: Westwood JD, Haluck RS, Hoffman HM, et al., eds. Medicine Meets Virtual Reality 12. Studies in Health Technology and Informatics Series. 2004;98:99–103. pmid:15544251
    OpenUrlPubMed
  33. 33.
    1. Hsieh CH,
    2. Jeng SF,
    3. Chen CY,
    4. et al
    . Teleconsultation with the mobile camera-phone in remote evaluation of replantation potential. J Trauma. 2005;58(6):1208–1212. pmid:15995472
    OpenUrlCrossRefPubMed
  34. 34.
    1. Pettis KS,
    2. Savona MR,
    3. Leibrandt PN,
    4. et al
    . Evaluation of the efficacy of hand-held computer screens for cardiologists' interpretations of 12-lead electrocardiograms. Am Heart J. 1999;138(4 Pt 1):765–770. doi:10.1016/S0002-8703(99)70194-8. pmid:10502225
    OpenUrlCrossRefPubMed
  35. 35.↵
    1. Yaghmai V,
    2. Kuppuswami S,
    3. Berlin JW,
    4. Salehi SA
    . Evaluation of personal digital assistants as an interpretation medium for computed tomography of patients with intracranial injury. Emerg Radiol. 2003;10(2):87–89. https://link.springer.com/article/10.1007%2Fs10140-003-0300-9. pmid:15290513
    OpenUrlCrossRefPubMed
  36. 36.↵
    1. Bos A,
    2. Hoogstraten J,
    3. Prahl-Andersen B
    . Failed appointments in an orthodontic clinic. Am J Orthod Dentofacial Orthop. 2005;127(3):355–357. doi:10.1016/j.ajodo.2004.11.014. pmid:15775951
    OpenUrlCrossRefPubMed
  37. 37.
    1. Chen ZW,
    2. Fang LZ,
    3. Chen LY,
    4. Dai HL
    . Comparison of an SMS text messaging and phone reminder to improve attendance at a health promotion center: a randomized controlled trial. J Zhejiang Univ Sci B. 2008;9(1):34–38. pmid:18196610
    OpenUrlCrossRefPubMed
  38. 38.
    1. Fairhurst K,
    2. Sheikh A
    . Texting appointment reminders to repeated non-attenders in primary care: randomised controlled study. Qual Saf Health Care. 2008;17(5):373–376. pmid:18842978
    OpenUrlAbstract/FREE Full Text
  39. 39.
    1. Leong KC,
    2. Chen WS,
    3. Leong KW,
    4. et al
    . The use of text messaging to improve attendance in primary care: a randomized controlled trial. Fam Pract. 2006;23(6):699–705. pmid:16916871
    OpenUrlCrossRefPubMed
  40. 40.↵
    1. Milne RG,
    2. Horne M,
    3. Torsney B
    . SMS reminders in the UK national health service: an evaluation of its impact on “no-shows” at hospital out-patient clinics. Health Care Manage Rev. 2006;31(2):130–136. pmid:16648692
    OpenUrlPubMed
  41. 41.↵
    1. Lund S,
    2. Hemed M,
    3. Nielsen BB,
    4. et al
    . Mobile phones as a health communication tool to improve skilled attendance at delivery in Zanzibar: a cluster-randomised controlled trial. BJOG. 2012;119(10):1256–1264. pmid:22805598
    OpenUrlCrossRefPubMed
  42. 42.↵
    1. Macleod B,
    2. Phillips J,
    3. Stone AE,
    4. Walji A,
    5. Awoonor-Williams JK
    . The architecture of a software system for supporting community-based primary health care with mobile technology: the Mobile Technology for Community Health (MoTeCH) Initiative in Ghana. Online J Public Health Inform. 2012;4(1):ojphi.v4i1.3910. pmid:23569631
  43. 43.↵
    1. Kim CS,
    2. Park SY,
    3. Kang JG,
    4. et al
    . Insulin dose titration system in diabetes patients using a short messaging service automatically produced by a knowledge matrix. Diabetes Technol Ther. 2010;12(8):663–669. pmid:20615108
    OpenUrlPubMed
  44. 44.↵
    1. Goodarzi M,
    2. Ebrahimzadeh I,
    3. Rabi A,
    4. Saedipoor B,
    5. Jafarabadi MA
    . Impact of distance education via mobile phone text messaging on knowledge, attitude, practice and self efficacy of patients with type 2 diabetes mellitus in Iran. J Diabetes Metab Disord. 2012;11(1):10. doi:10.1186/2251-6581-11-10. pmid:23497632
    OpenUrlCrossRefPubMed
  45. 45.↵
    1. Tomlinson M,
    2. Solomon W,
    3. Singh Y,
    4. et al
    . The use of mobile phones as a data collection tool: a report from a household survey in South Africa. BMC Med Inform Decis Mak. 2009;9:51. doi:10.1186/1472-6947-9-51. pmid:20030813
    OpenUrlCrossRefPubMed
  46. 46.↵
    1. Lim S,
    2. Kang SM,
    3. Kim KM,
    4. et al
    . Multifactorial intervention in diabetes care using real-time monitoring and tailored feedback in type 2 diabetes. Acta Diabetol. 2016;53(2):189–198. pmid:25936739
    OpenUrlPubMed
  47. 47.↵
    1. Agboola S,
    2. Jethwani K,
    3. Lopez L,
    4. Searl M,
    5. O'Keefe S,
    6. Kvedar J
    . Text to move: a randomized controlled trial of a text-messaging program to improve physical activity behaviors in patients with type 2 diabetes mellitus. J Med Internet Res. 2016;18(11):e307. pmid:27864165
    OpenUrlPubMed
  48. 48.↵
    1. Arora S,
    2. Peters AL,
    3. Burner E,
    4. Lam CN,
    5. Menchine M
    . Trial to examine text message-based mHealth in emergency department patients with diabetes (TExT-MED): a randomized controlled trial. Ann Emerg Med. 2014;63(6):745–54.e6. pmid:24225332
    OpenUrlCrossRefPubMed
  49. 49.↵
    1. Capozza K,
    2. Woolsey S,
    3. Georgsson M,
    4. et al
    . Going mobile with diabetes support: a randomized study of a text message-based personalized behavioral intervention for type 2 diabetes self-care. Diabetes Spectr. 2015;28(2):83–91. pmid:25987806
    OpenUrlAbstract/FREE Full Text
  50. 50.↵
    1. Daher J,
    2. Vijh R,
    3. Linthwaite B,
    4. et al
    . Do digital innovations for HIV and sexually transmitted infections work? Results from a systematic review (1996–2017). BMJ Open. 2017;7(11):e017604. pmid:29101138
    OpenUrlAbstract/FREE Full Text
  51. 51.↵
    1. Free C,
    2. Phillips G,
    3. Watson L,
    4. et al
    . The effectiveness of mobile-health technologies to improve health care service delivery processes: a systematic review and meta-analysis. PLoS Med. 2013;10(1):e1001363. doi:10.1371/journal.pmed.1001363. pmid:23458994
    OpenUrlCrossRefPubMed
  52. 52.
    1. Dobson R,
    2. Whittaker R,
    3. Pfaeffli Dale L,
    4. Maddison R
    . The effectiveness of text message-based self-management interventions for poorly-controlled diabetes: a systematic review. Digit Health. 2017;3:2055207617740315. doi:10.1177/2055207617740315. pmid:29942620
    OpenUrlCrossRefPubMed
  53. 53.↵
    1. Shetty AS,
    2. Chamukuttan S,
    3. Nanditha A,
    4. Raj RK,
    5. Ramachandran A
    . Reinforcement of adherence to prescription recommendations in Asian Indian diabetes patients using short message service (SMS)—a pilot study. J Assoc Physicians India. 2011;59:711–714. pmid:22616337
    OpenUrlPubMed
  54. 54.↵
    Global Health Workforce Alliance, World Health Organization (WHO). A Universal Truth: No Health Without a Workforce. Geneva: WHO; 2014. http://www.who.int/workforcealliance/knowledge/resources/GHWA-a_universal_truth_report.pdf?ua=1. Accessed September 6, 2018.
  55. 55.↵
    1. Kawamoto K,
    2. Houlihan CA,
    3. Balas EA,
    4. Lobach DF
    . Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ. 2005;330(7494):765. pmid:15767266
    OpenUrlAbstract/FREE Full Text
  56. 56.↵
    1. Divall P,
    2. Camosso-Stefinovic J,
    3. Baker R
    . The use of personal digital assistants in clinical decision making by health care professionals: a systematic review. Health Informatics J. 2013;19(1):16–28. pmid:23486823
    OpenUrlCrossRefPubMed
  57. 57.↵
    1. Agarwal S,
    2. Lasway C,
    3. L'Engle K,
    4. et al
    . Family planning counseling in your pocket: a mobile job aid for community health workers in Tanzania. Glob Health Sci Pract. 2016;4(2):300–310. pmid:27353622
    OpenUrlAbstract/FREE Full Text
  58. 58.↵
    1. Källander K,
    2. Tibenderana JK,
    3. Akpogheneta OJ,
    4. et al
    . Mobile health (mHealth) approaches and lessons for increased performance and retention of community health workers in low- and middle-income countries: a review. J Med Internet Res. 2013;15(1):e17. pmid:23353680
    OpenUrlCrossRefPubMed
  59. 59.↵
    1. Cervantes K,
    2. Salgado R,
    3. Choi M,
    4. Kalter H
    . Rapid Assessment of Referral Care Systems: A Guide for Program Managers. Arlington, VA: Basic Support for Institutionalizing Child Survival Project (BASICS II) project, John Snow, Inc.; 2003. http://www.who.int/management/facility/RapidAssessmentofReferralCareSystems.pdf. Accessed September 6, 2018.
  60. 60.↵
    World Health Organization (WHO). Referral systems – a summary of key processes to guide health services managers. Geneva: WHO; date unknown. http://www.who.int/management/Referralnotes.doc. Accessed September 8, 2018.
  61. 61.↵
    1. Bossyns P,
    2. Van Lerberghe W
    . The weakest link: competence and prestige as constraints to referral by isolated nurses in rural Niger. Hum Resour Health. 2004;2(1):1. doi:10.1186/1478-4491-2-1. pmid:15059284
    OpenUrlCrossRefPubMed
  62. 62.↵
    1. Kabakyenga J,
    2. Barigye C,
    3. Brenner J,
    4. et al
    . A demonstration of mobile phone deployment to support the treatment of acutely ill children under five in Bushenyi district, Uganda. Afr Health Sci. 2016;16(1):89–96. pmid:27358618
    OpenUrlPubMed
  63. 63.↵
    Global Health Workforce Alliance, World Health Organization (WHO). Global Experience of Community Health Workers for Delivery of Health Related Millennium Development Goals: A Systematic Review, Country Case Studies, and Recommendations for Integration into National Health Systems. Geneva: WHO; 2010. http://www.who.int/workforcealliance/knowledge/publications/CHW_FullReport_2010.pdf. Accessed September 6, 2018.
  64. 64.↵
    1. Mbuagbaw L,
    2. Thabane L,
    3. Ongolo-Zogo P,
    4. et al
    . The Cameroon Mobile Phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS One. 2012;7(12):e46909. pmid:23236345
    OpenUrlCrossRefPubMed
  65. 65.
    1. Asiimwe C,
    2. Gelvin D,
    3. Lee E,
    4. et al
    . Use of an innovative, affordable, and open-source short message service-based tool to monitor malaria in remote areas of Uganda. Am J Trop Med Hyg. 2011;85(1):26–33. pmid:21734120
    OpenUrlAbstract/FREE Full Text
  66. 66.
    1. Lund S,
    2. Nielsen BB,
    3. Hemed M,
    4. et al
    . Mobile phones improve antenatal care attendance in Zanzibar: a cluster randomized controlled trial. BMC Pregnancy Childbirth. 2014;14:29. pmid:24438517
    OpenUrlCrossRefPubMed
  67. 67.
    1. den Hollander D,
    2. Mars M
    . Smart phones make smart referrals: the use of mobile phone technology in burn care – a retrospective case series. Burns. 2017;43(1):190–194. doi:10.1016/j.burns.2016.07.015. pmid:27575675
    OpenUrlCrossRefPubMed
  68. 68.↵
    1. Daviaud E,
    2. Besada D,
    3. Leon N,
    4. et al
    . Costs of implementing integrated community case management (iCCM) in six African countries: implications for sustainability. J Glob Health. 2017;7(1):010403. pmid:28702174
  69. 69.↵
    International Telecommunication Union (ITU). ITU releases 2015 ICT figures: statistics confirm ICT revolution of the past 15 years [press release]. ITU website. http://www.itu.int/net/pressoffice/press_releases/2015/17.aspx. Published May 26, 2015. Accessed September 6, 2018.
  70. 70.↵
    1. Mehl G,
    2. Labrique A
    . Prioritizing integrated mHealth strategies for universal health coverage. Science. 2014;345(6202):1284–1287. pmid:25214614
    OpenUrlAbstract/FREE Full Text
PreviousNext
Back to top

In this issue

Global Health: Science and Practice: 6 (Supplement 1)
Global Health: Science and Practice
Vol. 6, No. Supplement 1
October 10, 2018
  • Table of Contents
  • About the Cover
  • Index by Author
  • Complete Issue (PDF)
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about Global Health: Science and Practice.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Strengthening Delivery of Health Services Using Digital Devices
(Your Name) has forwarded a page to you from Global Health: Science and Practice
(Your Name) thought you would like to see this page from the Global Health: Science and Practice web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Strengthening Delivery of Health Services Using Digital Devices
Maeghan Orton, Smisha Agarwal, Pierre Muhoza, Lavanya Vasudevan, Alexander Vu
Global Health: Science and Practice Oct 2018, 6 (Supplement 1) S61-S71; DOI: 10.9745/GHSP-D-18-00229

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Strengthening Delivery of Health Services Using Digital Devices
Maeghan Orton, Smisha Agarwal, Pierre Muhoza, Lavanya Vasudevan, Alexander Vu
Global Health: Science and Practice Oct 2018, 6 (Supplement 1) S61-S71; DOI: 10.9745/GHSP-D-18-00229
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Statistics from Altmetric.com

Jump to section

  • Article
    • ABSTRACT
    • INTRODUCTION
    • METHODS
    • RESULTS AND DISCUSSION
    • Conclusions
    • Notes
    • REFERENCES
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • Using Community Health Workers and a Smartphone Application to Improve Diabetes Control in Rural Guatemala
  • Digital Health and Health Systems of the Future
  • Google Scholar

More in this TOC Section

  • Timely Access to Essential Surgery, Surgical Workforce, and Surgical Volume: Global Surgery Indicators in Mexico
  • Applying the COM-B Model to Understand the Drivers of Mistreatment During Childbirth: A Qualitative Enquiry Among Maternity Care Staff
  • Perspectives of Muslim Religious Leaders to Shape an Educational Intervention About Family Planning in Rural Tanzania: A Qualitative Study
Show more ORIGINAL ARTICLE

Similar Articles

Subjects

  • Cross-Cutting Topics
    • Digital Health
US AIDJohns Hopkins Center for Communication ProgramsUniversity of Alberta

Follow Us On

  • Twitter
  • Facebook
  • LinkedIn
  • RSS

Articles

  • Current Issue
  • Advance Access Articles
  • Past Issues
  • Topic Collections
  • Most Read Articles
  • Supplements

More Information

  • Submit a Paper
  • Instructions for Authors
  • Instructions for Reviewers
  • GH Journals Database

About

  • About GHSP
  • Advisory Board
  • FAQs
  • Privacy Policy
  • Contact Us

© 2023 Creative Commons Attribution 4.0 International License. ISSN: 2169-575X

Powered by HighWire