Funders' Perspectives on Supporting Implementation Research in Low- and Middle-Income Countries

Ethics Approval

Human subjects research ethics approval to conduct interviews was given by the Research Ethics Committee for Science and Health at the University of Copenhagen. Ref: 504-0075/19-5000.

Involve All Relevant Stakeholders From the Outset and Throughout the Entire Research and Delivery Process

IR is most effective and sustainable if end users—health practitioners, patients, health administrators, policy makers, funders, and other community stakeholders—are actively involved not only from the inception of but also throughout the research process. This requires consulting these various groups in open and transparent ways and asking them to help identify specific research needs and concerns. Equally crucial is informing them about the research process and how and when they can contribute most effectively. These consultations were considered a priority for respondents as they form a solid basis for the implementation of research findings and increase the chances of research outcomes addressing the needs of the communities involved. Involving all stakeholders from the start and throughout the process can help ensure this engagement is at the forefront of the project.

Funding agencies and the broader health research community are increasingly aware of the importance and complexity of broad stakeholder involvement in ensuring that investments made in research programs have a wide impact.^10,11 They are in a unique position to support the collaborative process of research codesign and meaningful end user engagement across all stages of the research process.^12,13 Funders can contribute to this process in various ways: ensure sufficient time for consultations with end users as part of their funding strategy, fund systems and platforms focusing on addressing this gap, and fund education and training of stakeholders as part of their effective participation in the IR process.¹⁴ Publishers can also mandate that researchers report on stakeholder involvement for IR projects about which they publish.

Funding agencies can consider financing the formation of new IR platforms to facilitate the wider study and documentation of end users' perspectives, which will, in turn, lead to research that is increasingly comprehensive, relevant, and tangible. Our analysis indicates that a best practice for funders could be to require that stakeholders are involved from the start and throughout the project and that their involvement is a core aspect of all IR proposals and reports. Indeed, as Sturke et al. observe¹⁵: Enhanced interactions between researchers and users of scientific evidence are important and necessary to tackle enduring barriers to implementation.

An interview respondent stated: Sustainability of interventions means you need to begin with the end in mind. The right stakeholders must be engaged from the beginning to scale up interventions. This is what funders need to do, ensure that their grants have the applicant think about sustainability from the get-go, including having requirements that relate to having people that will be sustaining the intervention as part of the project team.

Acknowledging that priority setting for investments in research is often determined without input from all relevant stakeholders, and that this results in a gap between evidence needed and evidence produced, the U.S. Agency for International Development (USAID) has funded health evaluation and applied research projects through a consultative approach. This was¹⁶: rooted in an understanding that the use of evidence to improve health policies and programs requires the long-term active engagement of multiple actors representing an extensive array of skill sets and experiences.

USAID's consultative process has actively engaged funders, researchers and academic institutions, health practitioners, policy makers, and community advocates at the global, regional, national, and subnational levels across Asia, Africa, Europe, and North America. IR priorities pursued under this approach are iteratively developed through a combination of approaches, including literature reviews, rapid scoping reviews, interviews, stakeholder meetings, and surveys. By using multiple means to solicit and confirm priorities, USAID has been able to generate robust IR agendas on a range of topics. While it might not be possible to fund the full IR agenda immediately, the process helps to prioritize IR in ways that are relevant beyond specific funding opportunities and ensures that important issues are followed up in the future.

Embrace and Leverage the Diversity of IR Funders

IR funders have relatively diverse profiles in terms of thematic focus, grant holders, funding rules, and amount and duration of funding, as well as monitoring and evaluation strategies.

Some funding agencies have a specific mandate and dedicated programs to support IR (e.g., U.S. National Institutes of Health [NIH]) while others function in more ad hoc or opportunistic ways and have, in some cases, embedded IR as part of larger funding programs (e.g., clinical trials). This can be a practical way for funders to gain experience with this kind of research, and thereby help to formalize an organization's long-term commitment. According to respondents, it has taken some time for health research funders to see IR as critical to their mission.

Our analysis indicates that, ideally, the importance of IR could be reflected in the long-term strategic thinking and planning done by funders. In the meantime, several agencies have looked for opportunities to “learn by doing” within the scope of their existing mandate, thereby gaining experience in investing in IR, honing their expertise, and helping to inform the design of well-conceived and appropriate approaches to this important issue. In some cases, funding agencies form alliances to coordinate funding or share best practices on IR funding and management. One such example is the ESSENCE Working Group on Implementation Research in which 13 funding agencies participate to share experiences and align strategic agendas. Related to this, an interview respondent said: I am not sure there is a model way to fund IR. While we use fairly standardized processes, our examples might not work for others that have their own policies and requirements. But there are great examples of how major funders across the world get together to fund and increase investment in a particular area. We shouldn't think about what model the individual funder uses but rather about a larger model that allows using one's own funding mechanisms to reach a common goal.

Increase Awareness and Readiness to Implement New Knowledge in IR

Funders have remained alert and responsive to the challenges and opportunities that IR offers as it evolves. A few respondents said that the potential for improving health and health care should motivate funders to overcome its baffling diversity of meanings and processes and that the definitional variability that exists may offer opportunities to funders and beneficiaries alike. One of the respondents proposed that, ultimately, the goal of IR is to create comprehensive programs that will help transform individuals' health. Other interviewees considered that implementation has happened when the “real world,” national approval, or national policy has changed. They also considered that some global IR leaders and experts can help shape language that appeals to both a broader audience and implementation scientists so that it can be as inclusive as possible.

New definitions, methodologies, theoretical approaches, frameworks, and models are continually emerging in IR. Some funders have supported this fast-paced environment by financing efforts to develop new theories and innovative methodologies built through multidisciplinary and multisectoral collaborations that have the potential to vastly improve health outcomes in LMICs. As an illustration of how rapidly the field of IR is gaining acceptance and how collaboratively it can operate, we note that in 2002, the U.S. National Institute of Mental Health alone issued its first funding opportunity announcement (FOA) for dissemination and implementation research in mental health. In contrast, by 2019, 21 of 27 NIH institutes, centers, and offices were part of the trans-NIH FOA for dissemination and implementation research in health. The 2019 FOA, like those before it, called for studies to advance IR methods, measures, and research dissemination. Among many other areas of IR, the current FOA allows for studies that focus on testing theories, models, and frameworks for dissemination and implementation; developing valid and reliable dissemination and implementation outcome and process measures; and developing study designs, research methods, and analytic approaches for studying dissemination and implementation.

Consider Partnership Building as Central to IR

From our discussions, we noted that funding agencies use different partnering approaches and various types of creative platforms that help move the field forward. Funders generally work together because they share strategic goals, such as improving the quality of health care in resource-constrained countries (Table). By pooling their talents and resources, funders increase the likelihood that proven strategies, clinical interventions, and policies will make an impact beyond discovery research and create sustainable improvements in the health of populations. International partnerships were found to be ways to work around particular challenges and share accountability. In some cases, funding agencies partner to jointly allocate funding to an entity that runs a program for them, as was the case of the small grants scheme for IR on infectious diseases of poverty that was a joint initiative between the World Health Organization Regional Office for Africa; TDR, Special Programme for Research and Training in Tropical Diseases; and the European & Developing Countries Clinical Trials Partnership. In many cases, members of international alliances are encouraged to align research agendas and support joint programs, for example, as facilitated by the Global Alliance for Chronic Diseases.

At the national level, funders, including country government funders, can invest in partnerships that create IR training opportunities and IR mentorships. These national partnerships not only have the benefit of identifying IR activities within a single country but also create a forum for national stakeholders to come together and share information. National partnerships that receive support from external funders also make it easier for funders to recognize and invest in places where promising research is being done. A new mechanism proposed by ESSENCE in 2019 facilitates the identification of gaps in capacity in LMICs and provides opportunities for relevant stakeholders to work together to address these gaps.¹⁷

Promote Prioritization of Capacity Building for IR Within Funding Agencies and Among Wider Audiences

New ways of building capacity in IR are urgently needed, and this was raised at different levels during our discussions with funding agencies. As a relatively young field, IR has few bona fide experts and, consequently, relatively few mentors who can support students and early-career scientists. In LMICs, the shortage of researchers with IR experience and of institutions with the expertise to develop and run IR training programs is restricting the development of the field.¹⁸ As respondents said: There are few applicants right now… it feels like the same applicants, we need to find ways to get new people on board.

We are lacking rigor and a real knowledge of the methodologies as there is the idea that everybody can be an implementation researcher.

Researchers and research offices within research institutions can be trained in IR, and funders can play a role in nurturing and sustaining researchers' commitment to learning about IR through awarded grants. It is crucial to create a professional environment for this work and a career progression through it. Funders can support this career progression through fellowship programs that fund early- to mid-career and senior scientists. Funders can also support the research community to respond to a request for proposals, for example, through courses explaining what IR is (e.g., such as the massive open online course organized by TDR, Special Programme for Research and Training in Tropical Diseases) and grant proposal writing (e.g., as organized by the European & Developing Countries Clinical Trials Partnership). Funders can also make resources available to guide the research community (such as the Global Alliance for Chronic Diseases Researcher Resources directory¹⁹). These efforts are particularly important in LMICs, where region-specific constraints play a major role and few applicants have opportunities to obtain formal training or mentorship in proposal writing. However, as an interview respondent observed: Just training individuals won't strengthen the health system. What must be done is simultaneously support a large-scale national intervention, so everyone has a shared vision or shared goal to achieve. And then within that, supporting implementation research that leads to solving problems that relate to that end goal.

Another respondent said: We have to build standards, quality, careers, and education, collectively. It's no good just getting people to be able to write a grant, we need to get a global recognition that this kind of science can really affect what's happening in the country, and for this you need people within the health systems of these countries to get training to recognize the value.

The value of cross-disciplinary teams to help expand the pool of knowledge, skills, and resources that IR programs can draw on was also raised. At each stage, efforts can be made to improve the abilities of all stakeholders to understand and use the knowledge generated by IR. This also includes building capacity within funding agencies to ensure that IR is built into strategic planning and all stages of grant evaluation and management.

Create and Communicate Clear Evaluation Criteria

It is helpful for funders to clearly communicate the specifications and criteria they use to score, evaluate, and assess proposals or applications, which can vary among funders. Also, many grant applicants have limited training or experience in writing strong funding proposals, partly because this is a relatively new field. When funding cross-regional and global research consortia, funders can encourage and enable researchers in LMICs to participate as equal partners in proposal design and specification while clearly stipulating what a robust, responsive grant proposal should include. It has been proposed that funding agencies write funding announcements using the concepts and terminology that they would like to find in the research proposals that are submitted. The use of clear criteria is also important to help funders evaluate proposals and to brief external reviewers when needed.

Ensure That IR Outcomes and Skills Are Integrated Into National Health Systems

For IR investments to be worth the resources invested, outcomes should be envisioned and designed to become an integral part of health and other social systems, which is a key desirable outcome of the funding. Agencies can contribute to this by ensuring that researchers' and practitioners' engagements with health policy and related realms are a key component of IR-related investments in LMICs. Reliance on external sources of funding means that there is a risk that IR outcomes will not be embedded in national and local health systems. Answers to IR questions are highly specific to each context, and they differ within countries and subnational regions, but if IR skills are embedded into the system itself, it becomes possible to connect the local to national and even global networks. The need for the ability to integrate outcomes and skills into the national health system has been made evident with the ongoing coronavirus disease (COVID-19) pandemic, which demonstrated that in addition to providing access to vaccines, therapies, and tests, countries need sufficient infrastructure such as laboratories, technicians, and cold storage, all of which can vary greatly among subregions.²⁰ Also needed is the ability to disseminate information about prevention and understand how to implement effective preventative measures (for instance, the wearing of masks and the ability to address issues such as mask and vaccine hesitancy). An example of how such integration is encouraged is the SORT IT model (Structured Operational Research and Training IniTiative) coordinated by TDR, Special Programme for Research and Training in Tropical Diseases, which supports countries and institutions to conduct operational/IR around their own priorities.²¹

Funding agencies can contribute to this integration effort in several ways: (1) prioritize support for projects that are designed to take IR skills into the overlapping streams of activity that together constitute health systems; (2) support programs that identify underlying factors that point the way toward the establishment and expansion of networks that foster the link between researchers, policy makers, and implementers, as well as ensuring that these relationships are always open and transparent and that those involved remain accountable to the citizens they serve; and (3) fund research on how IR can influence health policy as part of the broader process of policy dissemination and IR.

In addition, funders could consider supporting efforts for “de-implementation,” which is the discontinuation of the use of a health service or practice that is not effective, proven, harmful, or inappropriate. Some funders, such as the U.S. National Cancer Institute and NIH, have already begun to examine processes for de-implementation research, which shows the importance of integrating IR into health systems. A final option for ensuring cost efficiency and integration would be embedding research into national and academic health programs and health systems in LMICs. In this way, the traditional calls for funding applications launched by funding agencies could be complemented with funding made available within the local program structure.