ORIGINAL ARTICLE
Open Access

Associations Between Practices and Behaviors at the Health Facility Level and Supply Chain Management for Antiretrovirals: Evidence from Cameroon, Namibia, and Swaziland

Diana Bowser, Laura Krech, David Mabirizi, Angela Y. Chang, David Kapaon and Thomas Bossert
Global Health: Science and Practice June 2019, 7(2):300-316; https://doi.org/10.9745/GHSP-D-19-00063

Using antiretrovirals (ARVs) as tracer products, we identified the following key practices that may affect supply chain management at the facility level: order verification, actions taken when stock is received, changes in prescription and dispensing due to ARV stock-out, actions to ensure patient adherence, and communication with other affiliated facilities and higher-level supply chain management. We propose a set of indicators to measure these practices.

ABSTRACT

Background:

While measuring, monitoring, and improving supply chain management (SCM) for antiretrovirals (ARVs) is understood at many levels of health systems, a gap remains in the identification and measurement of facility-level practices and behaviors that affect SCM. This study identifies practices and behaviors that are associated with SCM of ARVs at the hospital level and proposes new indicators for measurement.

Methods:

We performed an in-depth literature review to identify facility-level practices and behaviors and existing indicators that are associated with SCM. We used the United States Agency for International Development's 2013 National Supply Chain Assessment Toolkit to define 7 supply chain function areas to frame the study. Qualitative, semistructured key informant and focus group interviews were conducted in hospitals with health professionals from Cameroon, Namibia, and Swaziland to understand facility-level practices and behaviors.

Results:

Using the results from 54 key informant and focus group interviews from 12 hospitals, we identified 30 practices and behaviors that may affect ARV SCM at the facility level. The following practice areas were particularly associated with SCM: order verification, actions taken when ARV stock is received, changes in prescription and dispensing due to ARV stock-out, actions to ensure patient adherence, and communication with other affiliated facilities and higher-level SCM. We subsequently developed measurable indicators for future research.

Conclusion:

This study characterizes facility-level practices and behaviors that can affect ARV SCM. It also identifies gaps in their measurement. While this study uses ARVs as a tracer medicine to understand gaps in practices at the facility level, many of the findings are more broadly applicable to other medicines in an integrated setting. This study provides real-world evidence and the groundwork for further research to characterize the link between 30 facility-level practices and behaviors and ARV SCM at the facility and central levels.

BACKGROUND

Scaling up of antiretroviral (ARV) therapy in low- and middle-income countries, especially in Africa, has been supported by 2 main sources: the U.S. President's Emergency Plan for AIDS Relief (PEPFAR) and the Global Fund to Fight HIV/AIDS, Tuberculosis and Malaria (Global Fund).1 Many developing middle-income countries use their domestic resources to varying degrees to contribute to antiretroviral therapy (ART) scale-up. During the past decade, countries receiving donor support for HIV/AIDS programs have been transitioning disease-specific supply chains into integrated, essential medicine supply chains with domestic financing and government support.2 Some countries have accomplished this by increasing Ministry of Health (MOH) staff and funding budgets on par with donor organizations.3 Despite these efforts, supply chain management (SCM) remains a weak part of the national health system in many countries, where the delivery of ARVs is not yet sustainable or fully transitioned to the MOH, leaving the risk of stock-out for ARVs high.2

Effective and efficient communication between central, regional, and local health facility levels as well as quantification, secure transport, and quality assurance of medical products are all required parts of a functional supply chain.4–7 Although much is understood about how to measure, monitor, and improve ARV SCM at the central and regional levels of a health system, less has been done to identify and measure facility-level practices and behaviors that can affect SCM.5,6,8–12 In this article, we define facility-level SCM as activities related to managing and ordering inventory and monitoring the performance of facilities at the point of service delivery carried out by health care providers, managers, and administrators involved in prescribing and dispensing.7 These facilities may include public and private hospitals and health facilities, clinics, pharmacies, drug stores, and other outlets. Practices are defined as actions taken (or lack of actions taken) within facilities by health care workers and/or managers that affect SCM. Behaviors are defined as the leadership or management styles as well as the quality of relationships and communication between health care workers and managers at the facility level and those working in higher-level SCM management positions.

Comprehensive, well-designed reports and tools already exist with measurable indicators across various aspects of the supply chain. They include Management Sciences for Health's (MSH) Managing Drug Supply-3 (MDS-3): Managing Access to Medicines and Health Technologies; Logistics Indicator Assessment Tool (LIAT), which was developed with support from the United States Agency for International Development (USAID); the Logistics Handbook (USAID); and USAID's National Supply Chain Assessment Toolkit (NSCA), which includes the Capability Maturity Model Diagnostic Tool and National Supply Chain Key Performance Indicator Assessment (USAID).2,13–16 However, most of these reports and tools do not clearly distinguish or link between central, regional, and facility-level indicators. For example, no clear evidence exists that indicators developed and validated at the central and regional levels can be used for measuring SCM at facility levels. In addition, these tools cannot be readily used to understand how established facility-level SCM indicators affect and are connected to those at the regional and central levels. Furthermore, only a few studies examine associations of facility-level practice indicators to SCM.17–19

Some facility-level indicators of practices and behaviors do exist, but many of them have not been shown to be associated with SCM, and no system is in place to measure and monitor them in a systematic way.2,15,20 In this study, we aimed to identify facility-level practices and behaviors and their associations to ARV SCM and to propose indicators to measure these practices and behaviors in future studies.

We aimed to identify facility-level practices and behaviors and their associations to ARV supply chain management.

This study is unique in 2 ways. As previously stated, few studies have tried to expand understanding of facility-level practices and behaviors that could affect ARV SCM.2,6,20,21 Second, very limited publications or reports utilize a qualitative methodological framework of analysis to elucidate what is currently happening at the facility level as a means of determining the practices and behaviors that may have an impact on facility-level SCM.22

METHODS

We used a mixed research methodology that incorporated both quantitative and qualitative methods. The methodology included 4 phases consisting of a literature review, country and health facility selection and survey instrument development, in-country data collection, and data synthesis and analysis.

Literature Review

First, we conducted an in-depth review of published and gray literature to identify facility-level SCM indicators that can be used to measure and categorize facility-level practices and behaviors. The literature review was performed to identify facility-level practices and behaviors with evidence for an impact on SCM, with a specific focus on availability of and access to HIV/AIDS commodities. We focused mainly on literature from low- and middle-income countries, but we also searched for management literature in business journals, which included sources from higher-income countries. Key terms used in the search were HIV/AIDS, medicines and/or pharmaceutical supply chain management, supply chain performance, supply chain performance measurement, qualitative HIV/AIDS studies, behaviors and/or practices that impact supply chain, HIV/AIDS supply chain guidelines, and terms related to each step of the supply chain (e.g., product selection, forecasting, procurement, warehousing, inventory management, transportation, prescribing, and dispensing).

The review began with a search of published materials from 1990 to 2015 in the following databases: PubMed, Web of Science, and Google Scholar. We reviewed official reports published by nonprofit organizations, development agencies, and their implementing partners, in particular, USAID, MSH, John Snow Inc., and the World Health Organization.5,6,8,9,23–25 The following tools and reports were also analyzed: Managing Access to Medicines and Health Technologies (MDS-3, MSH), the Logistics Indicators Assessment Tool (USAID), Logistics Handbook (USAID), the 2013 toolkit documents from USAID's NSCA: Capability Maturity Model Diagnostic Tool and National Supply Chain Key Performance Indicator Assessment.

To identify existing facility-level SCM indicators, we reviewed indicators related to product selection, forecasting and supply planning, procurement, warehousing and inventory management, transportation, dispensing, waste management, laboratory issuing, information management, infrastructure, human resources, demand factors, behaviors and practices, and perceptions related to HIV/AIDS treatment.5,8,17,24,26,27 In addition to facility-level indicators, supply chain function areas were also reviewed in the literature. However, after analyzing numerous supply chain tools and reports, we chose to extract and adapt the supply chain function areas from USAID's 2013 NSCA Toolkit to categorize the facility-level practices and behaviors identified in the literature review. The main rationale for this decision was that the majority of the supply chain indicators and function areas proposed in that toolkit originated from and consolidated various aspects of other major tools.

The final 7 supply chain function areas used to classify facility-level behaviors and practices related to ARV SCM were forecasting and quantification; warehousing and inventory management; prescribing and dispensing; communication; information management; infrastructure; and human resources.

7 supply chain function areas were used to classify facility-level behaviors and practices related to ARV SCM.

The Figure shows the theoretical framework that guided the in-depth literature review, the methods, and the analysis. The blue boxes highlight areas included in the scope of the study. The framework shows how the study focused on identifying facility-level practices and behaviors, within facility-level supply chain function areas, and then linked them with measurable indicators. This framework also demonstrates how facility-level practices and behaviors connect to facility- and central-level SCM outcomes. We also considered health system design factors such as human resources, organization, and leadership. The orange boxes are included to capture the entire system, but they are not part of this study.

FIGURE
FIGURE

Study Design Focuses on the Practices and Behaviors at the Health Facility Level

Abbreviation: HR, human resources.

Country and Health Facility Selection and Survey Instrument Development

Country selection was carried out in coordination with the USAID-funded Systems for Improved Access to Pharmaceuticals and Services (SIAPS) Program, implemented by MSH. Countries selected were PEPFAR-funded African countries based on the source of funding for this research study.

The additional selection criteria pertained to language spoken (at least 1 francophone and 1 anglophone country), geographical variation (west/south/east), and availability and preparedness of country teams. Based on these criteria, 1 francophone and 2 anglophone countries were selected that also represented varied geographic areas: Anglophone/West/Southern Africa (Namibia), Anglophone/South/Eastern Africa (Swaziland), and Francophone/West/Central Africa (Cameroon). Further information was gathered based on each country selected, including a desktop review of the official, published, and gray literature on the ARV supply chain in each country.

We collaborated with local country experts from the MOH, particularly managers of national HIV/AIDS programs and SIAPS colleagues, to select the health facilities included in the study. Country experts assisted the study team in obtaining further reports and data that were not available publicly or online. Due to the variation and different types of lower-level facilities (health posts, clinics, etc.) in all 3 countries, hospitals were chosen as the facility unit of analysis due to more standard patient care responsibilities, availability of pharmacies, and types of health care workers and human resources. With technical assistance from national HIV/AIDS program managers, 4 hospitals in different geographic areas from each country were identified, for a total sample size of 12 hospitals.

4 hospitals in different geographic areas from each country were identified, for a total sample size of 12 hospitals.

The hospitals included in the study were selected based on indicators that we reviewed with each collaborating country study team. The indicators used to select the hospitals (listed below) were consistent within a country, but varied across the 3 countries. This variation was due to the 3 countries having different health information systems, which led to facilities across countries having different comparable and available indictors. The following 5 supply chain–related indicators were chosen to select facilities in Namibia:28,29

  • Storage condition: cleanliness, tidiness, appropriate arrangement of pharmaceuticals, and temperature monitoring practices

  • Inventory management and quantification: stock card use, cold chain management, and interim orders

  • Use of the Electronic Dispensing Tool for stock management (such tools help maintain basic patient profile information, medicine history, and other data that are essential for the dispenser to know at the time of dispensing)

  • Completeness of ART reports submitted to the Ministry of Health and Social Services (MOHSS)

  • Availability of adequate ART stock on hand

The following 2 supply chain–related indicators were used in Cameroon:

  • Discrepancies between patient figures and stock records

  • Discrepancies between physical stock count and stock records

The following supply chain–related indicator was used in Swaziland:

  • Months of stock on hand

Based on the in-depth literature review as well as country protocols for the management of HIV/AIDS patients in the participating countries, we developed qualitative interview guides to identify the practices and behaviors at the facility level that could have an impact on ARV SCM. Facility-level practices and behaviors were included in the guide for the following activities: prescribing, counseling, dispensing, clinical services, data-generating activities, data analysis, data reporting, forecasting, ordering, handling of expired stock, behaviors if a stock-out happens, submission of reports and orders, placing emergency orders, communication within and between facilities, and more general practices and behaviors regarding management leadership style and the quality of communication between facilities and higher-level SCM. All these activities fell within the 7 supply chain function areas.

Interview guides were developed to facilitate focus group discussions with key personnel at the facility level and interviews with key informants at central health system levels (e.g., the MOH, HIV/AIDS National Program, Central Medical Stores [CMSs]). We identified relevant interviewees based on their reported assigned tasks and daily responsibilities in each of the health facilities in the provision of ARVs and HIV services. We did not rely solely on using job titles or job descriptions because they do not necessarily correspond to actual day-to-day responsibilities and were not consistent across facilities.

In-Country Data Collection

One-week country visits occurred in January and February of 2014. Two of the authors, both from academia, conducted the interviews solely for this study in order to reduce any bias from donor-related activities, assessments, or evaluations.

First, key informant interviews were conducted with broader health system representatives from the MOH, HIV/AIDS National Program and regional offices, CMSs, and the World Health Organization. Second, key personnel focus group interviews were conducted with health care workers, pharmacists, and managers who interact with patients with HIV/AIDS arriving to the facility (hospital) for HIV medications. No key personnel were key informants.

Data Synthesis and Analysis

Interviews were recorded through interviewers' notes and later transcribed. A rubric of all practices and behaviors was developed to consistently identify themes and outliers in each of the key practices and behaviors within and across each country. A qualitative thematic analysis was performed to identify patterns in the practices and behaviors at the facility level that could have an impact on ARV SCM. A hybrid of deductive and inductive coding was used; meaning information identified from the literature at the beginning of the study was used as a starting point for analysis (deductive), and new themes and codes later emerged from the country-level data analysis of the interviews (inductive). All facility-level practices and behaviors observed in the countries were mapped to the 7 supply chain function areas adapted from the USAID's NSCA Toolkit.

Due to the extensive amount of qualitative results on all 30 practices and behaviors analyzed, we selected and summarized qualitative information for 7 of them in the results. We selected these 7 because they provide clear examples of how behavior and practice vary between and within countries across the supply chain function areas. In addition, the in-depth literature review and individual country results revealed that these 7 practices and behaviors had an association with SCM.

We selected and summarized qualitative information for 7 particularly relevant practices and behaviors.

The same 2 authors who carried out the in-country interviews and focus groups also carried out the data synthesis and analysis. Data synthesis and analyses were reviewed independently by authors 1 and 4 using a rubric of all identified practices and behaviors. For the small number of cases of disagreements, authors 1 and 4 discussed and resolved the discrepancy together. If the disagreement could not be resolved, author 2 was brought in and resolution was achieved by majority.

All major SCM measurement tools and relevant literature were then reviewed for a final time to identify indicators that mapped to each of the observed facility-level practices and behaviors. All indicators that were identified for each facility-level behavior and practice were listed. For those with no identifiable indicator, we used the results of the in-country interviews to propose new indicators. It should be noted that while this study used ARVs to understand gaps in practices at the facility level, many of the findings can be applied more broadly to medicines in an integrated setting.

Country Context

Table 1 summarizes relevant information on country context for Cameroon, Namibia, and Swaziland with respect to spending on HIV/AIDS, HIV prevalence, and demographics. The Namibian government has made the largest investment in HIV/AIDS spending, with 64% of the total HIV/AIDS budget coming from the public sector in 2014. Swaziland covers 38% of HIV/AIDS program costs with government funds, and Cameroon spends 15%. Consequently, Cameroon had the largest foreign donor investment in HIV/AIDS in 2014 (70%–80% of HIV/AIDS funding), with most of it coming from the Global Fund. Of the 3 countries, Cameroon has the lowest HIV prevalence, at 4.8% of 15–49-year-olds. Swaziland has one of the highest global HIV prevalence rates, with 26% of 15–49-year-olds living with HIV.

View this table:
TABLE 1.

Country Context

Namibia, the largest country in the study, has a population of only 2.3 million people, making it one of the least populated countries in the world. Namibia not only has a shortage of health care workers but also a shortage of supply chain personnel to work in the public health supply chain.18 The MOHSS oversees 14 regions with 350 public health facilities and manages the CMS distribution systems in Windhoek, Rundu, and Oshakati (the latter 2 being multiregional medical depots [MRMDs]).36 The distribution of medicines is carried out by CMS Windhoek to public health facilities in nearby central and southern Namibia and to the distant MRMDs of Rundu and Oshakati to cover a wide swath of Namibia's territory. MRMDs and public health facilities deliver medicines to health centers, clinics, and hospitals. Namibia operates an integrated pharmaceutical supply chain; ARVs do not have a parallel system of delivery, thus they are distributed with all other medicines from CMSs to clinic levels.

Cameroon is about half the size of Namibia but its population is tenfold higher (23.4 million inhabitants). The National AIDS Commission manages Cameroon's HIV/AIDS program. The national program manager is responsible for all programmatic aspects related to quantification and forecasting of ARVs and implementation of HIV/AIDS policies, among other duties. Cameroon has 10 regional medical stores (RMSs; centres d'approvisionnement pharmaceutiques des regionaux [CAPRs]) in each of its 10 administrative regions. CAPRs deliver medicines to health facilities and all receive ARV stock procured by Cameroon's CMS based in Yaounde (Centrale Nationale d'Approvisionnement en Médicaments Essentials et Consommables Médicaux).37 CAPRs distribute ARVs to the 124 ART sites based on health clinic needs; however, when ARVs are only available in limited quantities or facing stock-outs at the national level, ARVs are rationed to health facilities.

Swaziland is a small country with a population of 1.4 million, making it the most densely populated country in this study. Swaziland has an integrated pharmaceutical supply chain for medicines and medical supplies. CMSs are responsible for the SCM of all health commodities including medicines in the public sector. ARVs are directly distributed from CMSs on a monthly schedule to 45 hospitals and health facilities. ARVs are further delivered down the supply chain from hospitals and health facilities to what are known as baby (feeder) clinics.

Ethical Approval

The study was approved by the Institutional Review Board (IRB) of the Harvard T.H. Chan School of Public Health (protocol number IRB13-3167) and was determined to be exempt from obtaining written informed consent. The IRB determined that the protocol meets the criteria for exemption per the regulations found at 45 CFR 46.101(b)(2) and any additional review by the IRB was not required. In country, no local IRB approval was required; however, the research team obtained written authorization to conduct the study from the MOH of Cameroon, Namibia, and Swaziland. All participants in this study were adults (≥18 years). The purpose of the study was explained to participants, and verbal informed consent was obtained from all individuals participating in individual and focus group qualitative, semistructured interviews.

RESULTS

In total, 52 semistructured key informant and personnel interviews were conducted across the 12 hospitals included in the study. The number of key informants and personnel that were interviewed in each hospital varied depending on how many individuals were available on that particular day. For example, in Namibia across the 4 health facilities visited, 8 key informant/personnel interviews were conducted for an average of 2 individuals in each hospital. There were more individuals available for key informant interviews at the broader health system level in Namibia and Cameroon than in Swaziland. Table 2 details the number of key informant interviews conducted in each country and the type of interview.

View this table:
TABLE 2.

Semistructured Key Informant and Personnel Focus Group Interviews

52 semistructured key informant and personnel interviews were conducted across 12 hospitals in 3 countries.

Table 3 shows the 30 facility-level practices and behaviors that were identified through key informant and personnel interviews and mapped to 7 facility-level supply chain function areas. Some of these practices and behaviors are activities that are closely linked with routine activities for that particular supply chain function area and the literature supports a link between better completion of this activity and improved SCM. For example, calculation of minimum and maximum (min-max) buffer stock is an activity that is practiced widely across many facilities as part of forecasting and quantification exercises, although specific types of calculation differ. The MOH and donors often provide trainings on the different calculations that can be used to verify and document the maximum and minimum number of months of stock that should remain on the shelf, which should lead to lower stock-outs.7

View this table:
TABLE 3.

The 30 Supply Chain Management Practices and Behaviors Identified in the Analysis

Other identified practices and behaviors are not routinely carried out as part of that function area, and the literature contains minimal evidence on the link between them and any type of improved SCM. For example, communication between pharmacy team members and the clinical staff dispensing the medications is routinely practiced to different degrees of effectiveness across all the facilities included in the study. However, the literature includes little documentation on these types of communications and the relationship of communication with SCM.

In order to shorten the length of the full qualitative results, we selected 7 of the 30 practices and behaviors associated with ARV SCM as clear examples of the variation in supply chain function areas within each country (Table 4). These practices and behaviors are order verification before submission to the central/regional level; actions taken when stocks received from CMS/RMS; communication with higher-level SCM; communication with affiliated facilities; change in prescription during stock-out; change in dispensing during stock-out; and actions to ensure patient adherence. Additional qualitative information on all 30 practices and behaviors can be found in the SIAPS report Facility Level Practices and Behaviors That Affect the Performance of the Supply Chain of Antiretroviral Medicines.7 The 7 practices and behaviors reported and discussed in the current study describe what health care workers actually do (what they describe doing) and whether or not it is in line with guidelines for receiving a shipment, making an order, communicating among staff, and managing medicines and commodities.

View this table:
TABLE 4.

Selected Facility-Level Practices/Behaviors, Existing Indicators, and Potential New Indicators for Future Testing and Piloting

Order Verification Before Submission to the Central/Regional Level (Supply Chain Area: Forecasting and Quantification)

Order verification refers to a health facility staff member rechecking the ARV requisition request (verifying calculation, order, and inventory stock) before an order is sent to the central or regional level. We noted variation across facilities within each of the 3 countries with respect to how orders are verified. In Namibia, 2 facilities have a regional pharmacist and/or senior pharmacists who verify the orders. For example, at 1 hospital, the regional pharmacist always verifies stock card records on visits, even if the senior pharmacist has verified the order and inventory check of the pharmacy assistant. In the other 2 facilities visited in Namibia, no one checks the order before it is sent. In Swaziland, 3 of the 4 hospitals have a larger pharmacy team in which a senior pharmacist supervises work. This management structure enabled verification and review of orders before submission. In Cameroon, all 4 hospitals have their orders verified by the hospital coordinator.

Actions Taken When Stocks Are Received From CMS/RMS (Supply Chain Area: Warehousing and Inventory Management)

Actions taken when ARVs are received from the CMS/RMS refers to how and when new medications are received and added to the stock-keeping record. When stock arrives, some facilities quickly and diligently take actions, while others delay checking the physical count of medicines, opting instead to defer recording the receipt of stock and postpone storage.

In Namibia, 1 hospital prioritizes the counting, storing, and recording of new stocks upon arrival. The 3 other facilities experience delays; actions taken are less urgent or they are performed as staff becomes available. In Cameroon, 3 of 4 facilities take action when stocks are received. In 1 of these facilities, a staff member travels to the regional CAPRs to collect stocks, check physical count, and match them with the invoices. When this staff member returns to the hospital, stock cards are updated immediately with expiration dates and quantity. In 2 other facilities in Cameroon, staff members travel to the CAPRs to collect stocks and check physical counts to ensure stock cards are updated immediately upon stock arrival. In Swaziland, 2 of the 4 hospitals unpacked the new stocks when they “have time,” which can sometimes take days. The other 2 facilities unload and unpack the stocks as soon as they arrive.

Communication With Higher-Level SCM (Supply Chain Area: Communication)

Communication by the health facilities with their regional offices refers to the dialogue and discussion around supply chain issues between individuals in the health facilities and higher-level authorities who might be MOH personnel or individuals at the CMS. In Namibia, communication with higher-level regional management in 2 facilities is reported to be quite frequent (daily communication with the regional pharmacist). The other 2 facilities in Namibia report poor communication in that the regional pharmacist “never” visits the facility.

In Cameroon, 1 facility contacts the CAPR through the hospital coordinator; in another facility, the nurse directly contacts the regional office whenever a shortage occurs. The other 2 hospitals both call their respective CAPRs on a monthly basis to check their stock levels prior to placing an order for ARVs.

Communication with higher-level SCM does not take place in Swaziland because there is no regional pharmacist; however, key informants indicated in interviews that having a regional pharmacist would be helpful. Communication with CMS is done on a frequent basis by all facilities, but the CMS is consistently slow to respond to facility requests. Therefore, health facilities at times use other sources to obtain the medicines they need, such as reaching out to donors or other health facilities to inquire about stock and delivery availability.

Communication With Affiliated Facilities (Supply Chain Area: Communication)

Communication with the affiliated facilities refers to the dialogue and discussion of supply chain issues with other ARV clinics, other health posts, or other health personnel such as the physician who comes for outreach visits. Most facilities in Namibia reported the communication with their affiliated facilities is strong, which assists in maintaining appropriate stock levels and orders at the affiliated facilities. In Swaziland, 2 facilities reported having positive communication with their affiliated clinics, while 2 other facilities expressed concern with their clinics due to a backlog of data and nonsubmission of orders on a timely and necessary basis. No trends were reported for Cameroon because there are no affiliated facilities.

Change in Prescription and Dispensing During Stock-Out and Action to Ensure Patient Adherence (Supply Chain Function Area: Prescribing and Dispensing)

The results highlight 3 key themes in prescribing and dispensing that are noteworthy: change in ARV prescription during stock-out, change in dispensing of ARVs during stock-out, and actions to ensure patient adherence (e.g., pill count). This section summarizes some of the trends within each country with regard to changing a patient's ARV regimen and changing dispensing practices during periods of stock-out.

In all 3 countries, each of these prescribing and dispensing practices frequently occurs in all facilities. For example, 1 facility reports changing the ARV formulation for children if there is a stock-out of a particular formulation. If the child is currently using an ARV in tablet form but the facility has a stock-out, the physician will prescribe the syrup formula instead. There are also reports of modifying the duration of the prescription. For example, if a facility is short-stocked on an ARV medication and the physician is planning to travel to reach clinics located at a further distance, the physician prescribes only 1 month, instead of the regular 2 months of ARVs. The patient must then return to the facility in 1 month, which could potentially have a negative impact on adherence. Facilities also reported changing patients to different first-line or second-line regimens that are available when a shortage occurs. However, the patient often does not resume the original regimen when the ARV is back in stock and available. In summary, patients continue with the new first- or second-line regimen unless clinical side effects are present. These regimen changes can affect consumption patterns, forecasting, and procurement and significantly contribute to consumption pattern oscillations and a lack of predictability.

Facility-Level Practices and Behaviors With Existing and New Indicators

Existing literature and tools contain a number of indicators for forecasting and quantification and warehousing and storage.41 However, fewer standardized indicators to measure how facility-level behaviors and practices can affect SCM exist for prescribing and dispensing practices and communication with internal and external teams.7

Table 4 summarizes the mapping exercise for 7 of the 30 practices and behaviors associated with ARV SCM that were described previously, and maps each of these practices and behaviors to existing measurable indicators from the literature. For those without measurable indicators, new indicators based on country results are suggested that can potentially measure facility-level practices and behaviors and their impact on ARV SCM. Furthermore, in cases in which the qualitative data yielded important findings, new indicators are also proposed for behaviors and practices that already had some prior measures. The Supplement summarizes the mapping for all 30 practices and behaviors.

DISCUSSION

The results of this study are derived from focus group discussions with key personnel at the hospitals and semistructured interviews with key informants consisting of higher-level health system players. The results identify 30 practices and behaviors that may affect ARV SCM, focusing on several key areas that are associated with improved SCM: order verification, actions taken when ARV stock is received, changes in prescribing and dispensing during stock-out, actions to ensure patient adherence, and communication with other affiliated facilities and higher-level SCM. We developed measurable indicators for future research, focusing on practices and behaviors related to prescribing and dispensing, communication, and human resources. With a focus on ARVs, the study results provide insight into current SCM at the facility level in Cameroon, Namibia, and Swaziland, and we make recommendations based on the findings that are considered best practices.

The results of this study identify 30 practices and behaviors that may affect ARV SCM.

It was reassuring that pharmacy staff in many of the hospitals where interviews were conducted routinely calculated min-max amounts of stock, but stock-outs of key ARV products were still an issue. Therefore, despite routinely performing these calculations, staff were not able to apply the results to prevent stock-outs from happening. Several factors might explain this discrepancy, including (1) a lack of understanding and ability to calculate min-max amounts of stock followed by application of the results, (2) lack of monitoring the calculations to ensure accuracy and to link the min-max amounts to the actual amount of stock on the shelf, (3) improperly filled orders, and (4) other miscellaneous reasons related to stock assessments. A number of other, broader contextual factors were present, including orders being placed but not filled. The current study focused on practices and behaviors at the facility level, and future research will need to incorporate additional measures and analysis of upstream contextual factors.

The findings also indicate that for some supply chain functions (forecasting and quantification and warehousing and inventory management), national guidelines and/or best practices need to be standardized and disseminated to all facilities. More specifically, information from the qualitative interviews and focus groups suggests that trainings using standardized guidelines can strengthen the following practices and behaviors: order verification, redistribution of stock, emergency orders, control and access to stock, location and condition of storage, and where ARVs are stored. Trainings should be available for all facilities and not dependent on their distance from a regional office. For example, the process of redistributing stock between facilities and requesting an emergency order was extremely varied and should be reviewed to determine best practices to be communicated to all facilities. Currently, these 2 behaviors frequently occur together and are not standardized, and redistribution often occurs between facilities using informal processes. Since emergency orders are often sent to the central level at the same time that redistribution is happening at the lower level, the central level is unaware of what has been redistributed and where, which is a broader system design and reporting issue.

Some supply chain functions need standardized national guidelines and/or best practices for dissemination to all facilities.

The impact of prescribing and dispensing practices needs to be understood clinically to determine if any of the practices and behaviors identified in this study have a negative impact on the health outcomes of the patient. There is a lack of published literature and academic understanding exactly how and to what extent these practices affect patient health. For example, changing a regimen due to a stock-out is likely to affect adherence, may cause adverse drug reactions, and could pose risks for treatment resistance. Prescribers and dispensers frequently need to manage the reality of frequent ARV stock-outs and therefore must adjust patient doses and regimens; communication between providers and facilities about these changes is minimal, and a consistent method to record this critical information is lacking. At the time of the study, Swaziland was the only country that had an electronic patient record, including prescriptions, linked with a new pharmacy electronic system. However, implementation and linking of the 2 systems had some issues, causing backlog of requests. Namibia had an electronic dispensing tool, but it was not linked with clinical records. Health facilities are often on their own in dealing with shortages and stock-outs since there are no national standard operating procedures (SOPs) or standardized prescribing guidelines specific to these emergency issues.

While the importance of communication has been identified as a key aspect of appropriate management in health care in general, little research has investigated how better communication could be linked to SCM. Five different behaviors are linked to communications, including communication within the pharmacy team; communication within the facility; communication with higher-level hospital/clinic executives; communication with higher-level supply chain (regional and central medical stores); and communication with affiliated facilities.7 Communication within the facility, communication with affiliated facilities, and communication with higher-level SCM offices were newly identified practices and behaviors with potential indicators to be field tested.

Recommendations

Based on our findings, we propose recommendations to improve SCM in 4 main facility-level areas.

  • Understanding and monitoring of routine min-max calculations. Pharmacy staff should be monitored to perform the min-max calculations. This monitoring can happen within the facility by another colleague, such as a hospital coordinator, or by a higher-level regional pharmacist. Many hospitals relied on their regional pharmacist for periodic visits to check on specific practices and behaviors, reporting that the monitoring improved their SCM. Facilities in regions that did not have a regional pharmacist reported that having one would be helpful in such monitoring activities.

  • Development of national guidelines and norms. Best practices and guidelines should be developed and monitored at the facility level for order verification, redistribution of stock, emergency orders, control and access to stock, location and condition of storage, and where ARVs are stored.

  • Understanding the impact of prescribing and dispensing practices on health outcomes. Prescribers and dispensing staff would certainly benefit from guidelines, SOPs, and trainings on ARV regimen switches and managing shortages. Additional research is needed to understand the following: how prescribing and dispensing practices change during shortages and stock-outs; the frequency of regimen changes practiced in the country; and the impact of regimen changes on health outcomes including adherence and resistance.

  • The importance of communication. Communication has been more frequently measured and studied in hospital management, business, and organizational fields; however, how different types of communication can affect SCM has not been thoroughly examined or measured with standardized indicators. This gap holds true at the facility, regional, and central levels.7

Our recommendations are most likely applicable to other countries around the world that are experiencing similar difficulties with their own ARV supply chains. Further research, particularly field-based, pilot testing of the new, potential indicators for communication, human resources, and prescribing and dispensing identified in this study, is needed to understand their impact on SCM. Once these potential indicators are piloted for validity and reliability, causal study designs can be developed to test which practices and behaviors have a direct, measurable impact on facility-level SCM.

Limitations

Our study yielded some interesting findings, but it had some limitations. First, it was limited to selecting PEPFAR-supported countries based on availability and preparedness of the country teams. Secondly, the facility selection indicators varied across all 3 countries using information from country experts and available in-country data. Due to this wide variation in selection criteria for facilities across the countries, cross-country or intracountry comparisons or causal conclusions could not be made. Consequently, for each generalized result given above, a country-specific example is provided. While this is a major limitation, which is exacerbated by the sample size, it provides a baseline and unique opportunity to investigate these associations in more detail within each country. Furthermore, our study did not consider how gender, ethnicity, socioeconomic status, or other power dynamics may influence the lens through which the key informants viewed the issues. Finally, the relationship between facility- and central-level indicators (i.e., CMSs) is not explored in this article; however, improvements in facility-level practices and behaviors should logically lead to better SCM at the central level.

Due to these limitations, no cross-country or intra-country comparisons or conclusions could be made about potential linkages between the facility-level practices and behaviors identified and SCM outcomes.

CONCLUSIONS

This study identifies gaps in the measurement of facility-level practices and behaviors in the ARV supply chain. The results identify 30 facility-level practices and behaviors associated with SCM; 15 of the 30 do not have any existing indicators for measurement from literature and research. Potential new indicators are proposed based upon the analysis of the in-country qualitative results.

Improved practices and behaviors are recommended for implementation, such as offering trainings, developing SOPs and national guidelines related to communication with internal and external staff, developing new guidelines on how to adjust prescribing and dispensing patterns during shortages or stock-outs, and limiting access to ARVs in storage to selected staff at the facility. The study results provide insight into the way that ARV supply chains are currently managed at the facility level in 3 countries of sub-Saharan Africa. The results may serve as the basis for additional research, both within and across countries, to examine how improving specific behavior and practices affects SCM.

Acknowledgments

We would like to thank all the participants who provided information during the interviews for this study. We would also like to thank Helena Walkowiak and Ruth Musila from SIAPS for their contributions as technical reviewers of this article. We also recognize the approvals and support we received from the Ministries of Health and USAID missions in Cameroon, Namibia, and Swaziland. This article is based on our unpublished report titled, “Facility-Level Practices and Behaviors That Affect Performance of the Antiretroviral Medicine Supply Chain” (http://siapsprogram.org/publication/facility-level-practices-and-behaviors-that-affect-performance-of-the-antiretroviral-medicine-supply-chain/), which is referenced throughout the current article.

Notes

Peer Reviewed

Funding: This article was made possible by the generous support of the American people through USAID, under the terms of cooperative agreement number AID-OAA-A-11-00021. The authors led the study design, data collection, analysis, and interpretation of the data as well as the writing of the manuscript. The funding entities, USAID and MSH, provided input into the study design and overall research concept.

Disclaimer: The contents of this article are the responsibility of MSH and do not necessarily reflect the views of USAID or the United States Government.

Competing Interests: None declared.

Cite this article as: Bowser D, Krech L, Mabirizi D, Chang AY, Kapaon D, Bossert T. Associations between practices and behaviors at the health facility level and supply chain management for antiretrovirals: evidence from Cameroon, Namibia, and Swaziland. Glob Health Sci Pract. 2019;7(2):300-316. https://doi.org/10.9745/GHSP-D-19-00063

  • Received: February 6, 2019.
  • Accepted: April 30, 2019.
  • Published: June 24, 2019.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit http://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-19-00063

REFERENCES

  1. 1.↵
    1. Schouten EJ,
    2. Jahn A,
    3. Ben-Smith A,
    4. et al
    . Antiretroviral drug supply challenges in the era of scaling up ART in Malawi. J Int AIDS Soc. 2011;14(suppl 1):S4. doi:10.1186/1758-2652-14-S1-S4. pmid:21967844
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Windisch R,
    2. Waiswa P,
    3. Neuhann F,
    4. Scheibe F,
    5. de Savigny D
    . Scaling up antiretroviral therapy in Uganda: using supply chain management to appraise health systems strengthening. Global Health. 2011;7(1):25. doi:10.1186/1744-8603-7-25. pmid:21806826
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Cairney LI,
    2. Kapilashrami A
    . Confronting ‘scale-down’: assessing Namibia's human resource strategies in the context of decreased HIV/AIDS funding. Glob Public Health. 2014;9(1–2):198–209. doi:10.1080/17441692.2014.881525. pmid:24502449
    OpenUrlCrossRefPubMed
  4. 4.↵
    1. Daniel G,
    2. Tegegnework H,
    3. Demissie T,
    4. Reithinger R
    . Pilot assessment of supply chains for pharmaceuticals and medical commodities for malaria, tuberculosis and HIV infection in Ethiopia. Trans R Soc Trop Med Hyg. 2012;106(1):60–62. doi:10.1016/j.trstmh.2011.09.008. pmid:22093812
    OpenUrlCrossRefPubMed
  5. 5.↵
    John Snow, Inc., DELIVER Project. The Logistics Handbook: A Practical Guide for the Supply Chain Management of Health Commodities. 2nd ed. Arlington, VA: John Snow, Inc.; 2011. http://apps.who.int/medicinedocs/documents/s20211en/s20211en.pdf. Accessed May 22, 2019.
  6. 6.↵
    USAID Global Health Supply Chain Program (GHSC). National Supply Chain Assessment (NCSA) toolkit: Capability Maturity Model Diagnostic Tool (CMM) and National Supply Chain Key Performance Indicator Assessment (KPIS)—user's guide. Arlington, VA: GHSC; 2013. https://www.ghsupplychain.org/key-initiatives/national-supply-chain-assessment-nsca-toolkit. Accessed May 22, 2019.
  7. 7.↵
    1. Bowser DM,
    2. Chang AY,
    3. Bossert TJ,
    4. Mabirizi D
    . Facility-Level Practices and Behaviors That Affect Performance of the Antiretroviral Medicine Supply Chain. Arlington, VA: Management Sciences for Health; 2014. http://siapsprogram.org/publication/altview/facility-level-practices-and-behaviors-that-affect-performance-of-the-antiretroviral-medicine-supply-chain/english/. Accessed May 22, 2019.
  8. 8.↵
    John Snow, Inc., DELIVER Project. Logistics Indicators Assessment Tool (LIAT). Arlington, VA: John Snow, Inc., DELIVER Project; 2008. https://pdf.usaid.gov/pdf_docs/Pnade735.pdf. Accessed May 22, 2019.
  9. 9.↵
    1. Aronovich D,
    2. Tien M,
    3. Collins E,
    4. Sommerlatte A,
    5. Allain L
    . Measuring Supply Chain Performance: Guide to Key Performance Indicators for Public Health Managers. Arlington, VA: John Snow, Inc., DELIVER Project; 2010. https://www.ghsupplychain.org/sites/default/files/2017-03/Measuring%20SC%20Perf.pdf. Accessed May 22, 2019.
  10. 10.
    Management Sciences for Health (MSH), Rational Pharmaceutical Management Project. Rapid pharmaceutical management assessment: an indicator-based approach. Arlington, VA: MSH; 1995. https://www.msh.org/sites/msh.org/files/rapid-pharmaceutical-management-assessment-indicator-based-approach.pdf. Accessed May 22, 2019.
  11. 11.
    John Snow, Inc. (JSI). Reporting requirement and indicator harmonization for HIV medicines and diagnostics: a review of PEPFAR, GFATM and country specific requirements and indicators. Arlington, VA: JSI, 2005. https://www.who.int/hiv/amds/JSI_FinalReport9-29-05.pdf. Accessed May 22, 2019.
  12. 12.↵
    1. Serumaga B,
    2. Spisak C,
    3. Rosen J,
    4. Morgan L,
    5. Eichler R
    . Using performance-based financing (PBF) to motivate health commodity supply chain improvement at a central medical store in Mozambique. BMC Health Serv Res. 2014;14(S2):P148. doi:10.1186/1472-6963-14-S2-P148
    OpenUrlCrossRef
  13. 13.↵
    1. Bossert TJ,
    2. Bowser DM,
    3. Amenyah JK,
    4. Aronovich D,
    5. Bates J,
    6. Quam K
    . Impact of decentralization and integration on the performance of health logistics systems: concept paper and applied research protocol. Arlington, VA: John Snow, Inc., DELIVER Project; 2002.
  14. 14.
    1. Goel P,
    2. Ross-Degnan D,
    3. Berman P,
    4. Soumerai S
    . Retail pharmacies in developing countries: a behavior and intervention framework. Soc Sci Med. 1996;42(8):1155–1161. doi:10.1016/0277-9536(95)00388-6. pmid:8737433
    OpenUrlCrossRefPubMed
  15. 15.↵
    1. Yadav P
    . Health product supply chains in developing countries: diagnosis of the root causes of underperformance and an agenda for reform. Health Systems & Reform. 2015;1(2):142–154. doi:10.4161/23288604.2014.968005
    OpenUrlCrossRefPubMed
  16. 16.↵
    Republic of Uganda, Ministry of Health. Health facility-level indicators for monitoring the national HIV/AIDS antiretroviral therapy programme in Uganda. Kampala, Uganda: Ministry of Health; 2007.
  17. 17.↵
    World Health Organization (WHO). Harmonized Monitoring and Evaluation Indicators for Procurement and Supply Management Systems: Early-Warning Indicators to Prevent Stock-Outs and Overstocking of Antiretroviral, Antituberculosis and Antimalaria Medicines. Geneva: WHO; 2011. http://apps.who.int/medicinedocs/documents/s19906en/s19906en.pdf. Accessed May 22, 2019.
  18. 18.↵
    1. Hasselberg E,
    2. VanBuuren A,
    3. Ongeri B,
    4. McHenry B
    . Public Health Supply Chain Competency Mapping in Namibia. Results and Recommendations from the People that Deliver Initiative Collaboration Between the Ministry of Health and Social Services, SCMS, and CapacityPlus. Arlington, VA: Supply Chain Management System; 2014. https://peoplethatdeliver.org/ptd/download/file/fid/689. Accessed May 22, 2019.
  19. 19.↵
    1. Hasselberg E,
    2. Indongo L,
    3. Ngulu T,
    4. Kambyambya K,
    5. Ongeri B
    . Improving access to health commodities by strengthening the supply chain management workforce: the case of Namibia. J Pharm Policy Pract. 2014;7(suppl 1):O6. doi:10.1186/2052-3211-7-S1-O6
    OpenUrlCrossRef
  20. 20.↵
    1. Vledder M,
    2. Friedman J,
    3. Sjöblom M,
    4. Brown T,
    5. Yadav P
    . Optimal Supply Chain Structure for Distributing Essential Drugs in Low Income Countries: Results from a Randomized Experiment. Rochester, NY: Social Science Research Network; 2015. https://papers.ssrn.com/abstract=2585671. Accessed May 22, 2019.
  21. 21.↵
    1. Waako PJ,
    2. Odoi-adome R,
    3. Obua C,
    4. et al
    . Existing capacity to manage pharmaceuticals and related commodities in East Africa: an assessment with specific reference to antiretroviral therapy. Hum Resour Health. 2009;7(1):21. doi:10.1186/1478-4491-7-21. pmid:19272134
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Miguel P,
    2. Reis M
    . Coordination in Brazilian pharmaceutical supply chains. Journal of Operations & Supply Chain Management. 2014;7(2):75–90. doi:10.12660/joscmv7n2p75-90
    OpenUrlCrossRef
  23. 23.↵
    John Snow, Inc., DELIVER Project. Monitoring and Evaluation Indicators for Assessing Logistics Systems Performance. Arlington, VA: John Snow, Inc.; 2006. http://1i4rh11vccjs3zhs5v8cwkn2.wpengine.netdna-cdn.com/wp-content/uploads/2016/05/M_E_indicators_hdbk.pdf. Accessed May 22, 2019.
  24. 24.↵
    John Snow, Inc., DELIVER Project. Guide to Conducting Supply Chain Assessments Using the LSAT and LIAT. Arlington, VA: John Snow, Inc.; 2011. http://iaphl.org/wp-content/uploads/2016/05/Conducting-Assesment-with-the-_LSAT_LIAT.pdf. Accessed May 22, 2019.
  25. 25.↵
    1. Ali D,
    2. Bwembya M,
    3. Collins E,
    4. Papworth D,
    5. Ronnow E
    . Zambia: Family Planning Quantitative and Qualitative Logistics System Assessment. https://www.datafirst.uct.ac.za/dataportal/index.php/citations/4560. Arlington, VA: John Snow, Inc., DELIVER Project; 2008. Accessed May 22, 2019.
  26. 26.↵
    Management Sciences for Health (MSH). MDS-3: Managing Access to Medicines and Health Technologies. Arlington, VA: MSH; 2012. https://www.msh.org/sites/msh.org/files/mds3-jan2014.pdf. Accessed May 22, 2019.
  27. 27.↵
    World Health Organization (WHO). Monitoring and Reporting on the Health Sector's Response towards Universal Access to HIV/AIDS Treatment, Prevention, Care and Support 2007–2010. Geneva: WHO; 2007.
  28. 28.↵
    Republic of Namibia, Ministry of Health. National Supportive Supervision Report. Windhoek, Namibia: Ministry of Health; 2013.
  29. 29.↵
    Republic of Namibia, Ministry of Health. ART PMIS Quarterly Feedback Report for the Period July to September 2013. Windhoek, Namibia: Ministry of Health; 2013.
  30. 30.
    1. Degardin K,
    2. Roggo Y,
    3. Margot P
    . Understanding and fighting the medicine counterfeit market. J Pharm Biomed Anal. 2014;87:167–175. doi:10.1016/j.jpba.2013.01.009. pmid:23384475
    OpenUrlCrossRefPubMed
  31. 31.
    Republic of Namibia, Ministry of Health and Social Services (MoHSS); Namibia Statistics Agency (NSA); National Institute of Pathology (NIP); ICF International. Namibia Demographic and Health Survey 2013. Windhoek, Namibia: MoHSS; 2014. https://dhsprogram.com/pubs/pdf/fr298/fr298.pdf. Accessed May 22, 2019.
  32. 32.
    Joint United Nations Programme on HIV and AIDS. HIV and AIDS estimates: Cameroon, 2014. http://www.unaids.org/en/dataanalysis/datatools/spectrum-epp. Accessed May 22, 2019.
  33. 33.
    U.S. President's Emergency Plan for AIDS Relief (PEPFAR). Cameroon operational plan report FY 2012. Washington, DC: PEPFAR; 2013. https://www.pepfar.gov/documents/organization/212134.pdf. Accessed May 22, 2019.
  34. 34.
    Joint United Nations Programme on HIV and AIDS. HIV and AIDS estimates: Swaziland, 2014. http://www.unaids.org/en/dataanalysis/datatools/spectrum-epp. Accessed May 22, 2019.
  35. 35.
    Kingdom of Swaziland. Swaziland Global AIDS Response Progress Reporting 2014. Mbanane, Swaziland: National Emergency Response Council on HIV/AIDS of Swaziland; 2014. http://www.unaids.org/sites/default/files/country/documents/SWZ_narrative_report_2014.pdf. Accessed May 22, 2019.
  36. 36.↵
    1. Levenger MO,
    2. Wolde A,
    3. Kagoya H
    . Namibia National Supply Chain Assessment: Capability and Performance. Arlington, VA: Supply Chain Management System; 2013. https://www.medbox.org/namibia-national-supply-chain-assessment-results/download.pdf. Accessed May 22, 2019.
  37. 37.↵
    1. Eghan K,
    2. Daniel G
    . Assessment of the Pharmaceutical Management System in Cameroon. Arlington, VA: Management Sciences for Health, Strengthening Pharmaceutical Systems (SPS) Program; 2011. https://www.medbox.org/assessment-of-the-pharmaceutical-management-system-in-cameroon/download.pdf. Accessed May 22, 2019.
  38. 38.
    1. Bossert TJ,
    2. Bowser DM,
    3. Amenyah JK
    . Is decentralization good for logistics systems? Evidence on essential medicine logistics in Ghana and Guatemala. Health Policy Plan. 2007;22(2):73–82. doi:10.1093/heapol/czl041. pmid:17324947
    OpenUrlCrossRefPubMed
  39. 39.
    Management Sciences for Health (MSH), Systems for Improved Access to Pharmaceuticals and Services Program. Rapport de revue trimestrielle N 1 des données sur la gestion des patients et des intrants VIH/SIDA. Arlington, VA: MSH; 2013.
  40. 40.
    1. Yamamoto S
    1. Brauner P,
    2. Runge S,
    3. Groten M,
    4. Schuh G,
    5. Ziefle M
    . Human factors in supply chain management. In: Yamamoto S, ed. Human Interface and the Management of Information. Information and Interaction for Learning, Culture, Collaboration and Business, Lecture Notes in Computer Science. Berlin, Germany: Springer; 2013:423–432.
  41. 41.↵
    Management Sciences for Health, Systems for Improved Access to Pharmaceuticals and Services (SIAPS) Program. HIV and AIDS. SIAPS Program website. http://siapsprogram.org/health_areas/hivaids/. Accessed May 22, 2019.
Back to top

In this issue

Print
Download PDF
Article Alerts
Email Article
Citation Tools
Associations Between Practices and Behaviors at the Health Facility Level and Supply Chain Management for Antiretrovirals: Evidence from Cameroon, Namibia, and Swaziland
Diana Bowser, Laura Krech, David Mabirizi, Angela Y. Chang, David Kapaon, Thomas Bossert
Global Health: Science and Practice Jun 2019, 7 (2) 300-316; DOI: 10.9745/GHSP-D-19-00063
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo

Statistics from Altmetric.com

Jump to section