Skip to main content

Main menu

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
      • Local Voices Webinar
      • Connecting Creators and Users of Knowledge
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers

User menu

  • My Alerts

Search

  • Advanced search
Global Health: Science and Practice
  • My Alerts

Global Health: Science and Practice

Dedicated to what works in global health programs

Advanced Search

  • Content
    • Current Issue
    • Advance Access
    • Archive
    • Supplements
    • Special Collections
    • Topic Collections
  • For Authors
    • Instructions for Authors
    • Tips for Writing About Programs in GHSP
    • Submit Manuscript
    • Publish a Supplement
    • Promote Your Article
    • Resources for Writing Journal Articles
  • About
    • About GHSP
    • Editorial Team
    • Advisory Board
    • FAQs
    • Instructions for Reviewers
  • Alerts
  • Find GHSP on LinkedIn
  • Visit GHSP on Facebook
  • RSS
ORIGINAL ARTICLE
Open Access

Surgical System Efficiency and Operative Productivity in Public and Private Health Facilities in Ethiopia: A Cross-Sectional Evaluation

Manuel Kassaye Sibhatu, Edlawit Mesfin Getachew, Dawit Yifru Bete, Senedu Bekele Gebreegziabher, Tsegaye Hailu Kumsa, Mulatu Birru Shagre, Kassa Haile Merga, Desalegn Bekele Taye, Hassen Mohammed Bashir, Mikiyas Teferri Yicheneku, Wuletaw Chanie Zewude, Akililu Alemu Ashuro, Tigistu Adamu Ashengo and Berhane Redae Meshesha
Global Health: Science and Practice February 2024, 12(1):e2200277; https://doi.org/10.9745/GHSP-D-22-00277
Manuel Kassaye Sibhatu
aJhpiego, Addis Ababa, Ethiopia.
bAddis Ababa University, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: manuelcircle{at}gmail.com
Edlawit Mesfin Getachew
cArmauer Hansen Research Institute, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Dawit Yifru Bete
cArmauer Hansen Research Institute, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Senedu Bekele Gebreegziabher
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tsegaye Hailu Kumsa
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mulatu Birru Shagre
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Kassa Haile Merga
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Desalegn Bekele Taye
aJhpiego, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Hassen Mohammed Bashir
aJhpiego, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mikiyas Teferri Yicheneku
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wuletaw Chanie Zewude
eSaint Paul Hospital Millennium Medical College, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Akililu Alemu Ashuro
dMinistry of Health of Ethiopia, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tigistu Adamu Ashengo
aJhpiego, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Berhane Redae Meshesha
aJhpiego, Addis Ababa, Ethiopia.
eSaint Paul Hospital Millennium Medical College, Addis Ababa, Ethiopia.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
PreviousNext
  • Article
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF
Loading

Key Findings

  • In both public and private health facilities in Ethiopia, more than 84% of operating tables were functional. However, surgical system efficiency was low at an average productivity of 2 surgeries per operating room table per day.

  • Predefined surgical incision start time, a strong predictor of operative productivity, was reported in only 31% of facilities. Of the surgery incision times audited, nearly 20% were delayed.

  • First-case incision start times before 9:00 am had a significant association with shorter in-hospital surgery wait times.

Key Implication

  • Health organizations should monitor the productivity of surgical systems and introduce efficiency optimization tools to improve the timeliness and safety of surgical care.

ABSTRACT

Background:

Global and local health organizations track surgical system efficiency to improve surgical system performance using various efficiency metrics, such as operating room (OR) output, surgical incision start time (SIST), turnover time (TOT), cancellation rate among elective surgeries, and in-hospital surgery wait time. We evaluated the surgical system efficiency and factors affecting the efficiency in health facilities across Ethiopia.

Methods:

A cross-sectional study design with retrospective record review was used to evaluate the surgical system efficiency in 163 public and private health facilities in Ethiopia from December 2020 to June 2021. Experienced, trained surgical clinicians abstracted efficiency data from service registers and patient charts using a pretested tool. A bivariable and multivariable regression analysis was conducted.

Results:

In the study facilities, 84.11% of the operating tables were functional, and 68,596 major surgeries were performed. The aggregate OR output in both public and private health facilities was 2 surgeries per day per OR table. Operating productivity was shown to be affected by first-case SIST (P=.004). However, of the total 881 surgery incision times audited, 19.86% of the first-of-the-day elective surgeries started after 10:01 am. The SIST was strongly associated with an in-hospital wait time for surgery (P=.016). The elective surgery cancellation rate was 5.2%, and aggregate mean TOT was 50.25 minutes. The mean in-hospital surgery wait time was 45.40 hours, longer than the national cutoff for wait time. In a bivariable analysis, the independent variables that demonstrated association operating room productivity were then inputted into a multivariable regression analysis model. However, none of the predictor/independent variables showed significance in the multivariable regression analysis model.

Conclusion:

The volume of surgery and overall OR productivity in Ethiopia is low. This calls for concerted action to optimize OR efficiency and improve access to timely and safe surgical care in Ethiopia and other LMICs.

INTRODUCTION

To meet universal health coverage targets, countries need to invest more to enhance health care quality dimensions and accelerate access to safe, efficient, and affordable surgical care to reduce the disproportionately high mortality and morbidity rates associated with poor quality and lack of utilization of surgical care.1,2 Though the volume of surgery is growing worldwide, the safety and timeliness of care have not been optimized. Many low- and middle-income countries lag in meeting the global target for emergency and essential surgical care (i.e., 5,000 surgeries per 100,000 population per annum).3 Improving performance efficiency within the surgical care delivery system is one of the major potential ways to increase timely access to surgical care and eventually reduce the high surgical mortality and morbidity.4,5 The analysis by Jordi et al. of progress in countries meeting universal health coverage goals emphasized that an efficient health system is key for using resources, however insufficient, to positively impact health outcomes.6

Additionally, given that efficiency of care is a health care quality dimension, health facilities might benefit from closely monitoring system efficiency indicators. Perioperative (pre-surgery, intra-surgery, and post-surgery) system performance measures include surgical volume, operating room (OR) output, cancellation of elective surgeries, in-hospital wait time, first case on time, and patient turnover time (TOT), among other performance indicators (Table 1).6,7

View this table:
  • View inline
  • View popup
TABLE 1.

Key Surgical System Efficiency Indicators Adapted From the Saving Lives Through Safe Surgery Program in Ethiopia, 2016–2020

The Ministry of Health of Ethiopia’s national surgical care strategy (2016–2020) aimed to improve the quality and operational standards for the delivery of surgical care and defined surgical system performance metrics. However, no nationwide evaluation has been conducted to study the surgical system performance in public and private health facilities across Ethiopia. The few facility-based quality improvement reviews that have been conducted missed several efficiency metrics and suffered from national representation or generalization. Thus, the Ministry of Health and collaborating partners evaluated surgical system efficiency to document the overall surgical system performance and pinpoint the major factors influencing operative productivity in public and private health facilities. The evidence may inform future efforts to improve access to efficient surgical care. Lastly, quality improvement often fails due to poor implementation. A systematic review of quality improvement interventions by White et al. emphasized the need to strengthen the implementation strategies to further enhance the safety and quality of perioperative care.8,9

Surgical system efficiency was evaluated to document the system performance and pinpoint factors that influence operative productivity.

METHODS

To expand access to timely and safe surgical care, Ethiopia implemented a 5-year surgical care strategy (2016–2020) and the Saving Lives Through Safe Surgery program. Key surgical system performance indicators were tracked from the national DHIS2 in public health facilities across the country.

Study Design and Targets

A facility-based cross-sectional study design with retrospective record review was conducted to evaluate the OR performance and overall surgical system efficiency in 163 public and private health facilities in Ethiopia from December 2020 to June 2021.

Sampling Procedure and Sample Size

A multistage stratified random sampling technique was used to recruit public and private health facilities. The required minimum sample size was calculated based on a single population proportion formula, (n=z2pq/e2/1+(z2pq/e2*N), for a finite population with a 50% population proportions, 5% margin of error, and 95% level of confidence. Of the total of 282 public health facilities that provided surgical care and routinely reported to the national DHIS2, 26 were specialized hospitals, 75 were general hospitals, and 181 were public primary health care units (PHCUs), of which there were 172 primary hospitals and 9 health center OR blocks. From a pool of health facilities that provided surgical care and routinely reported to the DHIS2, 163 public health facilities were sampled. The sample size for each stratum of PHCUs was calculated using the proportion-to-size allocation method and distributed as 15 specialized hospitals, 43 general hospitals, and 105 primary hospitals.

All sample health facilities that provided surgical care, reported to the national DHIS2, and presented records of the surgeries performed for the 90 days before data extraction were included. All minor surgeries and health facilities that did not provide elective (nonemergent) surgical care were excluded.

Because private facilities with surgical services did not implement the national Saving Lives Through Safe Surgery program and were not reporting surgical care performance data in the DHSI2 report, 45 private health facilities providing surgical care were also enlisted. Of those, 40 private health facilities were purposively selected, making a total of 203 (163 public and 40 private) sample study facilities recruited (Figure).

FIGURE
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE

Sampling Process Applied in Evaluation of Surgical System Efficiency and Operative Productivity in Sample Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

Initially, the study included 172 health facilities to evaluate (which accounted for 84.7% of the estimated initial sample size of 203), but 9 health centers with OR blocks were excluded from efficiency analysis due to lack of elective surgery service and data, leaving a total of 163 total facilities evaluated (131 public and 32 private health facilities). Each hospital from each stratum was selected by a simple lottery method. However, due to internal conflict and limited transport accessibility in some parts of Ethiopia, it was not feasible to access all randomly selected health facilities. Consequently, some health facilities were replaced with suitable alternatives under the assumption of homogeneity within the same stratum. Because of travel restrictions in conflict zones in Tigray region, only a few study facilities were included in the aggregate analysis.

Data Variables

The key dependent efficiency variables are OR productivity or surgical volume. Independent variables include functionality of the OR, surgical incision start time (SIST), TOT, cancellation rate, and in-hospital surgery wait time (Table 1).

Data Collection Tools and Procedure

The data collection tool, adapted from the World Health Organization’s Surgical Assessment Tool, was pretested and used to capture the required data.10 The routine DHIS2 surgical care service database was used to abstract surgical data for public health facilities. In both public and private health facilities, surgical registers, patient charts, and audit reports were reviewed. Key efficiency data (surgical volume, OR output, first-case SIST, TOT, cancellation rate, and in-hospital wait time) were collected for the 90 days before record review. The OR output data were collected for the 10 days before data collection.

Thirteen experienced surgical clinicians were trained to abstract efficiency data from the DHIS2 database, surgical service registers, patient charts, and quality audit reports. During data collection, precautionary measures recommended to prevent COVID-19 transmission, such as wearing a face mask, using hand sanitizers, and maintaining physical distance, were observed.

Data Analysis

Data were checked on a weekly basis for completeness, correctness, and consistency and archived. Data were cleaned and entered into a Redcap study database. Data were exported to Stata 15 software for computing descriptive statistics (proportion, mean with standard deviation, and median with interquartile range) and compared to categorical variables by running a chi-square test. Statistical significance was declared at P<.05. A bivariable analysis was conducted, and the independent variables that demonstrated association with the dependent variable, OR productivity, were inputted into a multivariable regression analysis model. The type of health facility, level of care (primary and nonprimary health facility), and incision time were omitted from the multivariable analysis for collinearity reasons.

Ethical Approval

Ethical clearance was secured from the Armauer Hansen Research Institute Institutional Review Board (AHRI PO/35/20]. The Ministry of Health of Ethiopia issued a letter of support to study regions and health facilities.

RESULTS

Health Facility Characteristics

In total, the study evaluated 163 sampled health facilities for the efficiency of surgical systems, comprising 80.30% (n=131) public and 19.63% (n=32) private health facilities. When disaggregated by level of care, public primary hospitals (47.23%, n=77) accounted for the majority of the study facilities.

Operative Productivity

The surgery OR output per OR table was estimated based on the surgery volume for 10 days and showed that an average of 2 major surgeries were performed per table per day. Public specialized hospitals and private facilities contributed to 45.06% (n=4,104) and 18.27% (n=1,664), respectively (Table 2). The independent variables that showed association in a bivariable analysis were input to a multivariable regression analysis model; however, none of the predictor/independent variables showed significance.

View this table:
  • View inline
  • View popup
TABLE 2.

Surgical Operative Productivity in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

Functional Operating Tables

In the study facilities, 84.11% (482 of 573) of the operating tables were functional, and a total of 68,596 major surgeries were performed. Private hospitals performed 17.62% of these surgeries. Public specialized hospitals ran the highest number of functioning ORs with an average size of 8 tables per each public specialized hospital (Table 3).

View this table:
  • View inline
  • View popup
TABLE 3.

Characteristics of Select Surgical Inputs in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021a

Public specialized hospitals ran the highest number of functioning ORs with an average size of 8 tables per each public specialized hospital.

Surgical Incision Start Time of the First Surgery

Only 31.29% (51 of 163) of the study facilities posted a SIST for the first elective surgery in a working day. However, of the total 881 surgery incision times audited, 19.86% (n=175) of the first-of-the-day elective surgeries were started late after 10:01 am, while 33.82% (n=298) of the surgeries had their incision time between 6:00 am and 8:30 am. The proportion of facilities with a predefined operation start time was high in public generalized and specialized hospitals, 42.11% and 56.25%, respectively (Table 4).

View this table:
  • View inline
  • View popup
TABLE 4.

Surgical Incision Start Time for the First Patients of an Operation Day in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

Turnover Time

The aggregate average TOT computed from 305 consecutive patient-pairs (a total of 610 surgeries) was 50.25 minutes, and 48.52% (n=296) of the turnovers were completed within 30 minutes, while 11.47% (n=70) took longer than 90 minutes. TOT varied by type of facility; public hospitals had shorter TOT, 40.24–40.5 minutes, than private hospitals, 79.52 minutes (Table 5).

View this table:
  • View inline
  • View popup
TABLE 5.

Turnover Time Between Consecutive Elective Surgeries in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

In-Hospital Surgery Wait Time

Only 45.93% of the study health facilities routinely reported on in-hospital surgery wait time, and the mean wait time was 45.40 hours. The mean wait time varied by the level of health care; the longest mean wait time was observed in public generalized hospitals, 68.36 hours, while the shortest mean wait time was recorded in private hospitals, 18.33 hours (Table 6).

View this table:
  • View inline
  • View popup
TABLE 6.

In-Hospital Waiting Time for Elective Surgeries in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

Cancellation Rate

The aggregate elective surgery cancellation rate abstracted from facility self-report archived in the national DHIS2 database was 5.2% (ranging from 2.8% to 7.7%). The cancellation rate disaggregated by level of care ranges from 2.5% (ranging from 0.5% to 5.6%) in private hospitals to 14.6% (ranging from 6.1% to 22.9%) in public specialized hospitals.

Analysis of Factors and Their Associations With Operating Room Productivity

Surgical Incision Start Time

The presence of a predefined SIST was associated with an optimum OR productivity (P=.004) (Table 7). It was also shown that first-case incision started before 9:00 am had a significant association with shorter surgery wait times (P=.016) (Table 8).

View this table:
  • View inline
  • View popup
TABLE 7.

Association Between Operating Room Productivity and Presence/Absence of Predefined Surgical Incision Start Time for the First Patient in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

View this table:
  • View inline
  • View popup
TABLE 8.

Association Between In-Hospital Surgery Wait Time and Surgical Incision Start Time in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

In-Hospital Surgery Wait Time

Short in-hospital surgery wait time was not associated with optimum operative productivity (P=.673) (Table 9).

View this table:
  • View inline
  • View popup
TABLE 9.

Association Between Operative Productivity and In-Hospital Surgery Wait Time in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

Turnover Time

No association was demonstrated between operative performance and the TOT between successive surgeries (P=.981) (Table 10).

View this table:
  • View inline
  • View popup
TABLE 10.

Association Between Operative Productivity and Turnover Time Between Successive Surgeries in Public and Private Health Facilities in Ethiopia, December 2020 to June 2021

DISCUSSION

OR output is a strong predictor of surgical system efficiency and an indirect measure of timeliness of access to surgical care.11 In this study, despite the functionality of the ORs (84.11%), the surgical system efficiency and OR output in both public and private health facilities in Ethiopia is low, with an aggregate average of 2 surgeries per day per OR table. Low operative output can result from a loss of efficiency due to distractions, interruptions, and disruptions during emergency surgeries and a surgical climate that may impact operative efficiency.12 In their prospective review of operative efficiency of 299 surgeries conducted in Australian hospitals, Wallace et al. indicated that a significant proportion of OR time was spent on nonoperative tasks, and time spent for surgical preparation represented 42.4% (37.28 minutes), operating time 40.1% (35.28 minutes), and finishing-up time 17.5% (15.43 minutes).13

Despite the functionality of the ORs, the surgical system efficiency and OR output in both public and private health facilities is low.

Compared to public specialized and general hospitals, public primary and private health facilities performed the lowest number of surgeries. Additionally, the study documented a longer patient TOT, 79.52 minutes, in private health facilities. Some of the explanations for the high performance of public specialized tertiary-level care facilities could be the availability of a relatively higher number and mix of surgical professionals, the availability of intensive care unit setup, established hospital and surgical management system and leadership practices, and a lower cost of surgical care, among other factors.

In contrast, private health facilities scored favorably for demonstrating the lowest cancellation rate and in-hospital wait time for surgery. Although this study did not investigate other factors that influence the OR productivity in private health settings, the possible reasons may include but are not limited to criteria for admission of surgical cases, type of surgery performed, availability of a multidisciplinary surgical team, fear of legal litigation, and access to blood and blood products.

Here, one could argue that potentials in primary and private facilities could be met by addressing the bottlenecks of productivity. This agrees with a technical efficiency analysis conducted in Ethiopia by Mann et al. that evaluated the minimum level of resources for a unit of service output, in this case, surgical volume, and presented that only 29% of the 24 primary hospitals were technically efficient. The average pure technical efficiency score among the inefficient primary hospitals was 55%, implying that, on average, the inefficient primary hospitals could reduce their input by 45% without reducing output.14

OR productivity is influenced by an interplay of multiple independent factors that may be interrelated. Select independent variables demonstrated a strong association in a bivariable analysis but lacked significance in a multivariable regression analysis. This could be due to several reasons, including small sample size, the nature of independent variables, or other factors that may impact the multivariable association. This may call for robust research that includes a larger sample size and controls confounding factors.

Surgical Incision Start Time Was Associated With Operative Productivity

This study demonstrated a strong association between SIST and OR productivity (P=.004). It is alarming to note that most health facilities lacked a predefined incision start time and that nearly one-fifth of the surgeries were delayed (i.e., first-case incision performed after 10:00 am). Delay in operation start time is not uncommon in Ethiopian surgical settings. For example, Samuel et al. prospectively studied 933 elective surgeries performed in a tertiary hospital in Ethiopia and found that the elective surgery start time was delayed in 93.40% of cases with a mean start time of 9:41±60 minutes.15 Another study of the performance of 9 ORs in a tertiary teaching hospital in Addis Ababa by Tiruneh et al. reported an average delay of 43 minutes from the agreed 8:00 am, and only 2.50% of the operations were started as per the schedule communicated before the surgery.16

The literature described multiple interrelated factors to explain delays in surgery start time and overall OR productivity. Wright et al. reported surgeon and anesthesiologist unavailability and lack of preparedness of patients as the most common reasons for not starting on time.17,18 Team briefings and motivation may also play a role in the overall productivity of the OR. Martin et al. published evaluation results of a pre-OR safety briefing and a modest performance pay incentive for on-time starts (>90% compliance) for surgeons at a Veterans Affairs Medical Center. Before implementing either the pre-OR briefing or pay incentive, only 15% of cases started on time, and after implementation, 72% of cases started on time (P<.001). This initiative not only significantly improved OR utilization but also reduced unnecessary costs.19 Of note, the study’s tertiary-level teaching hospitals performed a higher number of elective surgeries during off-peak shift hours, between 6:00 am and 8:30 am. This could be because tertiary teaching hospitals have more surgical staff during off-work hours and may receive more case referrals and emergencies from other health facilities.

Turnover Time and Cancellation Rate Were Not Associated With Operating Room Productivity

Compared to the national recommended standard of 30 minutes, the mean aggregate TOT computed in this study of 50.25 minutes was much longer. A TOT of more than 30 minutes may indicate a loss of surgical process efficiency or a waste of resources. However, the TOT was not associated with OR productivity in this study setting. The possible reasons for loss of efficiency from an extended TOT could arise from a lack of standardization of surgical processes, ineffective communication across a multidisciplinary surgical team, weak accountability, rotation of the surgical team, and inadequate cleaning supplies. According to a retrospective review by Kwadwo et al. of 2,714 surgeries, consecutive surgeries performed by the same surgical team produced a significantly lower TOT (P<.0001), and it is highly recommended to perform consecutive elective surgeries by the same OR team.20 Further study on local factors influencing TOT and feasible strategies for optimizing transition time between operational processes could be rewarding.21,22

The aggregate cancellation rate of 5.20% obtained in this study was lower than the rate reported by other studies conducted in Ethiopia and other resource-limited settings. This could be because the initial part of the study period overlapped with the onset of the COVID-19 pandemic, and the number of elective surgeries scheduled, and overall surgical volume documented in the early phases of the pandemic was on the lowest side compared to the pre-pandemic period. A systematic review and meta-analysis of surgery cancellation in Ethiopia by Birhanu et al. estimated a pooled cancellation prevalence of 21.41% (95% confidence interval=12.75, 30.06) based on studies that involved 5,591 surgeries.23 Likewise, Feleke et al. documented a 25.6% cancellation rate among the 326 surgical patient schedules for elective surgery,24 and other tertiary-level care teaching hospitals in Ethiopia showed even higher cancellation rates of 33.90% and 35.80%.25

High cancellation rates remain a concern for surgical settings in both low-income and high-income countries. In Burkina Faso, Lankoande et al. proactively evaluated the incidence of elective surgery cancellation in a teaching hospital and showed that 36.90% (38 of 103) of surgeries were delayed, of which 9.70% (n=10) were canceled and another 27.20% (n=28) were delayed. Hospital-related cancellation accounted for 63.90%. The authors also argued that cancellations were avoidable in 68.5% of cases.26

In our study, the more common reported reasons for cancellation were grouped under medical reasons (e.g., patient unfit and reported acute illness) and shortage of blood and blood products, 35% and 25%, respectively. Additional reasons for cancellation were delayed COVID-19 test turnaround time, 4.48% (n=7); interrupted water supply, 3.21% (n=5); interrupted oxygen supply, 1.90% (n=3); and interrupted electric power supply, 1.28% (n=2).

A study in Tikur Anbessa Specialized Hospital in Ethiopia, where 35.8% of elective surgeries were canceled, reported that the most common reasons for cancellation were inadequate OR time and lack of patient preparation, 8.70% and 7.70%, respectively.15 Feleke et al. argued that surgical cancellations were primarily due to patient-related and administrative factors, 31.32% and 26.5%, respectively.24 Dhafar et al. retrospectively audited a total of 120 ORs in 25 hospitals in Saudi Arabia and reported that among the 7.60% (1,238 of 16,211) surgeries canceled, the major contributing factors were related to the patient (42.81%), facility (20.03%), and incomplete work-up (9.45%).27 In these studies, the medical and patient-related reasons accounted for 13.90% and 13.34%, respectively.23,28,29

Sadly, according to an integrative surgical literature review by Narmeen et al., most cancellations were avoidable.30

In-Hospital Surgery Wait Time Was Significantly Associated With First-Case Incision Time

This study demonstrated that the duration of in-hospital wait time is significantly associated with the first-case incision start time (P=.016). However, though other studies have indicated that in-hospital wait time is a strong predictor of surgical efficiency, there was no strong association between the in-hospital wait time and OR productivity (P=.673). Of those facilities that reported wait times, the observed mean wait time, 45.4±9.25 hours, was much longer than the national limit of 24 hours. The unnecessarily long in-hospital delay in public specialized hospitals may be partially explained by the high rate of surgery cancellations in those hospitals (14.6%) and the burden that tertiary-level care hospitals shoulder in terms of high bed occupancy by sizable proportion of surgical admissions and case referrals. Unfortunately, in-hospital emergency and elective surgical delays are not uncommon in resource-limited settings. In Malawi, Maine et al. showed that 281 of 764 (36.80%) emergency surgeries were delayed.31 Although the factors contributing to delays could be many and interrelated, a prospective observational study by Ray and Kirtania on wait time in India presented that the client’s age, physical fitness, and economic stature were factors significantly influencing wait time (P<.05).32

This study demonstrated that the duration of in-hospital wait time is significantly associated with the first-case incision start time.

Impact of Inefficient Surgical Systems on Quality of Care and Patient Safety

Inefficient surgical systems not only affect the targets set for addressing the huge unmet need for essential and emergency surgical care in low- and middle-income countries but also jeopardize patient safety.7,33,34 For example, Maine et al. reviewed 764 emergency surgeries in Malawi to show that a delay of surgery of more than 24 hours was associated with increased risk of surgical complications, including generalized peritonitis (relative risk=4.49; 95% confidence interval=1.69, 11.95; P=.005) and gastrointestinal perforation (relative risk=3.73, 95% confidence interval=1.25, 11.08; P=.018), and an increased risk of mortality.31

This warrants a renewed commitment to strengthening the safety and quality of perioperative care and introducing effective implementation strategies. At times, lack of agreement on efficiency indicators makes comparison of research findings on system efficiency very challenging, and further research on performance efficiency metrics and determinant factors is highly encouraged.35

Strengths and Limitations

This was the first nationwide evaluation of surgical system efficiency and OR productivity in public and private surgical facilities at all levels of health care in Ethiopia.

Because this evaluation may not include every system efficiency metric for pre-surgery, intra-surgery, and post-surgery processes and lacks a qualitative study component, deeper insights into the factors influencing surgical system efficiency may not be captured well. This may make generalizability of some of the findings less applicable in other surgical care settings. Though significant efforts were made to minimize facility selection bias, the omission of sample facilities in conflict and war zones and subsequent replacement by other similar facilities, as well as the interruption of surgical due to the COVID-19 pandemic, may have introduced some bias.

The initial phase of the study period overlapped with the onset of the COVID-19 pandemic, and the number of elective surgeries scheduled and performed has declined compared to the pre-COVID-19 period. However, in the later phases of the data collection period, health facilities introduced a surgical backlog clearance mechanism to maintain and increase surgical performance.

CONCLUSIONS AND RECOMMENDATION

Though a majority of the ORs were functional, the surgical system efficiency in both public and private health facilities was low. OR productivity was affected by several factors, including SIST, patient TOT, cancellation rate, and in-hospital wait time.

OR productivity is strongly associated with having an agreement on the specific or defined time for starting an operation and in-hospital wait time. Further, first-case incision start time is strongly associated with in-hospital wait time for surgery. Therefore, facilities need to set the incision start time, continuously track operation start and end times and other efficiency metrics, and enhance compliance with national perioperative care guidelines.

The inefficiency of surgical systems because of a delay in first-case surgical operation, prolonged TOT, high cancellation rate, and long in-hospital wait time for surgery in both public and private health facilities calls for immediate action. If inefficiencies could be corrected, the larger investment in infrastructure, supplies, and even human resources could increase the return on investment made by the Government of Ethiopia. Inefficiencies and preventable delays need to be investigated further.

We recommend team-based efficiency optimization strategies and continuous monitoring of operating performance and patient safety across facilities.

Acknowledgments

We would like to thank the Ministry of Health and health bureau surgical case teams, facility leadership, surgical teams, data management personnel, and others who assisted with the design, coordination, or execution of the evaluation activities.

Funding

The Ministry of Health of Ethiopia and Jhpiego Ethiopia provided financial and technical support through funding from UBS Optimus Foundation (Grant No. 48297) and other Ministry of Health funds. Armauer Hansen Research Institute provided technical support.

Author contributions

MKS led the evaluation design, execution, and write-up of the article. MKS and WCZ developed the evaluation protocol and tools. THK, EMG, BRM, and MTY cleaned, analyzed, and presented the data. MKS, EMG, DYB, and BRM developed the article. SBG, MBS, KHM, DBT, HMB, WCZ, AAA, and TAA provided technical inputs on the presentation and interpretation of results and discussion in the article. All authors reviewed the final version of this article.

Competing interests

None declared.

Notes

Peer Reviewed

First published online: February 9, 2024.

Cite this article as: Sibhatu MK, Getachew EM, Bete DY, et al. Surgical system efficiency and operative productivity in public and private health facilities in Ethiopia: a cross-sectional evaluation. Glob Health Sci Pract. 2024;12(1):e2200277. https://doi.org/10.9745/GHSP-D-22-00277

  • Received: September 6, 2022.
  • Accepted: December 19, 2023.
  • Published: February 28, 2024.
  • © Sibhatu et al.

This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly cited. To view a copy of the license, visit https://creativecommons.org/licenses/by/4.0/. When linking to this article, please use the following permanent link: https://doi.org/10.9745/GHSP-D-22-00277

REFERENCES

  1. 1.↵
    1. Kruk ME,
    2. Gage AD,
    3. Joseph NT,
    4. Danaei G,
    5. García-Saisó S,
    6. Salomon JA
    . Mortality due to low-quality health systems in the universal health coverage era: a systematic analysis of amenable deaths in 137 countries. Lancet. 2018;392(10160):2203–2212. doi:10.1016/S0140-6736(18)31668-4. pmid:30195398
    OpenUrlCrossRefPubMed
  2. 2.↵
    1. Kruk ME,
    2. Gage AD,
    3. Arsenault C, et al
    . High-quality health systems in the Sustainable Development Goals era: time for a revolution. Lancet Glob Health. 2018;6(11):e1196–e1252. doi:10.1016/S2214-109X(18)30386-3. pmid:30196093
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Weiser TG,
    2. Regenbogen SE,
    3. Thompson KD, et al
    . An estimation of the global volume of surgery: a modelling strategy based on available data. Lancet. 2008;372(9633):139–144. doi:10.1016/S0140-6736(08)60878-8. pmid:18582931
    OpenUrlCrossRefPubMed
  4. 4.↵
    Ethiopia. Ministry of Health (MOH); Health Service Quality Directorate; Armauer Hansen Research Institute; Jhpiego. Evaluation of the Five-year National Safe Surgery Strategy and the Saving Lives Through Safe Surgery (SaLTS I) Program in Ethiopia (2016–2020): A Nationwide Evaluation. MOH; 2021. Accessed January 4, 2024. http://www.dataverse.nipn.ephi.gov.et/handle/123456789/1660
  5. 5.↵
    Institute of Medicine (US) Committee on Quality of Health Care in America. Crossing the Quality Chasm: A New Health System for the 21st Century. National Academies Press (US); 2001. Accessed January 4, 2024. https://www.ncbi.nlm.nih.gov/books/NBK222274/
  6. 6.↵
    1. Jordi E,
    2. Pley C,
    3. Jowett M,
    4. Abou Jaoude GJ,
    5. Haghparast-Bidgoli H
    . Assessing the efficiency of countries in making progress towards universal health coverage: a data envelopment analysis of 172 countries. BMJ Glob Health. 2020;5(10):e002992. doi:10.1136/bmjgh-2020-002992. pmid:33115858
    OpenUrlAbstract/FREE Full Text
  7. 7.↵
    1. Meara JG,
    2. Leather AJM,
    3. Hagander L, et al
    . Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet. 2015;386(9993):569–624. doi:10.1016/S0140-6736(15)60160-X. pmid:25924834
    OpenUrlCrossRefPubMed
  8. 8.↵
    1. White MC,
    2. Ahuja S,
    3. Peven K, et al
    . Scaling up of safety and quality improvement interventions in perioperative care: a systematic scoping review of implementation strategies and effectiveness. BMJ Glob Health. 2022;7(10):e010649. doi:10.1136/bmjgh-2022-010649. pmid:36288819
    OpenUrlAbstract/FREE Full Text
  9. 9.↵
    1. Brima N,
    2. Morhason-Bello IO,
    3. Charles V,
    4. Davies J,
    5. Leather AJM
    . Improving quality of surgical and anaesthesia care in sub-Saharan Africa: a systematic review of hospital-based quality improvement interventions. BMJ Open. 2022;12(10):e062616. doi:10.1136/bmjopen-2022-062616. pmid:36220318
    OpenUrlAbstract/FREE Full Text
  10. 10.↵
    1. Iverson KR,
    2. Ahearn O,
    3. Citron I, et al
    . Development of a surgical assessment tool for national policy monitoring & evaluation in Ethiopia: a quality improvement study. Int J Surg. 2020;80:231–240. doi:10.1016/j.ijsu.2020.03.025. pmid:32198096
    OpenUrlCrossRefPubMed
  11. 11.↵
    1. Ubiali A,
    2. Perger P,
    3. Rochira A, et al
    . Operating room efficiency measurement made simple by a single metric. Ann Ig. 2021;33(1):100–102. doi:10.7416/ai.2021.2411. pmid:33354699
    OpenUrlCrossRefPubMed
  12. 12.↵
    1. Mcmullan RD,
    2. Urwin R,
    3. Gates P,
    4. Sunderland N,
    5. Westbrook JI
    . Are operating room distractions, interruptions and disruptions associated with performance and patient safety? A systematic review and meta-analysis. Int J Qual Health Care. 2021;33(2):mzab068. doi:10.1093/intqhc/mzab068. pmid:33856028
    OpenUrlCrossRefPubMed
  13. 13.↵
    1. Wallace L,
    2. Muir M,
    3. Romano L,
    4. Wyllie T,
    5. Gyomber D,
    6. Hodgson R
    . Assessing operating theatre efficiency: a prospective cohort study to identify intervention targets to improve efficiency. ANZ J Surg. 2021;91(11):2382–2388. doi:10.1111/ans.16991. pmid:34075673
    OpenUrlCrossRefPubMed
  14. 14.↵
    1. Mann C,
    2. Dessie E,
    3. Adugna M,
    4. Berman P
    . Measuring Efficiency of Public Primary Hospitals in Ethiopia. Resource Tracking and Management Project, Primary Health Care Cost Study Paper 4. Harvard T.H. Chan School of Public Health/Federal Democratic Republic of Ethiopia Ministry of Health; 2017. Accessed January 4, 2024. https://dokumen.tips/documents/measuring-efficiency-of-public-primary-hospitals-in-ethiopia-vi-terms-deffinitions.html
  15. 15.↵
    1. Negash S,
    2. Anberber E,
    3. Ayele B, et al
    . Operating room efficiency in a low resource setting: a pilot study from a large tertiary referral center in Ethiopia. Patient Saf Surg. 2022;16(1):3. doi:10.1186/s13037-021-00314-5. pmid:34996487
    OpenUrlCrossRefPubMed
  16. 16.↵
    1. Tiruneh AG,
    2. Ademe Y,
    3. Zeru HA,
    4. Leake T,
    5. Bekele PA
    . Operating room efficiency in a tertiary center in Ethiopia. Ethiop Med J. 2022;60(2). Accessed January 4, 2024. https://www.emjema.org/index.php/EMJ/article/view/1945
  17. 17.↵
    1. Wright JG,
    2. Roche A,
    3. Khoury AE
    . Improving on-time surgical starts in an operating room. Can J Surg. 2010;53(3):167–170. pmid:20507788
    OpenUrlAbstract/FREE Full Text
  18. 18.↵
    1. Phieffer L,
    2. Hefner JL,
    3. Rahmanian A, et al
    . Improving operating room efficiency: first case on-time start project. J Healthc Qual. 2017;39(5):e70–e78. doi:10.1097/JHQ.0000000000000018. pmid:26991350
    OpenUrlCrossRefPubMed
  19. 19.↵
    1. Martin L,
    2. Langell J
    . Improving on-time surgical starts: the impact of implementing pre-OR timeouts and performance pay. J Surg Res. 2017;219:222–225. doi:10.1016/j.jss.2017.05.092. pmid:29078885
    OpenUrlCrossRefPubMed
  20. 20.↵
    1. Sarpong K,
    2. Kamande S,
    3. Murray J, et al
    . Consecutive surgeon and anesthesia team improve turnover time in the operating room. J Med Syst. 2022;46(3):16. doi:10.1007/s10916-022-01802-6. pmid:35089430
    OpenUrlCrossRefPubMed
  21. 21.↵
    1. Mazzei WJ
    . Operating room start times and turnover times in a university hospital. J Clin Anesth. 1994;6(5):405–408. doi:10.1016/S0952-8180(05)80011-X. pmid:7986513
    OpenUrlCrossRefPubMed
  22. 22.↵
    1. Tagge EP,
    2. Thirumoorthi AS,
    3. Lenart J,
    4. Garberoglio C,
    5. Mitchell KW
    . Improving operating room efficiency in academic children’s hospital using Lean Six Sigma methodology. J Pediatr Surg. 2017;52(6):1040–1044. doi:10.1016/j.jpedsurg.2017.03.035. pmid:28389078
    OpenUrlCrossRefPubMed
  23. 23.↵
    1. Birhanu Y,
    2. Endalamaw A,
    3. Adu A
    . Root causes of elective surgical case cancellation in Ethiopia: a systematic review and meta-analysis. Patient Saf Surg. 2020;14(1):46. doi:10.1186/s13037-020-00271-5
    OpenUrlCrossRef
  24. 24.↵
    1. Feleke MG,
    2. Chichiabellu TY,
    3. Ayalew TL
    . Magnitude and reasons of surgery cancellation among elective surgical cases in Wolaita Sodo University Comprehensive Specialized Hospital, Southern Ethiopia, 2021. BMC Surg. 2022;22(1):300. doi:10.1186/s12893-022-01749-y. pmid:35927654
    OpenUrlCrossRefPubMed
  25. 25.↵
    1. Haile M,
    2. Desalegn N
    . Prospective study of proportions and causes of cancellation of surgical operations at Jimma University Teaching Hospital, Ethiopia. Int J Anesthesiol Res. 2015;3:87–90. doi:10.19070/2332-2780-1500022
    OpenUrlCrossRef
  26. 26.↵
    1. Lankoande M,
    2. Bonkoungou P,
    3. Traore SIS,
    4. Kabore RAF,
    5. Ouangre E,
    6. Pendeville P
    . Cancellation of elective surgical procedures in the university teaching hospital center Yalgado Ouedraogo in Burkina Faso: incidence, reasons and proposals for improvement. South African J Anaesth Analg. 2016;22(5):140–144. doi:10.1080/22201181.2016.1226539
    OpenUrlCrossRef
  27. 27.↵
    1. Dhafar KO,
    2. Ulmalki MAUA,
    3. Felemban MA, et al
    . Cancellation of operations in Saudi Arabian hospitals: incidence, reasons and suggestions for improvements. Pak J Med Sci. 2015;31(5):1027–1032. doi:10.12669/pjms.315.7932. pmid:26648980
    OpenUrlCrossRefPubMed
  28. 28.↵
    1. Desta M,
    2. Manaye A,
    3. Tefera A, et al
    . Incidence and causes of cancellations of elective operation on the intended day of surgery at a tertiary referral academic medical center in Ethiopia. Patient Saf Surg. 2018;12(1):25. doi:10.1186/s13037-018-0171-3. pmid:30154916
    OpenUrlCrossRefPubMed
  29. 29.↵
    1. Abate SM,
    2. Chekole YA,
    3. Minaye SY,
    4. Basu B
    . Global prevalence and reasons for case cancellation on the intended day of surgery: a systematic review and meta-analysis. Int J Surg Open. 2020;26:55–63. doi:10.1016/j.ijso.2020.08.006. pmid:34568611
    OpenUrlCrossRefPubMed
  30. 30.↵
    1. Al Talalwah N,
    2. McIltrot KH
    . Cancellation of surgeries: integrative review. J Perianesth Nurs. 2019;34(1):86–96. doi:10.1016/j.jopan.2017.09.012. pmid:29678319
    OpenUrlCrossRefPubMed
  31. 31.↵
    1. Maine RG,
    2. Kajombo C,
    3. Purcell L,
    4. Gallaher JR,
    5. Reid TD,
    6. Charles AG
    . Effect of in‐hospital delays on surgical mortality for emergency general surgery conditions at a tertiary hospital in Malawi. BJS Open. 2019;3(3):367–375. doi:10.1002/bjs5.50152. pmid:31183453
    OpenUrlCrossRefPubMed
  32. 32.↵
    1. Ray S,
    2. Kirtania J
    . Waiting time of inpatients before elective surgical procedures at a state government teaching hospital in India. Indian J Public Health. 2017;61(4):284–289. doi:10.4103/ijph.IJPH_210_16. pmid:29219135
    OpenUrlCrossRefPubMed
  33. 33.↵
    1. Patrick J,
    2. Puterman ML
    . Reducing wait times through operations research: optimizing the use of surge capacity. Healthc Policy. 2008;3(3):75–88. doi:10.12927/hcpol.2008.19575
    OpenUrlCrossRefPubMed
  34. 34.↵
    1. Oudhoff JP,
    2. Timmermans DRM,
    3. Knol DL,
    4. Bijnen AB,
    5. van der Wal G
    . Waiting for elective general surgery: impact on health related quality of life and psychosocial consequences. BMC Public Health. 2007;7(1):164. doi:10.1186/1471-2458-7-164. pmid:17640382
    OpenUrlCrossRefPubMed
  35. 35.↵
    1. Charlesworth M,
    2. Pandit JJ
    . Rational performance metrics for operating theatres, principles of efficiency, and how to achieve it. Br J Surg. 2020;107(2):e63–e69. doi:10.1002/bjs.11396. pmid:31903597
    OpenUrlCrossRefPubMed
PreviousNext
Back to top

In this issue

Global Health: Science and Practice: 12 (1)
Global Health: Science and Practice
Vol. 12, No. 1
February 28, 2024
  • Table of Contents
  • About the Cover
  • Index by Author
Print
Download PDF
Article Alerts
Sign In to Email Alerts with your Email Address
Email Article

Thank you for your interest in spreading the word about Global Health: Science and Practice.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Surgical System Efficiency and Operative Productivity in Public and Private Health Facilities in Ethiopia: A Cross-Sectional Evaluation
(Your Name) has forwarded a page to you from Global Health: Science and Practice
(Your Name) thought you would like to see this page from the Global Health: Science and Practice web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Surgical System Efficiency and Operative Productivity in Public and Private Health Facilities in Ethiopia: A Cross-Sectional Evaluation
Manuel Kassaye Sibhatu, Edlawit Mesfin Getachew, Dawit Yifru Bete, Senedu Bekele Gebreegziabher, Tsegaye Hailu Kumsa, Mulatu Birru Shagre, Kassa Haile Merga, Desalegn Bekele Taye, Hassen Mohammed Bashir, Mikiyas Teferri Yicheneku, Wuletaw Chanie Zewude, Akililu Alemu Ashuro, Tigistu Adamu Ashengo, Berhane Redae Meshesha
Global Health: Science and Practice Feb 2024, 12 (1) e2200277; DOI: 10.9745/GHSP-D-22-00277

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Surgical System Efficiency and Operative Productivity in Public and Private Health Facilities in Ethiopia: A Cross-Sectional Evaluation
Manuel Kassaye Sibhatu, Edlawit Mesfin Getachew, Dawit Yifru Bete, Senedu Bekele Gebreegziabher, Tsegaye Hailu Kumsa, Mulatu Birru Shagre, Kassa Haile Merga, Desalegn Bekele Taye, Hassen Mohammed Bashir, Mikiyas Teferri Yicheneku, Wuletaw Chanie Zewude, Akililu Alemu Ashuro, Tigistu Adamu Ashengo, Berhane Redae Meshesha
Global Health: Science and Practice Feb 2024, 12 (1) e2200277; DOI: 10.9745/GHSP-D-22-00277
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Statistics from Altmetric.com

Jump to section

  • Article
    • ABSTRACT
    • INTRODUCTION
    • METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS AND RECOMMENDATION
    • Acknowledgments
    • Funding
    • Author contributions
    • Competing interests
    • Notes
    • REFERENCES
  • Figures & Tables
  • Info & Metrics
  • Comments
  • PDF

Related Articles

  • No related articles found.
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

More in this TOC Section

  • A Comprehensive Strategy to Mitigate Institutional Maternal Mortality: Lessons From a Quality Improvement Initiative in Brazilian Maternity Hospitals
  • Research and Learning Priorities for a Surgical Obstetrics and Family Planning Project Implementing in Low- and Middle-Income Countries: Results of an Expert Consultation
  • Uganda Public Health Fellowship Program’s Contributions to Malaria Control Programs 2015–2022: Strategies, Implementation Challenges, and Opportunities
Show more ORIGINAL ARTICLE

Similar Articles

Subjects

  • Cross-Cutting Topics
    • Health Systems
    • Surgery
Johns Hopkins Center for Communication Programs

Follow Us On

  • LinkedIn
  • Facebook
  • RSS

Articles

  • Current Issue
  • Advance Access Articles
  • Past Issues
  • Topic Collections
  • Most Read Articles
  • Supplements

More Information

  • Submit a Paper
  • Instructions for Authors
  • Instructions for Reviewers

About

  • About GHSP
  • Advisory Board
  • FAQs
  • Privacy Policy
  • Contact Us

© 2026 Creative Commons Attribution 4.0 International License. ISSN: 2169-575X

Powered by HighWire