Development and content validation of the Safe Surgery Organizational Readiness Tool: A quality improvement study

The state of global surgery assessment and data collection tools: A scoping review

BACKGROUND

There has been a proliferation of global surgery assessment tools designed for use in low- and middle-income countries. This scoping review sought to categorize and organize the breadth of global surgery assessment tools in the literature.

METHODS

The search was conducted using PubMed from October 2022 to April 2023 according to PRISMA extension for scoping review guidelines. The search terms were (("global surgery"[All Fields]) AND ("assessment"[All Fields]) OR (data collection)). Only tools published in English that detailed surgical assessment tools designed for low- and middle-income countries were included.

RESULTS

The search resulted in 963 papers and 46 texts described unique tools that were included for the final review. Of these, 30 (65%) tools were quantitative, 1 (2%) qualitative, and 15 (33%) employed mixed-methods. 25 (54%) tools evaluated surgery in general, whereas 21 (46%) were focused on various surgical subspecialties. Qualitatively, major themes among the tools were noted. There was significant overlap of many tools.

CONCLUSIONS

Nonspecialty surgery was represented more than any specialty surgery and many specialties had little or no representation in the literature. Ideally, local leadership should be involved in surgical assessment tools. Different methodologies, such as checklists and observational studies, aimed to target varying aspects of surgery and had distinct strengths and weaknesses. Further efforts should focus on expanding tools in neglected specialties.

Building resilient surgical systems that can withstand external shocks

When surgical systems fail, there is the major collateral impact on patients, society and economies. While short-term impact on patient outcomes during periods of high system stress is easy to measure, the long-term repercussions of global crises are harder to quantify and require modelling studies with inherent uncertainty. When external stressors such as high-threat infectious disease, forced migration or climate-change-related events occur, there is a resulting surge in healthcare demand. This, directly and indirectly, affects perioperative pathways, increasing pressure on emergency, critical and operative care areas. While different stressors have different effects on healthcare systems, they share the common feature of exposing the weakest areas, at which point care pathways breakdown. Surgery has been identified as a highly vulnerable area for early failure. Despite efforts by the WHO to improve preparedness in the wake of the SARS-CoV-2 pandemic, measurement of healthcare investment and surgical preparedness metrics suggests that surgical care is not yet being prioritised by policy-makers. Investment in the 'response' phase of health system recovery without investment in the 'readiness' phase will not mitigate long-term health effects for patients as new stressors arise. This analysis aims to explore how surgical preparedness can be measured, identify emerging threats and explore their potential impact on surgical services. Finally, it aims to highlight the role of high-quality research in developing resilient surgical systems.

A practical tool for managing change: cross-sectional psychometric assessment of the safe surgery organizational readiness tool

BACKGROUND

Strengthening health systems through planned safety and quality improvement initiatives is an imperative to achieve more equitable, resilient, and effective care. And yet, years of organizational behavior research demonstrate that change initiatives often fall short because managers fail to account for organizational readiness for change. This finding remains true especially among surgical safety and quality improvement initiatives in low-income countries and middle-income countries. In this study, our aim was to psychometrically assess the construct validity and internal consistency of the Safe Surgery Organizational Readiness Tool (SSORT), a short survey tool designed to provide change leaders with insight into facility infrastructure that supports learning and readiness to undertake change.

MATERIALS AND METHODS

To demonstrate generalizability and achieve a large sample size ( n =1706) to conduct exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), a collaboration between seven surgical and anesthesia safety and quality improvement initiatives was formed. Collected survey data from health care workers were divided into pilot, exploration, and confirmation samples. The pilot sample was used to assess feasibility. The exploration sample was used to conduct EFA, while the confirmation sample was used to conduct CFA. Factor internal consistency was assessed using Cronbach's alpha coefficient.

RESULTS

Results of the EFA retained 9 of the 16 proposed factors associated with readiness to change. CFA results of the identified 9 factor model, measured by 28 survey items, demonstrated excellent fit to data. These factors (appropriateness, resistance to change, team efficacy, team learning orientation, team valence, communication about change, learning environment, vision for sustainability, and facility capacity) were also found to be internally consistent.

CONCLUSION

Our findings suggest that communication, team learning, and supportive environment are components of change readiness that can be reliably measured prior to implementation of projects that promote surgical safety and quality improvement in low-income countries and middle-income countries. Future research can link performance on identified factors to outcomes that matter most to patients.

Increasing access to pediatric surgical care: Assessing district hospital readiness in rural Rwanda

Introduction/Background

Safe and quality surgery is crucial for child health. In Rwanda, district hospitals serve as primary entry points for pediatric patients needing surgical care. This paper reports on the organizational readiness and facility capacity to provide pediatric surgery in three district hospitals in rural Rwanda.

Methods

We administered the Children's Surgical Assessment Tool (CSAT), adapted for a Rwandan district hospital, to assess facility readiness across 5 domains (infrastructure, workforce, service delivery, financing, and training) at three Partners in Health supported district hospitals (Kirehe, Rwinkwavu, and Butaro District Hospitals). We used the Safe Surgery Organizational Readiness Tool (SSORT) to measure perceived individual and team readiness to implement surgical quality improvement interventions across 14 domains.

Results

None of the facilities had a dedicated pediatric surgeon, and the most common barriers to pediatric surgery were lack of surgeon (68%), lack of physician anesthesiologists (19%), and inadequate infrastructure (17%). There were gaps in operating and recovery room infrastructure, and information management for pediatric outpatients and referrals. In SSORT interviews (n=47), the highest barriers to increasing pediatric surgery capacity were facility capacity (mean score=2.6 out of 5), psychological safety (median score=3.0 out of 5), and resistance to change (mean score=1.5 out of 5 with 5=no resistance).

Conclusions

This study highlights challenges in providing safe and high-quality surgical care to pediatric patients in three rural district hospitals in Rwanda. It underscores the need for targeted interventions to address facility and organizational barriers prior to implementing interventions to expand pediatric surgical capacity.

Addressing quality and safety in anatomic pathology in low- and middle-income countries

The World Health Organization (WHO) has created a sustainable development goal of reducing preventable mortality from cancer in low- and middle-income countries (LMICs) by 30% by 2030. Central to achieving this goal is the creation and maintenance of quality anatomic pathology services (APS). Within the last decade, quality assurance programs and patient safety measures have become a major focus of research for upper middle- and high-income countries (UMHICs), which has led to marked documented improvement in the quality of services provided by laboratories, as well as a decrease in patient safety events. We propose that as APS are developed in LMICs, the lessons learned by UMHICs are necessary to incorporate to produce quality and safe services toward obtaining the aforementioned goal. Furthermore, data suggests that Quality Improvement work requires change at the macrosystems and microsystems levels to achieve these goals. Here, we propose five "microsystems" strategies for professional organizations, healthcare institutions in LMICs and UMHICs that would accelerate quality improvement programs/systems implementation in APS in LMICs.

Implementing surgical mentorship in a resource-constrained context: a mixed methods assessment of the experiences of mentees, mentors, and leaders, and lessons learned

BACKGROUND

A well-qualified workforce is critical to effective functioning of health systems and populations; however, skill gaps present a challenge in low-resource settings. While an emerging body of evidence suggests that mentorship can improve quality, access, and systems in African health settings by building the capacity of health providers, less is known about its implementation in surgery. We studied a novel surgical mentorship intervention as part of a safe surgery intervention (Safe Surgery 2020) in five rural Ethiopian facilities to understand factors affecting implementation of surgical mentorship in resource-constrained settings.

METHODS

We designed a convergent mixed-methods study to understand the experiences of mentees, mentors, hospital leaders, and external stakeholders with the mentorship intervention. Quantitative data was collected through a survey (n = 25) and qualitative data through in-depth interviews (n = 26) in 2018 to gather information on (1) intervention characteristics including areas of mentorship, mentee-mentor relationships, and mentor characteristics, (2) organizational context including facilitators and barriers to implementation, (3) perceived impact, and (4) respondent characteristics. We analyzed the quantitative and qualitative data using frequency analysis and the constant comparison method, respectively; we integrated findings to identify themes.

RESULTS

All mentees (100%) experienced the intervention as positive. Participants perceived impact as: safer and more frequent surgical procedures, collegial bonds between mentees and mentors, empowerment among mentees, and a culture of continuous learning. Over 70% of all mentees reported their confidence and job satisfaction increased. Supportive intervention characteristics included a systems focus, psychologically safe mentee-mentor relationships, and mentor characteristics including generosity with time and knowledge, understanding of local context, and interpersonal skills. Supportive organizational context included a receptive implementation climate. Intervention challenges included insufficient clinical training, inadequate mentor support, and inadequate dose. Organizational context challenges included resource constraints and a lack of common understanding of the intervention.

CONCLUSION

We offer lessons for intervention designers, policy makers, and practitioners about optimizing surgical mentorship interventions in resource-constrained settings. We attribute the intervention's success to its holistic approach, a receptive climate, and effective mentee-mentor relationships. These qualities, along with policy support and adapting the intervention through user feedback are important for successful implementation.