Simple rules for evidence translation in complex systems: A qualitative study

Strengthening implementation of integrated care for small and nutritionally at-risk infants under six months and their mothers: Pre-trial feasibility study

An integrated care pathway to manage small and nutritionally at-risk infants under 6 months (u6m) and their mothers (MAMI Care Pathway) is consistent with 2023 WHO malnutrition guidelines and is being tested in a randomised controlled trial (RCT) in Ethiopia. To optimise trial implementation, we investigated contextual fit with key local stakeholders. We used scenario-based interviews with 17 health workers and four district managers to explore perceived feasibility. Eighteen policymakers were also surveyed to explore policy coherence, demand, acceptability, evidence needs, opportunities and risks. The Bowen feasibility framework and an access to health care framework were adapted and applied. Health workers perceived the MAMI Care Pathway as feasible to implement with support to access services and provide care. The approach is acceptable, given consistency with national policies, local protocols and potential to improve routine care quality. Demand for more comprehensive, preventive and person-centred outpatient care was driven by concerns about unmet, hidden and costly care burden for health services and families. Inpatient care only for severe wasting treatment is inaccessible and unacceptable. Support for routine and expanded components, especially maternal mental health, is needed for successful implementation. Wider contextual factors may affect implementation fidelity and strength. Policymakers cautiously welcomed the approach, which resonates with national commitments, policies and plans but need evidence on how it can work within varied, complex contexts without further system overstretch. A responsive, pragmatic randomised controlled trial will generate the most useful evidence for policymakers. Findings have informed trial preparation and implementation, including a realist evaluation to contextualise outcomes.

The Support Hospital Opioid Use Disorder Treatment (SHOUT) Texas program implementation strategy for expanding treatment for hospitalized adults with opioid use disorder

INTRODUCTION

In 2017, we launched the "B-Team" (buprenorphine team), the first hospitalist-led opioid use disorder (OUD) treatment program in Texas. Based on initial success, we obtained funding from Texas Health & Human Services to expand the model to other hospitals in Texas through the Support Hospital Opioid Use Disorder Treatment (SHOUT) Texas program.

METHODS

This is a mixed methods study of the implementation of the SHOUT program, which is an OUD treatment intervention, in different hospitals in Texas. Our implementation approach combined training, tailoring, and technical assistance following the Replicating Effective Programs (REP) strategy with statewide telementoring delivered via Project ECHO. To evaluate the reach, adoption, and impact of SHOUT Texas, we assessed: 1) participating hospitals (adoption); 2) patients screened for OUD (impact); 3) patients started on medications for OUD (impact); 4) patients discharged with coordinated outpatient care (impact); 5) providers and staff trained via ECHO (reach); and 6) satisfaction with ECHO training (impact). Additionally, semi-structured interviews were conducted with key stakeholders at expansion sites to identify strengths and weaknesses of the implementation strategy and supports and barriers to successful implementation. Rapid qualitative analysis was completed by a team of analysts who transcribed and summarized interviews to identify key domains of interest and emergent themes.

RESULTS

Between 2020 and 2023, the SHOUT Texas program expanded to three additional Texas hospital sites, resulting in 3065 hospitalized adult patients starting treatment for OUD. More than 2500 interprofessional clinicians (physicians, nurses, physician assistants, social workers) received SHOUT training regarding inpatient initiation of OUD treatment, with 241 attending at least one hour-long Project ECHO session. Eight key stakeholders at expansion sites were interviewed. Successful components of the SHOUT program included training resources, in-person launches, and collaboration with specialized addiction treatment subject matter experts. Challenges included identifying outpatient follow-up, pharmacy and medication constraints, and nursing education barriers. Interviews also identified lessons learned, advice to other hospitals, and next steps to build capacity.

CONCLUSIONS

Implementation of the SHOUT Texas model across diverse hospital settings using REP and Project ECHO resulted in significant provider engagement and rapid increase in the number of patients initiating OUD treatment during hospitalization. Lessons learned from this novel approach may be applicable in other states, particularly those that have not expanded Medicaid.

An integrated, multidisciplinary management team intervention to improve patient-centeredness, HIV, and maternal-child outcomes in Lesotho: formative research on participatory implementation strategies

BACKGROUND

Reducing perinatal HIV transmission and optimizing maternal and child health (MCH) outcomes in high HIV prevalence settings is an urgent, but complex, priority. Extant interventions over-emphasize individual-level provider and patient behaviors, and neglect critical health systems-level changes. The 'Integrated Management Team to Improve Maternal-Child Outcomes (IMPROVE)' study implemented a three-part, patient-centered, health-systems-level intervention to improve MCH and HIV outcomes in Lesotho. Ensuring intervention fit within the health systems context is important, but often overlooked. This manuscript describes implementation research conducted to tailor and adapt intervention implementation to optimize appropriateness, acceptability, and feasibility. It identifies resulting implementation variation across study sites and lessons learned.

METHODS

The research team reviewed intervention implementation documentation and conducted structured reflections to: 1) assess implementation strategy adaptations, 2) identify facility-specific strategies employed to improve the MCH patient experience, and 3) synthesize lessons.

RESULTS

Facility-based, integrated, multi-disciplinary management teams (MDT) were feasible and acceptable to establish through engagement with facility leadership and facilitation of a participatory training curriculum that established shared values between cadres supporting MCH, and identified facility-specific service delivery gaps and potential solutions. Ongoing MDT meetings provided coordination between facility and community-based MCH service providers to implement early ANC follow-up. Facility-specific improvement strategies included fee, staffing, and patient documentation-based changes. Piloting Positive Health, Dignity, and Prevention-focused counseling approaches resulted in tailored job aids pre-implementation. Leadership involvement was critical for improved coordination while staff turnover and competing donor priorities challenged MDT efforts.

CONCLUSIONS

IMPROVE created facility-specific adaptation opportunities through participatory intervention implementation practices. The MDTs, benefitting from leadership support, built relationships between HCW cadres, led facility-specific quality improvements, and, importantly, offered HCWs sought-after positive feedback by recognizing HCW efforts. The coordination, monitoring and cross-cadre communication functions of the MDTs supported implementation of other interventions, and may serve as a valuable platform for improving patient-centered care practices in similar settings and for other health services.

TRIAL REGISTRATION NUMBER

NCT04598958, 05 October 2020, retrospectively registered.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04598958. Registered 05 October 2020-Retrospectively registered, https://clinicaltrials.gov/ct2/show/record/NCT04598958.

Paramedic clinical practice guideline development in Australia and New Zealand: A qualitative descriptive analysis

BACKGROUND

This collaborative study by The Australasian College of Paramedicine's Clinical Practice Guidelines (CPG) Working Group aimed to examine CPG development practices in Australian and New Zealand ambulance services.

METHODS

Employing a qualitative descriptive design, the research utilised thematic analysis to extract insights from interviews with eleven experts actively involved in CPG development. The study embraced a nominalist and constructivist approach, recognising the intricate connection between individual experiences and the realities of CPG development in the paramedic field.

RESULTS

Key findings revealed significant heterogeneity in CPG development practices, emphasising a lack of formal training and a substantial reliance on existing guidelines. The study highlighted challenges in project management flexibility, limited research capacity, and inconsistencies in external consultations and resource utilisation.

CONCLUSION

The study recommends adopting project management frameworks, investing in training, and utilising evidence evaluation methodologies like GRADE. It emphasises the need for multidisciplinary teams and formal expertise in evidence synthesis, advocating for targeted training programs. Funding challenges highlight the importance of dedicated budgets and collaborative efforts for resource allocation. Knowledge translation and implementation issues underscore the significance of training programs for evidence evaluation and knowledge translation in overcoming these challenges.

If things were simple, word would have gotten around. Can complexity science help us improve pediatric research?

Complexity science is a discipline which explores how complex systems behave and how we interact with them. Though it is widely implemented outside medicine, particularly in the sciences involving human behavior, but also in the natural sciences such as physics and biology, there are only a few applications within medical research. We propose that complexity science can provide new and helpful perspectives on complex pediatric medical problems. It can help us better understand complex systems and develop ways to cope with their inherent unpredictabilities. In this article, we provide a brief introduction of complexity science, explore why many medical problems can be considered 'complex', and discuss how we can apply this perspective to pediatric research. IMPACT: Current methods in pediatric research often focus on single mechanisms or interventions instead of systems, and tend to simplify complexity. This may not be appropriate. Complexity science provides a framework and a toolbox to better address complex problems. This review provides a starting point for the application of complexity science in pediatric research.

Enhancing childhood immunization coverage in Mozambique and Malawi: Study protocol of a mixed methods evaluation of the 'Let's talk about vaccines' multisite community-based participatory project

BACKGROUND

Full coverage of childhood vaccines is a persistent challenge in low- and middle-income countries, suggesting the presence of specific contextual barriers. The emergence of the COVID-19 pandemic further worsened the situation. The complementary use of community-based participatory research (CBPR) and human-centered design (HCD) approaches has the potential to effectively create tailored interventions for improving public health outcomes. This protocol provides examples of methods to evaluate the use of these novel approaches in low- and middle-income countries. The 'Let's talk about vaccines' project is a multisite community-based participatory project by VillageReach that uses the CBPR and HCD approaches to identify the barriers and co-create interventions/solutions to address under two routine immunization access and uptake in Malawi and Mozambique.

METHODS

Guided by the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework, this evaluation prospectively evaluates the effectiveness (on under-two immunization coverage and related outcomes) of VillageReach's co-created interventions and processes of implementation (reach, adoption, implementation and maintenance) in two districts in Mozambique and two in Malawi. This paper will also describe the theory of change for VillageReach's project. Thematic analysis will be used to analyze the qualitative data, and interrupted time series analysis used to analyze the co-created interventions' effectiveness on specific under two immunization outcomes. The analysis will integrate complex systems thinking and constructs inherent in health systems strengthening.

DISCUSSION

This evaluation is an opportunity to share the use of novel and best practices, opportunities and challenges for improved community-responsive programming in routine immunization. It will be fundamental in providing evidence on the impact of interventions, evidence on mechanisms behind improvements in under- two immunization outcomes due to codesigned community-driven solutions and informing their scalability in similar contexts. Findings will inform the development of a comprehensive framework to guide the scalability of community-based approaches on childhood immunization uptake and access into similar contexts.

Navigating the future of health care with AI-driven digital therapeutics

Digital therapeutics (DTx) is a recently conceived idea in health care that aims to cure ailments and modify patient behavior by employing a range of digital technologies. Notably, when traditional medication is not entirely efficacious, DTx offers an innovative avenue for treatments linked to dysfunctional behaviors and lifestyle management. DTx involves extremely adaptable therapeutic devices that empower greater patient engagement in treating illness, using algorithms to collect, transfer and analyze the patient's data. Efficient clinical monitoring and supervision at the individual level by remote access and algorithms for a range of diseases is made possible by integrating machine learning and artificial intelligence with DTx. There is a potentially large worldwide market for DTx owing to its convenient, personalized therapies.

A decade of change towards Value-Based Health Care at a Dutch University Hospital: a complexity-informed process study

BACKGROUND

While healthcare organizations in several countries are embracing Value-Based Health Care (VBHC), there are limited insights into how to achieve this paradigm shift. This study examines the decade-long (2012-2023) change towards VBHC in a pioneering Dutch university hospital.

METHOD

Through retrospective, complexity-informed process research, we study how a Dutch university hospital's strategy to implement VBHC evolved, how implementation outcomes unfolded, and the underlying logic behind these developments. Data include the hospital's internal documents (n = 10,536), implementation outcome indicators (n = 4), a survey among clinicians (n = 47), and interviews with individuals contributing to VBHC at the hospital level (n = 20).

RESULTS

The change towards VBHC is characterized by three sequential strategies. Initially, the focus was on deep change through local, tailored implementation of multiple VBHC elements. The strategy then transitioned to a hospital-wide program aimed at evolutionary change on a large scale, emphasizing the integration of VBHC into mainstream IT and policies. Recognizing the advantages and limitations of both strategies, the hospital currently adopts a "hybrid" strategy. This strategy delicately combines deep and broad change efforts. The strategy evolved based on accumulated insights, contextual developments and shifts in decision-makers. The complexity of change was downplayed in plans and stakeholder communication. By the end of 2023, 68 (sub)departments engaged in VBHC, enabled to discuss patients' responses to Patient Reported Outcomes Measures (PROMs) during outpatient care. However, clinicians' use of PROMs data showed limitations. While pioneers delved deeper into VBHC, laggards have yet to initiate it.

CONCLUSIONS

VBHC does not lend itself to linear planning and is not easily scalable. While there appears to be no golden standard for implementation, blending local and larger-scale actions appears advantageous. Local, deep yet harmonized and system-integrated changes culminate in large scale transformation. Embracing complexity and focusing on the ultimate aims of (re)institutionalization and (re)professionalization are crucial.

The value of health service-based research to health service organisations: a qualitative study with senior health service executives

BACKGROUND

Research evidence has demonstrably improved health care practices and patient outcomes. However, systemic translation of evidence into practice is far from optimal. The reasons are complex, but often because research is not well aligned with health service priorities. The aim of this study was to explore the experiences and perspectives of senior health service executives on two issues: (1) the alignment between local research activity and the needs and priorities of their health services, and (2) the extent to which research is or can be integrated as part of usual health care practice.

METHODS

In this qualitative study, semi-structured interviews were conducted with senior health leaders from four large health service organisations that are members of Sydney Health Partners (SHP), one of Australia's nationally accredited research translation centres committed to accelerating the translation of research findings into evidence-based health care. The interviews were conducted between November 2022 and January 2023, and were either audio-recorded and transcribed verbatim or recorded in the interviewer field notes. A thematic analysis of the interview data was conducted by two researchers, using the framework method to identify common themes.

RESULTS

Seventeen health executives were interviewed, including chief executives, directors of medical services, nursing, allied health, research, and others in executive leadership roles. Responses to issue (1) included themes on re-balancing curiosity- and priority-driven research; providing more support for research activity within health organisations; and helping health professionals and researchers discuss researchable priorities. Responses to issue (2) included identification of elements considered essential for embedding research in health care; and the need to break down silos between research and health care, as well as within health organisations.

CONCLUSIONS

Health service leaders value research but want more research that aligns with their needs and priorities. Discussions with researchers about those priorities may need some facilitation. Making research a more integrated part of health care will require strong and broad executive leadership, resources and infrastructure, and investing in capacity- and capability-building across health clinicians, managers and executive staff.

'Atawhai': a primary care provider-led response to family violence in Aotearoa New Zealand

BACKGROUND

As a key determinant of ill-health, family violence is inadequately responded to within Aotearoa New Zealand health policy and practice. Without adequate system support, health professionals can often be unsure of what to do, or how to help. Developed in response to this system gap, 'Atawhai' aims to make it easier for primary care professionals to respond to family violence.

METHODS

Underpinned by indigenous Māori customs, Atawhai combines complexity theory and participatory research methodologies to be responsive to the complexity involved in family violence. We worked with 14 primary care professionals across ten whakawhitiwhiti kōrero wānanga (meetings for deliberate dialogue) to identify and develop primary care system pathways and tools for responding to family violence. This paper focuses on the development of Atawhai through wānanga and observation methods. Methods used to capture change will be reported separately.

FINDINGS

Atawhai is a relational response to family violence, focused on developing a network of trusted relationships between health and social care professionals to support safe responses to those accessing care. This study identified four key health system pathways to responsiveness and developed associated tools to support health care responsiveness to family violence. We found the quality of relationships, both among professionals and with those accessing care, coupled with critical reflection on the systems and structures that shape policy and practice are essential in generating change within primary care settings.

CONCLUSIONS

Atawhai is a unique health care response to family violence evidenced on empirical knowledge of primary care professionals. Our theoretical lens calls attention to parts of the system often obscured by current health care responses to family violence. Atawhai presents an opportunity to develop a grassroots-informed, long-term response to family violence that evolves in response to needs.

Barriers and facilitators of pharmacists' integration in a multidisciplinary home care team: a qualitative interview study based on the normalization process theory

BACKGROUND

There is a growing recognition of multidisciplinary practices as the most rational approach to providing better and more efficient healthcare services. Pharmacists are increasingly integrated into primary care teams, but there is no universal approach to implementing pharmacist services across healthcare settings. In Norway, most pharmacists work in pharmacies, with very few employed outside this traditional setting. The home care workforce is primarily made up of nurses, assistant nurses, and healthcare assistants. General practitioners (GPs) are not based in the same location as home care staff. This study utilized the Normalization Process Theory (NPT) to conduct a process evaluation of the integration of pharmacists in a Norwegian home care setting. Our aim was to identify barriers and facilitators to optimal utilization of pharmacist services within a multidisciplinary team.

METHODS

Semi-structured interviews (n = 9) were conducted with home care unit leaders, ward managers, registered nurses, and pharmacists in Norway, in November 2022-February 2023. Constructs from the NPT were applied to qualitative data.

RESULTS

Findings from this study pertain to the four constructs of the NPT. Healthcare professionals struggled to conceptualize the pharmacists' competencies and there were no collectively agreed-upon objectives of the intervention. Consequently, some participants questioned the necessity of pharmacist integration. Further, participants reported conflicting preferences regarding how to best utilize medication-optimizing services in everyday work. A lack of stakeholder empowerment was reported across all participants. Moreover, home care unit leaders and managers reported being uninformed of their roles and responsibilities related to the implementation process. However, the presence of pharmacists and their services were well received in the setting. Moreover, participants reported that pharmacists' contributions positively impacted the multidisciplinary practice.

CONCLUSION

Introducing new work methods into clinical practice is a complex task that demands expertise in implementation. Using the NTP model helped pinpoint factors that affect how pharmacists' skills are utilized in a home care setting. Insights from this study can inform the development of tailored implementation strategies to improve pharmacist integration in a multidisciplinary team.

Improving Venous Thromboembolism Prophylaxis Through Service Integration, Policy Enhancement, and Health Informatics

Introduction

Venous thromboembolism (VTE) prevention and management are susceptible issues that require specific rules to sustain and oversee their functioning, as preventing VTE is a vital patient safety priority. This paper aims to investigate and provide recommendations for VTE assessment and reassessment through policy enhancement and development.

Methods

We reviewed different papers and policies to propose recommendations and theme analysis for policy modifications and enhancements to improve VTE prophylaxis and management.

Results

Recommendations were set to enhance the overall work of VTE prophylaxis, where the current VTE protocols and policies must ensure high levels of patient safety and satisfaction. The recommendations included working through a well-organized multidisciplinary team and staff engagement to support and enhance VTE's work. Nurses', pharmacists', and physical therapists' involvement in setting up the plan and prevention is the way to share the knowledge and paradigm of experience to standardize the management. Promoting policies regarding VTE prophylaxis assessment and reassessment using electronic modules as a part of the digital health process was proposed. A deep understanding of the underlying issues and the incorporation of generic policy recommendations were set.

Conclusion

This article presents recommendations for stakeholders, social media platforms, and healthcare practitioners to enhance VTE prophylaxis and management.

Effect of implementing a heart failure admission care bundle on hospital readmission and mortality rates: interrupted time series study

This study aimed to evaluate the impact of developing and implementing a care bundle intervention to improve care for patients with acute heart failure admitted to a large London hospital. The intervention comprised three elements, targeted within 24 hours of admission: N-terminal pro-B-type natriuretic peptide (NT-proBNP) test, transthoracic Doppler two-dimensional echocardiography and specialist review by cardiology team. The SHIFT-Evidence approach to quality improvement was used. During implementation, July 2015-July 2017, 1169 patients received the intervention. An interrupted time series design was used to evaluate impact on patient outcomes, including 15 618 admissions for 8951 patients. Mixed-effects multiple Poisson and log-linear regression models were fitted for count and continuous outcomes, respectively. Effect sizes are slope change ratios pre-intervention and post-intervention. The intervention was associated with reductions in emergency readmissions between 7 and 90 days (0.98, 95% CI 0.97 to 1.00), although not readmissions between 0 and 7 days post-discharge. Improvements were seen in in-hospital mortality (0.96, 95% CI 0.95 to 0.98), and there was no change in trend for hospital length of stay. Care process changes were also evaluated. Compliance with NT-proBNP testing was already high in 2014/2015 (162 of 163, 99.4%) and decreased slightly, with increased numbers audited, to 2016/2017 (1082 of 1101, 98.2%). Over this period, rates of echocardiography (84.7-98.9%) and specialist input (51.6-90.4%) improved. Care quality and outcomes can be improved for patients with acute heart failure using a care bundle approach. A systematic approach to quality improvement, and robust evaluation design, can be beneficial in supporting successful improvement and learning.

Challenges for research uptake for health policymaking and practice in low- and middle-income countries: a scoping review

BACKGROUND

An estimated 85% of research resources are wasted worldwide, while there is growing demand for context-based evidence-informed health policymaking. In low- and middle-income countries (LMICs), research uptake for health policymaking and practice is even lower, while little is known about the barriers to the translation of health evidence to policy and local implementation. We aimed to compile the current evidence on barriers to uptake of research in health policy and practice in LMICs using scoping review.

METHODS

The scoping review followed the Preferred Reporting Items for Systematic Review and Meta-Analyses-extension for Scoping Reviews (PRISMA-ScR) and the Arksey and O'Malley framework. Both published evidence and grey literature on research uptake were systematically searched from major databases (PubMed, Cochrane Library, CINAHL (EBSCO), Global Health (Ovid)) and direct Google Scholar. Literature exploring barriers to uptake of research evidence in health policy and practice in LMICs were included and their key findings were synthesized using thematic areas to address the review question.

RESULTS

A total of 4291 publications were retrieved in the initial search, of which 142 were included meeting the eligibility criteria. Overall, research uptake for policymaking and practice in LMICs was very low. The challenges to research uptake were related to lack of understanding of the local contexts, low political priority, poor stakeholder engagement and partnership, resource and capacity constraints, low system response for accountability and lack of communication and dissemination platforms.

CONCLUSION

Important barriers to research uptake, mainly limited contextual understanding and low participation of key stakeholders and ownership, have been identified. Understanding the local research and policy context and participatory evidence production and dissemination may promote research uptake for policy and practice. Institutions that bridge the chasm between knowledge formation, evidence synthesis and translation may play critical role in the translation process.

Utilizing PRISM and RE-AIM to implement and evaluate the Rural Telementoring Training Center (RTTC) for health care workforce development in rural communities

Introduction

Amid rural health worker shortages and hospital closures, it is imperative to build and maintain the local workforce. Telementoring (TM) or technology-enabled mentoring, is a tool for improving health care quality and access by increasing workforce capacity and support. The national Rural Telementoring Training Center (RTTC) was developed to compile and disseminate TM best practices by delivering free training, tools, and technical assistance to support the implementation, sustainability, and evaluation of new and current TM programs for rural health workers. This paper details how the Practical, Robust Implementation and Sustainability Model (PRISM) was used to understand the context that shaped implementation as well as how Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) was concurrently applied to frame outcomes.

Methods

The RTTC has three implementation strategies: outreach, training and technical assistance (TTA), and a Quality Measure Toolkit. Ongoing periodic reflections with the RTTC team, informed by PRISM, were collected, as were RE-AIM outcomes. Central to this design was the continuous review of incoming data in team meetings to inform programmatic changes by identifying challenges and applying modifications to strategies in real time.

Results

Major implementation changes discussed during reflections included providing timely and relevant messaging through various platforms, streamlining and customizing a TTA approach, and offering different options for accessing the Toolkit. The outreach strategy resulted in high Reach across the US, with over 300 organizations contacted. The effectiveness of the RTTC was demonstrated by counts of people engaging with outreach (ex. over 8,300 impressions on LinkedIn), the website (over 6,400 views), and e-bursts (33% open rate). Moreover, there were 32 TTA requests and 70 people accessing the Toolkit. Adoption was demonstrated by 27 people participating in TTA and 14 individuals utilizing the Toolkit.

Discussion

The integration of PRISM and RE-AIM frameworks promoted a holistic implementation and evaluation plan. Using PRISM, the RTTC team was able to reflect on the implementation strategies through the lens of contextual factors and make rapid programmatic changes within team meetings. That process resulted in outcomes framed by RE-AIM. The integration of two frameworks in tandem provided an adaptive and comprehensive approach to implementing a large-scale, national program.

Developing a Theoretically Informed Implementation Model for Telemedicine-Delivered Medication for Opioid Use Disorder: Qualitative Study With Key Informants

BACKGROUND

Telemedicine-delivered medication for opioid use disorder (TMOUD) has become more prevalent during the COVID-19 pandemic, particularly in North America. This is considered a positive development as TMOUD has the potential to increase access to evidence-based treatment for a population heavily affected by the opioid crisis and consequent rising mortality and morbidity rates in relation to opioid use disorder. Despite the increase in the use of TMOUD, there are no established service- and process-focused models to guide the implementation of this intervention.

OBJECTIVE

This study aims to develop a process- and service-focused implementation model in collaboration with key stakeholders and bring together peer-reviewed literature, practice-based knowledge, and expert opinions.

METHODS

The simple rules for evidence translation in complex systems framework was applied to guide the development of a 6-step qualitative study. The steps were definition of the scope and objectives of the model, identification of evidence, stakeholder engagement, draft model development, key informant consultation, and final model specification.

RESULTS

The final specification for the TMOUD implementation model incorporated key strategic priorities, service delivery prerequisites, service design elements, stakeholder identification and engagement, key process domains, and iterative cycles of evaluation and improvement.

CONCLUSIONS

Through stakeholder engagement and key informant consultation, we produced a process- and service-focused TMOUD implementation model. The model is modifiable to different contexts and settings while also in keeping with the current evidence base and national and international standards of high-quality opioid use disorder care.

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System

Introduction

Workplace-based assessment occurs in authentic, dynamic clinical environments where reproducible, measurement-based assessments can often not be implemented. In these environments, research approaches that respect these multiple dynamic interactions, such as complexity perspectives, are encouraged. Previous research has shown that fairness in assessment is a nonlinear phenomenon that emerges from interactions between its components and behaves like a complex adaptative system. The aim of this study was to understand the external forces on the complex adaptive system which may disrupt fairness from emerging.

Methods

We conducted online focus groups with a purposeful sample of nineteen academic leaders in the Netherlands. We used an iterative approach to collection, analysis and coding of the data and interpreted the results using a lens of complexity, focusing on how individual elements of fairness work in concert to create systems with complex behaviour.

Results

We identified three themes of forces which can disrupt fairness: forces impairing interactivity, forces impairing adaption and forces impairing embeddedness. Within each of these themes, we identified subthemes: assessor and student forces, tool forces and system forces.

Discussion

Consistent with complexity theory, this study suggests there are multiple forces which can hamper the emergence of fairness. Whilst complexity thinking does not reduce the scale of the challenge, viewing forces through this lens provides insight into why and how these forces are disrupting fairness. This allows for more purposeful, meaningful changes to support the use of fair judgement in assessment in dynamic authentic clinical workplaces.

Organisation and integrated healthcare approaches for people living with HIV, multimorbidity, or both: a systematic review

BACKGROUND

Universal recommendation for antiretroviral drugs and their effectiveness has put forward the challenge of assuring a chronic and continued care approach to PLHIV (People Living with HIV), pressured by aging and multimorbidity. Integrated approaches are emerging which are more responsive to that reality. Studying those approaches, and their relation to the what of delivery arrangements and the how of implementation processes, may support future strategies to attain more effective organizational responses.

METHODS

We reviewed empirical studies on either HIV, multimorbidity, or both. The studies were published between 2011 and 2020, describing integrated approaches, their design, implementation, and evaluation strategy. Quantitative, qualitative, or mixed methods were included. Electronic databases reviewed cover PubMed, SCOPUS, and Web of Science. A narrative analysis was conducted on each study, and data extraction was accomplished according to the Effective Practice and Organisation of Care taxonomy of health systems interventions.

RESULTS

A total of 30 studies, reporting 22 different interventions, were analysed. In general, interventions were grounded and guided by models and frameworks, and focused on specific subpopulations, or priority groups at increased risk of poorer outcomes. Interventions mixed multiple integrated components. Delivery arrangements targeted more frequently clinical integration (n = 13), and care in proximity, community or online-telephone based (n = 15). Interventions reported investments in the role of users, through self-management support (n = 16), and in coordination, through multidisciplinary teams (n = 9) and continuity of care (n = 8). Implementation strategies targeted educational and training activities (n = 12), and less often, mechanisms of iterative improvement (n = 3). At the level of organizational design and governance, interventions mobilised users and communities through representation, at boards and committees, and through consultancy, along different phases of the design process (n = 11).

CONCLUSION

The data advance important lessons and considerations to take steps forward from disease-focused care to integrated care at two critical levels: design and implementation. Multidisciplinary work, continuity of care, and meaningful engagement of users seem crucial to attain care that is comprehensive and more proximal, within or cross organizations, or sectors. Promising practices are advanced at the level of design, implementation, and evaluation, that set integration as a continued process of improvement and value professionals and users' knowledge as assets along those phases.

TRIAL REGISTRATION

PROSPERO number CRD42020194117.

Fairness in Assessment: Identifying a Complex Adaptive System

Introduction

Assessment design in health professions education is continuously evolving. There is an increasing desire to better embrace human judgement in assessment. Thus, it is essential to understand what makes this judgement fair. This study builds upon existing literature by studying how assessment leaders conceptualise the characteristics of fair judgement.

Methods

Sixteen assessment leaders from 15 medical schools in Australia and New Zealand participated in online focus groups. Data collection and analysis occurred concurrently and iteratively. We used the constant comparison method to identify themes and build on an existing conceptual model of fair judgement in assessment.

Results

Fairness is a multi-dimensional construct with components at environment, system and individual levels. Components influencing fairness include articulated and agreed learning outcomes relating to the needs of society, a culture which allows for learner support, stakeholder agency and learning (environmental level), collection, interpretation and combination of evidence, procedural strategies (system level) and appropriate individual assessments and assessor expertise and agility (individual level).

Discussion

We observed that within the data at fractal, that is an infinite pattern repeating at different scales, could be seen suggesting fair judgement should be considered a complex adaptive system. Within complex adaptive systems, it is primarily the interaction between the entities which influences the outcome it produces, not simply the components themselves. Viewing fairness in assessment through a lens of complexity rather than as a linear, causal model has significant implications for how we design assessment programs and seek to utilise human judgement in assessment.

Unpacking the 'process of sustaining'-identifying threats to sustainability and the strategies used to address them: a longitudinal multiple case study

BACKGROUND

Although sustainability remains a recognised challenge for Quality Improvement (QI) initiatives, most available research continues to investigate sustainability at the end of implementation. As a result, the learning and continuous adjustments that shape sustainability outcomes are lost. With little understanding of the actions and processes that influence sustainability within QI initiatives, there is limited practical guidance and direction on how to enhance the sustainability of QI initiatives. This study aims to unpack the 'process of sustaining', by exploring threats to sustainability encountered throughout the implementation of QI Initiatives and identifying strategies used by QI teams to address these threats over time.

METHODS

A longitudinal multiple case study design was employed to follow 4 QI initiatives over a 3-year period. A standardised sustainability tool was used quarterly to collect perceptions of sustainability threats and actions throughout implementation. Interviews (n=38), observations (32.5 h), documentary analysis, and a focus group (n=10) were conducted to enable a greater understanding of how the process of sustaining is supported in practice. Data were analysed using the Consolidated Framework for Sustainability (CFS) to conduct thematic analysis.

RESULTS

Analysis identified five common threats to sustainability: workforce stability, improvement timelines, organisational priorities, capacity for improvement, and stakeholder support. Each of these threats impacted multiple sustainability constructs demonstrating the complexity of the issues encountered. In response to threats, 12 strategies to support the process of sustaining were identified under three themes: engagement (five strategies that promoted the development of relationships), integration (three strategies that supported initiatives to become embedded within local systems), and adaptation (four strategies that enhanced understanding of, and response to, emergent conditions and contextual needs).

CONCLUSIONS

Sustaining improvements from QI initiatives requires continuous investment in relationships, resilience to integrate improvements in local systems, and flexibility to understand emergent conditions. Findings provide practitioners, funders, and researchers with a better understanding of, and preparation for, the threats associated with sustaining improvements from QI initiatives and offer insight into specific actions that can be taken to mitigate these risks. This learning can be used to inform future initiative design and support, to optimise the sustainability of healthcare improvements.

TRIAL REGISTRATION

Not applicable.

Using Relational Community Engagement within the Digital Health Intervention (DHI) to Improve Access and Retention among People Living with HIV (PLWH): Findings from a Mixed-Method Study in Cambodia

We examined the impact of COVID-19-associated restrictive measures on the HIV care system in Cambodia through a complexity lens and aimed to use the findings to integrate social and relational processes into the design and implementation of proposed solutions that could support program outcomes during these times. Through a mixed-method design, we generated data on the strength of connection and quality of relationships between stakeholders and how this, in turn, provided a more holistic understanding of the challenges experienced during a pandemic. We interviewed 43 HIV care providers and 13 patients from eight HIV clinics and 13 policy-level stakeholders from relevant institutions involved in HIV care from April to May 2021. We identified several challenges, as well as an opportunity to improve HIV care access that built upon a strong foundation of trust between the HIV care providers and receivers in Cambodia. Trusting relationships between providers and patients provided the basis for intervention development aiming to improve the care experience and patients' engagement in care. Iterative research processes could better inform the intervention, and communication resources provided through relational skills training are key to their application and sustainability.

Application of complexity theory in health and social care research: a scoping review

BACKGROUND

Complexity theory has been chosen by many authors as a suitable lens through which to examine health and social care. Despite its potential value, many empirical investigations apply the theory in a tokenistic manner without engaging with its underlying concepts and underpinnings.

OBJECTIVES

The aim of this scoping review is to synthesise the literature on empirical studies that have centred on the application of complexity theory to understand health and social care provision.

METHODS

This scoping review considered primary research using complexity theory-informed approaches, published in English between 2012 and 2021. Cochrane Database of Systematic Reviews, MEDLINE, CINAHL, EMBASE, Web of Science, PSYCHINFO, the NHS Economic Evaluation Database, and the Health Economic Evaluations Database were searched. In addition, a manual search of the reference lists of relevant articles was conducted. Data extraction was conducted using Covidence software and a data extraction form was created to produce a descriptive summary of the results, addressing the objectives and research question. The review used the revised Arksey and O'Malley framework and adhered to the Preferred Reporting Items for Systematic Reviews and Meta-analysis Extension for Scoping Reviews (PRISMA-ScR).

RESULTS

2021 studies were initially identified with a total of 61 articles included for extraction. Complexity theory in health and social care research is poorly defined and described and was most commonly applied as a theoretical and analytical framework. The full breadth of the health and social care continuum was not represented in the identified articles, with the majority being healthcare focused.

DISCUSSION

Complexity theory is being increasingly embraced in health and care research. The heterogeneity of the literature regarding the application of complexity theory made synthesis challenging. However, this scoping review has synthesised the most recent evidence and contributes to translational systems research by providing guidance for future studies.

CONCLUSION

The study of complex health and care systems necessitates methods of interpreting dynamic prcesses which requires qualitative and longitudinal studies with abductive reasoning. The authors provide guidance on conducting complexity-informed primary research that seeks to promote rigor and transparency in the area.

REGISTRATION

The scoping review protocol was registered at Open Science Framework, and the review protocol was published at BMJ Open (https://bit.ly/3Ex1Inu).

Exploring the intersection of hermeneutics and implementation: a scoping review

BACKGROUND

An enduring challenge remains about how to effectively implement programs, services, or practices. Too often, implementation does not achieve its intended effectiveness, fidelity, and sustainability, even when frameworks or theories determine implementation strategies and actions. A different approach is needed. This scoping review joined two markedly different bodies of literature: implementation and hermeneutics. Implementation is usually depicted as focused, direct, and somewhat linear, while hermeneutics attends to the messiness of everyday experience and human interaction. Both, however, are concerned with practical solutions to real-life problems. The purpose of the scoping review was to summarize existing knowledge on how a hermeneutic approach has informed the process of implementing health programs, services, or practices.

METHODS

We completed a scoping review by taking a Gadamerian hermeneutic approach to the JBI scoping review method. Following a pilot search, we searched eight health-related electronic databases using broadly stated terms such as implementation and hermeneutics. A diverse research team that included a patient and healthcare leader, working in pairs, independently screened titles/abstracts and full-text articles. Through the use of inclusion criteria and full-team dialogue, we selected the final articles and identified their characteristics, hermeneutic features, and implementation components.

RESULTS

Electronic searches resulted in 2871 unique studies. After full-text screening, we retained six articles that addressed both hermeneutics and implementing a program, service, or practice. The studies varied widely in location, topic, implementation strategies, and hermeneutic approach. All addressed assumptions underpinning implementation, the human dimensions of implementing, power differentials, and knowledge creation during implementation. All studies addressed issues foundational to implementing such as cross-cultural communication and surfacing and addressing tensions during processes of change. The studies showed how creating conceptual knowledge was a precursor to concrete, instrumental knowledge for action and behavioral change. Finally, each study demonstrated how the hermeneutic process of the fusion of horizons created new understandings needed for implementation.

CONCLUSIONS

Hermeneutics and implementation have rarely been combined. The studies reveal important features that can contribute to implementation success. Implementers and implementation research may benefit from understanding, articulating, and communicating hermeneutic approaches that foster the relational and contextual foundations necessary for successful implementation.

TRIAL REGISTRATION

The protocol was registered at the Centre for Open Science on September 10, 2019. MacLeod M, Snadden D, McCaffrey G, Zimmer L, Wilson E, Graham I, et al. A hermeneutic approach to advancing implementation science: a scoping review protocol 2019. Accessed at osf.io/eac37.

Impact of a social prescribing intervention in North East England on adults with type 2 diabetes: the SPRING_NE multimethod study

Background

Link worker social prescribing enables health-care professionals to address patients’ non-medical needs by linking patients into various services. Evidence for its effectiveness and how it is experienced by link workers and clients is lacking.

Objectives

To evaluate the impact and costs of a link worker social prescribing intervention on health and health-care costs and utilisation and to observe link worker delivery and patient engagement.

Data sources

Quality Outcomes Framework and Secondary Services Use data.

Design

Multimethods comprising (1) quasi-experimental evaluation of effects of social prescribing on health and health-care use, (2) cost-effectiveness analysis, (3) ethnographic methods to explore intervention delivery and receipt, and (4) a supplementary interview study examining intervention impact during the first UK COVID-19 lockdown (April–July 2020).

Study population and setting

Community-dwelling adults aged 40–74 years with type 2 diabetes and link workers in a socioeconomically deprived locality of North East England, UK.

Intervention

Link worker social prescribing to improve health and well-being-related outcomes among people with long-term conditions.

Participants

(1) Health outcomes study, approximately n = 8400 patients; EuroQol-5 Dimensions, five-level version (EQ-5D-5L), study, n = 694 (baseline) and n = 474 (follow-up); (2) ethnography, n = 20 link workers and n = 19 clients; and COVID-19 interviews, n = 14 staff and n = 44 clients.

Main outcome measures

The main outcome measures were glycated haemoglobin level (HbA1c; primary outcome), body mass index, blood pressure, cholesterol level, smoking status, health-care costs and utilisation, and EQ-5D-5L score.

Results

Intention-to-treat analysis of approximately 8400 patients in 13 intervention and 11 control general practices demonstrated a statistically significant, although not clinically significant, difference in HbA1c level (–1.11 mmol/mol) and a non-statistically significant 1.5-percentage-point reduction in the probability of having high blood pressure, but no statistically significant effects on other outcomes. Health-care cost estimates ranged from £18.22 (individuals with one extra comorbidity) to –£50.35 (individuals with no extra comorbidity). A statistically non-significant shift from unplanned (non-elective and accident and emergency admissions) to planned care (elective and outpatient care) was observed. Subgroup analysis showed more benefit for individuals living in more deprived areas, for the ethnically white and those with fewer comorbidities. The mean cost of the intervention itself was £1345 per participant; the incremental mean health gain was 0.004 quality-adjusted life-years (95% confidence interval –0.022 to 0.029 quality-adjusted life-years); and the incremental cost-effectiveness ratio was £327,250 per quality-adjusted life-year gained. Ethnographic data showed that successfully embedded, holistic social prescribing providing supported linking to navigate social determinants of health was challenging to deliver, but could offer opportunities for improving health and well-being. However, the intervention was heterogeneous and was shaped in unanticipated ways by the delivery context. Pressures to generate referrals and meet targets detracted from face-to-face contact and capacity to address setbacks among those with complex health and social problems.

Limitations

The limitations of the study include (1) a reduced sample size because of non-participation of seven general practices; (2) incompleteness and unreliability of some of the Quality and Outcomes Framework data; (3) unavailability of accurate data on intervention intensity and patient comorbidity; (4) reliance on an exploratory analysis with significant sensitivity analysis; and (5) limited perspectives from voluntary, community and social enterprise.

Conclusions

This social prescribing model resulted in a small improvement in glycaemic control. Outcome effects varied across different groups and the experience of social prescribing differed depending on client circumstances.

Future work

To examine how the NHS Primary Care Network social prescribing is being operationalised; its impact on health outcomes, service use and costs; and its tailoring to different contexts.

Trial registration

This trial is registered as ISRCTN13880272.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme, Community Groups and Health Promotion (grant no. 16/122/33) and will be published in full in Public Health Research; Vol. 11, No. 2. See the NIHR Journals Library website for further project information.

Drawbacks of Artificial Intelligence and Their Potential Solutions in the Healthcare Sector

Artificial intelligence (AI) has the potential to make substantial progress toward the goal of making healthcare more personalized, predictive, preventative, and interactive. We believe AI will continue its present path and ultimately become a mature and effective tool for the healthcare sector. Besides this AI-based systems raise concerns regarding data security and privacy. Because health records are important and vulnerable, hackers often target them during data breaches. The absence of standard guidelines for the moral use of AI and ML in healthcare has only served to worsen the situation. There is debate about how far artificial intelligence (AI) may be utilized ethically in healthcare settings since there are no universal guidelines for its use. Therefore, maintaining the confidentiality of medical records is crucial. This study enlightens the possible drawbacks of AI in the implementation of healthcare sector and their solutions to overcome these situations.

Graphical Abstract

Enhancing equitable engagement for digital health promotion: Lessons from evaluating a childrearing app in Indonesia

Part of the appeal of digital health interventions, including mHealth, is the potential for greater reach in places where conventional health promotion is hampered by geographical, financial or social barriers. Yet, 'engagement' - typically understood as user experience and interactions with technology - remains a persistent challenge, particularly in places where technology access or familiarity with technology is limited. We undertook an evaluation of a childrearing app to promote socioemotional and cognitive development in early childhood across the world. In this article, we present findings from qualitative research on app rollout in Indonesia, the first of numerous low- and middle-income countries targeted by the app. We draw on systems theory and complexity thinking to broaden the lens of 'engagement' beyond individual users to encompass collective systems (families and communities), exploring how the intervention was harnessed to meet local contextual needs. The qualitative research involved semi-structured interviews, workshops and audio diaries with 57 diverse stakeholders, including Indonesian parents, caregivers, and collaborators involved in funding, development, and dissemination of the app. We observed the importance of social connection, sense-making, and interactive learning for enhancing engagement with the app and its messages. Enthusiastic users, strongly linked across community networks (e.g. kindergarten teachers), improvised dissemination strategies to facilitate uptake. Interactive learning that tapped into familiar social structures (e.g. intergenerational hierarchies) was crucial for engagement. Understanding ways the app failed to tap into structures of social connection served to highlight the need to embed strategies to support collective engagement.

Engaging stakeholders to inform national implementation of critical time intervention in a program serving homeless-experienced Veterans

The Veterans Affairs (VA) Grant and Per Diem Case Management "Aftercare" program provides 6 months of case management for homeless-experienced Veterans (HEVs) transitioning to permanent housing, with the aim of decreasing returns to homelessness. Implementing Critical Time Intervention (CTI)-an evidence-based case management practice-would standardize care across the 128 community-based agencies that provide Aftercare services. To prepare for national CTI implementation in Aftercare, guided by Replicating Effective Programs (REP), we conducted a four-site pilot in which we adapted a CTI implementation package (training, technical assistance, and external facilitation); characterized stakeholder perspectives regarding the acceptability and appropriateness of this package; and identified contextual factors that affected CTI implementation. We engaged a stakeholder workgroup to tailor existing CTI training and technical assistance materials for Aftercare. To provide tailored support for providers and leaders to adopt and incorporate evidence-based practices (EBPs) into routine care, we also developed external facilitation materials and processes. Over 9 months, we implemented this package at four sites. We conducted semi-structured interviews at pre-implementation, mid-implementation, and 6 months post-implementation, with HEVs (n = 37), case managers (n = 16), supervisors (n = 10), and VA leaders (n = 4); these data were integrated with templated reflection notes from the project facilitator. We used rapid qualitative analysis and targeted coding to assess the acceptability and appropriateness of CTI and our implementation package and identify factors influencing CTI implementation. Stakeholders generally found CTI acceptable and appropriate; there was consensus that components of CTI were useful and compatible for this setting. To adapt our implementation package for scale-up, this pilot highlighted the value of robust and tangible CTI training and technical assistance-grounded in real-world cases-that highlights the congruence of CTI with relevant performance metrics. Variations in agency-level contextual factors may necessitate more intense and tailored supports to implement and sustain complex EBPs like CTI. Processes used in this pilot are relevant for implementing other EBPs in organizations that serve vulnerable populations. EBP scale-up and sustainment can be enhanced by engaging stakeholders to tailor EBPs for specific contexts; pilot testing and refining implementation packages for scale-up; and using qualitative methods to characterize contextual factors that affect EBP implementation.

Organizational influences on the use of low-value care in primary health care - a qualitative interview study with physicians in Sweden

AIM

The aim was (1) to explore organizational factors influencing the use of low-value care (LVC) as perceived by primary care physicians and (2) to explore which organizational strategies they believe are useful for reducing the use of LVC.

DESIGN

Qualitative study with semi-structured focus group discussions (FGDs) analyzed using qualitative content analysis.

SETTING

Six publicly owned primary health care centers in Stockholm.

SUBJECTS

The participants were 31 primary care physicians. The number of participants in each FGD varied between 3 and 7.

MAIN OUTCOME MEASURES

Categories and subcategories reporting organizational factors perceived to influence the use of LVC and organizational strategies considered useful for reducing the use of LVC.

RESULTS

Four types of organizational factors (resources, care processes, improvement activities, and governance) influenced the use of LVC. Resources involved time to care for patients, staff knowledge, and working tools. Care processes included work routines and the ways activities and resources were prioritized in the organization. Improvement activities involved performance measurement and improvement work to reduce LVC. Governance concerned organizational goals, higher-level decision making, and policies. Physicians suggested multiple strategies targeting these factors to reduce LVC, including increased patient-physician continuity, adjusted economic incentives, continuous professional development for physicians, and gatekeeping functions which prevent unnecessary appointments and guide patients to the appropriate point of care. .

CONCLUSION

The influence of multiple organizational factors throughout the health-care system indicates that a whole-system approach might be useful in reducing LVC.KEY POINTSWe know little about how organizational factors influence the use of low-value care (LVC) in primary health care.Physicians perceive organizational resources, care processes, improvement activities, and governance as influences on the use of LVC and LVC-reducing strategies.This study provides insights about how these factors influence LVC use.Strategies at multiple levels of the health-care system may be warranted to reduce LVC.

Building engagement to support adoption of community-based substance use prevention initiatives

BACKGROUND

System-level approaches that target social determinants of health are promising strategies to support substance use prevention, holistic youth development and wellbeing. Yet, the youth services system is largely based on individual-focused programs that do not adequately account for social determinants of health and place the responsibility for wellness on the individual. There is a need to understand how to enhance adoption of complex system-level approaches that support comprehensive youth development. The Icelandic Prevention Model (IPM) represents a collaborative initiative that takes an ecological, system-level approach to prevent substance use and promote wellness in youth. This research was designed to examine key stakeholder perceptions to better understand social motivations and contextual complexities that influence stakeholder support to garner community-level adoption of the IPM in a rural Canadian community.

METHODS

This research applies a case study approach using qualitative interviews to explore strategies to support uptake in the early stages of IPM adoption associated with developing community buy-in and acceptance. A thematic analysis was applied using QSR NVivo.

RESULTS

Nine interviews were conducted with community partners leading the implementation of the IPM. Three over-arching themes emerged from the data: 1) Motivating influences 2) Strategies to develop buy-in, and 3) Resistance to the adoption of the IPM. Findings reflect issues that affect behaviour change in system transformation in general as well as upstream prevention and the IPM, in particular.

CONCLUSIONS

The findings from this research describe critical insight derived from implementing community-driven initiatives that are designed to support health promotion. It contributes new scientific knowledge related to implementation of complex system-level innovations and practical information that is useful for communities interested in implementing the IPM or following similar approaches to prevent substance use.

Implementing best practice occupational therapist‐led environmental assessment and modification to prevent falls: A qualitative study of two regional and rural public health services in Australia

BACKGROUND

Occupational therapist-led environmental assessment and modification (EAM) is effective in reducing falls for populations at high risk. Two regional and rural public health services in Queensland devised an implementation strategy to embed best practice occupational therapist-led EAM.

METHODS

A qualitative study was conducted to compare the determinants of implementation success across the different health services, using the COM-B model of behaviour change. Six semi-structured interviews were completed with occupational therapists involved at each site, following 12 months of implementation. Interview data were triangulated with minutes from three combined site steering committee meetings, eight local steering committee meetings, and field notes. Thematic analysis was completed to compare barriers and facilitators to best practice uptake of EAM and differences in outcomes between the two sites.

RESULTS

Both sites commenced implementation with similar states of capability and motivation. After 12 months, one site considered that practice change had been embedded as noted in steering committee minutes and comments; however, the other site observed limited progress. According to the COM-B analysis, opportunity (the factors that lie outside the individual's control) had a significant influence on how both sites were able to respond to the practice change and navigate some of the unexpected challenges that emerged, including the COVID-19 pandemic. Existing team structure, multiple responsibilities of key stakeholders, differences in access to resources, and lack of connection between complementary services meant that COVID-19 disruptions were only a catalyst for unveiling other systemic issues.

CONCLUSION

This study highlights the power of external factors on influencing behaviour change for best practice implementation. Learnings from the study will provide deeper understanding of completing implementation projects in regional and rural contexts and support the future implementation of EAM in occupational therapy clinical settings.

Realizing the potential of artificial intelligence in healthcare: Learning from intervention, innovation, implementation and improvement sciences

Introduction

Artificial intelligence (AI) is widely seen as critical for tackling fundamental challenges faced by health systems. However, research is scant on the factors that influence the implementation and routine use of AI in healthcare, how AI may interact with the context in which it is implemented, and how it can contribute to wider health system goals. We propose that AI development can benefit from knowledge generated in four scientific fields: intervention, innovation, implementation and improvement sciences.

Aim

The aim of this paper is to briefly describe the four fields and to identify potentially relevant knowledge from these fields that can be utilized for understanding and/or facilitating the use of AI in healthcare. The paper is based on the authors' experience and expertise in intervention, innovation, implementation, and improvement sciences, and a selective literature review.

Utilizing knowledge from the four fields

The four fields have generated a wealth of often-overlapping knowledge, some of which we propose has considerable relevance for understanding and/or facilitating the use of AI in healthcare.

Conclusion

Knowledge derived from intervention, innovation, implementation, and improvement sciences provides a head start for research on the use of AI in healthcare, yet the extent to which this knowledge can be repurposed in AI studies cannot be taken for granted. Thus, when taking advantage of insights in the four fields, it is important to also be explorative and use inductive research approaches to generate knowledge that can contribute toward realizing the potential of AI in healthcare.

Challenges to implementing artificial intelligence in healthcare: a qualitative interview study with healthcare leaders in Sweden

BACKGROUND

Artificial intelligence (AI) for healthcare presents potential solutions to some of the challenges faced by health systems around the world. However, it is well established in implementation and innovation research that novel technologies are often resisted by healthcare leaders, which contributes to their slow and variable uptake. Although research on various stakeholders' perspectives on AI implementation has been undertaken, very few studies have investigated leaders' perspectives on the issue of AI implementation in healthcare. It is essential to understand the perspectives of healthcare leaders, because they have a key role in the implementation process of new technologies in healthcare. The aim of this study was to explore challenges perceived by leaders in a regional Swedish healthcare setting concerning the implementation of AI in healthcare.

METHODS

The study takes an explorative qualitative approach. Individual, semi-structured interviews were conducted from October 2020 to May 2021 with 26 healthcare leaders. The analysis was performed using qualitative content analysis, with an inductive approach.

RESULTS

The analysis yielded three categories, representing three types of challenge perceived to be linked with the implementation of AI in healthcare: 1) Conditions external to the healthcare system; 2) Capacity for strategic change management; 3) Transformation of healthcare professions and healthcare practice.

CONCLUSIONS

In conclusion, healthcare leaders highlighted several implementation challenges in relation to AI within and beyond the healthcare system in general and their organisations in particular. The challenges comprised conditions external to the healthcare system, internal capacity for strategic change management, along with transformation of healthcare professions and healthcare practice. The results point to the need to develop implementation strategies across healthcare organisations to address challenges to AI-specific capacity building. Laws and policies are needed to regulate the design and execution of effective AI implementation strategies. There is a need to invest time and resources in implementation processes, with collaboration across healthcare, county councils, and industry partnerships.

An evaluation of the evidence brief for policy development process in WHO EVIPNet Europe countries

BACKGROUND

Evidence briefs for policy (EBPs) represent a potentially powerful tool for supporting evidence-informed policy-making. Since 2012, WHO Evidence-Informed Policy Network (EVIPNet) Europe has been supporting Member States in developing EBPs. The aim of this study was to evaluate the process of developing EBPs in Estonia, Hungary and Slovenia.

METHODS

We used a rapid appraisal approach, combining semi-structured interviews and document review, guided by the Medical Research Council (MRC) process evaluation framework. Interviews were conducted with a total of 20 individuals familiar with the EBP process in the three study countries. Data were analysed thematically, and emerging themes were related back to the MRC framework components (implementation, mechanisms of impact, and context). We also reflected on the appropriateness of this evaluation approach for EVIPNet teams without evaluation research expertise to conduct themselves.

RESULTS

The following themes emerged as important to the EBP development process: how the focus problem is prioritized, who initiates this process, EBP team composition, EBP team leadership, availability of external support in the process, and the culture of policy-making in a country. In particular, the EBP process seemed to be supported by early engagement of the Ministry of Health and other stakeholders as initiators, clear EBP team roles and expectations, including a strong leader, external support to strengthen EBP team capacity and cultural acceptance of the necessity of evidence-informed policy-making. Overall, the evaluation approach was considered feasible by the EBP teams and captured rich qualitative data, but may be limited by the absence of external reviewers and long lag times between the EBP process and the evaluation.

CONCLUSIONS

This process occurs in a complex system and must be conceptualized in each country and each EBP project in a way that fits local policy-making culture, priorities, leadership and team styles, roles and available resources. The use of a rapid appraisal approach, combining qualitative interviews and document review, is a feasible method of process evaluation for EVIPNet member countries.

The pursuit of fairness in assessment: Looking beyond the objective

Health professions education has undergone significant changes over the last few decades, including the rise of competency-based medical education, a shift to authentic workplace-based assessments, and increased emphasis on programmes of assessment. Despite these changes, there is still a commonly held assumption that objectivity always leads to and is the only way to achieve fairness in assessment. However, there are well-documented limitations to using objectivity as the 'gold standard' to which assessments are judged. Fairness, on the other hand, is a fundamental quality of assessment and a principle that almost no one contests. Taking a step back and changing perspectives to focus on fairness in assessment may help re-set a traditional objective approach and identify an equal role for subjective human judgement in assessment alongside objective methods. This paper explores fairness as a fundamental quality of assessments. This approach legitimises human judgement and shared subjectivity in assessment decisions alongside objective methods. Widening the answer to the question: 'What is fair assessment' to include not only objectivity but also expert human judgement and shared subjectivity can add significant value in ensuring learners are better equipped to be the health professionals required of the 21st century.

Improving safety and outcomes in perioperative care: does implementation matter?

The IMPROVE study describes a large perioperative quality improvement project with reporting of both compliance with improvement activities and patient outcomes. It highlights the importance of such projects, as well as the challenges in implementing change and proving benefit. Challenges identified include the importance of effective training in practice change, selection of trial design and relevant quality measures, and how the context of quality improvement initiatives may influence outcomes. Quality improvement programmes of this nature, despite the difficulties with implementation and trial design, remain a high priority because of their positive influence on improving clinical practice.

Bridging the Silos: A Comparative Analysis of Implementation Science and Improvement Science

Background

Implementation science and improvement science have similar goals of improving health care services for better patient and population outcomes, yet historically there has been limited exchange between the two fields. Implementation science was born out of the recognition that research findings and effective practices should be more systematically disseminated and applied in various settings to achieve improved health and welfare of populations. Improvement science has grown out of the wider quality improvement movement, but a fundamental difference between quality improvement and improvement science is that the former generates knowledge for local improvement, whereas the latter is aimed at producing generalizable scientific knowledge.

Objectives

The first objective of this paper is to characterise and contrast implementation science and improvement science. The second objective, building on the first, is to highlight aspects of improvement science that potentially could inform implementation science and vice versa.

Methods

We used a critical literature review approach. Search methods included systematic literature searches in PubMed, CINAHL, and PsycINFO until October 2021; reviewing references in identified articles and books; and the authors' own cross-disciplinary knowledge of key literature.

Findings

The comparative analysis of the fields of implementation science and improvement science centred on six categories: (1) influences; (2) ontology, epistemology and methodology; (3) identified problem; (4) potential solutions; (5) analytical tools; and (6) knowledge production and use. The two fields have different origins and draw mostly on different sources of knowledge, but they have a shared goal of using scientific methods to understand and explain how health care services can be improved for their users. Both describe problems in terms of a gap or chasm between current and optimal care delivery and consider similar strategies to address the problems. Both apply a range of analytical tools to analyse problems and facilitate appropriate solutions.

Conclusions

Implementation science and improvement science have similar endpoints but different starting points and academic perspectives. To bridge the silos between the fields, increased collaboration between implementation and improvement scholars will help to clarify the differences and connections between the science and practice of improvement, to expand scientific application of quality improvement tools, to further address contextual influences on implementation and improvement efforts, and to share and use theory to support strategy development, delivery and evaluation.

Public attitudes to, and perceived impacts of 20mph (32km/h) speed limits in Edinburgh: an exploratory study using the Speed Limits Perceptions Survey (SLiPS)

Between 2016 and 2018 a policy was implemented to increase the proportion of 20mph (32 km/h) streets in Edinburgh, UK from approximately 50% to 80%, providing the opportunity to evaluate how behaviour and public perceptions change over time. This is important as negative public responses have been reported to limit the implementation of transport policies and may reduce the effectiveness of the policy. The Speed Limits Perception Survey (SLiPS) was developed to assess changes in public perceptions from baseline to 6 and 12 months post-implementation. We collected 3,485 individual responses to the survey, 64.6% (n=2,253) of which included complete perceptions data. Using exploratory factor analysis, the following perception factors were identified: i) Detraction and resistance, ii) Support, iii) Rule following, iv) Child safety, and v) Walking safety. Following the 20mph implementation at 6-12 months: Support (ii) and Rule following (iii) had increased; Detraction and resistance (i) had decreased; and Child safety (iv) and Walking safety (v) had not changed significantly. These findings indicate that the public in Edinburgh became more positive towards the policy once it was implemented. However, more extensive policy or ongoing communication of the safety benefits of 20mph limits are needed to increase perceptions of safety that might lead to increased walking and cycling. Future research should aim to understand how those implementing speed limit interventions can positively influence public perceptions and how public perceptions about speed limits influence behaviour.

Implementing clinical decision support for reducing women Veterans' cardiovascular risk in VA: A mixed-method, longitudinal study of context, adaptation, and uptake

Evaluations of clinical decision support (CDS) implementation often struggle to measure and explain heterogeneity in uptake over time and across settings, and to account for the impact of context and adaptation on implementation success. In 2017-2020, the EMPOWER QUERI implemented a cardiovascular toolkit using a computerized template aimed at reducing women Veterans' cardiovascular risk across five Veterans Healthcare Administration (VA) sites, using an enhanced Replicating Effective Programs (REP) implementation approach. In this study, we used longitudinal joint displays of qualitative and quantitative findings to explore (1) how contextual factors emerged across sites, (2) how the template and implementation strategies were adapted in response to contextual factors, and (3) how contextual factors and adaptations coincided with template uptake across sites and over time. We identified site structure, staffing changes, relational authority of champions, and external leadership as important contextual factors. These factors gave rise to adaptations such as splitting the template into multiple parts, pairing the template with a computerized reminder, conducting academic detailing, creating cheat sheets, and using small-scale pilot testing. All five sites exhibited variability in utilization over the months of implementation, though later sites exhibited higher template utilization immediately post-launch, possibly reflecting a "preloading" of adaptations from previous sites. These findings underscore the importance of adaptive approaches to implementation, with intentional shifts in intervention and strategy to meet the needs of individual sites, as well as the value of integrating mixed-method data sources in conducting longitudinal evaluation of implementation efforts.

Complexities in interdisciplinary community engagement projects: some reflections and lessons from an applied drama and theatre project in diabetes care

There is a growing interest in using drama techniques and theatrical performance to disseminate health information to lay audiences as part of community engagement projects. This process can be challenging for a number of reasons, however. In this paper, we describe the process and pitfalls of an interdisciplinary project involving the development and performance of a play about diabetes mellitus. The play formed part of a long-term, three-way community engagement project between social science, applied drama and a diabetes clinic in South Africa. Building on a framework derived from a number of applied drama methods, we elicited narratives from key 'storytellers' that were developed and embodied by actors in a new performance called Blood Sugars Creating this play provided insight into working in an interdisciplinary space and highlighted the importance of establishing shared goals and joint ownership of the project right from the outset. This was without doubt a challenging project and the complexities of finding common ground across three disciplines are not to be underestimated. In this paper, we explore the collaboration and its challenges, drawing on the framework of complexity theory. In particular, we examine the layers of complexity that emerged as a result of the interdisciplinary nature of the project and the demands of balancing the authenticity of the stories with the perceived requirements of health messaging. We consider the methodological, conceptual and ethical challenges of this type of research, and discuss some recommendations for teams taking on similar complex multidisciplinary research and intervention projects.

Towards successful implementation of artificial intelligence in healthcare practice: A research program (Preprint)

Background

Objective

Methods

Results

Conclusions

International Registered Report Identifier (IRRID)

Missed nursing care and complexity theory: a conceptual paper

Background

Missed nursing care is a complex healthcare problem. Extant literature in this area identifies several interventions that can be used in acute hospital settings to minimise the impact of missed nursing care. However, controversy still exists as to the effectiveness of these interventions on reducing the occurrence of missed nursing care.

Aim

This theoretical paper aimed to provide a conceptual understanding of missed nursing care using complexity theory.

Methods

The method utilised for this paper is based on a literature review on missed care and complexity theory in healthcare.

Results

We found that the key virtues of complexity theory relevant to the missed nursing care phenomenon were adaptation and self-organisation, non-linear interactions and history. It is suggested that the complex adaptive systems approach may be more useful for nurse managers to inform and prepare nurses to meet uncertain encounters in their everyday clinical practice and therefore reduce instances of missed care.

Conclusions

This paper envisions that it is time that methods used to explore missed care changed. Strategies proposed in this paper may have an important impact on the ability of nursing staff to provide quality and innovative healthcare in the modern healthcare system.

A mixed-methods study to test a tailored coaching program for health researchers to manage stress and achieve work-life balance

Dissemination and implementation (D&I) researchers serve critical scientific, practical, and personal roles in translating science to public health benefit. However, they face multifaceted barriers that may erode their capacity to plan, lead, and evaluate implementation. Individualized coaching focused on human flourishing is an unexplored approach to fully actualize D&I researchers' capacity to bridge the research-practice gap. The purpose of this exploratory pilot study was to investigate a tailored coaching program to support human flourishing among D&I researchers. A pragmatic, mixed-methods approach guided by the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) Framework was used to evaluate an individualized, nine session coaching program called FUEL (Focus, Unplug, Exercise, Love). Reach and Implementation were assessed through descriptive statistics and rapid qualitative analysis of surveys and coaching logs. Effectiveness and Maintenance were assessed through descriptive statistics and iterative content analysis of participant surveys, as well as iterative content analysis of proxy (e.g., colleague) semi-structured interviews. Reach results indicated that demand for coaching exceeded study enrollment capacity (n = 16 participants). Implementation results showed that the coach spent 12.96 ± 2.82 hr per participant over 3 months. Effectiveness and Maintenance results indicated that FUEL was well-received and provided participants with myriad psychological and professional benefits. Preliminary evidence suggests that the FUEL coaching program is a promising and feasible approach to enhance flourishing among D&I researchers. Future research is needed to evaluate Adoption and scalability. This pilot study may inform future D&I capacity-building initiatives that address researchers' holistic situatedness within the implementation process.

The Active Hospital pilot: A qualitative study exploring the implementation of a Trust-wide Sport and Exercise Medicine-led physical activity intervention

BACKGROUND

In 2017 Public Health England and Sport England commissioned a Consultant-led Sport and Exercise Medicine (SEM) pilot to test the feasibility and acceptability of embedding physical activity interventions in secondary care clinical pathways. The aim of this paper is to report qualitative findings exploring the experience of healthcare professionals (HCPs) and patients involved in the Active Hospital pilot.

METHODS

Qualitative data was collected by semi-structured interviews with Active Hospital pilot SEM Consultants, and staff and patients involved in three clinical pathways. Interviews with SEM Consultants explored the experience of developing and implementing the pilot. Interviews with staff and patients explored the experience of delivering and receiving Active Hospital interventions. Data were analysed thematically.

RESULTS

Interviews identified the importance of the Active Hospital pilot being Consultant-led for the following reasons; i) having trusting relationships with decision makers, ii) having sufficient influence to effect change, iii) identifying champions within the system, and iv) being adaptable to change and ensuring the programme fits within the wider strategic frameworks. HCPs emphasised the importance of the Active Hospital interventions fitting easily within existing work practices, the need for staff training and to tailor interventions for individual patient needs. The Active Hospital pilot was well received by patients, however a lack of dedicated resource and capacity to deliver the intervention was highlighted as a challenge by both patients and HCPs.

CONCLUSION

The SEM Consultants' ability to navigate the political climate of a large National Health Service (NHS) Trust with competing agendas and limited resource was valuable. The interventions were well received and a valued addition to usual clinical care. However, implementation and ongoing delivery of the pilot encountered challenges including lack of capacity within the system and delays with recruiting to the delivery teams in each pathway.

What risks to sustainability are identified throughout care bundle implementation and how can they be addressed? A mixed methods case study

OBJECTIVES

Despite national guidance on how to identify and treat heart failure (HF), variation in HF care persists across UK hospitals. Care bundles have been proposed as a mechanism to deliver reliable optimal care for patients; however, specific challenges to sustain care bundles in practice have been highlighted. With few studies providing insight into how to design or implement care bundles to optimise sustainability, there is little direction for practitioners seeking to ensure long-term impact of their initiatives. This study explores the sustainability risks encountered throughout the implementation of a HF care bundle (HFCB) and describes how these challenges were addressed by a multidisciplinary team (MDT) to enhance sustainability over time.

DESIGN

A longitudinal mixed method case study examined the HFCB improvement initiative from September 2015 to August 2018. A standardised sustainability tool was used to collect perceptions of sustainability risks and actions throughout the initiative. Observations, key-informant interviews and documentary analysis were conducted to gain in-depth understanding of how the MDT influenced sustainability through specific actions. A qualitative database was developed using a consolidated sustainability framework to conduct thematic analysis. Sustainability outcomes were explored 1-year post funding to ascertain progress towards sustainment.

RESULTS

The MDT identified six sustainability challenges for the HFCB: infrastructure limitations, coding reliability, delivery consistency, organisational fit, resource stability and demonstrating impact. The MDT undertook multiple actions to enhance sustainability, including: (1) developing a business case to address infrastructure limitations; (2) incorporating staff feedback to increase bundle usability; (3) establishing consistent training; (4) increasing reliability of baseline data; (5) embedding monitoring and communication; and (6) integrating the bundle into current practices.

CONCLUSION

Through the description of challenges, actions and learning from the MDT, this study provides practical lessons for practitioners and researchers seeking to embed and sustain care bundles in practice.

An Integrative Review of Organizational Factors Influencing Successful Large-Scale Changes in Healthcare

OBJECTIVE

The aim of this study was to review organizational factors influencing successful large-scale change (LSC) in healthcare.

BACKGROUND

LSC is necessary to achieve sustained and meaningful healthcare improvement. However, organizational readiness needs to be considered to promote successful LSC.

METHODS

Four databases were searched for articles published between 2009 and 2018. Thematic analysis was used to identify enabling or hindering factors to LSC.

RESULTS

Seven organizational factors were consistently described as facilitators of or barriers to successful LSC in healthcare: infrastructure support, organizational culture, leadership, change management approach, roles and responsibilities, networks, and measurement and feedback.

CONCLUSION

The factors that emerged from this review are consistent with concepts of implementation but broadened and highlight learning organizations in successful LSC. The results of this review informed the development of a reflective tool on LSC for nurse leaders.

Exploring the Quality Paradigms in Integrated Care: The Need for Emergence and Reflection

INTRODUCTION AND AIM

There are four quality paradigms, of which the Empirical and Reference paradigm fit best in stable circumstances, and the Reflective and Emergence paradigms, which fit best in unstable circumstances. This study aims to explore the use of the four quality paradigms in integrated care, and to shed light on the different paradigmatic commitments and different perspectives on quality.

METHODS

Peer-reviewed articles from the International Journal of Integrated care published between January 2015 and December 2019 were included in this study. For each article was determined in which paradigm it belonged. Additionally, the role of the patient and domain of impact in research, policy or practice in relationship to the paradigms were investigated.

RESULTS

In total, 255 articles were assessed based on the four quality paradigms. 55 (21.6%) of the articles were placed in the Empirical paradigm, 147 (57.6%) in the Reference paradigm and 45 (17.6%) in the Reflective paradigm. The Emergence paradigm occurred the least (n = 8, 3.1%).

DISCUSSION AND CONCLUSION

Of all reviewed studies, 80% were placed in the Empirical and Reference paradigm. This raises the question if the used research approaches are consistent with the complexity and contexts in the field of integrated care and support a personalised care approach. More awareness of all four paradigms and reflection on the used epistemologies is needed.