Lessons from complex interventions to improve health

Hospital design for inpatient psychiatry: A realistic umbrella review

The evaluation of the effects of architecture and design in psychiatric hospitals primarily focuses on final outcomes, such as disease progression, and is made from the perspective of evidence-based medicine. Meanwhile, the evidence-informed, realist approach addresses how the intervention works. Understanding the underlying action mechanisms of the intervention is needed to facilitate its scaling-up and adaptation in new environments. This umbrella review reports in which ways architecture and design have an effect on patients' and staff experience in inpatient psychiatric hospital. The search was constructed around three key concepts (psychiatric hospital, design, and staff and patient outcomes) and was conducted across three reference databases (Embase, Medline, and PsychINFO). Academic and gray literature was analyzed. Information on design and architectural features in psychiatric hospitals, their effects on patients and staff experience, and the acting mechanisms enabling these effects were extracted. From 951 original references, 14 full texts were included in the analysis. Design and architectural features (e.g., aesthetic appeal of places, home-like environment) in psychiatric hospitals address patients' stress, boost social interaction, foster patients' autonomy and feelings of control, ensure respect for patient's privacy and dignity, and prevent under-and overstimulation. Using theory-driven evaluation may facilitate future hospital renovation and the evaluation of its effect.

Mobilizing strategic inflection points for sustainment of an effective intervention in an integrated learning health system: an interpretive description

BACKGROUND

Innovative models of care have the potential to improve the sustainability of health systems by improving patient and provider experiences and population outcomes while simultaneously reducing costs. Yet, it is challenging to recognize the distinctive points during research and quality improvement processes that contribute to sustainment of effective interventions. The business concept of an inflection point-the position on the curve of a trajectory where the progress in implementation of an intervention is accelerated or decelerated-may be useful to understand implementation and improve sustainability and ultimately sustainment of effective interventions. The purpose of this study was to retrospectively identify and describe strategic inflection points that accelerated the sustainability process and led to the sustainment of Alberta Family Integrated Care.

METHODS

This qualitative study was conducted in Alberta, Canada and employed an interpretive description design. Purposively sampled documents (proposals, project management plans, reports to funders and sponsors, meeting minutes, and fidelity audit and feedback checklists) from the Alberta Family Integrated Care cluster randomized controlled trial and quality improvement project constituted data for this study.

RESULTS

To accelerate sustainability in the research context, we identified (1) alignment with strategic priorities, (2) iterative, user-centered co-design, and (3) contextualization of implementation as strategic inflection points. To accelerate sustainability in the health system context, we identified (1) the learning health system, (2) enduring partnerships, (3) responsivity to societal and system change, (4) embedded governance, and (5) intentional integration into the health system as strategic inflection points. Capitalizing on these strategic inflection points led to sustainment of Alberta Family Integrated Care in the provincial health system.

CONCLUSIONS

We identified key inflection points in the research and health system contexts that led to sustainment of Alberta Family Integrated Care. By anticipating, recognizing, and leveraging inflection points in the sustainability process, researchers may be able to accelerate implementation and achieve sustainment of multi-component interventions in complex systems.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT02879799. Registration date: May 27, 2016. Protocol version: June 9, 2016; version 2. Protocol publication: https://doi.org/10.1186/s13063-017-2181-3 .

Logic modelling as hermeneutic praxis: Bringing knowledge systems into view during comprehensive primary health care planning for homelessness in Australia

Logic modelling is used widely in health promotion planning for complex health and social problems. It is often undertaken collaboratively with stakeholders across sectors that hold and enact different institutional approaches. We use hermeneutic philosophy to explore how knowledge is 'lived' by - and unfolds differently for - cross-sectoral stakeholders during comprehensive primary healthcare service planning. An Organisational Action Research partnership was established with a non-government organisation designing comprehensive primary health care for individuals experiencing homelessness in Adelaide, Australia. Grey literature, stakeholder input, academic feedback, a targeted literature review and evidence synthesis were integrated in iterative cycles to inform and refine the logic model. Diverse knowledge systems are active when cross-sectoral stakeholders collaborate on logic models for comprehensive primary health care planning. Considering logic modelling as a hermeneutic praxis helps to foreground and explore these differences. In our case, divergent ideas emerged in how health/wellbeing and trust were conceptualised; language had different meanings across sectors; and the outcomes and data sought were nuanced for various collaborators. We explicate these methodological insights and also contribute our evidence-informed, collaboratively-derived model for design of a comprehensive primary health care service with populations experiencing homelessness. We outline the value of considering cross-sectoral logic modelling as hermeneutic praxis. Engaging with points of difference in cross-sectoral knowledge systems can strengthen logic modelling processes, partnerships and potential outcomes for complex and comprehensive primary health care services.

A Review of Public Sector Engagement in Age-Friendly Community Initiatives

The global age-friendly cities and communities (AFCC) movement has centered on the involvement of the public sector, calling on high-ranking authorities to commit to improving the built, social, and service environments of their localities. This interpretive review aimed to advance understanding of the ways in which the public sector is involved in AFCC efforts. Based on emergent themes from peer-reviewed articles from the United States and Canada published since 2010, we derived a two-dimensional framework for conceptualizing variability in public sector involvement, encompassing the internal/external (a) locus of responsibility for cross-sector change and (b) target for cross-sector change. We discuss implications for research, policy, practice, and further knowledge development in AFCC implementation.

Understanding the challenges and successes of implementing 'hybrid' interventions in healthcare settings: findings from a process evaluation of a patient involvement trial

INTRODUCTION

'Hybrid' interventions in which some intervention components are fixed across sites and others are flexible (locally created) are thought to allow for adaptation to the local context while maintaining fidelity. However, there is little evidence regarding the challenges and facilitators of implementing hybrid interventions. This paper reports on a process evaluation of a patient safety hybrid intervention called Your Care Needs You (YCNY). YCNY was tested in the Partners at Care Transitions (PACT) randomised controlled trial and aimed to enhance older patients and their families' involvement in their care in order to achieve safer transitions from hospital to home.

METHODS

The process evaluation took place across eight intervention wards taking part in the PACT trial. 23 interviews and 37 informal conversations were conducted with National Health Service (NHS) staff. Patients (n=19) were interviewed twice, once in hospital and once after discharge. Interviews with staff and patients concerned the delivery and experiences of YCNY. Ethnographic observations (n=81 hours) of relevant activities (eg, multidisciplinary team meetings, handovers, etc) were undertaken.

RESULTS

The main finding relates to how staff understood and engaged with YCNY, which then had a major influence on its implementation. While staff broadly valued the aims of YCNY, staff from seven out of the eight wards taking part in the process evaluation enacted YCNY in a mostly task-based manner. YCNY implementation often became a hurried activity which concentrated on delivering fixed intervention components rather than a catalyst for culture change around patient involvement. Factors such as understaffing, constraints on staff time and the COVID-19 pandemic contributed towards a 'taskification' of intervention delivery, which meant staff often did not have capacity to creatively devise flexible intervention components. However, one ward with a sense of distributed ownership of YCNY had considerable success implementing flexible components.

DISCUSSION

Hybrid interventions may allow aspects of an intervention to be adapted to the local context. However, the current constrained and pressured environment of the NHS left staff with little ability to creatively engage with devising flexible intervention components, despite recognising the need for and being motivated to deliver the intervention.

A manifesto for improving cancer detection: four key considerations when implementing innovations across the interface of primary and secondary care

Improving cancer outcomes through innovative cancer detection initiatives in primary care is an international policy priority. There are unique implementation challenges to the roll-out and scale-up of different innovations, requiring synchronisation between national policy levers and local implementation strategies. We draw on implementation science to highlight key considerations when seeking to sustainably embed cancer detection initiatives within health systems and clinical practice. Points of action include considering the implications of change on the current configuration of responsibility for detecting cancer; investing in understanding how to adapt systems to support innovations; developing strategies to address inequity when planning innovation implementation; and anticipating and making efforts to mitigate the unintended consequences of innovation. We draw on examples of contemporary cancer detection issues to illustrate how to apply these recommendations to practice.

Epidaure Market-Effectiveness and transferability of a school-based intervention to improve healthy and sustainable food choices by schoolchildren: Protocol of a randomized controlled trial and qualitative study

CONTEXT

At least 40% of cancers are linked to environmental or behavioral factors, and dietary behavior appears to be a major lever. Epidaure Market is a prevention initiative developed using a method for co-constructing health promotion initiatives and prevention programs that stratifies evidence from the scientific literature and combines it with experiential knowledge (DEVA, TPB, BCT). It promotes a sustainable diet (i.e., healthy, ecological and ethical nutrition) among 5th and 4th grade students during the crucial period of adolescence, when these behaviors are often far from the recommendations.

METHOD

The protocol implemented was carried out in 72 middle school classes in the Montpellier and Dijon academies. The intervention included teaching sessions and a virtual supermarket game, integrated into the school curriculum and delivered by science teachers. Effectiveness is tested in a cluster randomized controlled trial with 3 evaluation times (pre- and post-intervention and 1 follow-up). The study also includes an implementation assessment, with process analysis and implementation elements, as well as a transferability assessment based on key functions (FIC model and Astaire grid).

EXPECTED OUTCOMES

The study is still underway within the school. The primary expected outcome is a positive influence on the motives underlying food choices to move towards a sustainable diet. Secondary expectations involve changes in variables such as self-efficacy and perceived social norms, as well as an increase in knowledge about healthy eating. We also expect the qualitative approaches to provide information on the deployment process in the new territories.

DISCUSSION

The study aims not only to demonstrate the effectiveness of Epidaure Market, but also to identify the optimal conditions for its nationwide implementation in France's middle schools. Ultimately, the initiative aims to help reduce the incidence of cancer by promoting healthier eating habits among teenagers.

Adherence-enhancing interventions for pharmacological and oxygen therapy in patients with COPD: a systematic review and component network meta-analyses

INTRODUCTION

Adherence to COPD management strategies is complex, and it is unclear which intervention may enhance it.

OBJECTIVES

We aim to evaluate the effectiveness of adherence-enhancing interventions, alone or compared to interventions, for patients with COPD.

METHODS

This review comprises a component network meta-analysis with a structured narrative synthesis. We searched MEDLINE, Embase, CENTRAL, CINAHL and trial registries on 9 September 2023. We included controlled studies that explored adherence in patients with COPD. Two review authors independently performed the study selection, data extraction and the risk of bias assessment. We involved patients with COPD in developing this systematic review through focus group interviews and displayed the findings in pre-designed logic models.

RESULTS

We included 33 studies with 5775 participants. We included 13 studies in the component network meta-analysis that explored adherence. It was mainly assessed through questionnaires. As a continuous outcome, there was a tendency mainly for education (standardised mean difference 1.26, 95% CI 1.13-1.38, very low certainty of evidence) and motivation (mean difference 1.85, 95% CI 1.19-2.50, very low certainty of evidence) to improve adherence. As a dichotomous outcome (e.g. adherent/non-adherent), we found a possible benefit with education (odds ratio 4.77, 95% CI 2.25-10.14, low certainty of evidence) but not with the other components. We included six studies that reported quality of life in the component network meta-analysis. Again, we found a benefit of education (mean difference -9.70, 95% CI -10.82- -8.57, low certainty of evidence) but not with the other components.

CONCLUSIONS

Education may improve adherence and quality of life in COPD patients. Patient focus group interviews indicated that interventions that strengthen patients' self-efficacy and help them to achieve individual goals are the most helpful.

How do behavioral public policy experts see the role of complex systems perspectives? An expert interview study

Amidst the global momentum of behavioral insights (BI), there has been a shift from mostly nudge-based BI applications to systemic approaches. This is particularly pressing in public health, where interacting issues regularly produce unanticipated consequences. Regardless, little is known about adopting complex systems approaches in behavioral public policy. This study aims to capture current practices of international BI experts on the definition, application, drivers, and hindering factors in adopting complex systems approaches in public policy. Semi-structured individual expert interviews (n = 12) of international BI experts with extensive experience in educating, cooperating with, and/or advising public servants were analyzed with inductive content analysis. While the working definition of BI aligned with published definitions, experts varied in their descriptions of complex systems approaches and its significance for public policy, including socioecological aspects, systematic BI use across policy stages, recognizing intertwined behavior, and lack of ready-made solutions. They emphasized the importance of systems approaches, identifying drivers (e.g. need for a broader focus) and hindrances (e.g. pressure for quick results). Embracing complex systems in behavioral public policy provides a holistic perspective, extending beyond simple nudges, sometimes presumed as universally applicable. While complexity perspectives would align with policymakers' worldview, applications require more work to tailor to local situations and to evaluate. Recognizing that, given their distinct expertise content, BI expertise can be quite different from complex systems expertise. The field would benefit from clear descriptions and specialized training for effective integration and advocacy for these approaches.

Using a health equity lens to measure patient experiences of care in diverse health care settings

People who are structurally disadvantaged and marginalized often report poor health care experiences, such as inequitable treatment, due to intersecting forms of stigma and discrimination. There are many measures of patient experiences of care, however, few are designed to measure equity-oriented health care. In alignment with ongoing calls to integrate actions in support of health equity, we report on the development and testing of patient-reported experience measures that explicitly use a health equity and intersectional lens. Our analysis focuses on two different scales: the Equity-Oriented Health Care Scale-Ongoing, which was evaluated in primary health care settings where patients have an ongoing relationship with providers over time, and the Equity-Oriented Health Care Scale-Episodic, which was tested in an emergency department where care is provided on an episodic basis. Item Response Theory was used to develop and refine the scales. The psychometric properties of each scale were also evaluated. The Equity-Oriented Health Care Scale-Ongoing was first tested with a cohort of 567 patients. The Equity-Oriented Health Care Scale-Episodic was subsequently tested in an emergency department setting with 284 patients. Results of the Item Response Theory analysis for each scale yielded a brief index that captured the level of equity-oriented care when care is ongoing (12 items) or episodic (9 items). Both scales showed evidence of internal consistency and concurrent validity, based on a high correlation with quality of care. They are brief, easy-to-administer patient-reported experience measures that can support organizations to monitor quality of care. Their availability enhances the possibility of measuring equity-oriented health care in diverse contexts and can provide nuanced understandings of quality of care through an intersectional and equity lens.

HCI Contributions in Mental Health: A Modular Framework to Guide Psychosocial Intervention Design

Many people prefer psychosocial interventions for mental health care or other concerns, but these interventions are often complex and unavailable in settings where people seek care. Intervention designers use technology to improve user experience or reach of interventions, and HCI researchers have made many contributions toward this goal. Both HCI and mental health researchers must navigate tensions between innovating on and adhering to the theories of change that guide intervention design. In this paper, we propose a framework that describes design briefs and evaluation approaches for HCI contributions at the scopes of capabilities, components, intervention systems, and intervention implementations. We show how theories of change (from mental health) can be translated into design briefs (in HCI), and that these translations can bridge and coordinate efforts across fields. It is our hope that this framework can support researchers in motivating, planning, conducting, and communicating work that advances psychosocial intervention design.

How can asset-based approaches reduce inequalities? Exploring processes of change in England and Spain

Initiatives to promote health and reduce inequalities in place-based communities have increasingly adopted asset-based approaches (ABAs). However, the processes through which such initiatives might reduce inequalities are not well understood, and evidence of their impact on health is still limited. This study aimed to understand how ABAs can impact practices, relationships and the redistribution of resources to reduce health inequalities in and between less advantaged neighbourhoods. Qualitative research was conducted in two settings (England and Spain) where similar asset-based initiatives, aimed at training community members to become health promoters, were being implemented. Data were collected using theory of change workshops, 120 hours of observations and semi-structured interviews with 44 stakeholders (trained community members, voluntary and community sector organizations' workers and health professionals). A thematic analysis informed by systems thinking was carried out. Three main processes of change were identified: first, 'enabling asset-based thinking' defined as supporting people to adopt a view that values their own resources and people's skills and expertise. Second, 'developing asset-based capacities', described as developing personal skills, knowledge, self-confidence and relationships underpinned by asset-based thinking. Finally, 'changing decision-making and wider health determinants through ABAs' referred to achieving changes in neighbourhoods through mobilizing the asset-based capacities developed. These processes were associated with changes at an individual level, with potential to contribute to reducing inequalities through supporting individual empowerment and social capital. However, contextual factors were found key to enable or hinder changes in the neighbourhoods and acted as barriers to processes of collective empowerment, thus limiting ABAs' impact on health inequalities.

The Benefits of Cooperative Inquiry in Health Services Research: Lessons from an Australian Aboriginal and Torres Strait Islander Health Study

Health services research is underpinned by partnerships between researchers and health services. Partnership-based research is increasingly needed to deal with the uncertainty of global pandemics, climate change induced severe weather events, and other disruptions. To date there is very little data on what has happened to health services research during the COVID-19 pandemic. This paper describes the establishment of an Australian multistate Decolonising Practice research project and charts its adaptation in the face of disruptions. The project used cooperative inquiry method, where partner health services contribute as coresearchers. When the COVID-19 pandemic hit, data collection needed to be immediately paused, and when restrictions started to lift, all research plans had to be renegotiated with services. Adapting the research surfaced health service, university, and staffing considerations. Our experience suggests that cooperative inquiry was invaluable in successfully navigating this uncertainty and negotiating the continuance of the research. Flexible, participatory methods such as cooperative inquiry will continue to be vital for successful health services research predicated on partnerships between researchers and health services into the future. They are also crucial for understanding local context and health services priorities and ways of working, and for decolonising Indigenous health research.

A Settings and Systems Approach to Promoting the Health and Wellbeing of People with an Intellectual Disability

Research has shown that people with an intellectual disability have higher rates of certain preventable health conditions and a higher rate of avoidable mortality relative to the general population. With respect to health behaviours, they also have lower levels of physical activity and poorer nutrition. Despite the increased health needs, this population cohort is less likely to have the opportunity to participate in health promotion programs. The interventions that have been delivered are programmatic and individual in focus and have lacked a broader ecological and settings focus, which makes them very difficult to scale. Health promotion programs designed for the general population, such as lifestyle campaigns, rarely reach people with an intellectual disability. This increases the importance of ensuring that the settings in which they live and engage with are as health promoting as possible. Interventions have been particularly absent in the workplace for people with an intellectual disability. This paper highlights gaps in a settings-and-systems-based approach to promoting the health and wellbeing of people with an intellectual disability, particularly with respect to workplace health promotion. The paper concludes with recommendations for a systems approach that integrates approaches across multiple settings to better promote the health of this population cohort.

Reconsidering performance management to support innovative changes in health care services

PURPOSE

A large number of studies indicate that coercive forms of organizational control and performance management in health care services often backfire and initiate dysfunctional consequences. The purpose of this article is to discuss new approaches to performance management in health care services when the purpose is to support innovative changes in the delivery of services.

DESIGN/METHODOLOGY/APPROACH

The article represents cross-boundary work as the theoretical and empirical material used to discuss and reconsider performance management comes from several relevant research disciplines, including systematic reviews of audit and feedback interventions in health care and extant theories of human motivation and organizational control.

FINDINGS

An enabling approach to performance management in health care services can potentially contribute to innovative changes. Key design elements to operationalize such an approach are a formative and learning-oriented use of performance measures, an appeal to self- and social-approval mechanisms when providing feedback and support for local goals and action plans that fit specific conditions and challenges.

ORIGINALITY/VALUE

The article suggests how to operationalize an enabling approach to performance management in health care services. The framework is consistent with new governance and managerial approaches emerging in public sector organizations more generally, supporting a higher degree of professional autonomy and the use of nonfinancial incentives.

Rethinking Barriers and Enablers in Qualitative Health Research: Limitations, Alternatives, and Enhancements

Explorations of barriers and enablers (or barriers and facilitators) to a desired health practice, implementation process, or intervention outcome have become so prevalent that they seem to be a default in much health services and public health research. In this article, we argue that decisions to frame research questions or analyses using barriers and enablers (B&Es) should not be default. Contrary to the strengths of qualitative research, the B&Es approach often bypasses critical reflexivity and can lead to shallow research findings with poor understanding of the phenomena of interest. The B&Es approach is untheorised, relying on assumptions of linear, unidirectional processes, universally desirable outcomes, and binary thinking which are at odds with the rich understanding of context and complexity needed to respond to the challenges faced by health services and public health. We encourage researchers to develop research questions using informed deliberation that considers a range of approaches and their implications for producing meaningful knowledge. Alternatives and enhancements to the B&Es approach are explored, including using 'whole package' methodologies; theories, conceptual frameworks, and sensitising ideas; and participatory methods. We also consider ways of advancing existing research on B&Es rather than doing 'more of the same': researchers can usefully investigate how a barrier or enabler works in depth; develop and test implementation strategies for addressing B&Es; or synthesise the B&Es literature to develop a new model or theory. Illustrative examples from the literature are provided. We invite further discussion on this topic.

The Limitations and Potentials of Evaluating Economic Aspects of Community-Based Health Promotion: A Critical Review

Community-based health promotion (CBHP) interventions are promising approaches to address public health problems; however, their economic evaluation presents unique challenges. This review aims to explore the opportunities and limitations of evaluating economic aspects of CBHP, focusing on the assessment of intervention costs and outcomes, and the consideration of political-level changes and health equity. A systematic search of the PubMed, Web of Science and PsycInfo databases identified 24 CBHP interventions, the majority of which targeted disadvantaged communities. Only five interventions included a detailed cost/resource assessment. Outcomes at the operational level were mainly quantitative, related to sociodemographics and environment or health status, while outcomes at the political level were often qualitative, related to public policy, capacity building or networks/collaboration. The study highlights the limitations of traditional health economic evaluation methods in capturing the complexity of CBHP interventions. It proposes the use of cost-consequence analysis (CCA) as a more comprehensive approach, offering a flexible and multifaceted assessment of costs and outcomes. However, challenges remain in the measurement and valuation of outcomes, equity considerations, intersectoral costs and attribution of effects. While CCA is a promising starting point, further research and methodological advancements are needed to refine its application and improve decision making in CBHP.

Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members' views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention's core functions and forms with the PRISM's contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework's 'outcomes cascade' to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate 'where things go wrong'. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

Fidelity-consistency and deliberateness of modifications in parenting programs

BACKGROUND

Evidence-based interventions (EBIs) are frequently modified in practice. It is recommended that decisions to modify EBIs should be made deliberately to ensure fidelity-consistency, yet the relationship between fidelity-consistency and deliberateness is not well understood. This study aims to explore modifications in a sample of practitioners delivering evidence-based parenting programs (i.e., interventions to strengthen parent-child relationships, reduce harmful interactions, and improve child health and well-being). The study investigated three research questions: (1) What kind of modifications are made during the delivery of parenting programs? (2) To what degree are the identified modifications consistent with the core functions of each program? and (3) Is deliberateness associated with the fidelity-consistency of the identified modifications?

METHODS

In total, 28 group leaders of five widely disseminated parenting programs in Sweden participated in five focus groups, and two participants from each group also participated in individual interviews (n = 10). A content analysis approach was used where the identification of modifications was directed by the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and then assessed for fidelity-consistency and four levels of deliberateness (universal, situational, conditional, and unintentional). Chi-square tests were performed to compare consistent and inconsistent modifications, and logistic regression was performed to explore whether deliberateness predicted consistency.

RESULTS

A total of 137 content modifications were identified, covering most of the content modification categories in FRAME. The most common were tailoring/tweaking/refining, adding elements, shortening/condensing, lengthening/extending, and integrating another treatment. Modifications were mostly fidelity-consistent but consistency varied greatly among categories. Furthermore, modifications made unintentionally or situationally were more likely to be fidelity-inconsistent.

CONCLUSIONS

These results indicate that explicit consideration of modifications and their impact could be essential for sustaining the fidelity-consistent use of EBIs, even as such interventions are continuously modified.

The current state of complex systems research on socioeconomic inequalities in health and health behavior-a systematic scoping review

BACKGROUND

Interest in applying a complex systems approach to understanding socioeconomic inequalities in health is growing, but an overview of existing research on this topic is lacking. In this systematic scoping review, we summarize the current state of the literature, identify shared drivers of multiple health and health behavior outcomes, and highlight areas ripe for future research.

METHODS

SCOPUS, Web of Science, and PubMed databases were searched in April 2023 for peer-reviewed, English-language studies in high-income OECD countries containing a conceptual systems model or simulation model of socioeconomic inequalities in health or health behavior in the adult general population. Two independent reviewers screened abstracts and full texts. Data on study aim, type of model, all model elements, and all relationships were extracted. Model elements were categorized based on the Commission on Social Determinants of Health framework, and relationships between grouped elements were visualized in a summary conceptual systems map.

RESULTS

A total of 42 publications were included; 18 only contained a simulation model, 20 only contained a conceptual model, and 4 contained both types of models. General health outcomes (e.g., health status, well-being) were modeled more often than specific outcomes like obesity. Dietary behavior and physical activity were by far the most commonly modeled health behaviors. Intermediary determinants of health (e.g., material circumstances, social cohesion) were included in nearly all models, whereas structural determinants (e.g., policies, societal values) were included in about a third of models. Using the summary conceptual systems map, we identified 15 shared drivers of socioeconomic inequalities in multiple health and health behavior outcomes.

CONCLUSIONS

The interconnectedness of socioeconomic position, multiple health and health behavior outcomes, and determinants of socioeconomic inequalities in health is clear from this review. Factors central to the complex system as it is currently understood in the literature (e.g., financial strain) may be both efficient and effective policy levers, and factors less well represented in the literature (e.g., sleep, structural determinants) may warrant more research. Our systematic, comprehensive synthesis of the literature may serve as a basis for, among other things, a complex systems framework for socioeconomic inequalities in health.

School-based interventions TO Prevent Dating and Relationship Violence and Gender-Based Violence: STOP-DRV-GBV systematic review

Background

Schools have a duty of care to prevent violence between students but a significant amount of dating and relationship violence and gender-based violence occurs in schools. These are important public health issues with important longitudinal consequences for young people.

Objectives

To understand functioning and effectiveness of school-based interventions for the prevention of dating and relationship violence and gender-based violence.

Review methods

We undertook a mixed-methods systematic review to synthesise different types of evidence relating to school-based interventions for the prevention of dating and relationship violence and gender-based violence to understand if, how and in what ways these interventions are effective. We searched 21 databases and 2 trial registers and undertook forwards and backwards citation chasing, author contact and other supplementary search methods. Searches identified all literature published to June 2021. All screening was undertaken in duplicate and independently, and we quality appraised all included studies.

Results

We included 247 reports (68 outcome evaluations, 137 process evaluations). Synthesis of intervention components produced an intervention typology: single-component, curricular, multicomponent, and multilevel programmes. Synthesis of intervention theories suggested that interventions aiming to increase students' sense of school belonging and sense of safety in the school building could encourage increased learning of prosocial skills and increased prosocial peer norms, and so potentially reducing dating and relationship violence and gender-based violence. Synthesis of factors affecting delivery highlighted school organisation and leaders who believed in the importance of addressing dating and relationship violence/gender-based violence, along with time and resources to deliver the interventions. The ease with which the intervention could be delivered and modified was also important. Meta-analysis found stronger evidence for intervention effectiveness in reducing dating and relationship violence than for gender-based violence, with significant long-term impacts on dating and relationship violence victimisation and perpetration, and some evidence that interventions in high-income countries could be effective for reducing victimisation and perpetration of gender-based violence in the long-term. Impacts on knowledge and attitudes were primarily short-term. Network meta-analysis did not suggest superiority of any intervention type. Moderation evidence suggested interventions reduced dating and relationship violence perpetration in boys more than girls, but reduced gender-based violence perpetration more in girls. Metaregression by intervention component did not explain heterogeneity in effectiveness, but qualitative comparative analysis suggested that reducing perpetration was important to reducing victimisation, and that perpetration could be reduced via focus on interpersonal skills, guided practice and (for gender-based violence) implementation of social structural components.

Limitations

Despite an exhaustive search, trials may have been missed and risk of publication bias was high for several analyses.

Conclusions

This is the most comprehensive systematic review of school-based interventions for dating and relationship violence and gender-based violence to date. It is clear that the prevention of dating and relationship violence and gender-based violence in schools will require longer-term investment to show benefit.

Future work

Future research is needed to understand why intervention effectiveness appears stronger for dating and relationship violence than gender-based violence.

Study registration

The study is registered as PROSPERO CRD42020190463.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme (NIHR award ref: NIHR130144) and is published in full in Public Health Research; Vol. 12, No. 3. See the NIHR Funding and Awards website for further award information.

Exploring settings as social complex adaptive systems in setting-based health research: a scoping review

Since launching health health-promoting settings approach to health by WHO, valuable progress has happened in implementing its holistic concepts in settings such as cities, schools, workplaces, hospitals and healthcare services. However, significant knowledge-intention-success gaps still exist in creating sustainable health-promoting changes in settings. The complexity of the task of bridging this gap has contributed to the call for a complexity-informed paradigm shift to health as well as settings, followed by increasing consultation of relevant complexity theories, frameworks and tools in health research. This paper provides a critical scoping review of the application of complex adaptive system (CAS) theory in settings-based health promotion research. We included 14 papers, mostly qualitative studies, reporting on planning or implementation of change initiatives, less on its evaluation. CAS theory application was often incomplete thereby reducing the potential benefit of using this lens to understand change management. We suggest some recommendations how to comprehensively apply the CAS theory in setting-based health research and to report on all CAS characteristics to enhance the understanding of settings as adaptive health-promoting settings.

Untangling the complex implementation process of community-based health promotion: a multiple-case study in the Netherlands

Community-based programmes are a widely implemented approach for population health promotion. Due to the context-dependent and dynamic nature of these programmes, evaluating their implementation is challenging. Identifying key events in the implementation process in evaluation could enable us to support future implementation, while acknowledging the complexity of real-world implementation. We studied the nationwide implementation of the Dutch Healthy Youth, Healthy Future (JOGG) approach, a community-based programme for childhood overweight prevention. The aims of our study were (i) to gain insights into the implementation process of the JOGG approach, and (ii) to identify key events that influenced said process. In nine communities, we conducted interviews (n = 24) with coordinators and stakeholders involved in the implementation of the JOGG approach and collected documents on the programme's implementation. We applied the analytical tool 'Critical Event Card' to identify key events in the implementation process. Results showed that in 5-10 years of implementing the JOGG approach, communities have undergone different phases: preparation, upscaling, resource mobilization, integration with other policy initiatives and adaptation of the implementation strategy. Key events influencing the implementation process included national policy developments (e.g. new health programmes), framing of the JOGG approach in local policy, staff turnover and coordination teams' experiences and actions. Furthermore, changes in implementation were often triggered by the destabilization of the implementation process and linked to opportunities for change in the policy process. The identified key events can inform future implementation of the JOGG approach as well as other community-based health promotion programmes.

A 16-Year Chronicle of Developing a Healthy Workplace Participatory Program for Total Worker Health® in the Connecticut Department of Correction: The Health Improvement through Employee Control (HITEC) Program

Health Improvement Through Employee Control (HITEC) is a 16-year program directed toward the health of corrections personnel and developed through the application of the principles of Participatory Action Research (PAR) and participatory ergonomics. Its impetus has always been the adverse health status of the corrections workforce: early mortality, depression, obesity, and hypertension. The HITEC program trained small "Design Teams" (DTs) of front-line personnel in participatory methods for intervention design for health improvement and organizational change in line with the Total Worker Health® principles. Periodic surveys and physical testing were introduced for longitudinal assessments. Comparative interventions at comparable sites included DTs without a priori assignation, problem-focused kaizen effectiveness teams (KETs), and bargaining unit-centered DTs. DT resilience and the replacement of members who transferred facilities or retired was aided by novel cooperative administrative structures. DT-generated interventions included stress lounges, changes in critical event report writing, a joint program with trained inmates to improve air quality, and training in staff mental health and sleep behavior. A specialized peer-to-peer Health Mentoring Program (HMP) paired new officers with trained peers. Many interventions and program features were institutionalized, thus improving prospects for self-supporting program longevity. Participatory interventions designed and supported by the corrections workforce were found to be both feasible and exceptionally effective.

Development of an integrated and decentralised skin health strategy to improve experiences of skin neglected tropical diseases and other skin conditions in Atwima Mponua District, Ghana

Integrated strategies are recommended to tackle neglected tropical diseases of the skin (skin NTDs), which pose a substantial health and economic burden in many countries, including Ghana. We describe the development of an integrated and decentralised skin health strategy designed to improve experiences of skin NTDs in Atwima Mponua district in Ashanti Region. A multidisciplinary research team led an iterative process to develop an overall strategy and specific interventions, based on a theory of change informed by formative research conducted in Atwima Mponua district. The process involved preparatory work, four co-development workshops (August 2021 to November 2022), collaborative working groups to operationalise intervention components, and obtaining ethical approval. Stakeholders including affected individuals, caregivers, other community members and actors from different levels of the health system participated in co-development activities. We consulted these stakeholders at each stage of the research process, including discussion of study findings, development of our theory of change, identifying implementable solutions to identified challenges, and protocol development. Participants determined that the intervention should broadly address wounds and other skin conditions, rather than only skin NTDs, and should avoid reliance on non-governmental organisations and research teams to ensure sustainable implementation by district health teams and transferability elsewhere. The overall strategy was designed to focus on a decentralised model of care for skin conditions, while including other interventions to support a self-care delivery pathway, community engagement, and referral. Our theory of change describes the pathways through which these interventions are expected to achieve the strategy's aim, the assumptions, and problems addressed. This complex intervention strategy has been designed to respond to the local context, while maximising transferability to ensure wider relevance. Implementation is expected to begin in 2023.

Promoting Coordination and Collaboration in Tribal Home Visiting Programs in the United States

BACKGROUND

A joint statement from two federal agencies in the United States calls for coordination and collaboration between programs serving families of infants and toddlers who are at risk or developmentally delayed or disabled U.S. Department of Education and U.S. Department of Health and Human Services. Policy guidance: Joint statement on collaboration and coordination of the MIECHV and IDEA Part C programs. (2017). Individuals with Disabilities Education Act. ED/HHS Joint Guidance Document: Collaboration and Coordination of the Maternal, Infant, and Early Childhood Home Visiting Program and the Individuals with Disabilities Education Act Part C Programs. Young Native American children living on tribal lands in this country are currently eligible for two federal programs associated with these agencies which overlap in mission and implementation.

PURPOSE

This paper outlines potential strategies for creating a more seamless system of services for tribal families involving more centralized intake processes and procedures, cross training of staff to work across programs, and adopting more unifying approaches to program implementation.

CONCLUSION

A streamlined system of services will result in interventions that better support family and child outcomes while reducing duplication of services, consolidating the limited number of qualified professionals available to provide services, and increasing convenience and cultural attunement of services to Native American families currently participating in both programs.

NeuroRehabilitation OnLine: Description of a regional multidisciplinary group telerehabilitation innovation for stroke and neurological conditions using the Template for Intervention Description and Replication checklist

Background

Providing recommended amounts of rehabilitation for stroke and neurological patients is challenging. Telerehabilitation is viable for delivering rehabilitation and an acceptable adjunct to in-person therapy. NeuroRehabilitation OnLine (NROL) was developed as a pilot and subsequently operationalised as a regional innovation embedded across four National Health Service (NHS) Trusts.

Objective

To describe the NROL innovation to assist future implementation and replication efforts.

Methods

The Template for Intervention Description and Replication (TIDieR) checklist, with guidance from the TIDieR-Telehealth extension, was used to describe NROL. The description was developed collaboratively by clinical academics, therapists, managers and researchers. Updated Consolidated Framework for Implementation Research domains were used to describe the context in which the innovation was delivered.

Results

NROL delivers online group-based real-time neurorehabilitation with technology assistance. It incorporates multidisciplinary targeted therapy and peer support to complement existing therapy. Procedures, materials and structure are detailed to demonstrate how NROL is embedded within a healthcare system. NROL uses existing NHS therapy workforce alongside dedicated NROL roles, including an essential technology support role. Selection of NROL groups is dependent on patient needs. The NROL innovation is tailored over time in response to feedback. NROL described here is successfully integrated within a regional stroke and neurorehabilitation network, aligns with local and national strategies and capitalises on an existing clinical-academic partnership.

Conclusion

This comprehensive description of a regional NROL innovation, and clarification of core components, should facilitate other healthcare settings to adapt and implement NROL for their context. Continuous evaluation alongside implementation will ensure maximal impact for neurorehabilitation.

Promoting social, emotional, and cognitive development in early childhood: A protocol for early valuation of a culturally adapted digital tool for supporting optimal childrearing practices

Objective

The Thrive by Five app promotes positive interactions between children and parents, extended family, and trusted community members that support optimal socio-emotional and cognitive development in the early years. This article aims to describe the protocol for a prospective mixed-methods multi-site study evaluating Thrive by Five using surveys, interviews, workshops, audio diaries from citizen ethnographers and app usage data.

Methods

The study activities and timelines differ by site, with an extensive longitudinal evaluation being conducted at two sites and a basic evaluation being conducted at five sites. The learnings from the more comprehensive evaluations inform the iterative research and development processes while also ensuring ongoing evaluation of usability, acceptability and effectiveness of the app and its content across varying contexts. The study evaluates: (1) the impact of the Thrive by Five content on caregiver knowledge, behaviours, attitudes and confidence; (2) how the content changes relationships at the familial, community and system level; (3) how cultural and contextual factors influence content engagement and effectiveness and (4) the processes that facilitate or disrupt the success of the implementation and dissemination.

Results

All in-country partners have been identified and data collection has been completed in Indonesia, Malaysia, Afghanistan, Kyrgyzstan, Uzbekistan, Namibia and Cameroon.

Conclusions

Very few digital health solutions have been trialled for usability and effectiveness in diverse cultural contexts. By combining quantitative, qualitative, process and ethnographic methodologies, this innovative study informs the iterative and ongoing optimisation of the cultural and contextual sensitivity of the Thrive by Five content and the processes supporting implementation and dissemination.

Identifying the Active Ingredients of a Computerized Speech and Language Therapy Intervention for Poststroke Aphasia: Multiple Methods Investigation Alongside a Randomized Controlled Trial

BACKGROUND

Aphasia is a communication disorder affecting more than one-third of stroke survivors. Computerized Speech and Language Therapy (CSLT) is a complex intervention requiring computer software, speech and language therapists, volunteers, or therapy assistants, as well as self-managed practice from the person with aphasia. CSLT was found to improve word finding, a common symptom of aphasia, in a multicenter randomized controlled trial (Clinical and Cost Effectiveness of Computer Treatment for Aphasia Post Stroke [Big CACTUS]).

OBJECTIVE

This study provides a detailed description of the CSLT intervention delivered in the Big CACTUS trial and identified the active ingredients of the intervention directly associated with improved word finding for people with aphasia.

METHODS

We conducted a multiple methods study within the context of a randomized controlled trial. In study 1, qualitative interviews explored key informants' understanding of the CSLT intervention, how the components interacted, and how they could be measured. Qualitative data were transcribed verbatim and analyzed thematically. Qualitative findings informed the process measures collected as part of a process evaluation of the CSLT intervention delivered in the Big CACTUS trial. In study 2, quantitative analyses explored the relationship between intervention process measures (length of computer therapy access; therapists' knowledge of CSLT; degree of rationale for CSLT tailoring; and time spent using the software to practice cued confrontation naming, noncued naming, and using words in functional sentences) and change in word-finding ability over a 6-month intervention period.

RESULTS

Qualitative interviews were conducted with 7 CSLT approach experts. Thematic analysis identified four overarching components of the CSLT approach: (1) the StepByStep software (version 5; Steps Consulting Ltd), (2) therapy setup: tailoring and personalizing, (3) regular independent practice, and (4) support and monitoring. Quantitative analyses included process and outcome data from 83 participants randomized to the intervention arm of the Big CACTUS trial. The process measures found to be directly associated with improved word-finding ability were therapists providing a thorough rationale for tailoring the computerized therapy exercises and the amount of time the person with aphasia spent using the computer software to practice using words in functional sentences.

CONCLUSIONS

The qualitative exploration of the CSLT approach provided a detailed description of the components, theories, and mechanisms underpinning the intervention and facilitated the identification of process measures to be collected in the Big CACTUS trial. Quantitative analysis furthered our understanding of which components of the intervention are associated with clinical improvement. To optimize the benefits of using the CSLT approach for word finding, therapists are advised to pay particular attention to the active ingredients of the intervention: tailoring the therapy exercises based on the individual's specific language difficulties and encouraging people with aphasia to practice the exercises focused on saying words in functional sentences.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN68798818; https://www.isrctn.com/ISRCTN68798818.

Emergency Department Bridge Model and Health Services Use Among Patients With Opioid Use Disorder

STUDY OBJECTIVES

Little is known about the effectiveness of bridge clinics as transitional care programs for people with opioid use disorder in emergency departments (EDs). We assessed the effect of bridge clinic referral on health services use among patients with opioid use disorder identified in the ED.

METHODS

We used data for individuals aged 18 years and over with active opioid use disorder and no history of medication for opioid use disorder who were administered medication for opioid use disorder while in the ED between January 2013 and August 2022. Bridge clinic referrals started in January 2021. Eligible patients after this date comprised the intervention group. The usual care group included eligible patients before bridge clinic implementation, who were a 1:1 propensity score matched to intervention patients. We estimated risk differences and 95% confidence limits for linkage to long-term care, ED use, and inpatient admission within 120 days of the index ED visit.

RESULTS

Our study population comprised 928 observations after matching. Patients referred to the bridge clinic had a higher risk of linkage to long-term care (risk differences=25%; 95% confidence limits: 20%, 30%), higher risk of ED use (risk differences=7.5%, 95% confidence limits: 1.6%, 13%), and lower risk of inpatient admission (risk differences= -1.9%, 95% confidence limits: -5.9%, 2.1%). Inpatient admission increased among patients with serious mental illness but decreased among patients without serious mental illness.

CONCLUSION

Our overall results suggest that bridge clinic referral increases linkage to long-term care. Nevertheless, qualitatively different effects on inpatient admission between patients with and without serious mental illness warrant consideration of unmet needs among patients with serious mental illness.

Essential content for teaching implementation practice in healthcare: a mixed-methods study of teams offering capacity-building initiatives

BACKGROUND

Applying the knowledge gained through implementation science can support the uptake of research evidence into practice; however, those doing and supporting implementation (implementation practitioners) may face barriers to applying implementation science in their work. One strategy to enhance individuals' and teams' ability to apply implementation science in practice is through training and professional development opportunities (capacity-building initiatives). Although there is an increasing demand for and offerings of implementation practice capacity-building initiatives, there is no universal agreement on what content should be included. In this study we aimed to explore what capacity-building developers and deliverers identify as essential training content for teaching implementation practice.

METHODS

We conducted a convergent mixed-methods study with participants who had developed and/or delivered a capacity-building initiative focused on teaching implementation practice. Participants completed an online questionnaire to provide details on their capacity-building initiatives; took part in an interview or focus group to explore their questionnaire responses in depth; and offered course materials for review. We analyzed a subset of data that focused on the capacity-building initiatives' content and curriculum. We used descriptive statistics for quantitative data and conventional content analysis for qualitative data, with the data sets merged during the analytic phase. We presented frequency counts for each category to highlight commonalities and differences across capacity-building initiatives.

RESULTS

Thirty-three individuals representing 20 capacity-building initiatives participated. Study participants identified several core content areas included in their capacity-building initiatives: (1) taking a process approach to implementation; (2) identifying and applying implementation theories, models, frameworks, and approaches; (3) learning implementation steps and skills; (4) developing relational skills. In addition, study participants described offering applied and pragmatic content (e.g., tools and resources), and tailoring and evolving the capacity-building initiative content to address emerging trends in implementation science. Study participants highlighted some challenges learners face when acquiring and applying implementation practice knowledge and skills.

CONCLUSIONS

This study synthesized what experienced capacity-building initiative developers and deliverers identify as essential content for teaching implementation practice. These findings can inform the development, refinement, and delivery of capacity-building initiatives, as well as future research directions, to enhance the translation of implementation science into practice.

Delivery of a novel intervention to facilitate liberation from mechanical ventilation in paediatric intensive care: A process evaluation

BACKGROUND

Prolonged mechanical ventilation increases the risk of mortality and morbidity. Optimising sedation and early testing for possible liberation from invasive mechanical ventilation (IMV) has been shown to reduce time on the ventilator. Alongside a multicentre trial of sedation and ventilation weaning, we conducted a mixed method process evaluation to understand how the intervention content and delivery was linked to trial outcomes.

METHODS

10,495 children admitted to 18 paediatric intensive care units (ICUs) in the United Kingdom participated in a stepped-wedge, cluster randomised controlled trial, with 1955 clinical staff trained to deliver the intervention. The intervention comprised assessment and optimisation of sedation levels, and bedside screening of respiratory parameters to indicate readiness for a spontaneous breathing trial prior to liberation from ventilation. 193 clinical staff were interviewed towards the end of the trial. Interview data were thematically analysed, and quantitative adherence data were analysed using descriptive statistics.

RESULTS

The intervention led to a reduced duration of IMV (adjusted median difference- 7.1 hours, 95% CI -9.6 to -5.3, p = 0.01). Overall intervention adherence was 75% (range 59-85%). Ease and flexibility of the intervention promoted it use; designated responsibilities, explicit pathways of decision-making and a shared language for communication fostered proactivity and consistency towards extubation. Delivery of the intervention was hindered by established hospital and unit organisational and patient care routines, clinician preference and absence of clinical leadership.

CONCLUSIONS

The SANDWICH trial showed a significant, although small, reduction in duration of IMV. Findings suggest that greater direction in decision-making pathways, robust embedment of new practice in unit routine, and capitalising on the skills of Advanced Nurse Practitioners and physiotherapists would have contributed to greater intervention effect.

TRIAL REGISTRATION

isrctn.org Identifier: ISRCTN16998143.

A health-social service partnership programme for improving the health self-management of community-dwelling older adults: a hybrid effectiveness-implementation pilot study protocol

BACKGROUND

The ageing population requires seamless, integrated health and social care services in the community to promote the health of older adults. However, inadequate financial resources, a lack of clear operational guidelines, and various organisational work cultures may affect the implementation quality and sustainability of these services. As a unique approach, this study seeks to examine the preliminary effects of a health-social partnership programme on the health self-management of community-dwelling older adults in Hong Kong. Additionally, the study seeks to ascertain key insights into the mechanisms and processes required to implement and sustain a self-care management programme in broader practice in community settings.

METHODS

This study will use a hybrid effectiveness-implementation design. During the 3-month programme, subjects in the intervention group will receive four Zoom video conference sessions and four telephone calls conducted by a health-social service team that will include a nurse case manager, community workers, general practitioners, a Chinese medicine practitioner, and social workers. Subjects in the control group will receive a monthly social telephone call from a trained research assistant to rule out the possible social effect of the intervention. The reach, effectiveness, adoption, implementation, and maintenance framework (i.e. RE-AIM framework) will be used to evaluate the implementation and effectiveness outcomes. Of the five dimensions included in the RE-AIM framework, only effectiveness and maintenance outcomes will be collected from both the intervention and control groups. The outcomes of the other three dimensions-reach, adoption, and implementation-will only be collected from subjects in the intervention group. Data will be collected pre-intervention, immediately post-intervention, and 3 months after the intervention is completed to evaluate the maintenance effect of the programme.

DISCUSSION

This programme will aim to enhance health-promoting self-care management behaviours in older adults dwelling in the community. This will be the first study in Hong Kong to use the hybrid effectiveness-implementation design and involve key stakeholders in the evaluation and implementation of a health self-management programme using a health-social service partnership approach. The programme, which will be rooted in the community, may be used as a model, if proven successful, for similar types of services.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT04442867. Submitted 19 June 2020.

The theoretical and practical difficulties of evaluating a community-based 'whole systems' obesity prevention intervention: a research team's critical reflection

AIMS

This article critically discusses the purpose, pragmatics and politics of conducting commissioned evaluations on behalf of public sector organisations by drawing on the experience of evaluating a community-based 'whole systems' obesity prevention intervention for an English local council.

METHODS

The study presented in this article incorporated two approaches: an evaluability assessment that interrogated the theoretical and practical difficulties of evaluating the intervention in a non-political way, and a retrospective analysis using Soft Systems Methodology that interrogated the more political difficulties of conducting such an evaluation in the 'real world'. The information and insights that enabled these reflections came from over 3 years of working closely with the programme team, attending and participating in stakeholder events and meetings, presenting to the Council's Scrutiny Committee meetings, four interviews with the programme manager, and multiple face-to-face group meetings, email exchanges and telephone conversations.

RESULTS

The study reveals and analyses three key inter-related challenges that arose during the evaluation of the 'whole systems' obesity prevention intervention: the programme's evaluability, the evaluation purpose, and the nature, role and quality of evidence.

CONCLUSIONS

The evaluability assessment was important for defining the programme's theoretical and practical evaluability, and the retrospective analysis using Soft Systems Methodology enabled a greater understanding of the political tensions that existed. Key learning points related to the challenges that arose during this evaluation have broad applicability.

Frameworks for cultural adaptation of psychosocial interventions: A systematic review with narrative synthesis

INTRODUCTION

Psychosocial dementia interventions may be less effective when used with populations for whom they were not initially intended. Cultural adaptation of interventions aims to increase effectiveness of interventions by enhancing cultural relevance. Use of theoretical frameworks may promote more systematic cultural adaptation. The aim of this review was to provide a comprehensive synthesis of published cultural adaptation frameworks for psychosocial interventions to understand important elements of cultural adaptation and guide framework selection.

METHOD

Five scientific databases, grey literature and reference lists were searched to January 2023 to identify cultural adaptation frameworks for psychosocial interventions. Papers were included that presented cultural adaptation frameworks for psychosocial interventions. Data were mapped to the framework for reporting adaptations and modifications to evidence-based interventions, then analysed using thematic synthesis.

RESULTS

Twelve cultural adaptation frameworks met inclusion criteria. They were mostly developed in the United States and for adaptation of psychological interventions. The main elements of cultural adaptation for psychosocial interventions were modifying intervention content, changing context (where, by whom an intervention is delivered) and consideration of fidelity to the original intervention. Most frameworks suggested that key intervention components must be retained to ensure fidelity, however guidance was not provided on how to identify or retain these key components. Engagement (ways to reach and involve recipients) and cultural competence of therapists were found to be important elements for cultural adaptation.

CONCLUSIONS

Comprehensive frameworks are available to guide cultural adaptation of psychosocial dementia interventions. More work is required to articulate how to ensure fidelity during adaptation, including how to identify and retain key intervention components.

A complexity-informed in-depth case study into the sustainability and impact of a culture of health: The TR14ers community youth dance group

There are calls for researchers to study existing community assets and activities that appear to improve health and have achieved longevity. The TR14ers Community Dance Charity Limited is a community youth dance group that has been running since 2005 providing free weekly sessions for children and adolescents in an economically disadvantaged town in the UK. An in-depth case study employing qualitative, quantitative and participatory methods was undertaken with the TR14ers (current participants and those who have left, co-ordinators and families) over 6 months with the aim of understanding the sustainable processes and impact of the Group. The 12 complex systems' leverage points described by Meadows and the five domains of adolescent wellbeing developed by the United Nations H6+ Technical Working Group on Adolescent Health and Well-Being were used as frameworks to recognise the complexity of community assets like the TR14ers. The quantitative and qualitative data indicated that being part of the TR14ers contributed to multiple health and wellbeing outcomes. The positive experiences of being a TR14er led members to actively recruit others through word of mouth and public performances. Central to the TR14ers is a commitment to children's rights, which is communicated formally and informally throughout the membership informing how and what the Group does, leading to the structure and delivery of the Group evolving over time. Members sought to ensure the sustainability of the Group after they had left and were keen to mentor younger members to develop and become the leaders. Based on the insights from this case study we suggest that efforts to develop cultures of health, like the TR14ers, should focus on the core values of the activity or intervention that underpin what it does and how within the local context.

Patterns in bottlenecks for implementation of health promotion interventions: a cross-sectional observational study on intervention-context interactions in the Netherlands

BACKGROUND

From a complex systems perspective, implementation should be understood as the introduction of an intervention in a context with which it needs to interact in order to achieve its function in terms of improved health. The presence of intervention-context interactions could mean that during implementation particular patterns of crucial interaction points might arise. We examined the presence of - and regularities in - such 'bottlenecks for implementation', as this could create opportunities to predict and intervene in potential implementation problems.

METHODS

We conducted a cross-sectional observational study against the background of municipal intersectoral policymaking in the Netherlands. We asked implementers of health promotion interventions to identify bottlenecks by rating the presence and importance of conditions for implementation in a range of intervention systems. We used descriptive statistics to characterize these systems (by their behaviour change method, health theme and implementation setting) and the conditions that acted as bottlenecks. After stratifying bottlenecks by intervention system and the system's characteristics, we tested our hypotheses by comparing the number and nature of the bottlenecks that emerged.

RESULTS

More than half of the possible conditions were identified as a bottleneck for implementation. Bottlenecks occurred in all categories of conditions, e.g., relating to the implementer, the intervention, and political and administrative support, and often connected with intersectoral policymaking, e.g., relating to the co-implementer and the co-implementer's organization. Both our hypotheses were supported: (1) Each intervention system came across a unique set of - a limited number of - conditions hampering implementation; (2) Most bottlenecks were associated with the characteristics of the system in which they occurred, but bottlenecks also appeared in the absence of such an association, or remained absent in the presence thereof.

CONCLUSIONS

We conclude that intervention-context interactions in integrated health policymaking may lead to both regularities and variations in bottlenecks for implementation. Regularities may partly be predicted by the function of an intervention system, and may serve as the basis for building the capacity needed for the structural changes that can bring about long-lasting health improvements. Variations may point at the need for flexibility in further tailoring the implementation approach to the - mostly unpredictable - problems at individual sites.

Evaluating an intervention to improve the safety and experience of transitions from hospital to home for older people (Your Care Needs You): a protocol for a cluster randomised controlled trial and process evaluation

BACKGROUND

Older patients often experience safety issues when transitioning from hospital to home. The 'Your Care Needs You' (YCNY) intervention aims to support older people to 'know more' and 'do more' whilst in hospital so that they are better prepared for managing at home.

METHODS

A multi-centre cluster randomised controlled trial (cRCT) will evaluate the effectiveness and cost-effectiveness of the YCNY intervention. Forty acute hospital wards (clusters) in England from varying medical specialities will be randomised to deliver YCNY or care-as-usual on a 1:1 basis. The primary outcome will be unplanned hospital readmission rates within 30 days of discharge. This will be extracted from routinely collected data of at least 5440 patients (aged 75 years and older) discharged to their own homes during the 4- to 5-month YCNY intervention period. A nested cohort of up to 1000 patients will be recruited to the study to collect secondary outcomes via follow-up questionnaires at 5-, 30- and 90-day post-discharge. These will include measures of patient experience of transitions, patient-reported safety events, quality of life and healthcare resource use. Unplanned hospital readmission rates at 60 and 90 days of discharge will be collected from routine data. A process evaluation (primarily interviews and observations with patients, carers and staff) will be conducted to understand the implementation of the intervention and the contextual factors that shape this, as well as the intervention's underlying mechanisms of action. Fidelity of intervention delivery will also be assessed across all intervention wards.

DISCUSSION

This study will establish the effectiveness and cost-effectiveness of the YCNY intervention which aims to improve patient safety and experience for older people during transitions of care. The process evaluation will generate insights about how the YCNY intervention was implemented, what elements of the intervention work and for whom, and how to optimise its implementation so that it can be delivered with high fidelity in routine service contexts.

TRIAL REGISTRATION

UK Clinical Research Network Portfolio: 44559; ISTCRN: ISRCTN17062524. Registered on 11/02/2020.

Investigating health and social outcomes of the Big Local community empowerment initiative in England: a mixed method evaluation

Background

Most research on community empowerment provides evidence on engaging communities for health promotion purposes rather than attempts to create empowering conditions. This study addresses this gap.

Intervention

Big Local started in 2010 with £271M from the National Lottery. Ending in 2026, it gives 150 relatively disadvantaged communities in England control over £1M to improve their neighbourhoods.

Objective

To investigate health and social outcomes, at the population level and among engaged residents, of the community engagement approach adopted in a place-based empowerment initiative.

Study design, data sources and outcome variables

This study reports on the third wave of a longitudinal mixed-methods evaluation. Work package 1 used a difference-in-differences design to investigate the impact of Big Local on population outcomes in all 150 Big Local areas compared to matched comparator areas using secondary data. The primary outcome was anxiety; secondary outcomes included a population mental health measure and crime in the neighbourhood. Work package 2 assessed active engagement in Big Local using cross-sectional data and nested cohort data from a biannual survey of Big Local partnership members. The primary outcome was mental well-being and the secondary outcome was self-rated health. Work package 3 conducted qualitative research in 14 Big Local neighbourhoods and nationally to understand pathways to impact. Work package 4 undertook a cost-benefit analysis using the life satisfaction approach to value the benefits of Big Local, which used the work package 1 estimate of Big Local impact on life satisfaction.

Results

At a population level, the impacts on 'reporting high anxiety' (-0.8 percentage points, 95% confidence interval -2.4 to 0.7) and secondary outcomes were not statistically significant, except burglary (-0.054 change in z-score, 95% confidence interval -0.100 to -0.009). There was some effect on reduced anxiety after 2017. Areas progressing fastest had a statistically significant reduction in population mental health measure (-0.053 change in z-score, 95% confidence interval -0.103 to -0.002). Mixed results were found among engaged residents, including a significant increase in mental well-being in Big Local residents in the nested cohort in 2018, but not by 2020; this is likely to be COVID-19. More highly educated residents, and males, were more likely to report a significant improvement in mental well-being. Qualitative accounts of positive impacts on mental well-being are often related to improved social connectivity and physical/material environments. Qualitative data revealed increasing capabilities for residents' collective control. Some negative impacts were reported, with local factors sometimes undermining residents' ability to exercise collective control. Finally, on the most conservative estimate, the cost-benefit calculations generate a net benefit estimate of £64M.

Main limitations

COVID-19 impacted fieldwork and interpretation of survey data. There was a short 4-year follow-up (2016/20), no comparators in work package 2 and a lack of power to look at variations across areas.

Conclusions

Our findings suggest the need for investment to support community organisations to emerge from and work with communities. Residents should lead the prioritisation of issues and design of solutions but not necessarily lead action; rather, agencies should work as equal partners with communities to deliver change.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research Programme (16/09/13) and will be published in full in Public Health Research; Vol. 11, No. 9. See the NIHR Journals Library website for further project information.

Experiences in the application of logic models in the context of workplace health promotion - A focus group discussion

Gathering evidence on complex workplace health promotion interventions faces methodological challenges. Therefore, the application of logic models as a theory of change is recommended to support outcome and process evaluations. The present study explores challenges and opportunities of applying logic models in application-oriented intervention research on workplace health promotion. A focus group (n = 6), consisting of scientists and workplace health promotion practitioners, was conducted using a semi-structured interview guide. The recorded qualitative data were transcribed and analysed using the structuring content analysis method. According to the focus group, logic models provide several opportunities for planning and evaluating complex workplace health promotion interventions. Logic models support the communication between science and practice, and have benefits for the provider of workplace health promotion interventions. The main challenges in working with logic models were dealing with the complex and constantly developing intervention and with the derivation and implementation of reasonable evaluation methods. The focus group exposed repeated application and a shared understanding between stakeholders as facilitators for working with logic models. In conclusion, at the science-practice interface, logic models could enhance the integrative understanding and the further development of evidence-based workplace health promotion.

Adapting family-based treatment for adolescent anorexia nervosa delivered in the home: A novel approach for improving access to care and generalizability of skill acquisition

BACKGROUND

Anorexia nervosa (AN) is a serious mental illness associated with high rates of morbidity and mortality. Family-based treatment (FBT) is a well-established treatment for adolescent AN, yet it is underutilized in community settings and is unavailable to many families, particularly those from lower income and racial and ethnic minority backgrounds. Furthermore, some families do not respond optimally to FBT, possibly because of challenges translating skills acquired in office-based treatment settings to naturalistic settings. Home-based treatment could reduce barriers to access and enhance generalization of newly learned treatment skills. Home-based models demonstrate initial feasibility, acceptability, and efficacy for adolescent AN, however, FBT principles have yet to be applied as a stand-alone intervention in a home-based level of care. This paper describes the rationale for and process of adapting FBT principles/interventions to improve fit within a home-based model delivered in the context of community mental health, and discusses potential strengths and opportunities associated with this approach.

RESULTS

Adaptations were made through consultation with collaborating community agencies and were guided by the complex interventions framework. The primary modifications included: (1) altered dose; (2) multiple family meals; (3) additional support for meal preparation and supervision; (4) clinician attendance at medical appointments; (5) cultural adaptation; and (6) introduction of distress tolerance and emotion regulation skills.

CONCLUSIONS

Implementing FBT in the home may present one promising and novel approach to enhance engagement and treatment outcomes for adolescents with restrictive eating disorders, particularly those who are underserved, but evaluation of efficacy/effectiveness is needed.

Context matters-the phased development of an adaptable food literacy intervention: Up for Cooking

Adapting interventions to the context increases the impact and sustainability of interventions. Literature acknowledges the need to adapt existing interventions and that these adaptations should be clearly reported. However, little is known about how to incorporate adaptation from the beginning. This paper argues that interventions should be developed and adaptations should be made using an ongoing non-linear approach. An action-oriented research approach with feedback loops is proposed. We illustrate this with the development of a food literacy intervention 'Up for Cooking' (Dutch: Zin in Koken) and present lessons learned in developing, implementing and studying such adaptable interventions. Interventions should clearly define and differentiate the intervention function and form. Implementers, in turn, should be encouraged to tailor interventions within a form that fits with a specific context. Sufficient time, continuous adaptation based on co-creation, feedback loops and interdisciplinary collaboration are important prerequisites for the development of adaptable interventions.

Unpacking the Cinderella black box of complex intervention development through the Partners at Care Transitions (PACT) programme of research

INTRODUCTION

Complex intervention development has been described as the 'Cinderella' black box in health services research. Greater transparency in the intervention development process is urgently needed to help reduce research waste.

METHODS

We applied a new consensus-based framework for complex intervention development to our programme of research, in which we developed an intervention to improve the safety and experience of care transitions for older people. Through this process, we aimed to reflect on the framework's utility for intervention development and identify any important gaps within it to support its continued development.

FINDINGS

The framework was a useful tool for transparent reporting of the process of complex intervention development. We identified potential 'action' gaps in the framework including 'consolidation of evidence' and 'development of principles' that could bracket and steer decision-making in the process.

CONCLUSIONS

We consider that the level of transparency demonstrated in this report, aided through use of the framework, is essential in the quest for reducing research waste.

PATIENT OR PUBLIC CONTRIBUTION

We have involved our dedicated patient and public involvement group in all work packages of this programme of research. Specifically, they attended and contributed to co-design workshops and contributed to finalizing the intervention for the pilot evaluation. Staff also participated by attending co-design workshops, helping us to prioritize content ideas for the intervention and supporting the development of intervention components outside of the workshops.

Factors influencing social prescribing initiatives: a systematic review of qualitative evidence

AIMS

Social prescribing is a growing health policy agenda to improve the quality and effectiveness of health systems. However, systematically collected knowledge on factors influencing the effective implementation of SP is scarce. A systematic review was conducted to identify and categorize factors influencing social prescribing initiatives.

METHODS

A search of three electronic databases (PubMed, Scopus, and ISI Web of Knowledge) was carried out to retrieve studies from inception to May 2022, supplemented by grey literature searching and snowballing of the relevant references. The inclusion criteria were original empirical research, qualitative data collection, and a description of factors affecting social prescribing initiatives. Study quality was evaluated using the Critical Appraisal Skills Programme tool. We categorized the results of individual studies using a narrative approach.

RESULTS

A total of 23 studies were included for analysis. Along with patient-related factors (patient-centeredness, clinical complexity, perception, knowledge), three main settings of social prescribing initiatives (including healthcare providers, link workers, and voluntary and community sectors) are affected by (1) individual characteristics (knowledge, perception, skill mix); (2) interpersonal relations (collaboration, trust, feedback, supportive climate, follow-up, sustained connection, peer support within and across sectors); (3) organizational contingencies (resource adequacy, staffing, training, role description, continuity of support, caseload management, monitoring, affordability, accessibility, referral criteria, and tailored support); and (4) political context (national policy and guidance, stewardship, planning, cocreation, bureaucracy, economic condition, and the number of support organizations).

CONCLUSION

Many factors influencing social prescribing initiatives were identified. The results of this review can be applied by different stakeholders of social prescribing to guide development, implementation, description, and evaluation.

An external facilitation intervention to increase uptake of an adverse drug event reporting intervention

Background

Adverse drug events (ADEs) are a leading cause of emergency department visits and hospital admissions in Canada. ActionADE prevents repeat ADEs by enabling clinicians to document and communicate standardized ADE information across care settings. We used an external facilitation intervention to promote the uptake of ActionADE in four hospitals in British Columbia, Canada. This study examined whether, how and in what context external facilitation influenced the uptake of ActionADE.

Methods

In this convergent-parallel mixed-methods study, an external facilitator used a four-step iterative process to support site champions using context-specific implementation strategies to increase the ADE reporting rate at their sites. We extracted archival data to assess implementation determinants before and after the implementation of the external facilitation and implementation strategies. We also retrieved data on the mean monthly counts of reported ADEs for each user from the ActionADE server. Zero-inflated Poisson models were used to examine changes in mean monthly counts of reported ADEs per user between pre-intervention (June 2021 to October 2021) and intervention (November 2021 to March 2022) periods.

Results

The external facilitator and site champions co-created three functions: (1) educate pharmacists about what and how to report in ActionADE, (2) educate pharmacists about the impact of ActionADE on patient outcomes, and (3) provide social support for pharmacists to integrate ADE reporting into clinical workflows. Site champions used eight forms to address the three functions. Peer support and reporting competition were the two common strategies used by all sites. Sites' responses to external facilitation varied. The rate of mean monthly counts of reported ADEs per user significantly increased during the intervention period compared to the pre-intervention period at LGH (RR: 3.74, 95% CI 2.78 to 5.01) and RH (RR: 1.43, 95% CI 1.23 to 1.94), but did not change at SPH (RR: 0.68, 95% CI: 0.43 to 1.09) and VGH (RR: 1.17, 95% CI 0.92 to 1.49). Leave of absence of the clinical pharmacist champion and failure to address all identified functions were implementation determinants that influenced the effectiveness of external facilitation.

Conclusion

External facilitation effectively supported researchers and stakeholders to co-create context-specific implementation strategies. It increased ADE reporting at sites where clinical pharmacist champions were available, and where all functions were addressed.

A qualitative exploration of stakeholder perspectives on the implementation of a whole school approach to mental health and emotional well-being in Wales

Early intervention to support mental health and well-being of school-aged children may be of significant benefit in preventing escalation of mental health problems in later life. While there are limitations to current understanding of the best ways for schools to support mental well-being, a whole school approach (WSA), involving all those who are part of the school system in creating and sustaining a supportive environment where health is prioritized, may be effective. This research explored stakeholder views of this approach, as part of a contract commissioned by the Welsh Government to conduct an evaluability assessment of a WSA. Semistructured focus groups and interviews were completed with stakeholders from the health and education sectors, as well as parents, to explore how a WSA may operate in a Welsh context and barriers and facilitators to potential implementation and outcomes. Findings suggest that existing pressures on schools may impact implementation of a WSA, with school staff already time poor and many staff experiencing their own mental well-being challenges. Implementation may be supported by clear guidance at local and national levels, funding for staff time and training and stakeholder involvement at all stages. Long-term monitoring and evaluation are also needed to understand system changes.

The Need for Systems Approaches for Precision Communications in Public Health

A major challenge in communicating health-related information is the involvement of multiple complex systems from the creation of the information to the sources and channels of dispersion to the information users themselves. To date, public health communications approaches have often not adequately accounted for the complexities of these systems to the degree necessary to have maximum impact. The virality of COVID-19 misinformation and disinformation has brought to light the need to consider these system complexities more extensively. Unaided, it is difficult for humans to see and fully understand complex systems. Luckily, there are a range of systems approaches and methods, such as systems mapping and systems modeling, that can help better elucidate complex systems. Using these methods to better characterize the various systems involved in communicating public health-related information can lead to the development of more tailored, precise, and proactive communications. Proceeding in an iterative manner to help design, implement, and adjust such communications strategies can increase impact and leave less opportunity for misinformation and disinformation to spread.

How can climate change and its interaction with other compounding risks be considered in evaluation? Experiences from Vietnam

While evaluations play a critical role in accounting for and learning from context, it is unclear how evaluations can take account of climate change. Our objective was to explore how climate change and its interaction with other contextual factors influenced One Health food safety programs. To do so, we integrated questions about climate change into a qualitative evaluation study of an ongoing, multi-sectoral program aiming to improve pork safety in Vietnam called SafePORK. We conducted remote interviews with program researchers (n = 7) and program participants (n = 23). Based on our analysis, researchers believed climate change had potential impacts on the program but noted evidence was lacking, while program participants (slaughterhouse workers and retailers) shared how they were experiencing and adapting to the impacts of climate change. Climate change also interacted with other contextual factors to introduce additional complexities. Our study underscored the importance of assessing climate factors in evaluation and building adaptive capacity in programming.