Lessons from complex interventions to improve health

Using a health equity lens to measure patient experiences of care in diverse health care settings

People who are structurally disadvantaged and marginalized often report poor health care experiences, such as inequitable treatment, due to intersecting forms of stigma and discrimination. There are many measures of patient experiences of care, however, few are designed to measure equity-oriented health care. In alignment with ongoing calls to integrate actions in support of health equity, we report on the development and testing of patient-reported experience measures that explicitly use a health equity and intersectional lens. Our analysis focuses on two different scales: the Equity-Oriented Health Care Scale-Ongoing, which was evaluated in primary health care settings where patients have an ongoing relationship with providers over time, and the Equity-Oriented Health Care Scale-Episodic, which was tested in an emergency department where care is provided on an episodic basis. Item Response Theory was used to develop and refine the scales. The psychometric properties of each scale were also evaluated. The Equity-Oriented Health Care Scale-Ongoing was first tested with a cohort of 567 patients. The Equity-Oriented Health Care Scale-Episodic was subsequently tested in an emergency department setting with 284 patients. Results of the Item Response Theory analysis for each scale yielded a brief index that captured the level of equity-oriented care when care is ongoing (12 items) or episodic (9 items). Both scales showed evidence of internal consistency and concurrent validity, based on a high correlation with quality of care. They are brief, easy-to-administer patient-reported experience measures that can support organizations to monitor quality of care. Their availability enhances the possibility of measuring equity-oriented health care in diverse contexts and can provide nuanced understandings of quality of care through an intersectional and equity lens.

A manifesto for improving cancer detection: four key considerations when implementing innovations across the interface of primary and secondary care

Improving cancer outcomes through innovative cancer detection initiatives in primary care is an international policy priority. There are unique implementation challenges to the roll-out and scale-up of different innovations, requiring synchronisation between national policy levers and local implementation strategies. We draw on implementation science to highlight key considerations when seeking to sustainably embed cancer detection initiatives within health systems and clinical practice. Points of action include considering the implications of change on the current configuration of responsibility for detecting cancer; investing in understanding how to adapt systems to support innovations; developing strategies to address inequity when planning innovation implementation; and anticipating and making efforts to mitigate the unintended consequences of innovation. We draw on examples of contemporary cancer detection issues to illustrate how to apply these recommendations to practice.

How do behavioral public policy experts see the role of complex systems perspectives? An expert interview study

Amidst the global momentum of behavioral insights (BI), there has been a shift from mostly nudge-based BI applications to systemic approaches. This is particularly pressing in public health, where interacting issues regularly produce unanticipated consequences. Regardless, little is known about adopting complex systems approaches in behavioral public policy. This study aims to capture current practices of international BI experts on the definition, application, drivers, and hindering factors in adopting complex systems approaches in public policy. Semi-structured individual expert interviews (n = 12) of international BI experts with extensive experience in educating, cooperating with, and/or advising public servants were analyzed with inductive content analysis. While the working definition of BI aligned with published definitions, experts varied in their descriptions of complex systems approaches and its significance for public policy, including socioecological aspects, systematic BI use across policy stages, recognizing intertwined behavior, and lack of ready-made solutions. They emphasized the importance of systems approaches, identifying drivers (e.g. need for a broader focus) and hindrances (e.g. pressure for quick results). Embracing complex systems in behavioral public policy provides a holistic perspective, extending beyond simple nudges, sometimes presumed as universally applicable. While complexity perspectives would align with policymakers' worldview, applications require more work to tailor to local situations and to evaluate. Recognizing that, given their distinct expertise content, BI expertise can be quite different from complex systems expertise. The field would benefit from clear descriptions and specialized training for effective integration and advocacy for these approaches.

HCI Contributions in Mental Health: A Modular Framework to Guide Psychosocial Intervention Design

Many people prefer psychosocial interventions for mental health care or other concerns, but these interventions are often complex and unavailable in settings where people seek care. Intervention designers use technology to improve user experience or reach of interventions, and HCI researchers have made many contributions toward this goal. Both HCI and mental health researchers must navigate tensions between innovating on and adhering to the theories of change that guide intervention design. In this paper, we propose a framework that describes design briefs and evaluation approaches for HCI contributions at the scopes of capabilities, components, intervention systems, and intervention implementations. We show how theories of change (from mental health) can be translated into design briefs (in HCI), and that these translations can bridge and coordinate efforts across fields. It is our hope that this framework can support researchers in motivating, planning, conducting, and communicating work that advances psychosocial intervention design.

How can asset-based approaches reduce inequalities? Exploring processes of change in England and Spain

Initiatives to promote health and reduce inequalities in place-based communities have increasingly adopted asset-based approaches (ABAs). However, the processes through which such initiatives might reduce inequalities are not well understood, and evidence of their impact on health is still limited. This study aimed to understand how ABAs can impact practices, relationships and the redistribution of resources to reduce health inequalities in and between less advantaged neighbourhoods. Qualitative research was conducted in two settings (England and Spain) where similar asset-based initiatives, aimed at training community members to become health promoters, were being implemented. Data were collected using theory of change workshops, 120 hours of observations and semi-structured interviews with 44 stakeholders (trained community members, voluntary and community sector organizations' workers and health professionals). A thematic analysis informed by systems thinking was carried out. Three main processes of change were identified: first, 'enabling asset-based thinking' defined as supporting people to adopt a view that values their own resources and people's skills and expertise. Second, 'developing asset-based capacities', described as developing personal skills, knowledge, self-confidence and relationships underpinned by asset-based thinking. Finally, 'changing decision-making and wider health determinants through ABAs' referred to achieving changes in neighbourhoods through mobilizing the asset-based capacities developed. These processes were associated with changes at an individual level, with potential to contribute to reducing inequalities through supporting individual empowerment and social capital. However, contextual factors were found key to enable or hinder changes in the neighbourhoods and acted as barriers to processes of collective empowerment, thus limiting ABAs' impact on health inequalities.

The Benefits of Cooperative Inquiry in Health Services Research: Lessons from an Australian Aboriginal and Torres Strait Islander Health Study

Health services research is underpinned by partnerships between researchers and health services. Partnership-based research is increasingly needed to deal with the uncertainty of global pandemics, climate change induced severe weather events, and other disruptions. To date there is very little data on what has happened to health services research during the COVID-19 pandemic. This paper describes the establishment of an Australian multistate Decolonising Practice research project and charts its adaptation in the face of disruptions. The project used cooperative inquiry method, where partner health services contribute as coresearchers. When the COVID-19 pandemic hit, data collection needed to be immediately paused, and when restrictions started to lift, all research plans had to be renegotiated with services. Adapting the research surfaced health service, university, and staffing considerations. Our experience suggests that cooperative inquiry was invaluable in successfully navigating this uncertainty and negotiating the continuance of the research. Flexible, participatory methods such as cooperative inquiry will continue to be vital for successful health services research predicated on partnerships between researchers and health services into the future. They are also crucial for understanding local context and health services priorities and ways of working, and for decolonising Indigenous health research.

A Settings and Systems Approach to Promoting the Health and Wellbeing of People with an Intellectual Disability

Research has shown that people with an intellectual disability have higher rates of certain preventable health conditions and a higher rate of avoidable mortality relative to the general population. With respect to health behaviours, they also have lower levels of physical activity and poorer nutrition. Despite the increased health needs, this population cohort is less likely to have the opportunity to participate in health promotion programs. The interventions that have been delivered are programmatic and individual in focus and have lacked a broader ecological and settings focus, which makes them very difficult to scale. Health promotion programs designed for the general population, such as lifestyle campaigns, rarely reach people with an intellectual disability. This increases the importance of ensuring that the settings in which they live and engage with are as health promoting as possible. Interventions have been particularly absent in the workplace for people with an intellectual disability. This paper highlights gaps in a settings-and-systems-based approach to promoting the health and wellbeing of people with an intellectual disability, particularly with respect to workplace health promotion. The paper concludes with recommendations for a systems approach that integrates approaches across multiple settings to better promote the health of this population cohort.

Reconsidering performance management to support innovative changes in health care services

PURPOSE

A large number of studies indicate that coercive forms of organizational control and performance management in health care services often backfire and initiate dysfunctional consequences. The purpose of this article is to discuss new approaches to performance management in health care services when the purpose is to support innovative changes in the delivery of services.

DESIGN/METHODOLOGY/APPROACH

The article represents cross-boundary work as the theoretical and empirical material used to discuss and reconsider performance management comes from several relevant research disciplines, including systematic reviews of audit and feedback interventions in health care and extant theories of human motivation and organizational control.

FINDINGS

An enabling approach to performance management in health care services can potentially contribute to innovative changes. Key design elements to operationalize such an approach are a formative and learning-oriented use of performance measures, an appeal to self- and social-approval mechanisms when providing feedback and support for local goals and action plans that fit specific conditions and challenges.

ORIGINALITY/VALUE

The article suggests how to operationalize an enabling approach to performance management in health care services. The framework is consistent with new governance and managerial approaches emerging in public sector organizations more generally, supporting a higher degree of professional autonomy and the use of nonfinancial incentives.

Rethinking Barriers and Enablers in Qualitative Health Research: Limitations, Alternatives, and Enhancements

Explorations of barriers and enablers (or barriers and facilitators) to a desired health practice, implementation process, or intervention outcome have become so prevalent that they seem to be a default in much health services and public health research. In this article, we argue that decisions to frame research questions or analyses using barriers and enablers (B&Es) should not be default. Contrary to the strengths of qualitative research, the B&Es approach often bypasses critical reflexivity and can lead to shallow research findings with poor understanding of the phenomena of interest. The B&Es approach is untheorised, relying on assumptions of linear, unidirectional processes, universally desirable outcomes, and binary thinking which are at odds with the rich understanding of context and complexity needed to respond to the challenges faced by health services and public health. We encourage researchers to develop research questions using informed deliberation that considers a range of approaches and their implications for producing meaningful knowledge. Alternatives and enhancements to the B&Es approach are explored, including using 'whole package' methodologies; theories, conceptual frameworks, and sensitising ideas; and participatory methods. We also consider ways of advancing existing research on B&Es rather than doing 'more of the same': researchers can usefully investigate how a barrier or enabler works in depth; develop and test implementation strategies for addressing B&Es; or synthesise the B&Es literature to develop a new model or theory. Illustrative examples from the literature are provided. We invite further discussion on this topic.

The Limitations and Potentials of Evaluating Economic Aspects of Community-Based Health Promotion: A Critical Review

Community-based health promotion (CBHP) interventions are promising approaches to address public health problems; however, their economic evaluation presents unique challenges. This review aims to explore the opportunities and limitations of evaluating economic aspects of CBHP, focusing on the assessment of intervention costs and outcomes, and the consideration of political-level changes and health equity. A systematic search of the PubMed, Web of Science and PsycInfo databases identified 24 CBHP interventions, the majority of which targeted disadvantaged communities. Only five interventions included a detailed cost/resource assessment. Outcomes at the operational level were mainly quantitative, related to sociodemographics and environment or health status, while outcomes at the political level were often qualitative, related to public policy, capacity building or networks/collaboration. The study highlights the limitations of traditional health economic evaluation methods in capturing the complexity of CBHP interventions. It proposes the use of cost-consequence analysis (CCA) as a more comprehensive approach, offering a flexible and multifaceted assessment of costs and outcomes. However, challenges remain in the measurement and valuation of outcomes, equity considerations, intersectoral costs and attribution of effects. While CCA is a promising starting point, further research and methodological advancements are needed to refine its application and improve decision making in CBHP.

Aligning the planning, development, and implementation of complex interventions to local contexts with an equity focus: application of the PRISM/RE-AIM Framework

For the fields of implementation science and health equity, understanding and being responsive to local contexts is of utmost importance to better inform the development, implementation, and evaluation of healthcare and public health interventions to increase their uptake and sustainment. Contexts are multi-level and include political, historical, economic, and social factors that influence health, as well as organizational characteristics, reflecting the richness of members' views, resources, values, and needs. Poor alignment between solutions and those contextual characteristics could have an impact on inequities. The PRISM (Practical Robust Implementation and Sustainability Model) is a context-based implementation science framework that incorporates RE-AIM outcomes (Reach, Effectiveness, Adoption, Implementation, Maintenance) and offers guidance to researchers, practitioners, and their patient and community partners on how to conceptualize, assess, and address contextual domains with a focus on health equity. Drawing from systems thinking, participatory engagement, and health equity principles, this commentary expands on previous work to 1) offer a novel perspective on how to align an intervention's core functions and forms with the PRISM's contextual domains, and 2) foster an ongoing and iterative engagement process with diverse partners throughout the research and practice process using a co-creation approach. We recommend intervention-to-context alignment through iterative cycles. To that end, we present the RE-AIM Framework's 'outcomes cascade' to illustrate touch points of opportunity and gaps within and across each of the five RE-AIM outcomes to illustrate 'where things go wrong'. We present a case study to illustrate and offer recommendations for research and practice efforts to increase contextual responsiveness, and enhance alignment with context before, during, and after implementation efforts and to ensure equity is being addressed. We strive to make a conceptual contribution to advance the field of pragmatic research and implementation of evidence-based practices through the application of the contextually-based PRISM framework with a focus on health equity.

Fidelity-consistency and deliberateness of modifications in parenting programs

BACKGROUND

Evidence-based interventions (EBIs) are frequently modified in practice. It is recommended that decisions to modify EBIs should be made deliberately to ensure fidelity-consistency, yet the relationship between fidelity-consistency and deliberateness is not well understood. This study aims to explore modifications in a sample of practitioners delivering evidence-based parenting programs (i.e., interventions to strengthen parent-child relationships, reduce harmful interactions, and improve child health and well-being). The study investigated three research questions: (1) What kind of modifications are made during the delivery of parenting programs? (2) To what degree are the identified modifications consistent with the core functions of each program? and (3) Is deliberateness associated with the fidelity-consistency of the identified modifications?

METHODS

In total, 28 group leaders of five widely disseminated parenting programs in Sweden participated in five focus groups, and two participants from each group also participated in individual interviews (n = 10). A content analysis approach was used where the identification of modifications was directed by the Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) and then assessed for fidelity-consistency and four levels of deliberateness (universal, situational, conditional, and unintentional). Chi-square tests were performed to compare consistent and inconsistent modifications, and logistic regression was performed to explore whether deliberateness predicted consistency.

RESULTS

A total of 137 content modifications were identified, covering most of the content modification categories in FRAME. The most common were tailoring/tweaking/refining, adding elements, shortening/condensing, lengthening/extending, and integrating another treatment. Modifications were mostly fidelity-consistent but consistency varied greatly among categories. Furthermore, modifications made unintentionally or situationally were more likely to be fidelity-inconsistent.

CONCLUSIONS

These results indicate that explicit consideration of modifications and their impact could be essential for sustaining the fidelity-consistent use of EBIs, even as such interventions are continuously modified.

The current state of complex systems research on socioeconomic inequalities in health and health behavior-a systematic scoping review

BACKGROUND

Interest in applying a complex systems approach to understanding socioeconomic inequalities in health is growing, but an overview of existing research on this topic is lacking. In this systematic scoping review, we summarize the current state of the literature, identify shared drivers of multiple health and health behavior outcomes, and highlight areas ripe for future research.

METHODS

SCOPUS, Web of Science, and PubMed databases were searched in April 2023 for peer-reviewed, English-language studies in high-income OECD countries containing a conceptual systems model or simulation model of socioeconomic inequalities in health or health behavior in the adult general population. Two independent reviewers screened abstracts and full texts. Data on study aim, type of model, all model elements, and all relationships were extracted. Model elements were categorized based on the Commission on Social Determinants of Health framework, and relationships between grouped elements were visualized in a summary conceptual systems map.

RESULTS

A total of 42 publications were included; 18 only contained a simulation model, 20 only contained a conceptual model, and 4 contained both types of models. General health outcomes (e.g., health status, well-being) were modeled more often than specific outcomes like obesity. Dietary behavior and physical activity were by far the most commonly modeled health behaviors. Intermediary determinants of health (e.g., material circumstances, social cohesion) were included in nearly all models, whereas structural determinants (e.g., policies, societal values) were included in about a third of models. Using the summary conceptual systems map, we identified 15 shared drivers of socioeconomic inequalities in multiple health and health behavior outcomes.

CONCLUSIONS

The interconnectedness of socioeconomic position, multiple health and health behavior outcomes, and determinants of socioeconomic inequalities in health is clear from this review. Factors central to the complex system as it is currently understood in the literature (e.g., financial strain) may be both efficient and effective policy levers, and factors less well represented in the literature (e.g., sleep, structural determinants) may warrant more research. Our systematic, comprehensive synthesis of the literature may serve as a basis for, among other things, a complex systems framework for socioeconomic inequalities in health.

Exploring settings as social complex adaptive systems in setting-based health research: a scoping review

Since launching health health-promoting settings approach to health by WHO, valuable progress has happened in implementing its holistic concepts in settings such as cities, schools, workplaces, hospitals and healthcare services. However, significant knowledge-intention-success gaps still exist in creating sustainable health-promoting changes in settings. The complexity of the task of bridging this gap has contributed to the call for a complexity-informed paradigm shift to health as well as settings, followed by increasing consultation of relevant complexity theories, frameworks and tools in health research. This paper provides a critical scoping review of the application of complex adaptive system (CAS) theory in settings-based health promotion research. We included 14 papers, mostly qualitative studies, reporting on planning or implementation of change initiatives, less on its evaluation. CAS theory application was often incomplete thereby reducing the potential benefit of using this lens to understand change management. We suggest some recommendations how to comprehensively apply the CAS theory in setting-based health research and to report on all CAS characteristics to enhance the understanding of settings as adaptive health-promoting settings.

Untangling the complex implementation process of community-based health promotion: a multiple-case study in the Netherlands

Community-based programmes are a widely implemented approach for population health promotion. Due to the context-dependent and dynamic nature of these programmes, evaluating their implementation is challenging. Identifying key events in the implementation process in evaluation could enable us to support future implementation, while acknowledging the complexity of real-world implementation. We studied the nationwide implementation of the Dutch Healthy Youth, Healthy Future (JOGG) approach, a community-based programme for childhood overweight prevention. The aims of our study were (i) to gain insights into the implementation process of the JOGG approach, and (ii) to identify key events that influenced said process. In nine communities, we conducted interviews (n = 24) with coordinators and stakeholders involved in the implementation of the JOGG approach and collected documents on the programme's implementation. We applied the analytical tool 'Critical Event Card' to identify key events in the implementation process. Results showed that in 5-10 years of implementing the JOGG approach, communities have undergone different phases: preparation, upscaling, resource mobilization, integration with other policy initiatives and adaptation of the implementation strategy. Key events influencing the implementation process included national policy developments (e.g. new health programmes), framing of the JOGG approach in local policy, staff turnover and coordination teams' experiences and actions. Furthermore, changes in implementation were often triggered by the destabilization of the implementation process and linked to opportunities for change in the policy process. The identified key events can inform future implementation of the JOGG approach as well as other community-based health promotion programmes.

A 16-Year Chronicle of Developing a Healthy Workplace Participatory Program for Total Worker Health® in the Connecticut Department of Correction: The Health Improvement through Employee Control (HITEC) Program

Health Improvement Through Employee Control (HITEC) is a 16-year program directed toward the health of corrections personnel and developed through the application of the principles of Participatory Action Research (PAR) and participatory ergonomics. Its impetus has always been the adverse health status of the corrections workforce: early mortality, depression, obesity, and hypertension. The HITEC program trained small "Design Teams" (DTs) of front-line personnel in participatory methods for intervention design for health improvement and organizational change in line with the Total Worker Health® principles. Periodic surveys and physical testing were introduced for longitudinal assessments. Comparative interventions at comparable sites included DTs without a priori assignation, problem-focused kaizen effectiveness teams (KETs), and bargaining unit-centered DTs. DT resilience and the replacement of members who transferred facilities or retired was aided by novel cooperative administrative structures. DT-generated interventions included stress lounges, changes in critical event report writing, a joint program with trained inmates to improve air quality, and training in staff mental health and sleep behavior. A specialized peer-to-peer Health Mentoring Program (HMP) paired new officers with trained peers. Many interventions and program features were institutionalized, thus improving prospects for self-supporting program longevity. Participatory interventions designed and supported by the corrections workforce were found to be both feasible and exceptionally effective.

Development of an integrated and decentralised skin health strategy to improve experiences of skin neglected tropical diseases and other skin conditions in Atwima Mponua District, Ghana

Integrated strategies are recommended to tackle neglected tropical diseases of the skin (skin NTDs), which pose a substantial health and economic burden in many countries, including Ghana. We describe the development of an integrated and decentralised skin health strategy designed to improve experiences of skin NTDs in Atwima Mponua district in Ashanti Region. A multidisciplinary research team led an iterative process to develop an overall strategy and specific interventions, based on a theory of change informed by formative research conducted in Atwima Mponua district. The process involved preparatory work, four co-development workshops (August 2021 to November 2022), collaborative working groups to operationalise intervention components, and obtaining ethical approval. Stakeholders including affected individuals, caregivers, other community members and actors from different levels of the health system participated in co-development activities. We consulted these stakeholders at each stage of the research process, including discussion of study findings, development of our theory of change, identifying implementable solutions to identified challenges, and protocol development. Participants determined that the intervention should broadly address wounds and other skin conditions, rather than only skin NTDs, and should avoid reliance on non-governmental organisations and research teams to ensure sustainable implementation by district health teams and transferability elsewhere. The overall strategy was designed to focus on a decentralised model of care for skin conditions, while including other interventions to support a self-care delivery pathway, community engagement, and referral. Our theory of change describes the pathways through which these interventions are expected to achieve the strategy's aim, the assumptions, and problems addressed. This complex intervention strategy has been designed to respond to the local context, while maximising transferability to ensure wider relevance. Implementation is expected to begin in 2023.

Promoting Coordination and Collaboration in Tribal Home Visiting Programs in the United States

BACKGROUND

A joint statement from two federal agencies in the United States calls for coordination and collaboration between programs serving families of infants and toddlers who are at risk or developmentally delayed or disabled U.S. Department of Education and U.S. Department of Health and Human Services. Policy guidance: Joint statement on collaboration and coordination of the MIECHV and IDEA Part C programs. (2017). Individuals with Disabilities Education Act. ED/HHS Joint Guidance Document: Collaboration and Coordination of the Maternal, Infant, and Early Childhood Home Visiting Program and the Individuals with Disabilities Education Act Part C Programs. Young Native American children living on tribal lands in this country are currently eligible for two federal programs associated with these agencies which overlap in mission and implementation.

PURPOSE

This paper outlines potential strategies for creating a more seamless system of services for tribal families involving more centralized intake processes and procedures, cross training of staff to work across programs, and adopting more unifying approaches to program implementation.

CONCLUSION

A streamlined system of services will result in interventions that better support family and child outcomes while reducing duplication of services, consolidating the limited number of qualified professionals available to provide services, and increasing convenience and cultural attunement of services to Native American families currently participating in both programs.

NeuroRehabilitation OnLine: Description of a regional multidisciplinary group telerehabilitation innovation for stroke and neurological conditions using the Template for Intervention Description and Replication checklist

Background

Providing recommended amounts of rehabilitation for stroke and neurological patients is challenging. Telerehabilitation is viable for delivering rehabilitation and an acceptable adjunct to in-person therapy. NeuroRehabilitation OnLine (NROL) was developed as a pilot and subsequently operationalised as a regional innovation embedded across four National Health Service (NHS) Trusts.

Objective

To describe the NROL innovation to assist future implementation and replication efforts.

Methods

The Template for Intervention Description and Replication (TIDieR) checklist, with guidance from the TIDieR-Telehealth extension, was used to describe NROL. The description was developed collaboratively by clinical academics, therapists, managers and researchers. Updated Consolidated Framework for Implementation Research domains were used to describe the context in which the innovation was delivered.

Results

NROL delivers online group-based real-time neurorehabilitation with technology assistance. It incorporates multidisciplinary targeted therapy and peer support to complement existing therapy. Procedures, materials and structure are detailed to demonstrate how NROL is embedded within a healthcare system. NROL uses existing NHS therapy workforce alongside dedicated NROL roles, including an essential technology support role. Selection of NROL groups is dependent on patient needs. The NROL innovation is tailored over time in response to feedback. NROL described here is successfully integrated within a regional stroke and neurorehabilitation network, aligns with local and national strategies and capitalises on an existing clinical-academic partnership.

Conclusion

This comprehensive description of a regional NROL innovation, and clarification of core components, should facilitate other healthcare settings to adapt and implement NROL for their context. Continuous evaluation alongside implementation will ensure maximal impact for neurorehabilitation.

Promoting social, emotional, and cognitive development in early childhood: A protocol for early valuation of a culturally adapted digital tool for supporting optimal childrearing practices

Objective

The Thrive by Five app promotes positive interactions between children and parents, extended family, and trusted community members that support optimal socio-emotional and cognitive development in the early years. This article aims to describe the protocol for a prospective mixed-methods multi-site study evaluating Thrive by Five using surveys, interviews, workshops, audio diaries from citizen ethnographers and app usage data.

Methods

The study activities and timelines differ by site, with an extensive longitudinal evaluation being conducted at two sites and a basic evaluation being conducted at five sites. The learnings from the more comprehensive evaluations inform the iterative research and development processes while also ensuring ongoing evaluation of usability, acceptability and effectiveness of the app and its content across varying contexts. The study evaluates: (1) the impact of the Thrive by Five content on caregiver knowledge, behaviours, attitudes and confidence; (2) how the content changes relationships at the familial, community and system level; (3) how cultural and contextual factors influence content engagement and effectiveness and (4) the processes that facilitate or disrupt the success of the implementation and dissemination.

Results

All in-country partners have been identified and data collection has been completed in Indonesia, Malaysia, Afghanistan, Kyrgyzstan, Uzbekistan, Namibia and Cameroon.

Conclusions

Very few digital health solutions have been trialled for usability and effectiveness in diverse cultural contexts. By combining quantitative, qualitative, process and ethnographic methodologies, this innovative study informs the iterative and ongoing optimisation of the cultural and contextual sensitivity of the Thrive by Five content and the processes supporting implementation and dissemination.

Identifying the Active Ingredients of a Computerized Speech and Language Therapy Intervention for Poststroke Aphasia: Multiple Methods Investigation Alongside a Randomized Controlled Trial

BACKGROUND

Aphasia is a communication disorder affecting more than one-third of stroke survivors. Computerized Speech and Language Therapy (CSLT) is a complex intervention requiring computer software, speech and language therapists, volunteers, or therapy assistants, as well as self-managed practice from the person with aphasia. CSLT was found to improve word finding, a common symptom of aphasia, in a multicenter randomized controlled trial (Clinical and Cost Effectiveness of Computer Treatment for Aphasia Post Stroke [Big CACTUS]).

OBJECTIVE

This study provides a detailed description of the CSLT intervention delivered in the Big CACTUS trial and identified the active ingredients of the intervention directly associated with improved word finding for people with aphasia.

METHODS

We conducted a multiple methods study within the context of a randomized controlled trial. In study 1, qualitative interviews explored key informants' understanding of the CSLT intervention, how the components interacted, and how they could be measured. Qualitative data were transcribed verbatim and analyzed thematically. Qualitative findings informed the process measures collected as part of a process evaluation of the CSLT intervention delivered in the Big CACTUS trial. In study 2, quantitative analyses explored the relationship between intervention process measures (length of computer therapy access; therapists' knowledge of CSLT; degree of rationale for CSLT tailoring; and time spent using the software to practice cued confrontation naming, noncued naming, and using words in functional sentences) and change in word-finding ability over a 6-month intervention period.

RESULTS

Qualitative interviews were conducted with 7 CSLT approach experts. Thematic analysis identified four overarching components of the CSLT approach: (1) the StepByStep software (version 5; Steps Consulting Ltd), (2) therapy setup: tailoring and personalizing, (3) regular independent practice, and (4) support and monitoring. Quantitative analyses included process and outcome data from 83 participants randomized to the intervention arm of the Big CACTUS trial. The process measures found to be directly associated with improved word-finding ability were therapists providing a thorough rationale for tailoring the computerized therapy exercises and the amount of time the person with aphasia spent using the computer software to practice using words in functional sentences.

CONCLUSIONS

The qualitative exploration of the CSLT approach provided a detailed description of the components, theories, and mechanisms underpinning the intervention and facilitated the identification of process measures to be collected in the Big CACTUS trial. Quantitative analysis furthered our understanding of which components of the intervention are associated with clinical improvement. To optimize the benefits of using the CSLT approach for word finding, therapists are advised to pay particular attention to the active ingredients of the intervention: tailoring the therapy exercises based on the individual's specific language difficulties and encouraging people with aphasia to practice the exercises focused on saying words in functional sentences.

TRIAL REGISTRATION

ISRCTN Registry ISRCTN68798818; https://www.isrctn.com/ISRCTN68798818.

Emergency Department Bridge Model and Health Services Use Among Patients With Opioid Use Disorder

STUDY OBJECTIVES

Little is known about the effectiveness of bridge clinics as transitional care programs for people with opioid use disorder in emergency departments (EDs). We assessed the effect of bridge clinic referral on health services use among patients with opioid use disorder identified in the ED.

METHODS

We used data for individuals aged 18 years and over with active opioid use disorder and no history of medication for opioid use disorder who were administered medication for opioid use disorder while in the ED between January 2013 and August 2022. Bridge clinic referrals started in January 2021. Eligible patients after this date comprised the intervention group. The usual care group included eligible patients before bridge clinic implementation, who were a 1:1 propensity score matched to intervention patients. We estimated risk differences and 95% confidence limits for linkage to long-term care, ED use, and inpatient admission within 120 days of the index ED visit.

RESULTS

Our study population comprised 928 observations after matching. Patients referred to the bridge clinic had a higher risk of linkage to long-term care (risk differences=25%; 95% confidence limits: 20%, 30%), higher risk of ED use (risk differences=7.5%, 95% confidence limits: 1.6%, 13%), and lower risk of inpatient admission (risk differences= -1.9%, 95% confidence limits: -5.9%, 2.1%). Inpatient admission increased among patients with serious mental illness but decreased among patients without serious mental illness.

CONCLUSION

Our overall results suggest that bridge clinic referral increases linkage to long-term care. Nevertheless, qualitatively different effects on inpatient admission between patients with and without serious mental illness warrant consideration of unmet needs among patients with serious mental illness.

Essential content for teaching implementation practice in healthcare: a mixed-methods study of teams offering capacity-building initiatives

BACKGROUND

Applying the knowledge gained through implementation science can support the uptake of research evidence into practice; however, those doing and supporting implementation (implementation practitioners) may face barriers to applying implementation science in their work. One strategy to enhance individuals' and teams' ability to apply implementation science in practice is through training and professional development opportunities (capacity-building initiatives). Although there is an increasing demand for and offerings of implementation practice capacity-building initiatives, there is no universal agreement on what content should be included. In this study we aimed to explore what capacity-building developers and deliverers identify as essential training content for teaching implementation practice.

METHODS

We conducted a convergent mixed-methods study with participants who had developed and/or delivered a capacity-building initiative focused on teaching implementation practice. Participants completed an online questionnaire to provide details on their capacity-building initiatives; took part in an interview or focus group to explore their questionnaire responses in depth; and offered course materials for review. We analyzed a subset of data that focused on the capacity-building initiatives' content and curriculum. We used descriptive statistics for quantitative data and conventional content analysis for qualitative data, with the data sets merged during the analytic phase. We presented frequency counts for each category to highlight commonalities and differences across capacity-building initiatives.

RESULTS

Thirty-three individuals representing 20 capacity-building initiatives participated. Study participants identified several core content areas included in their capacity-building initiatives: (1) taking a process approach to implementation; (2) identifying and applying implementation theories, models, frameworks, and approaches; (3) learning implementation steps and skills; (4) developing relational skills. In addition, study participants described offering applied and pragmatic content (e.g., tools and resources), and tailoring and evolving the capacity-building initiative content to address emerging trends in implementation science. Study participants highlighted some challenges learners face when acquiring and applying implementation practice knowledge and skills.

CONCLUSIONS

This study synthesized what experienced capacity-building initiative developers and deliverers identify as essential content for teaching implementation practice. These findings can inform the development, refinement, and delivery of capacity-building initiatives, as well as future research directions, to enhance the translation of implementation science into practice.

Delivery of a novel intervention to facilitate liberation from mechanical ventilation in paediatric intensive care: A process evaluation

BACKGROUND

Prolonged mechanical ventilation increases the risk of mortality and morbidity. Optimising sedation and early testing for possible liberation from invasive mechanical ventilation (IMV) has been shown to reduce time on the ventilator. Alongside a multicentre trial of sedation and ventilation weaning, we conducted a mixed method process evaluation to understand how the intervention content and delivery was linked to trial outcomes.

METHODS

10,495 children admitted to 18 paediatric intensive care units (ICUs) in the United Kingdom participated in a stepped-wedge, cluster randomised controlled trial, with 1955 clinical staff trained to deliver the intervention. The intervention comprised assessment and optimisation of sedation levels, and bedside screening of respiratory parameters to indicate readiness for a spontaneous breathing trial prior to liberation from ventilation. 193 clinical staff were interviewed towards the end of the trial. Interview data were thematically analysed, and quantitative adherence data were analysed using descriptive statistics.

RESULTS

The intervention led to a reduced duration of IMV (adjusted median difference- 7.1 hours, 95% CI -9.6 to -5.3, p = 0.01). Overall intervention adherence was 75% (range 59-85%). Ease and flexibility of the intervention promoted it use; designated responsibilities, explicit pathways of decision-making and a shared language for communication fostered proactivity and consistency towards extubation. Delivery of the intervention was hindered by established hospital and unit organisational and patient care routines, clinician preference and absence of clinical leadership.

CONCLUSIONS

The SANDWICH trial showed a significant, although small, reduction in duration of IMV. Findings suggest that greater direction in decision-making pathways, robust embedment of new practice in unit routine, and capitalising on the skills of Advanced Nurse Practitioners and physiotherapists would have contributed to greater intervention effect.

TRIAL REGISTRATION

isrctn.org Identifier: ISRCTN16998143.

A health-social service partnership programme for improving the health self-management of community-dwelling older adults: a hybrid effectiveness-implementation pilot study protocol

BACKGROUND

The ageing population requires seamless, integrated health and social care services in the community to promote the health of older adults. However, inadequate financial resources, a lack of clear operational guidelines, and various organisational work cultures may affect the implementation quality and sustainability of these services. As a unique approach, this study seeks to examine the preliminary effects of a health-social partnership programme on the health self-management of community-dwelling older adults in Hong Kong. Additionally, the study seeks to ascertain key insights into the mechanisms and processes required to implement and sustain a self-care management programme in broader practice in community settings.

METHODS

This study will use a hybrid effectiveness-implementation design. During the 3-month programme, subjects in the intervention group will receive four Zoom video conference sessions and four telephone calls conducted by a health-social service team that will include a nurse case manager, community workers, general practitioners, a Chinese medicine practitioner, and social workers. Subjects in the control group will receive a monthly social telephone call from a trained research assistant to rule out the possible social effect of the intervention. The reach, effectiveness, adoption, implementation, and maintenance framework (i.e. RE-AIM framework) will be used to evaluate the implementation and effectiveness outcomes. Of the five dimensions included in the RE-AIM framework, only effectiveness and maintenance outcomes will be collected from both the intervention and control groups. The outcomes of the other three dimensions-reach, adoption, and implementation-will only be collected from subjects in the intervention group. Data will be collected pre-intervention, immediately post-intervention, and 3 months after the intervention is completed to evaluate the maintenance effect of the programme.

DISCUSSION

This programme will aim to enhance health-promoting self-care management behaviours in older adults dwelling in the community. This will be the first study in Hong Kong to use the hybrid effectiveness-implementation design and involve key stakeholders in the evaluation and implementation of a health self-management programme using a health-social service partnership approach. The programme, which will be rooted in the community, may be used as a model, if proven successful, for similar types of services.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT04442867. Submitted 19 June 2020.

The theoretical and practical difficulties of evaluating a community-based 'whole systems' obesity prevention intervention: a research team's critical reflection

AIMS

This article critically discusses the purpose, pragmatics and politics of conducting commissioned evaluations on behalf of public sector organisations by drawing on the experience of evaluating a community-based 'whole systems' obesity prevention intervention for an English local council.

METHODS

The study presented in this article incorporated two approaches: an evaluability assessment that interrogated the theoretical and practical difficulties of evaluating the intervention in a non-political way, and a retrospective analysis using Soft Systems Methodology that interrogated the more political difficulties of conducting such an evaluation in the 'real world'. The information and insights that enabled these reflections came from over 3 years of working closely with the programme team, attending and participating in stakeholder events and meetings, presenting to the Council's Scrutiny Committee meetings, four interviews with the programme manager, and multiple face-to-face group meetings, email exchanges and telephone conversations.

RESULTS

The study reveals and analyses three key inter-related challenges that arose during the evaluation of the 'whole systems' obesity prevention intervention: the programme's evaluability, the evaluation purpose, and the nature, role and quality of evidence.

CONCLUSIONS

The evaluability assessment was important for defining the programme's theoretical and practical evaluability, and the retrospective analysis using Soft Systems Methodology enabled a greater understanding of the political tensions that existed. Key learning points related to the challenges that arose during this evaluation have broad applicability.

Frameworks for cultural adaptation of psychosocial interventions: A systematic review with narrative synthesis

INTRODUCTION

Psychosocial dementia interventions may be less effective when used with populations for whom they were not initially intended. Cultural adaptation of interventions aims to increase effectiveness of interventions by enhancing cultural relevance. Use of theoretical frameworks may promote more systematic cultural adaptation. The aim of this review was to provide a comprehensive synthesis of published cultural adaptation frameworks for psychosocial interventions to understand important elements of cultural adaptation and guide framework selection.

METHOD

Five scientific databases, grey literature and reference lists were searched to January 2023 to identify cultural adaptation frameworks for psychosocial interventions. Papers were included that presented cultural adaptation frameworks for psychosocial interventions. Data were mapped to the framework for reporting adaptations and modifications to evidence-based interventions, then analysed using thematic synthesis.

RESULTS

Twelve cultural adaptation frameworks met inclusion criteria. They were mostly developed in the United States and for adaptation of psychological interventions. The main elements of cultural adaptation for psychosocial interventions were modifying intervention content, changing context (where, by whom an intervention is delivered) and consideration of fidelity to the original intervention. Most frameworks suggested that key intervention components must be retained to ensure fidelity, however guidance was not provided on how to identify or retain these key components. Engagement (ways to reach and involve recipients) and cultural competence of therapists were found to be important elements for cultural adaptation.

CONCLUSIONS

Comprehensive frameworks are available to guide cultural adaptation of psychosocial dementia interventions. More work is required to articulate how to ensure fidelity during adaptation, including how to identify and retain key intervention components.

A complexity-informed in-depth case study into the sustainability and impact of a culture of health: The TR14ers community youth dance group

There are calls for researchers to study existing community assets and activities that appear to improve health and have achieved longevity. The TR14ers Community Dance Charity Limited is a community youth dance group that has been running since 2005 providing free weekly sessions for children and adolescents in an economically disadvantaged town in the UK. An in-depth case study employing qualitative, quantitative and participatory methods was undertaken with the TR14ers (current participants and those who have left, co-ordinators and families) over 6 months with the aim of understanding the sustainable processes and impact of the Group. The 12 complex systems' leverage points described by Meadows and the five domains of adolescent wellbeing developed by the United Nations H6+ Technical Working Group on Adolescent Health and Well-Being were used as frameworks to recognise the complexity of community assets like the TR14ers. The quantitative and qualitative data indicated that being part of the TR14ers contributed to multiple health and wellbeing outcomes. The positive experiences of being a TR14er led members to actively recruit others through word of mouth and public performances. Central to the TR14ers is a commitment to children's rights, which is communicated formally and informally throughout the membership informing how and what the Group does, leading to the structure and delivery of the Group evolving over time. Members sought to ensure the sustainability of the Group after they had left and were keen to mentor younger members to develop and become the leaders. Based on the insights from this case study we suggest that efforts to develop cultures of health, like the TR14ers, should focus on the core values of the activity or intervention that underpin what it does and how within the local context.

Patterns in bottlenecks for implementation of health promotion interventions: a cross-sectional observational study on intervention-context interactions in the Netherlands

BACKGROUND

From a complex systems perspective, implementation should be understood as the introduction of an intervention in a context with which it needs to interact in order to achieve its function in terms of improved health. The presence of intervention-context interactions could mean that during implementation particular patterns of crucial interaction points might arise. We examined the presence of - and regularities in - such 'bottlenecks for implementation', as this could create opportunities to predict and intervene in potential implementation problems.

METHODS

We conducted a cross-sectional observational study against the background of municipal intersectoral policymaking in the Netherlands. We asked implementers of health promotion interventions to identify bottlenecks by rating the presence and importance of conditions for implementation in a range of intervention systems. We used descriptive statistics to characterize these systems (by their behaviour change method, health theme and implementation setting) and the conditions that acted as bottlenecks. After stratifying bottlenecks by intervention system and the system's characteristics, we tested our hypotheses by comparing the number and nature of the bottlenecks that emerged.

RESULTS

More than half of the possible conditions were identified as a bottleneck for implementation. Bottlenecks occurred in all categories of conditions, e.g., relating to the implementer, the intervention, and political and administrative support, and often connected with intersectoral policymaking, e.g., relating to the co-implementer and the co-implementer's organization. Both our hypotheses were supported: (1) Each intervention system came across a unique set of - a limited number of - conditions hampering implementation; (2) Most bottlenecks were associated with the characteristics of the system in which they occurred, but bottlenecks also appeared in the absence of such an association, or remained absent in the presence thereof.

CONCLUSIONS

We conclude that intervention-context interactions in integrated health policymaking may lead to both regularities and variations in bottlenecks for implementation. Regularities may partly be predicted by the function of an intervention system, and may serve as the basis for building the capacity needed for the structural changes that can bring about long-lasting health improvements. Variations may point at the need for flexibility in further tailoring the implementation approach to the - mostly unpredictable - problems at individual sites.

Evaluating an intervention to improve the safety and experience of transitions from hospital to home for older people (Your Care Needs You): a protocol for a cluster randomised controlled trial and process evaluation

BACKGROUND

Older patients often experience safety issues when transitioning from hospital to home. The 'Your Care Needs You' (YCNY) intervention aims to support older people to 'know more' and 'do more' whilst in hospital so that they are better prepared for managing at home.

METHODS

A multi-centre cluster randomised controlled trial (cRCT) will evaluate the effectiveness and cost-effectiveness of the YCNY intervention. Forty acute hospital wards (clusters) in England from varying medical specialities will be randomised to deliver YCNY or care-as-usual on a 1:1 basis. The primary outcome will be unplanned hospital readmission rates within 30 days of discharge. This will be extracted from routinely collected data of at least 5440 patients (aged 75 years and older) discharged to their own homes during the 4- to 5-month YCNY intervention period. A nested cohort of up to 1000 patients will be recruited to the study to collect secondary outcomes via follow-up questionnaires at 5-, 30- and 90-day post-discharge. These will include measures of patient experience of transitions, patient-reported safety events, quality of life and healthcare resource use. Unplanned hospital readmission rates at 60 and 90 days of discharge will be collected from routine data. A process evaluation (primarily interviews and observations with patients, carers and staff) will be conducted to understand the implementation of the intervention and the contextual factors that shape this, as well as the intervention's underlying mechanisms of action. Fidelity of intervention delivery will also be assessed across all intervention wards.

DISCUSSION

This study will establish the effectiveness and cost-effectiveness of the YCNY intervention which aims to improve patient safety and experience for older people during transitions of care. The process evaluation will generate insights about how the YCNY intervention was implemented, what elements of the intervention work and for whom, and how to optimise its implementation so that it can be delivered with high fidelity in routine service contexts.

TRIAL REGISTRATION

UK Clinical Research Network Portfolio: 44559; ISTCRN: ISRCTN17062524. Registered on 11/02/2020.

Investigating health and social outcomes of the Big Local community empowerment initiative in England: a mixed method evaluation

Background

Most research on community empowerment provides evidence on engaging communities for health promotion purposes rather than attempts to create empowering conditions. This study addresses this gap.

Intervention

Big Local started in 2010 with £271M from the National Lottery. Ending in 2026, it gives 150 relatively disadvantaged communities in England control over £1M to improve their neighbourhoods.

Objective

To investigate health and social outcomes, at the population level and among engaged residents, of the community engagement approach adopted in a place-based empowerment initiative.

Study design, data sources and outcome variables

This study reports on the third wave of a longitudinal mixed-methods evaluation. Work package 1 used a difference-in-differences design to investigate the impact of Big Local on population outcomes in all 150 Big Local areas compared to matched comparator areas using secondary data. The primary outcome was anxiety; secondary outcomes included a population mental health measure and crime in the neighbourhood. Work package 2 assessed active engagement in Big Local using cross-sectional data and nested cohort data from a biannual survey of Big Local partnership members. The primary outcome was mental well-being and the secondary outcome was self-rated health. Work package 3 conducted qualitative research in 14 Big Local neighbourhoods and nationally to understand pathways to impact. Work package 4 undertook a cost-benefit analysis using the life satisfaction approach to value the benefits of Big Local, which used the work package 1 estimate of Big Local impact on life satisfaction.

Results

At a population level, the impacts on 'reporting high anxiety' (-0.8 percentage points, 95% confidence interval -2.4 to 0.7) and secondary outcomes were not statistically significant, except burglary (-0.054 change in z-score, 95% confidence interval -0.100 to -0.009). There was some effect on reduced anxiety after 2017. Areas progressing fastest had a statistically significant reduction in population mental health measure (-0.053 change in z-score, 95% confidence interval -0.103 to -0.002). Mixed results were found among engaged residents, including a significant increase in mental well-being in Big Local residents in the nested cohort in 2018, but not by 2020; this is likely to be COVID-19. More highly educated residents, and males, were more likely to report a significant improvement in mental well-being. Qualitative accounts of positive impacts on mental well-being are often related to improved social connectivity and physical/material environments. Qualitative data revealed increasing capabilities for residents' collective control. Some negative impacts were reported, with local factors sometimes undermining residents' ability to exercise collective control. Finally, on the most conservative estimate, the cost-benefit calculations generate a net benefit estimate of £64M.

Main limitations

COVID-19 impacted fieldwork and interpretation of survey data. There was a short 4-year follow-up (2016/20), no comparators in work package 2 and a lack of power to look at variations across areas.

Conclusions

Our findings suggest the need for investment to support community organisations to emerge from and work with communities. Residents should lead the prioritisation of issues and design of solutions but not necessarily lead action; rather, agencies should work as equal partners with communities to deliver change.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research Programme (16/09/13) and will be published in full in Public Health Research; Vol. 11, No. 9. See the NIHR Journals Library website for further project information.

Experiences in the application of logic models in the context of workplace health promotion - A focus group discussion

Gathering evidence on complex workplace health promotion interventions faces methodological challenges. Therefore, the application of logic models as a theory of change is recommended to support outcome and process evaluations. The present study explores challenges and opportunities of applying logic models in application-oriented intervention research on workplace health promotion. A focus group (n = 6), consisting of scientists and workplace health promotion practitioners, was conducted using a semi-structured interview guide. The recorded qualitative data were transcribed and analysed using the structuring content analysis method. According to the focus group, logic models provide several opportunities for planning and evaluating complex workplace health promotion interventions. Logic models support the communication between science and practice, and have benefits for the provider of workplace health promotion interventions. The main challenges in working with logic models were dealing with the complex and constantly developing intervention and with the derivation and implementation of reasonable evaluation methods. The focus group exposed repeated application and a shared understanding between stakeholders as facilitators for working with logic models. In conclusion, at the science-practice interface, logic models could enhance the integrative understanding and the further development of evidence-based workplace health promotion.

Logic modelling as hermeneutic praxis: Bringing knowledge systems into view during comprehensive primary health care planning for homelessness in Australia

Logic modelling is used widely in health promotion planning for complex health and social problems. It is often undertaken collaboratively with stakeholders across sectors that hold and enact different institutional approaches. We use hermeneutic philosophy to explore how knowledge is 'lived' by - and unfolds differently for - cross-sectoral stakeholders during comprehensive primary healthcare service planning. An Organisational Action Research partnership was established with a non-government organisation designing comprehensive primary health care for individuals experiencing homelessness in Adelaide, Australia. Grey literature, stakeholder input, academic feedback, a targeted literature review and evidence synthesis were integrated in iterative cycles to inform and refine the logic model. Diverse knowledge systems are active when cross-sectoral stakeholders collaborate on logic models for comprehensive primary health care planning. Considering logic modelling as a hermeneutic praxis helps to foreground and explore these differences. In our case, divergent ideas emerged in how health/wellbeing and trust were conceptualised; language had different meanings across sectors; and the outcomes and data sought were nuanced for various collaborators. We explicate these methodological insights and also contribute our evidence-informed, collaboratively-derived model for design of a comprehensive primary health care service with populations experiencing homelessness. We outline the value of considering cross-sectoral logic modelling as hermeneutic praxis. Engaging with points of difference in cross-sectoral knowledge systems can strengthen logic modelling processes, partnerships and potential outcomes for complex and comprehensive primary health care services.

Adapting family-based treatment for adolescent anorexia nervosa delivered in the home: A novel approach for improving access to care and generalizability of skill acquisition

BACKGROUND

Anorexia nervosa (AN) is a serious mental illness associated with high rates of morbidity and mortality. Family-based treatment (FBT) is a well-established treatment for adolescent AN, yet it is underutilized in community settings and is unavailable to many families, particularly those from lower income and racial and ethnic minority backgrounds. Furthermore, some families do not respond optimally to FBT, possibly because of challenges translating skills acquired in office-based treatment settings to naturalistic settings. Home-based treatment could reduce barriers to access and enhance generalization of newly learned treatment skills. Home-based models demonstrate initial feasibility, acceptability, and efficacy for adolescent AN, however, FBT principles have yet to be applied as a stand-alone intervention in a home-based level of care. This paper describes the rationale for and process of adapting FBT principles/interventions to improve fit within a home-based model delivered in the context of community mental health, and discusses potential strengths and opportunities associated with this approach.

RESULTS

Adaptations were made through consultation with collaborating community agencies and were guided by the complex interventions framework. The primary modifications included: (1) altered dose; (2) multiple family meals; (3) additional support for meal preparation and supervision; (4) clinician attendance at medical appointments; (5) cultural adaptation; and (6) introduction of distress tolerance and emotion regulation skills.

CONCLUSIONS

Implementing FBT in the home may present one promising and novel approach to enhance engagement and treatment outcomes for adolescents with restrictive eating disorders, particularly those who are underserved, but evaluation of efficacy/effectiveness is needed.

Context matters-the phased development of an adaptable food literacy intervention: Up for Cooking

Adapting interventions to the context increases the impact and sustainability of interventions. Literature acknowledges the need to adapt existing interventions and that these adaptations should be clearly reported. However, little is known about how to incorporate adaptation from the beginning. This paper argues that interventions should be developed and adaptations should be made using an ongoing non-linear approach. An action-oriented research approach with feedback loops is proposed. We illustrate this with the development of a food literacy intervention 'Up for Cooking' (Dutch: Zin in Koken) and present lessons learned in developing, implementing and studying such adaptable interventions. Interventions should clearly define and differentiate the intervention function and form. Implementers, in turn, should be encouraged to tailor interventions within a form that fits with a specific context. Sufficient time, continuous adaptation based on co-creation, feedback loops and interdisciplinary collaboration are important prerequisites for the development of adaptable interventions.

Factors influencing social prescribing initiatives: a systematic review of qualitative evidence

AIMS

Social prescribing is a growing health policy agenda to improve the quality and effectiveness of health systems. However, systematically collected knowledge on factors influencing the effective implementation of SP is scarce. A systematic review was conducted to identify and categorize factors influencing social prescribing initiatives.

METHODS

A search of three electronic databases (PubMed, Scopus, and ISI Web of Knowledge) was carried out to retrieve studies from inception to May 2022, supplemented by grey literature searching and snowballing of the relevant references. The inclusion criteria were original empirical research, qualitative data collection, and a description of factors affecting social prescribing initiatives. Study quality was evaluated using the Critical Appraisal Skills Programme tool. We categorized the results of individual studies using a narrative approach.

RESULTS

A total of 23 studies were included for analysis. Along with patient-related factors (patient-centeredness, clinical complexity, perception, knowledge), three main settings of social prescribing initiatives (including healthcare providers, link workers, and voluntary and community sectors) are affected by (1) individual characteristics (knowledge, perception, skill mix); (2) interpersonal relations (collaboration, trust, feedback, supportive climate, follow-up, sustained connection, peer support within and across sectors); (3) organizational contingencies (resource adequacy, staffing, training, role description, continuity of support, caseload management, monitoring, affordability, accessibility, referral criteria, and tailored support); and (4) political context (national policy and guidance, stewardship, planning, cocreation, bureaucracy, economic condition, and the number of support organizations).

CONCLUSION

Many factors influencing social prescribing initiatives were identified. The results of this review can be applied by different stakeholders of social prescribing to guide development, implementation, description, and evaluation.

An external facilitation intervention to increase uptake of an adverse drug event reporting intervention

Background

Adverse drug events (ADEs) are a leading cause of emergency department visits and hospital admissions in Canada. ActionADE prevents repeat ADEs by enabling clinicians to document and communicate standardized ADE information across care settings. We used an external facilitation intervention to promote the uptake of ActionADE in four hospitals in British Columbia, Canada. This study examined whether, how and in what context external facilitation influenced the uptake of ActionADE.

Methods

In this convergent-parallel mixed-methods study, an external facilitator used a four-step iterative process to support site champions using context-specific implementation strategies to increase the ADE reporting rate at their sites. We extracted archival data to assess implementation determinants before and after the implementation of the external facilitation and implementation strategies. We also retrieved data on the mean monthly counts of reported ADEs for each user from the ActionADE server. Zero-inflated Poisson models were used to examine changes in mean monthly counts of reported ADEs per user between pre-intervention (June 2021 to October 2021) and intervention (November 2021 to March 2022) periods.

Results

The external facilitator and site champions co-created three functions: (1) educate pharmacists about what and how to report in ActionADE, (2) educate pharmacists about the impact of ActionADE on patient outcomes, and (3) provide social support for pharmacists to integrate ADE reporting into clinical workflows. Site champions used eight forms to address the three functions. Peer support and reporting competition were the two common strategies used by all sites. Sites' responses to external facilitation varied. The rate of mean monthly counts of reported ADEs per user significantly increased during the intervention period compared to the pre-intervention period at LGH (RR: 3.74, 95% CI 2.78 to 5.01) and RH (RR: 1.43, 95% CI 1.23 to 1.94), but did not change at SPH (RR: 0.68, 95% CI: 0.43 to 1.09) and VGH (RR: 1.17, 95% CI 0.92 to 1.49). Leave of absence of the clinical pharmacist champion and failure to address all identified functions were implementation determinants that influenced the effectiveness of external facilitation.

Conclusion

External facilitation effectively supported researchers and stakeholders to co-create context-specific implementation strategies. It increased ADE reporting at sites where clinical pharmacist champions were available, and where all functions were addressed.

A qualitative exploration of stakeholder perspectives on the implementation of a whole school approach to mental health and emotional well-being in Wales

Early intervention to support mental health and well-being of school-aged children may be of significant benefit in preventing escalation of mental health problems in later life. While there are limitations to current understanding of the best ways for schools to support mental well-being, a whole school approach (WSA), involving all those who are part of the school system in creating and sustaining a supportive environment where health is prioritized, may be effective. This research explored stakeholder views of this approach, as part of a contract commissioned by the Welsh Government to conduct an evaluability assessment of a WSA. Semistructured focus groups and interviews were completed with stakeholders from the health and education sectors, as well as parents, to explore how a WSA may operate in a Welsh context and barriers and facilitators to potential implementation and outcomes. Findings suggest that existing pressures on schools may impact implementation of a WSA, with school staff already time poor and many staff experiencing their own mental well-being challenges. Implementation may be supported by clear guidance at local and national levels, funding for staff time and training and stakeholder involvement at all stages. Long-term monitoring and evaluation are also needed to understand system changes.

Unpacking the Cinderella black box of complex intervention development through the Partners at Care Transitions (PACT) programme of research

INTRODUCTION

Complex intervention development has been described as the 'Cinderella' black box in health services research. Greater transparency in the intervention development process is urgently needed to help reduce research waste.

METHODS

We applied a new consensus-based framework for complex intervention development to our programme of research, in which we developed an intervention to improve the safety and experience of care transitions for older people. Through this process, we aimed to reflect on the framework's utility for intervention development and identify any important gaps within it to support its continued development.

FINDINGS

The framework was a useful tool for transparent reporting of the process of complex intervention development. We identified potential 'action' gaps in the framework including 'consolidation of evidence' and 'development of principles' that could bracket and steer decision-making in the process.

CONCLUSIONS

We consider that the level of transparency demonstrated in this report, aided through use of the framework, is essential in the quest for reducing research waste.

PATIENT OR PUBLIC CONTRIBUTION

We have involved our dedicated patient and public involvement group in all work packages of this programme of research. Specifically, they attended and contributed to co-design workshops and contributed to finalizing the intervention for the pilot evaluation. Staff also participated by attending co-design workshops, helping us to prioritize content ideas for the intervention and supporting the development of intervention components outside of the workshops.

The Need for Systems Approaches for Precision Communications in Public Health

A major challenge in communicating health-related information is the involvement of multiple complex systems from the creation of the information to the sources and channels of dispersion to the information users themselves. To date, public health communications approaches have often not adequately accounted for the complexities of these systems to the degree necessary to have maximum impact. The virality of COVID-19 misinformation and disinformation has brought to light the need to consider these system complexities more extensively. Unaided, it is difficult for humans to see and fully understand complex systems. Luckily, there are a range of systems approaches and methods, such as systems mapping and systems modeling, that can help better elucidate complex systems. Using these methods to better characterize the various systems involved in communicating public health-related information can lead to the development of more tailored, precise, and proactive communications. Proceeding in an iterative manner to help design, implement, and adjust such communications strategies can increase impact and leave less opportunity for misinformation and disinformation to spread.

How can climate change and its interaction with other compounding risks be considered in evaluation? Experiences from Vietnam

While evaluations play a critical role in accounting for and learning from context, it is unclear how evaluations can take account of climate change. Our objective was to explore how climate change and its interaction with other contextual factors influenced One Health food safety programs. To do so, we integrated questions about climate change into a qualitative evaluation study of an ongoing, multi-sectoral program aiming to improve pork safety in Vietnam called SafePORK. We conducted remote interviews with program researchers (n = 7) and program participants (n = 23). Based on our analysis, researchers believed climate change had potential impacts on the program but noted evidence was lacking, while program participants (slaughterhouse workers and retailers) shared how they were experiencing and adapting to the impacts of climate change. Climate change also interacted with other contextual factors to introduce additional complexities. Our study underscored the importance of assessing climate factors in evaluation and building adaptive capacity in programming.

System Action Learning: Reorientating Practice for System Change in Preventive Health

It is now widely accepted that many of the problems we face in public health are complex, from chronic disease to COVID-19. To grapple with such complexity, researchers have turned to both complexity science and systems thinking to better understand the problems and their context. Less work, however, has focused on the nature of complex solutions, or intervention design, when tackling complex problems. This paper explores the nature of system intervention design through case illustrations of system action learning from a large systems level chronic disease prevention study in Australia. The research team worked with community partners in the design and implementation of a process of system action learning designed to reflect on existing initiatives and to reorient practice towards responses informed by system level insights and action. We were able to observe and document changes in the mental models and actions of practitioners and in doing so shine a light on what may be possible once we turn our attention to the nature and practice of system interventions.

Using Implementation Mapping to increase uptake and use of Salud en Mis Manos: A breast and cervical cancer screening and HPV vaccination intervention for Latinas

Background

Despite CDC recommendations for breast and cervical cancer screening and HPV vaccination, cancer control behaviors are underutilized among low-income Latinas. Salud en Mis Manos (SEMM), adapted from Cultivando La Salud, is a community health worker- (CHW-) delivered evidence-based intervention (EBI), shown to increase breast and cervical cancer screening.

Methods

We used Implementation Mapping to create SEMM-Dissemination and Implementation Assistance (SEMM-DIA), a set of implementation strategies designed to support implementation and maintenance of SEMM in clinic settings. Specifically, we used Implementation Mapping's five iterative tasks to guide the use of theories and frameworks, evidence, new data, and stakeholder input to develop strategies to accelerate and improve implementation fidelity, reach, and maintenance of the SEMM intervention. The resulting implementation mapping logic model also guides the SEMM-DIA evaluation plan to assess reach, effectiveness, implementation, and maintenance.

Discussion

Increased use of implementation planning frameworks is necessary to accelerate the translation of EBIs to public health practice. This work demonstrates the application of Implementation Mapping to develop SEMM-DIA, providing a model for the development of other implementation strategies to support translation of evidence-based health promotion interventions into clinic settings.

Perceptions of friendship, peers and influence on adolescent smoking according to tobacco control context: a systematic review and meta-ethnography of qualitative research

BACKGROUND

A relationship between smoking and interpersonal influences has been well established within the literature. There have been cultural shifts in denormalisation and a reduction in tobacco smoking in many countries. Hence there is a need to understand social influences on adolescents' smoking across smoking normalisation contexts.

METHODS

The search was conducted in July 2019 and updated in March 2022 within 11 databases and secondary sources. Search terms included schools, adolescents, smoking, peers, social norms and qualitative research. Screening was conducted by two researchers independently and in duplicate. Study quality was assessed using the eight-item Evidence for Policy and Practice Information and Co-ordinating Centre (EPPI-centre) tool for the appraisal of qualitative studies. Results were synthesised using a meta-narrative lens for meta-ethnography and compared across smoking normalisation contexts.

RESULTS

Forty one studies were included and five themes were developed, mapping onto the socio ecological model. The social processes by which adolescents take up smoking differed according to a mixture of school type, peer group structure and the smoking culture within the school, as well as the wider cultural context. Data available from smoking denormalised contexts, described changes in social interactions around smoking to cope with its stigmatisation. This was manifested through i) direct peer influence, whereby subtle techniques were employed, ii) group belonging whereby smoking was less likely to be seen as a key determinant of group membership and smoking was less commonly reported to be used as a social tool, and iii) popularity and identity construction, whereby smoking was perceived more negatively in a denormalised context, compared with a normalised context.

CONCLUSIONS

This meta-ethnography is the first study to demonstrate, drawing on international data, that peer processes in adolescent smoking may undergo changes as smoking norms within society change. Future research should focus on understanding differences across socioeconomic contexts, to inform the adaptation of interventions.

From Pre-Implementation to Institutionalization: Lessons From Sustaining a Perinatal Audit Program in South Africa

INTRODUCTION

Maternal and perinatal death surveillance and response (MPDSR), or related forms of maternal and perinatal death audits, can strengthen health systems. We explore the history of initiating, scaling up, and institutionalizing a national perinatal audit program in South Africa.

METHODS

Data collection involved 56 individual interviews, a systematic document review, administration of a semistructured questionnaire, and 10 nonparticipant observations of meetings related to the perinatal audit program. Fieldwork and data collection in the subdistricts occurred from September 2019 to March 2020. Data analysis included thematic content analysis and application of a tool to measure subdistrict-level implementation. This study expands on case study research applied to 5 Western Cape subdistricts with long histories of implementation.

RESULTS

Although established in the early 1990s, the perinatal audit program was not integrated into national policy and guidelines until 2012 but was then excluded from policy in 2021. A network of national and subnational structures that benefited from a continuity of actors evolved and interacted to support uptake and implementation. Intentional efforts to demonstrate impact and enable local adaptation allowed for more ownership and buy-in. Implementation requires continuous efforts. Even in 5 subdistricts with long histories of practice, we found operational gaps, such as incomplete meeting minutes, signaling a need for strengthening. Nevertheless, the tool used to measure implementation may require revisions, particularly in settings with institutionalized practice.

CONCLUSION

This article provides lessons on how to initiate, expand, and strengthen perinatal audit. Despite a long history of implementation, the perinatal audit program in South Africa cannot be assumed to be indefinitely sustainable or final in its current form. To monitor uptake and sustainability of MPDSR, including perinatal audit, we need research approaches that allow exploration of context, local adaptation, and underlying issues that support sustainability, such as relationships, leadership, and trust.

Building the foundation for a community-generated national research blueprint for inherited bleeding disorders: research priorities in health services; diversity, equity, and inclusion; and implementation science

BACKGROUND

The National Hemophilia Foundation (NHF) conducted extensive all-stakeholder inherited bleeding disorder (BD) community consultations to inform a blueprint for future research. Sustaining and expanding the specialized and comprehensive Hemophilia Treatment Center care model, to better serve all people with inherited BDs (PWIBD), and increasing equitable access to optimal health emerged as top priorities.

RESEARCH DESIGN AND METHODS

NHF, with the American Thrombosis and Hemostasis Network (ATHN), convened multidisciplinary expert working groups (WG) to distill priority research initiatives from consultation findings. WG5 was charged with prioritizing health services research (HSR); diversity, equity, and inclusion (DEI); and implementation science (IS) research initiatives to advance community-identified priorities.

RESULTS

WG5 identified multiple priority research themes and initiatives essential to capitalizing on this potential. Formative studies using qualitative and mixed methods approaches should be conducted to characterize issues and meaningfully investigate interventions. Investment in HSR, DEI and IS education, training, and workforce development are vital.

CONCLUSIONS

An enormous amount of work is required in the areas of HSR, DEI, and IS, which have received inadequate attention in inherited BDs. This research has great potential to evolve the experiences of PWIBD, deliver transformational community-based care, and advance health equity.

Generalizability of randomized controlled trials in primary health care: Applying the PRECIS-2 tool on published protocols

RATIONALE

Pragmatic design may facilitate the generalizability of effectiveness of randomized controlled trials (RCTs) in primary health care (PHC).

AIMS AND OBJECTIVES

The aim of this study was to investigate whether published protocols in PHC were designed pragmatically and to explore whether specific trial characteristics may be related to a pragmatic design.

METHODS

Using the Pragmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2), we assessed pragmatism for 123 published RCT protocols. For each domain, we calculated the mean score with the 95% confidence interval (95% CI). Interrater reliability was assessed by weighted κ-coefficient with 95% CI. We examined potential associations of published protocol characteristics with overall pragmatism by performing univariate and multivariate analyses.

RESULTS

We observed the highest score for primary analysis (4.66, 95% CI: 4.51, 4.82). The eligibility score was intermediate (3.16, 95% CI: 3.01, 3.32). Domains with scores towards the explanatory side included organization (2.50, 95% CI: 2.36, 2.63), flexibility of delivery (2.74, 95% CI: 2.60, 2.88) and flexibility of adherence (3.00, 95% CI: 2.83, 3.17). Interrater agreement was good (κ = 0.61; 95% CI: 0.34, 0.80; p < 0.001). Higher sample sizes were correlated to a pragmatic design (odds ratio: 6.86, 95% CI: 1.64, 28.75; p = 0.04).

CONCLUSION

Most RCT protocols were rated as intermediate in the pragmatic-explanatory continuum. Future research may guide all stakeholders on how best to incorporate the level of pragmatism in the interpretation of the results so that the trials are more likely to be applicable in real-world settings.

Impact of a social prescribing intervention in North East England on adults with type 2 diabetes: the SPRING_NE multimethod study

Background

Link worker social prescribing enables health-care professionals to address patients’ non-medical needs by linking patients into various services. Evidence for its effectiveness and how it is experienced by link workers and clients is lacking.

Objectives

To evaluate the impact and costs of a link worker social prescribing intervention on health and health-care costs and utilisation and to observe link worker delivery and patient engagement.

Data sources

Quality Outcomes Framework and Secondary Services Use data.

Design

Multimethods comprising (1) quasi-experimental evaluation of effects of social prescribing on health and health-care use, (2) cost-effectiveness analysis, (3) ethnographic methods to explore intervention delivery and receipt, and (4) a supplementary interview study examining intervention impact during the first UK COVID-19 lockdown (April–July 2020).

Study population and setting

Community-dwelling adults aged 40–74 years with type 2 diabetes and link workers in a socioeconomically deprived locality of North East England, UK.

Intervention

Link worker social prescribing to improve health and well-being-related outcomes among people with long-term conditions.

Participants

(1) Health outcomes study, approximately n = 8400 patients; EuroQol-5 Dimensions, five-level version (EQ-5D-5L), study, n = 694 (baseline) and n = 474 (follow-up); (2) ethnography, n = 20 link workers and n = 19 clients; and COVID-19 interviews, n = 14 staff and n = 44 clients.

Main outcome measures

The main outcome measures were glycated haemoglobin level (HbA1c; primary outcome), body mass index, blood pressure, cholesterol level, smoking status, health-care costs and utilisation, and EQ-5D-5L score.

Results

Intention-to-treat analysis of approximately 8400 patients in 13 intervention and 11 control general practices demonstrated a statistically significant, although not clinically significant, difference in HbA1c level (–1.11 mmol/mol) and a non-statistically significant 1.5-percentage-point reduction in the probability of having high blood pressure, but no statistically significant effects on other outcomes. Health-care cost estimates ranged from £18.22 (individuals with one extra comorbidity) to –£50.35 (individuals with no extra comorbidity). A statistically non-significant shift from unplanned (non-elective and accident and emergency admissions) to planned care (elective and outpatient care) was observed. Subgroup analysis showed more benefit for individuals living in more deprived areas, for the ethnically white and those with fewer comorbidities. The mean cost of the intervention itself was £1345 per participant; the incremental mean health gain was 0.004 quality-adjusted life-years (95% confidence interval –0.022 to 0.029 quality-adjusted life-years); and the incremental cost-effectiveness ratio was £327,250 per quality-adjusted life-year gained. Ethnographic data showed that successfully embedded, holistic social prescribing providing supported linking to navigate social determinants of health was challenging to deliver, but could offer opportunities for improving health and well-being. However, the intervention was heterogeneous and was shaped in unanticipated ways by the delivery context. Pressures to generate referrals and meet targets detracted from face-to-face contact and capacity to address setbacks among those with complex health and social problems.

Limitations

The limitations of the study include (1) a reduced sample size because of non-participation of seven general practices; (2) incompleteness and unreliability of some of the Quality and Outcomes Framework data; (3) unavailability of accurate data on intervention intensity and patient comorbidity; (4) reliance on an exploratory analysis with significant sensitivity analysis; and (5) limited perspectives from voluntary, community and social enterprise.

Conclusions

This social prescribing model resulted in a small improvement in glycaemic control. Outcome effects varied across different groups and the experience of social prescribing differed depending on client circumstances.

Future work

To examine how the NHS Primary Care Network social prescribing is being operationalised; its impact on health outcomes, service use and costs; and its tailoring to different contexts.

Trial registration

This trial is registered as ISRCTN13880272.

Funding

This project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme, Community Groups and Health Promotion (grant no. 16/122/33) and will be published in full in Public Health Research; Vol. 11, No. 2. See the NIHR Journals Library website for further project information.

Standardizing variation: Scaling up clinical genomics in Australia

PURPOSE

Clinical genomics demands close interaction of physicians, laboratory scientists, and genetic professionals. Taking genomics to scale requires an understanding of the underlying processes from the perspective of nongenetic physicians who are new to the field. We identified components of the processes amenable to adaptation when scaling up clinical genomics.

METHODS

Semistructured interviews informed by the Theoretical Domains Framework with nongenetic physicians, who were using clinical genomics in practice, were guided by an annotated process map with 7 steps following the patient's journey. Findings from the individual maps were synthesized into an overview process map and a series of individual maps by common location and specialty. Interviews were analyzed using the Theoretical Domains Framework.

RESULTS

In total, 16 nongenetic physicians (eg, nephrologists, immunologists) participated, generating 1 overview and 10 individual process maps. Sixteen common steps were identified across clinical specialties and locations, with variations over 9 steps. We report the potential for standardization across these 9 steps.

CONCLUSION

When scaling up complex interventions, it is essential to identify steps where variation can be accommodated. With these results we show how process mapping can be used to identify steps where variation is acceptable during scale up to accommodate adaptation to local context, allowing for the inevitable evolution of factors influencing ongoing implementation and sustainability.

In Centralized Health Systems, Much Is Left Out When Analyses of Local HiAP Strategies Are Limited to Public Administration Comment on "A Realist Explanatory Case Study Investigating How Common Goals, Leadership, and Committed Staff Facilitate Health in All Policies Implementation in the Municipality of Kuopio, Finland"

We argue that the lessons drawn by Guglielmin and colleagues, from the Health in All Policies (HiAP) approach in the municipality of Kuopio, are of limited use to centralised health systems. There is a need for research more attuned to the circumstances of local governments that have little power over the provision of health programmes; yet can address a range of determinants of population health. In these cases, adopting a state-centric perspective may fail to capture the role of other actors such as non-governmental organizations (NGOs) and local branches of state agencies. Evidence from France shows that centralised health systems can foster HiAP locally through political commitment and dedicated coordination staff whose role is to mobilise and support NGOs, inhabitants, and other local branches of regional and central governments. We highlight, as three important challenges, the issue of legitimacy, funding and positioning of the HiAP instrument in the local government structure.