Designing process evaluations using case study to explore the context of complex interventions evaluated in trials

Understanding the processes underpinning IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) in primary care: study protocol for a process evaluation within a cluster randomised controlled implementation trial

BACKGROUND

Providing supported self-management for people with asthma can reduce the burden on patients, health services and wider society. Implementation, however, remains poor in routine clinical practice. IMPlementing IMProved Asthma self-management as RouTine (IMP2ART) is a UK-wide cluster randomised implementation trial that aims to test the impact of a whole-systems implementation strategy, embedding supported asthma self-management in primary care compared with usual care. To maximise opportunities for sustainable implementation beyond the trial, it is necessary to understand how and why the IMP2ART trial achieved its clinical and implementation outcomes.

METHODS

A mixed-methods process evaluation nested within the IMP2ART trial will be undertaken to understand how supported self-management was implemented (or not) by primary care practices, to aid interpretation of trial findings and to inform scaling up and sustainability. Data and analysis strategies have been informed by mid-range and programme-level theory. Quantitative data will be collected across all practices to describe practice context, IMP2ART delivery (including fidelity and adaption) and practice response. Case studies undertaken in three to six sites, supplemented by additional interviews with practice staff and stakeholders, will be undertaken to gain an in-depth understanding of the interaction of practice context, delivery, and response. Synthesis, informed by theory, will combine analyses of both qualitative and quantitative data. Finally, implications for the scale up of asthma self-management implementation strategies to other practices in the UK will be explored through workshops with stakeholders.

DISCUSSION

This mixed-methods, theoretically informed, process evaluation seeks to provide insights into the delivery and response to a whole-systems approach to the implementation of supported self-management in asthma care in primary care. It is underway at a time of significant change in primary care in the UK. The methods have, therefore, been developed to be adaptable to this changing context and to capture the impact of these changes on the delivery and response to research and implementation processes.

How a National Organization Works in Partnership With People Who Have Lived Experience in Mental Health Improvement Programs: Protocol for an Exploratory Case Study

BACKGROUND

This is a research proposal for a case study to explore how a national organization works in partnership with people with lived experience in national mental health improvement programs. Quality improvement is considered a key solution to addressing challenges within health care, and in Scotland, there are significant efforts to use quality improvement as a means of improving health and social care delivery. In 2016, Healthcare Improvement Scotland (HIS) established the improvement hub, whose purpose is to lead national improvement programs that use a range of approaches to support teams and services. Working in partnership with people with lived experience is recognized as a key component of such improvement work. There is, however, little understanding of how this is manifested in practice in national organizations. To address gaps in evidence and strengthen a consistent approach, a greater understanding is required to improve partnership working.

OBJECTIVE

The aim of this study is to better understand how a national organization works in partnership with people who have lived experience with improvement programs in mental health services, exploring people's experiences of partnership working in a national organization. An exploratory case study approach will be used to address the research questions in relation to the Personality Disorder (PD) Improvement Programme: (1) How is partnership working described in the PD Improvement Programme? (2) How is partnership working manifested in practice in the PD Improvement Programme? and (3) What factors influence partnership working in the PD Improvement Programme?

METHODS

An exploratory case study approach will be used in relation to the PD Improvement Programme, led by HIS. This research will explore how partnership working with people with lived experience is described and manifested in practice, outlining factors influencing partnership working. Data will be gathered from various qualitative sources, and analysis will deepen an understanding of partnership working.

RESULTS

This study is part of a clinical doctorate program at the University of Stirling and is unfunded. Data collection was completed in October 2023; analysis is expected to be completed and results will be published in January 2025.

CONCLUSIONS

This study will produce new knowledge on ways of working with people with lived experience and will have practical implications for all improvement-focused interventions. Although the main focus of the study is on national improvement programs, it is anticipated that this study will contribute to the understanding of how all national public service organizations work in partnership with people with lived experience of mental health care.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/51779.

Exploring the experiences and perceptions of patients awaiting rotator cuff repair surgery: An integrated qualitative study within the POWER pilot and feasibility trial

BACKGROUND

As waiting times for orthopaedic surgery increase, there have been calls to move from 'waiting lists' to 'preparation lists', to better prepare patients for surgery. In this context, a pilot randomised controlled trial (POWER) was conducted, comparing physiotherapist-led exercise to waiting-list control (usual care), for patients awaiting rotator cuff repair surgery. This qualitative study was integrated within the pilot trial.

OBJECTIVES

Explore the experiences of adults awaiting rotator cuff repair surgery in the NHS. Explore the acceptability of the physiotherapist-led exercise intervention. Explore the barriers and enablers to recruitment, retention, and adherence.

DESIGN

Integrated qualitative study with semi-structured telephone interviews.

METHODS

Adults awaiting rotator cuff repair, consenting to participate in the trial were eligible. Sampling was purposive regarding age, gender, randomised allocation, and hospital site. Interviews were audio-recorded and transcribed. Data were analysed using Reflexive Thematic Analysis.

RESULTS

20 participants were recruited (age range 49-81 years; 12 male, 10 randomised to physiotherapist-led exercise). Many participants were unable to recall their experiences of trial processes; nonetheless, three themes were identified from the data: experience of shoulder pain and pathway to treatment; communication and decision-making in the context of rotator cuff repair surgery; and experiences of the POWER physiotherapist-led exercise intervention and processes.

CONCLUSIONS

Patients experience significant burden due to shoulder pain. Their journey to surgery can be long, confusing, and associated with perceived abandonment. In a future trial, the intervention should offer opportunity for shared decision-making, optional exit from the surgical pathway, and an individualised exercise programme.

What do we want to get out of this? a critical interpretive synthesis of the value of process evaluations, with a practical planning framework

BACKGROUND

Process evaluations aim to understand how complex interventions bring about outcomes by examining intervention mechanisms, implementation, and context. While much attention has been paid to the methodology of process evaluations in health research, the value of process evaluations has received less critical attention. We aimed to unpack how value is conceptualised in process evaluations by identifying and critically analysing 1) how process evaluations may create value and 2) what kind of value they may create.

METHODS

We systematically searched for and identified published literature on process evaluation, including guidance, opinion pieces, primary research, reviews, and discussion of methodological and practical issues. We conducted a critical interpretive synthesis and developed a practical planning framework.

RESULTS

We identified and included 147 literature items. From these we determined three ways in which process evaluations may create value or negative consequences: 1) through the socio-technical processes of 'doing' the process evaluation, 2) through the features/qualities of process evaluation knowledge, and 3) through using process evaluation knowledge. We identified 15 value themes. We also found that value varies according to the characteristics of individual process evaluations, and is subjective and context dependent.

CONCLUSION

The concept of value in process evaluations is complex and multi-faceted. Stakeholders in different contexts may have very different expectations of process evaluations and the value that can and should be obtained from them. We propose a planning framework to support an open and transparent process to plan and create value from process evaluations and negotiate trade-offs. This will support the development of joint solutions and, ultimately, generate more value from process evaluations to all.

How to embed qualitative research in trials: insights from the feasibility study of the SAFER trial programme

Qualitative research can enhance the design, conduct and interpretation of trials. Despite this, few trials incorporate qualitative methods, and those that do may not realise their full potential. In this commentary, we highlight how qualitative research can contribute to the design, conduct and day-to-day running of a trial, outlining the working arrangements and relationships that facilitate these contributions. In doing so, we draw on (i) existing frameworks on the role of qualitative research alongside trials and (ii) our experience of integrated qualitative research conducted as part of the feasibility study of the SAFER trial (Screening for Atrial Fibrillation with ECG to Reduce stroke), a cluster randomised controlled trial of screening people aged 70 and above for atrial fibrillation in primary care in England. The activities and presence of the qualitative team contributed to important changes in the design, conduct and day-to-day running of the SAFER feasibility study, and the subsequent main trial, informing diverse decisions concerning trial documentation, trial delivery, timing and content of measures and the information given to participating patients and practices. These included asking practices to give screening results to all participants and not just to 'screen positive' participants, and greater recognition of the contribution of practice reception staff to trial delivery. These changes were facilitated by a 'one research team' approach that underpinned all formal and informal working processes from the outset and maximised the value of both qualitative and trial coordination expertise. The challenging problems facing health services require a combination of research methods and data types. Our experience and the literature show that the benefits of embedding qualitative research in trials are more likely to be realised if attention is given to both structural factors and relationships from the outset. These include sustained and sufficient funding for qualitative research, embedding qualitative research fully within the trial programme, providing shared infrastructure and resources and committing to relationships based on mutual recognition of and respect for the value of different methods and perspectives. We outline key learning for the planning of future trials.Trial registration: Screening for atrial fibrillation with ECG to reduce stroke ISRCTN16939438 (feasibility study); Screening for atrial fibrillation with ECG to reduce stroke - a randomised controlled trial ISRCTN72104369 .

Trial collaborators' perceptions of the process of delivering Healthy Beginnings advice via telephone calls or text messages

ISSUE ADDRESSED

One in four Australian children aged between the ages of two and four are affected by overweight. In New South Wales, the Communicating Healthy Beginnings Advice by Telephone (CHAT) trial delivered an intervention to pregnant women and women with infants via telephone calls and text messages. The focus of the intervention was on infant feeding and establishing healthy habits for infants by building the capacity of mothers. This study investigates trial collaborators' perspectives concerning the implementation of this intervention, to obtain insights that will support future translation and scale-up.

METHODS

This research was undertaken during the intervention phase of the trial. Twenty trial collaborators involved in the planning, implementation or delivery of the CHAT trial were invited to participate. Qualitative interviews were conducted with collaborators using open-ended questions based on Steckler and Linnan's process evaluation framework and the Consolidated Framework for Implementation Research. Inductive thematic analysis was employed to identify themes from the interview data.

RESULTS

Fourteen trial collaborators were interviewed. Collaborators included child and family health nurses (intervention providers), nurse managers with extensive child and family health nursing experience, a paediatrician, dietitians, health promotion experts, health service managers, health and nursing executives, program personnel (project coordinator, research fellow and evaluation officer) and university researchers. Following coding of qualitative data, themes were realised from the data as a result of active co-production on the part of the researcher. Five themes were identified: (a) context (organisational support, engagement and partnerships, communication and project leadership); (b) program receipt, benefit and reach; (c) program delivery (intervention providers' experience and skills, mode of intervention delivery, referral to other services, support and training for intervention providers); (d) implementation (program delivered as planned); (e) opportunities for scale-up. Collaborators perceived that the program was implemented and delivered as planned. This specific research addresses the success of the process of implementing and delivering interventions for infant feeding and establishing healthy habits for children by building the capacity of mothers. Collaborators attributed successful program implementation to contextual factors: strong support by the host organisation; good project leadership; clear communication; collaborative internal and external partnerships; intervention provision by experienced nurses. Remote delivery was convenient to program participants and participants were able to resolve other personal concerns in addition to direct immediate benefits. Because of their capacity to influence policy decisions, the absence of policymakers at project meetings was a shortcoming. Collaborative partnerships with health and research partners, understanding of contextual issues and consumer involvement could lead to program expansion. The program has the potential to be scaled up through integration with existing services and gradual expansion into other health districts prior to state-wide rollout.

CONCLUSIONS

The CHAT trial delivered the Healthy Beginnings intervention which resulted in improvements in infant feeding, active play and sedentary behaviours. This evaluation demonstrated that the involvement of key stakeholders from early planning stages through to implementation of the program and the partnerships that evolved contributed to the successful implementation of the program. An unintended benefit to participants from this program was the social support that was provided. Intervention delivery via telephone and text messages enabled easy access to the program. Most importantly, the program has the potential to be scaled up through integration into existing services and gradual expansion prior to state-wide rollout. SO WHAT?: Strong internal and external partnerships, effective communication systems and integration with existing services create the context for potential translation and scaling up of the program to other health promotion settings.