RETurn to work After stroKE (RETAKE) Trial: protocol for a mixed-methods process evaluation using normalisation process theory

OBJECTIVES

This mixed-method process evaluation underpinned by normalisation process theory aims to measure fidelity to the intervention, understand the social and structural context in which the intervention is delivered and identify barriers and facilitators to intervention implementation.

SETTING

RETurn to work After stroKE (RETAKE) is a multicentre individual patient randomised controlled trial to determine whether Early Stroke Specialist Vocational Rehabilitation (ESSVR) plus usual care is a clinically and cost-effective therapy to facilitate return to work after stroke, compared with usual care alone. This protocol paper describes the embedded process evaluation.

PARTICIPANTS AND OUTCOME MEASURES

Intervention training for therapists will be observed and use of remote mentor support reviewed through documentary analysis. Fidelity will be assessed through participant questionnaires and analysis of therapy records, examining frequency, duration and content of ESSVR sessions. To understand the influence of social and structural contexts, the process evaluation will explore therapists' attitudes towards evidence-based practice, competency to deliver the intervention and evaluate potential sources of contamination. Longitudinal case studies incorporating non-participant observations will be conducted with a proportion of intervention and usual care participants. Semistructured interviews with stroke survivors, carers, occupational therapists, mentors, service managers and employers will explore their experiences as RETAKE participants. Analysis of qualitative data will draw on thematic and framework approaches. Quantitative data analysis will include regression models and descriptive statistics. Qualitative and quantitative data will be independently analysed by process evaluation and Clinical Trials Research Unit teams, respectively. Linked data, for example, fidelity and describing usual care will be synthesised by comparing and integrating quantitative descriptive data with the qualitative findings.

ETHICS AND DISSEMINATION

Approval obtained through the East Midlands-Nottingham 2 Research Ethics Committee (Ref: 18/EM/0019) and the National Health ServiceResearch Authority. Dissemination via journal publications, stroke conferences, social media and meetings with national Stroke clinical leads.

TRIAL REGISTRATION NUMBER

ISRCTN12464275.

An intervention to increase physical activity in care home residents: results of a cluster-randomised, controlled feasibility trial (the REACH trial)

BACKGROUND

Care home (CH) residents are mainly inactive, leading to increased dependency and low mood. Strategies to improve activity are required.

DESIGN AND SETTING

Cluster randomised controlled feasibility trial with embedded process and health economic evaluations. Twelve residential CHs in Yorkshire, United Kingdom, were randomised to the MoveMore intervention plus usual care (UC) (n = 5) or UC only (n = 7).

PARTICIPANTS

Permanent residents aged ≥65 years.

INTERVENTION

MoveMore: a whole home intervention involving all CH staff designed to encourage and support increase in movement of residents.

OBJECTIVES AND MEASUREMENTS

Feasibility objectives relating to recruitment, intervention delivery, data collection and follow-up and safety concerns informed the feasibility of progression to a definitive trial. Data collection at baseline, 3, 6 and 9 months included: participants' physical function and mobility, perceived health, mood, quality of life, cognitive impairment questionnaires; accelerometry; safety data; intervention implementation.

RESULTS

300 residents were screened; 153 were registered (62 MoveMore; 91 UC). Average cluster size: MoveMore: 12.4 CHs; UC: 13.0 CHs. There were no CH/resident withdrawals. Forty (26.1%) participants were unavailable for follow-up: 28 died (12 MoveMore; 16 UC); 12 moved from the CH. Staff informant/proxy data collection for participants was >80%; data collection from participants was <75%; at 9 months, 65.6% of residents provided valid accelerometer data; two CHs fully, two partially and one failed to implement the intervention. There were no safety concerns.

CONCLUSIONS

Recruiting CHs and residents was feasible. Intervention implementation and data collection methods need refinement before a definitive trial. There were no safety concerns.

Effectiveness of Dementia Care Mapping™ to reduce agitation in care home residents with dementia: an open-cohort cluster randomised controlled trial

OBJECTIVES

Agitation is common and problematic in care home residents with dementia. This study investigated the (cost)effectiveness of Dementia Care Mapping™ (DCM) for reducing agitation in this population.

METHOD

Pragmatic, cluster randomised controlled trial with cost-effectiveness analysis in 50 care homes, follow-up at 6 and 16 months and stratified randomisation to intervention (n = 31) and control (n = 19). Residents with dementia were recruited at baseline (n = 726) and 16 months (n = 261). Clusters were not blinded to allocation. Three DCM cycles were scheduled, delivered by two trained staff per home. Cycle one was supported by an external DCM expert. Agitation (Cohen-Mansfield Agitation Inventory (CMAI)) at 16 months was the primary outcome.

RESULTS

DCM was not superior to control on any outcomes (cross-sectional sample n = 675: 287 control, 388 intervention). The adjusted mean CMAI score difference was -2.11 points (95% CI -4.66 to 0.44, p = 0.104, adjusted ICC control = 0, intervention 0.001). Sensitivity analyses supported the primary analysis. Incremental cost per unit improvement in CMAI and QALYs (intervention vs control) on closed-cohort baseline recruited sample (n = 726, 418 intervention, 308 control) was £289 and £60,627 respectively. Loss to follow-up at 16 months in the original cohort was 312/726 (43·0%) mainly (87·2%) due to deaths. Intervention dose was low with only a quarter of homes completing more than one DCM cycle.

CONCLUSION

No benefits of DCM were evidenced. Low intervention dose indicates standard care homes may be insufficiently resourced to implement DCM. Alternative models of implementation, or other approaches to reducing agitation should be considered.

Strategies to enhance routine physical activity in care home residents: the REACH research programme including a cluster feasibility RCT

Background

Care home residents are mainly inactive, leading to increased dependency and low mood. Although exercise classes may increase activity, a more sustainable model is to engage staff and residents in increasing routine activity.

Objectives

The objectives were to develop and preliminarily test strategies to enhance the routine physical activity of care home residents to improve their physical, psychological and social well-being through five overlapping workstreams.

Design

This trial had a mixed-methods research design to develop and test the feasibility of undertaking an evaluative study consisting of gaining an understanding of the opportunities for and barriers to enhancing physical activity in care homes (workstream 1); testing physical activity assessment instruments (workstream 2); developing an intervention through a process of intervention mapping (workstream 3); refining the provisional intervention in the care home setting and clarifying outcome measurement (workstream 4); and undertaking a cluster randomised feasibility trial of the intervention [introduced via three facilitated workshops at baseline (with physiotherapist input), 2 weeks (with artist input) and 2 months], with embedded process and health economic evaluations (workstream 5).

Setting

The trial was set in 12 residential care homes differing in size, location, ownership and provision in Yorkshire, UK.

Participants

The participants were elderly residents, carers, managers and staff of care homes.

Intervention

The intervention was MoveMore, designed for the whole home, to encourage and support the movement of residents in their daily routines.

Main outcome measures

The main outcome measures related to the feasibility and acceptability of implementing a full-scale trial in terms of recruitment and retention of care homes and residents, intervention delivery, completion and reporting of baseline data and outcomes (including hours of accelerometer wear, hours of sedentary behaviour and hours and type of physical activity), and safety and cost data (workstream 5).

Results

Workstream 1 – through a detailed understanding of life in a care home, a needs assessment was produced, and barriers to and facilitators of activity were identified. Key factors included ethos of care; organisation, management and delivery of care; use of space; and the residents’ daily routines. Workstream 2 – 22 (73.3%) out of 30 residents who wore a hip accelerometer had valid data (≥ 8 hours on ≥ 4 days of the week). Workstream 3 – practical mechanisms for increasing physical activity were developed, informed by an advisory group of stakeholders and outputs from workstreams 1 and 2, framed by the process of intervention mapping. Workstream 4 – action groups were convened in four care homes to refine the intervention, leading to further development of implementation strategies. The intervention, MoveMore, is a whole-home intervention involving engagement with a stakeholder group to implement a cyclical process of change to encourage and support the movement of residents in their daily routines. Workstream 5 – 12 care homes and 153 residents were recruited to the cluster randomised feasibility trial. Recruitment in the care homes varied (40–89%). Five care homes were randomised to the intervention and seven were randomised to usual care. Predetermined progression criteria were recruitment of care homes and residents (green); intervention delivery (amber); and data collection and follow-up – 52% of residents provided usable accelerometer data at 9 months (red), > 75% of residents had reported outcomes at 9 months (green, but self-reported resident outcomes were red), 26% loss of residents to follow-up at 9 months [just missing green criterion (no greater than 25%)] and safety concerns (green).

Limitations

Observations of residents’ movements were not conducted in private spaces. Working with care home residents to identify appropriate outcome measures was challenging. Take-up of the intervention was suboptimal in some sites. It was not possible to make a reliably informed decision on the most appropriate physical activity end point(s) for future use in a definitive trial.

Conclusions

A whole-home intervention was developed that was owned and delivered by staff and was informed by residents and staff. The feasibility of conducting a cluster randomised controlled trial was successfully tested: the target numbers of care homes and residents were recruited, demonstrating that it is possible to recruit care home residents to a cluster randomised trial, although this process was time-consuming and resource heavy. A large data set was collected, which provided a comprehensive picture of the environment, residents and staff in care homes. Extensive quantitative and qualitative work comprehensively explored a neglected area of health and social care research. Completion of ethnographic work in a range of settings enabled the production of an in-depth picture of life in care homes that will be helpful for other researchers considering organisational change in this setting.

Future work

The content and delivery of the intervention requires optimisation and the outcome measurement requires further refinement prior to undertaking a full trial evaluation. Consideration could be given to a recommended, simplified, core outcome set, which would facilitate data collection in this population.

Trial registration

Current Controlled Trials ISRCTN16076575.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grant for Applied Research programme and will be published in full in Programme Grant for Applied Research; Vol. 9, No. 9. See the NIHR Journals Library website for further project information.

An individually randomised controlled multi-centre pragmatic trial with embedded economic and process evaluations of early vocational rehabilitation compared with usual care for stroke survivors: study protocol for the RETurn to work After stroKE (RETAKE) trial

BACKGROUND

Return to work (RTW) is achieved by less than 50% of stroke survivors. The rising incidence of stroke among younger people, the UK economic forecast, and clinical drivers highlight the need for stroke survivors to receive support with RTW. However, evidence for this type of support is lacking. This randomised controlled trial (RCT) will investigate whether Early Stroke Specialist Vocational Rehabilitation (ESSVR) plus usual care (UC) (i.e. usual NHS rehabilitation) is more clinically and cost-effective for supporting post-stroke RTW, than UC alone.

METHODS

Seven hundred sixty stroke survivors and their carers will be recruited from approximately 20 NHS stroke services. A 5:4 allocation ratio will be employed to randomise participants to receive ESSVR plus UC, or UC alone. The individually tailored ESSVR intervention will commence within 12 weeks of stroke onset and be delivered for up to 12 months as necessary by trained RETAKE occupational therapists in the community, participants' homes or workplaces, and outpatient/inpatient therapy settings, via telephone, email, or SMS text message. Outcome data will be collected via self-report questionnaires administered by post or online at 3, 6, and 12 months follow-up. The primary outcome will be self-reported RTW and job retention at 12 months (minimum 2 h/week). Secondary outcomes will include mood, function, participation, health-related quality of life, confidence, intervention compliance, health and social care resource use, and mortality. An embedded economic evaluation will estimate cost-effectiveness and cost-utility analyses from National Health Service (NHS) and Personal Social Services (PSS) perspectives. An embedded process evaluation will employ a mixed methods approach to explore ESSVR implementation, contextual factors linked to outcome variation, and factors affecting NHS roll-out.

DISCUSSION

This article describes the protocol for a multi-centre RCT evaluating the clinical- and cost-effectiveness of an early vocational rehabilitation intervention aimed at supporting adults to return to work following a stroke. Evidence favouring the ESSVR intervention would support its roll-out in NHS settings.

TRIAL REGISTRATION

ISRCTN, ISRCTN12464275 . Registered on 26 February 2018.

Dementia Care Mapping™ to reduce agitation in care home residents with dementia: the EPIC cluster RCT

BACKGROUND

The quality of care for people with dementia in care homes is of concern. Interventions that can improve care outcomes are required.

OBJECTIVE

To investigate the clinical effectiveness and cost-effectiveness of Dementia Care Mapping™ (DCM) for reducing agitation and improving care outcomes for people living with dementia in care homes, versus usual care.

DESIGN

A pragmatic, cluster randomised controlled trial with an open-cohort design, follow-up at 6 and 16 months, integrated cost-effectiveness analysis and process evaluation. Clusters were not blinded to allocation. The primary end point was completed by staff proxy and independent assessors.

SETTING

Stratified randomisation of 50 care homes to the intervention and control groups on a 3 : 2 ratio by type, size, staff exposure to dementia training and recruiting hub.

PARTICIPANTS

Fifty care homes were randomised (intervention, n = 31; control, n = 19), with 726 residents recruited at baseline and a further 261 recruited after 16 months. Care homes were eligible if they recruited a minimum of 10 residents, were not subject to improvement notices, had not used DCM in the previous 18 months and were not participating in conflicting research. Residents were eligible if they lived there permanently, had a formal diagnosis of dementia or a score of 4+ on the Functional Assessment Staging Test of Alzheimer's Disease, were proficient in English and were not terminally ill or permanently cared for in bed. All homes were audited on the delivery of dementia and person-centred care awareness training. Those not reaching a minimum standard were provided training ahead of randomisation. Eighteen homes took part in the process evaluation.

INTERVENTION

Two staff members from each intervention home were trained to use DCM and were asked to carry out three DCM cycles; the first was supported by an external expert.

MAIN OUTCOME MEASURES

The primary outcome was agitation (Cohen-Mansfield Agitation Inventory), measured at 16 months. Secondary outcomes included resident behaviours and quality of life.

RESULTS

There were 675 residents in the final analysis (intervention, n = 388; control, n = 287). There was no evidence of a difference in agitation levels between the treatment arms. The adjusted mean difference in Cohen-Mansfield Agitation Inventory score was -2.11 points, being lower in the intervention group than in the control (95% confidence interval -4.66 to 0.44; p = 0.104; adjusted intracluster correlation coefficient: control = 0, intervention = 0.001). The sensitivity analyses results supported the primary analysis. No differences were detected in any of the secondary outcomes. The health economic analyses indicated that DCM was not cost-effective. Intervention adherence was problematic; only 26% of homes completed more than their first DCM cycle. Impacts, barriers to and facilitators of DCM implementation were identified.

LIMITATIONS

The primary completion of resident outcomes was by staff proxy, owing to self-report difficulties for residents with advanced dementia. Clusters were not blinded to allocation, although supportive analyses suggested that any reporting bias was not clinically important.

CONCLUSIONS

There was no benefit of DCM over control for any outcomes. The implementation of DCM by care home staff was suboptimal compared with the protocol in the majority of homes.

FUTURE WORK

Alternative models of DCM implementation should be considered that do not rely solely on leadership by care home staff.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN82288852.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 24, No. 16. See the NIHR Journals Library website for further project information.

Longer-term effectiveness of systemic family therapy compared with treatment as usual for young people after self-harm: An extended follow up of pragmatic randomised controlled trial

BACKGROUND

Self-harm in adolescents is common and repetition frequent. Evidence for effective interventions to reduce self-harm is limited. Long term follow-up of existing studies is rare.

METHODS

Extended follow up, from 18 to at least 36-months, of the SHIFT trial: a pragmatic, multi-centre, individually-randomised, controlled trial involving young people (11-17) who had self-harmed at least twice and presented to Child & Adolescent Mental Health Services (CAMHS). SHIFT evaluated manualised family therapy (FT) versus treatment as usual (TAU) in reducing repetition of self-harm leading to hospital attendance 18 months post-randomisation.We obtained ONS mortality data, adult mental health data, and further details of hospital attendance from routine Hospital Episode Statistics (HES) data plus researcher follow-up. We assessed longer-term differences in outcome using multivariable Cox Proportional Hazards regression analysis, and assessed all-cause mortality and morbidity relating to hospital attendances for reasons other than self-harm.

STUDY REGISTRATION

ISRCTN 59793150.

OUTCOMES

The original sample of 832 were randomised between April 2010 and December 2013. Extended follow-up continued until February 2017 for a median 55·4 months (range 0-82·5 months), providing post 18-month data for 804 (96·6%) participants, of whom 785 (94·4%) had a minimum of 36-months follow-up.There was no evidence of a between-group difference in the primary outcome during the extended follow-up period (Hazard Ratio (HR) 1·03; 95% CI: 0·83, 1·28; p-value=0·78), consistent with our findings in the original trial with 18 months follow-up (HR 1·14, 95% CI 0·87, 1·49; p-value 0·33). There was a reduced rate of self-harm in older participants aged 15-17 (HR 0·7, 95% CI 0·56, 0·88), as compared with those aged 11-14; and significantly increased rates of self-harm in participants whose index episode combined self-injury and poisoning (HR 1·8, 95% CI 1·2, 2·7). Two deaths were reported during the extended follow up period.

INTERPRETATION

For adolescents referred to CAMHS after self-harm, having self-harmed at least once before, trial FT confers no benefits over TAU in reducing subsequent hospitalisation for self-harm over 18 months or 36 months.

FUNDING

NIHR HTA Reference: 07/33/01.

Recruiting care homes to a randomised controlled trial

Background

There are more than a quarter of a million individuals aged ≥ 65 years who are resident in care homes in England and Wales. Care home residents have high levels of cognitive impairment, physical disability, multimorbidity and polypharmacy. Research is needed to ensure there are robust, evidence-based interventions to improve the quality of life of this frail group. However, there is a paucity of research studies in this area. Recruiting care homes and their residents to research is challenging.

A feasibility, cluster randomised controlled trial was undertaken as part of a research programme to identify ways to develop and test methods to enhance the physical activity of care home residents. This paper describes two methods of recruiting care homes to the trial and draws out learning to inform future studies.

Methods

Eligible care homes met the following criteria: they were within a defined geographical area in the north of England; provided residential care for adults ≥ 65 years of age; had not previously been involved in the research programme; were not taking part in a conflicting study; were not recorded on the Care Quality Commission website as ‘inadequate’ or ‘requiring improvements’ in any area; and had ≥ 10 beds. Care homes were identified by a ‘systematic approach’ using the Care Quality Commission website database of care homes or a ‘targeted approach’ via a network of research-ready care homes. A standardised method was used to recruit care homes including eligibility screening; invitation letters; telephone contact; visits; formal letter of agreement.

Results

In the systematic approach, 377 care homes were screened, 230 (61%) were initially eligible and invited to participate, 11 were recruited (recruitment rate (RR) 4.8%). In the targeted approach, 15 care homes were invited to participate, two were recruited (RR 13.3%). Overall, 245 care homes were approached and 13 recruited (RR 5.3%). A variety of care homes were recruited to the trial in terms of size, location, ownership and care provision.

Conclusions

Systematic recruitment of care homes to the study was time-consuming and resource-heavy but led to a variety of care homes being recruited. The targeted approach led to a higher recruitment rate.

Trial registration

ISRCTN registry, ISRCTN16076575. Registered on 25 June 2015.

Research Exploring Physical Activity in Care Homes (REACH): study protocol for a randomised controlled trial

Background

As life expectancy increases and the number of older people, particularly those aged 85 years and over, expands there is an increase in demand for long-term care. A large proportion of people in a care home setting spend most of their time sedentary, and this is one of the leading preventable causes of death. Encouraging residents to engage in more physical activity could deliver benefits in terms of physical and psychological health, and quality of life. This study is the final stage of a programme of research to develop and preliminarily test an evidence-based intervention designed to enhance opportunities for movement amongst care home residents, thereby increasing levels of physical activity.

Methods/design

This is a cluster randomised feasibility trial, aiming to recruit at least 8–12 residents at each of 12 residential care homes across Yorkshire, UK. Care homes will be randomly allocated on a 1:1 basis to receive either the intervention alongside usual care, or to continue to provide usual care alone. Assessment will be undertaken with participating residents at baseline (prior to care home randomisation) and at 3, 6, and 9 months post-randomisation. Data relating to changes in physical activity, physical function, level of cognitive impairment, mood, perceived health and wellbeing, and quality of life will be collected. Data at the level of the home will also be collected and will include staff experience of care, and changes in the numbers and types of adverse events residents experience (for example, hospital admissions, falls). Details of National Health Service (NHS) usage will be collected to inform the economic analysis. An embedded process evaluation will obtain information to test out the theory of change underpinning the intervention and its acceptability to staff and residents.

Discussion

This feasibility trial with embedded process evaluation and collection of health economic data will allow us to undertake detailed feasibility work to inform a future large-scale trial. It will provide valuable information to inform research procedures in this important but challenging area.

Trial registration

ISRCTN registry, ISRCTN16076575. Registered on 25 June 2015.

Electronic supplementary material

The online version of this article (doi:10.1186/s13063-017-1921-8) contains supplementary material, which is available to authorized users.