Fidelity of delivery of a physical activity intervention: Predictors and consequences

Identifying the active content of interventions targeting the psychological well-being of carers of people with motor neuron disease: A systematic review

OBJECTIVES

The primary aim of this research was to use a taxonomy of behavior change techniques (BCTTv1) to identify, map, and describe the active components of intervention and comparator groups in studies evaluating the psychological well-being (PWB) of motor neuron disease (MND) carers. Secondary aims were to (a) identify absent active ingredients and (b) explore whether variability in the effectiveness of interventions targeting the PWB of MND carers could be better explained through improved characterization of the active content of these interventions.

METHODS

Mixed-methods systematic review based on Joanna Briggs Institute methodology for quantitative, qualitative, and mixed-methods reviews and Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Content-coding of interventions targeting the PWB of MND carers using BCTTv1 was conducted.

RESULTS

Sixteen manuscripts describing 14 studies were included. Forty-one of the possible 93 behavior change techniques (BCTs, 44%) were identified as active ingredients, while 52 BCTs (56%) were absent. BCTs were identified in all 14 intervention groups and 4 control groups. Four of the 16 overall BCTTv1 categories were absent. Eleven of the 14 studies demonstrated PWB benefits from their interventions.

SIGNIFICANCE OF RESULTS

Identified and absent BCTs and BCTTv1 categories were mapped for all study groups, enabling a transparent characterization of active intervention content associated with positive PWB outcomes. Directions to improve interventions in this nascent field of research included the investigation of relevant untested BCTs in this population and the management of reporting and methodological quality issues.

Play brick therapy to aid the social skills of children and young people with autism spectrum disorder: the I-SOCIALISE cluster RCT

Background

Social skills interventions are commonly recommended to help children and young people with autism spectrum disorder develop social skills, but some struggle to engage in these interventions. LEGO® (LEGO System A/S, Billund, Denmark) based therapy, a group social skills intervention, aims to be more interesting and engaging.

Objective

To evaluate the clinical effectiveness of LEGO® based therapy on the social and emotional skills of children and young people with autism spectrum disorder in school settings compared with usual support. Secondary objectives included evaluations of cost-effectiveness, acceptability and treatment fidelity.

Design

A cluster randomised controlled trial randomly allocating participating schools to either LEGO® based therapy and usual support or usual support only.

Setting

Mainstream schools in the north of England.

Participants

Children and young people (aged 7-15 years) with autism spectrum disorder, their parent/guardian, an associated teacher/teaching assistant and a facilitator teacher/teaching assistant (intervention schools only).

Intervention

Schools randomised to the intervention arm delivered 12 weekly sessions of LEGO® based therapy, which promotes collaborative play and encourages social problem-solving in groups of three children and young people with a facilitator (trained teacher or teaching assistant). Participants received usual support from school and community services. Participants in the control arm received usual support only. Research assistants and statisticians were blind to treatment allocation.

Main outcome measure

The social skills subscale of the Social Skills Improvement System (SSIS), completed by the children and young people's unblinded teacher pre randomisation and 20 weeks post randomisation. The SSIS social skills subscale measures social skills including social communication, co-operation, empathy, assertion, responsibility and self-control. Participants completed a number of other pre- and post-randomisation measures of emotional health, quality of life, loneliness, problem behaviours, academic competence, service resource utilisation and adverse events.

Results

A total of 250 children and young people from 98 schools were randomised: 127 to the intervention arm and 123 to the control arm. Intention-to-treat analysis of the main outcome measure showed a modest positive difference of 3.74 points (95% confidence interval -0.16 to 7.63 points, standardised effect size 0.18; p = 0.06) in favour of the intervention arm. Statistical significance increased in per-protocol analysis, with a modest positive difference (standardised effect size 0.21; p = 0.036). Cost-effectiveness of the intervention was found in reduced service use costs and a small increase in quality-adjusted life-years. Intervention fidelity and acceptability were positive. No intervention-related adverse events or effects were reported.

Conclusions

The primary and pre-planned sensitivity analysis of the primary outcome consistently showed a positive clinical difference, with modest standardised effect sizes of between 0.15 and 0.21. There were positive health economics and qualitative findings, corroborated by the difference between arms for the majority of secondary outcomes, which were not statistically significant but favoured the intervention arm. Post hoc additional analysis was exploratory and was not used in drawing this conclusion. Given the small positive change, LEGO® based therapy for children and young people with autism spectrum disorder in schools should be considered.

Limitations

The primary outcome measure was completed by an unblinded teacher (rather than by the facilitator).

Future work

The study team recommends future research into LEGO® based therapy, particularly in school environments.

Trial registration

This trial is registered as ISRCTN64852382.

Funding

This award was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme (NIHR award ref: 15/49/32) and is published in full in Public Health Research; Vol. 11, No. 12. See the NIHR Funding and Awards website for further award information.

eHealth for maintenance cardiovascular rehabilitation: a systematic review and meta-analysis

AIMS

To provide a quantitative analysis of eHealth-supported interventions on health outcomes in cardiovascular rehabilitation (CR) maintenance (phase III) in patients with coronary artery disease (CAD) and to identify effective behavioural change techniques (BCTs).

METHODS AND RESULTS

A systematic review was conducted (PubMed, CINAHL, MEDLINE, and Web of Science) to summarize and synthesize the effects of eHealth in phase III maintenance on health outcomes including physical activity (PA) and exercise capacity, quality of life (QoL), mental health, self-efficacy, clinical variables, and events/rehospitalization. A meta-analysis following the Cochrane Collaboration guidelines using Review Manager (RevMan5.4) was performed. Analyses were conducted differentiating between short-term (≤6 months) and medium/long-term effects (>6 months). Effective behavioural change techniques were defined based on the described intervention and coded according to the BCT handbook. Fourteen eligible studies (1497 patients) were included. eHealth significantly promoted PA (SMD = 0.35; 95%CI 0.02-0.70; P = 0.04) and exercise capacity after 6 months (SMD = 0.29; 95%CI 0.05-0.52; P = 0.02) compared with usual care. Quality of life was higher with eHealth compared with care as usual (SMD = 0.17; 95%CI 0.02-0.32; P = 0.02). Systolic blood pressure decreased after 6 months with eHealth compared with care as usual (SMD = -0.20; 95%CI -0.40-0.00; P = 0.046). There was substantial heterogeneity in the adapted BCTs and type of intervention. Mapping of BCTs revealed that self-monitoring of behaviour and/or goal setting as well as feedback on behaviour were most frequently included.

CONCLUSION

eHealth in phase III CR is effective in stimulating PA and improving exercise capacity in patients with CAD while increasing QoL and decreasing systolic blood pressure. Currently, data of eHealth effects on morbidity, mortality, and clinical outcomes are scarce and should be investigated in future studies.

REGISTRATION

PROSPERO: CRD42020203578.

Time to move beyond monological perspectives in health behavior change communication research and practice

Chronic disease self-management and health behavior change programs are becoming increasingly important to health service delivery to prevent the development of chronic disease and optimize health outcomes for those who suffer from it. To train people to deliver these programs effectively, we need to understand both the what and how of program delivery. While there is an abundant literature on what, and a merging evidence about what techniques to use, such as goals setting and self-monitoring, the literature on how programs should be delivered is less well developed. This paper reviews emerging research in this area and identifies an underlying monological approach. We argue that this currently dominant model cannot address the key issues in this area. By considering the theoretical framework of Dialogism, we introduce the method of Conversation Analysis to the field of behavior change interventions. Extensive research into health communication has endeavored to show the importance of language and the organization of interactions. We demonstrate and discuss how a monological approach to interventions prevents exploration of what professionals do to deliver intervention content. In doing so, we show that techniques do not account for how successfully an intervention is delivered.

Is it Possible to Reduce Pain-Related Fear in Individuals with Knee Osteoarthritis? a Systematic Review of Randomised Clinical Trials

OBJECTIVE

To evaluate the effectiveness of different interventions in reducing pain-related fear outcomes in people with knee osteoarthritis who have or have not had previous knee surgery, and to analyze whether included trials reported their interventions in full detail.

METHODS

Systematic searches were carried out in the Cochrane CENTRAL, CINAHL, EMBASE, PEDro, PsycINFO, PubMed, and SPORTDiscus from the inception of the database up to November 2019. Searches were manually updated to July 2021. We included randomized clinical trials that evaluated pain-related fear outcomes as a primary or secondary outcome in adults with knee osteoarthritis. The Cochrane Risk of Bias Tool 2 and the GRADE approach evaluated the risk of bias and the certainty of the evidence, respectively.

RESULTS

Eighteen trials were included. Four trials evaluated pain-related fear as a primary outcome and all evaluated kinesiophobia in samples that had previously undergone a knee surgical procedure. These trials found that interventions based primarily on cognitive aspects (e.g. cognitive-behavioral principles) can be effective in reducing kinesiophobia. Trials evaluating pain-related fear as the secondary outcome also found that interventions that included cognitive aspects (e.g. pain neuroscience education) decreased the levels of pain-related fear (e.g. fear of falling or kinesiophobia) in patients with or without a previous knee surgery. However, serious to very serious risk of bias and imprecisions were found in included trials. Thus, the certainty of the evidence was judged as low and very low using the GRADE approach. All trials reported insufficient details to allow a complete replication of their interventions.

CONCLUSIONS

Interventions that include cognitive aspects may be the best option to reduce pain-related fear in people with knee osteoarthritis. However, we found a general low and very low certainty of the evidence and the findings should be considered with caution.

GP delivered brief weight loss advice: associations between in-consultation behaviour change techniques and patient weight loss in recorded primary care discussions

Background

Primary care clinicians are encouraged to intervene opportunistically, offering weight-loss advice to people living with obesity. The BWeL trial showed patients receiving brief weight-loss advice from their general practitioner lost weight at one year follow-up. We examined the behaviour change techniques (BCTs) clinicians used to identify which BCTs are associated with this weight loss.

Methods

We coded 224 audio recorded interventions from the BWeL trial using the behavioural change techniques version one taxonomy (BCTTv1) and the 'refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours' (CALOR-RE taxonomy). Linear and logistic regressions were performed to analyse associations between behaviour change techniques used in these taxonomies and patient weight loss.

Results

Mean intervention length was 86 s. We identified 28 different BCTs BCTTv1 and 22 from CALOR-RE. No BCTs or BCT domains were associated with mean weight loss at 12 months, loss of 5% bodyweight, or action taken at 3 months. The BCT 'Feedback on outcomes of behaviour (future)' was associated with an increased likelihood that the patient reported taking action to lose weight by 12 months (OR = 6.10, 95%CI = 1.20, 31.0).

Conclusion

Although we found no evidence to support the use of particular BCTs, our results suggest that it is the brief intervention itself, rather than specific content, which may motivate weight loss. This can support clinicians to confidently intervene without needing complex training. Offering follow-up appointments can support positive changes to health behaviours, even if these are not associated with weight loss.

Electrically assisted cycling for individuals with type 2 diabetes mellitus: a pilot randomized controlled trial

BACKGROUND

Type 2 diabetes mellitus (T2DM) and its associated complications puts considerable strain on healthcare systems. With the global incidence of T2DM increasing, effective disease management is essential. Physical activity (PA) is a key component of T2DM management; however, rates of PA engagement are low in this population. Developing effective and sustainable interventions that encourage PA is a high priority. Electrically assisted bicycles are becoming increasingly popular and may increase PA in healthy adults. This study aimed to provide evidence of the feasibility of conducting a randomized controlled trial to evaluate the efficacy of an e-cycling intervention to increase PA and improve health in individuals with T2DM.

METHODS

A parallel-group two-arm randomized, waitlist-controlled pilot study was conducted. Individuals were randomized to either an e-bike intervention or standard care. The intervention incorporated two one-to-one e-bike skills training and behavioural counselling sessions delivered by a community-based cycling charity, followed by a 12-week e-bike loan with two further sessions with the instructors. Feasibility was assessed via measures related to recruitment, retention and intervention implementation. Post-intervention interviews with instructors and participants explored the acceptability of the study procedures and intervention. Clinical, physiological and behavioural outcomes were collected at baseline and post-intervention to evaluate the intervention's potential.

RESULTS

Forty participants (M_age = 57) were randomized, of which 34 were recruited from primary care practices. Thirty-five participants were retained in the trial. The intervention was conducted with high fidelity (> 80% content delivered). E-bike training provided participants with the skills, knowledge and confidence needed to e-bike independently. Instructors reported being more confident delivering the skills training than behavioural counselling, despite acknowledging its importance. The study procedures were found to be acceptable to participants. Between-group differences in change during the intervention were indicative of the interventions potential for improving glucose control, health-related quality of life and cardiorespiratory fitness. Increases in overall device measured moderate-to-vigorous PA behaviour following the intervention were found, and there was evidence that this population self-selected to e-cycle at a moderate intensity.

CONCLUSIONS

The study's recruitment, retention, acceptability and potential efficacy support the development of a definitive trial subject to identified refinements.

TRIAL REGISTRATION

ISRCTN, ISRCTN67421464 . Registered 17/12/2018.

Exploring the Association between Individual-Level Attributes and Fidelity to a Vocational Rehabilitation Intervention within a Randomised Controlled Trial

Understanding what attributes or characteristics of those delivering interventions affect intervention fidelity and patient outcomes is important for contextualising intervention effectiveness. It may also inform implementation of interventions in future research and clinical practice. This study aimed to explore the relationships between attributes of Occupational Therapists (OTs), their faithful delivery of an early stroke specialist vocational rehabilitation intervention (ESSVR), and stroke survivor return-to-work (RTW) outcomes. Thirty-nine OTs were surveyed about their experience and knowledge of stroke and vocational rehabilitation and were trained to deliver ESSVR. ESSVR was delivered across 16 sites in England and Wales between February 2018 and November 2021. OTs received monthly mentoring to support ESSVR delivery. The amount of mentoring each OT received was recorded in OT mentoring records. Fidelity was assessed using an intervention component checklist completed using retrospective case review of one randomly selected participant per OT. Linear and logistic regression analyses explored relationships between OT attributes, fidelity, and stroke survivor RTW outcome. Fidelity scores ranged from 30.8 to 100% (Mean: 78.8%, SD: 19.2%). Only OT engagement in mentoring was significantly associated with fidelity (b = 0.29, 95% CI = 0.05-0.53, p < 0.05). Increased fidelity (OR = 1.06, 95% CI = 1.01-1.1, p = 0.01) and increasing years of stroke rehabilitation experience (OR = 1.17, 95% CI = 1.02-1.35) was significantly associated with positive stroke survivor RTW outcomes. Findings of this study suggest that mentoring OTs may increase fidelity of delivery of ESSVR, which may also be associated with positive stroke survivor return-to-work outcomes. The results also suggest that OTs with more experience of stroke rehabilitation may be able to support stroke survivors to RTW more effectively. Upskilling OTs to deliver complex interventions, such as ESSVR, in clinical trials may require mentoring support in addition to training to ensure fidelity.

Repeated measures of implementation variables

It is commonly acknowledged that implementation work is long-term and contextual in nature and often takes years to accomplish. Repeated measures are needed to study the trajectory of implementation variables over time. To be useful in typical practice settings, measures that are relevant, sensitive, consequential, and practical are needed to inform planning and action. If implementation independent variables and implementation dependent variables are to contribute to a science of implementation, then measures that meet these criteria must be established. This exploratory review was undertaken to "see what is being done" to evaluate implementation variables and processes repeatedly in situations where achieving outcomes was the goal (i.e., more likely to be consequential). No judgement was made about the adequacy of the measure (e.g., psychometric properties) in the review. The search process resulted in 32 articles that met the criteria for a repeated measure of an implementation variable. 23 different implementation variables were the subject of repeated measures. The broad spectrum of implementation variables identified in the review included innovation fidelity, sustainability, organization change, and scaling along with training, implementation teams, and implementation fidelity. Given the long-term complexities involved in providing implementation supports to achieve the full and effective use of innovations, repeated measurements of relevant variables are needed to promote a more complete understanding of implementation processes and outcomes. Longitudinal studies employing repeated measures that are relevant, sensitive, consequential, and practical should become common if the complexities involved in implementation are to be understood.

Assessing the fidelity of delivery style of a mental skills training programme for young people experiencing homelessness

There is a need for positive youth development/strengths-based approaches to support the wellbeing and social inclusion of young people experiencing or at risk of homelessness. My Strengths Training for Life™ (MST4Life™) uses a strengths-based approach with the aim to improve young people's resilience, self-worth, wellbeing and engagement in education, employment, and training. This mixed methods study assessed the fidelity of delivery style of the MST4Life™ programme, the extent to which frontline service staff can delivery psychologically informed programmes to service users and identified barriers and enablers to delivering with fidelity to the intended style. Observations of programme delivery (two facilitators per session) took place across early, middle, and late phases of the programme across a pilot phase (n = 18) and main study (n = 45). Facilitators also completed self-reflection forms following each session. The mean observation score was 82.2 ± 15.7 %, and facilitator self-report mean adherence score was 89.3 ± 6.2 % which indicate that the programme was delivered with high fidelity. Quantitative data was also analysed using non-parametric statistical test (Mann-Whitney U Test). There was a significant difference between observation scores for deliverers with postgraduate psychology training compared to deliverers without postgraduate psychology training (p = .029). Qualitative data were analysed using inductive thematic analysis. Barriers and enablers included communication, frontline staff support, logistics, and participant behaviours. Overall, this study highlights that despite the challenges of delivering complex community programmes to young people experiencing homelessness, it was possible for frontline service staff to deliver MST4Life™ with high fidelity.

Interrogating intervention delivery and participants' emotional states to improve engagement and implementation: A realist informed multiple case study evaluation of Engager

BACKGROUND

'Engager' is an innovative 'through-the-gate' complex care intervention for male prison-leavers with common mental health problems. In parallel to the randomised-controlled trial of Engager (Trial registration number: ISRCTN11707331), a set of process evaluation analyses were undertaken. This paper reports on the depth multiple case study analysis part of the process evaluation, exploring how a sub-sample of prison-leavers engaged and responded to the intervention offer of one-to-one support during their re-integration into the community.

METHODS

To understand intervention delivery and what response it elicited in individuals, we used a realist-informed qualitative multiple 'case' studies approach. We scrutinised how intervention component delivery lead to outcomes by examining underlying causal pathways or 'mechanisms' that promoted or hindered progress towards personal outcomes. 'Cases' (n = 24) were prison-leavers from the intervention arm of the trial. We collected practitioner activity logs and conducted semi-structured interviews with prison-leavers and Engager/other service practitioners. We mapped data for each case against the intervention logic model and then used Bhaskar's (2016) 'DREIC' analytic process to categorise cases according to extent of intervention delivery, outcomes evidenced, and contributing factors behind engagement or disengagement and progress achieved.

RESULTS

There were variations in the dose and session focus of the intervention delivery, and how different participants responded. Participants sustaining long-term engagement and sustained change reached a state of 'crises but coping'. We found evidence that several components of the intervention were key to achieving this: trusting relationships, therapeutic work delivered well and over time; and an in-depth shared understanding of needs, concerns, and goals between the practitioner and participants. Those who disengaged were in one of the following states: 'Crises and chaos', 'Resigned acceptance', 'Honeymoon' or 'Wilful withdrawal'.

CONCLUSIONS

We demonstrate that the 'implementability' of an intervention can be explained by examining the delivery of core intervention components in relation to the responses elicited in the participants. Core delivery mechanisms often had to be 'triggered' numerous times to produce sustained change. The improvements achieved, sustained, and valued by participants were not always reflected in the quantitative measures recorded in the RCT. The compatibility between the practitioner, participant and setting were continually at risk of being undermined by implementation failure as well as changing external circumstances and participants' own weaknesses.

TRIAL REGISTRATION NUMBER

ISRCTN11707331, Wales Research Ethics Committee, Registered 02-04-2016-Retrospectively registered https://doi.org/10.1186/ISRCTN11707331.

A systematic review of interventions to increase physical activity and reduce sedentary behaviour following bariatric surgery

Background

Objectives

Eligibility

Study appraisal and synthesis methods

Results

Limitations

Conclusion and implications of key findings

Systematic review registration number

PARIS: protocol for a prospective single arm, theory-based, group-based feasibility intervention study to increase Physical Activity and reduce sedentary behaviouR after barIatric Surgery

INTRODUCTION

Increased physical activity and reduced sedentary behaviour can encourage favourable outcomes after bariatric surgery. However, there is a lack of evidence as to how to support patients with behaviour change. The aim of this study is to assess the feasibility of a physiotherapist led, online group-based behaviour change intervention to increase physical activity and reduce sedentary behaviour following bariatric surgery.

METHODS AND ANALYSIS

Single arm feasibility study of a theory and evidence-based group behaviour change intervention based on the Behaviour Change Wheel and Theoretical Domains Framework using behaviour change techniques from the Behaviour Change Technique Taxonomy v1. The intervention has eight objectives and specifies behaviour change techniques that will be used to address each of these. Groups of up to eight participants who have had surgery within the previous 5 years will meet weekly over 6 weeks for up to 1½ hours. Groups will be held online led by a physiotherapist and supported by an intervention handbook. Feasibility study outcomes include: rate of recruitment, retention, intervention fidelity, participant engagement and acceptability. Secondary outcomes include: physical activity, sedentary behaviour, body composition, self-reported health status and will be analysed descriptively. Change in these outcomes will be used to calculate the sample size for a future evaluation study. Qualitative interviews will explore participants' views of the intervention including its acceptability. Data will be analysed according to the constant comparative approach of grounded theory.

ETHICS AND DISSEMINATION

This study has National Health Service Research Ethics Committee approval; Haydock 20/NW/0472. All participants will provide informed consent and can withdraw at any point. Findings will be disseminated through peer-reviewed journals, conference and clinical service presentations.

TRIAL REGISTRATION NUMBER

ISRCTN31524689.

Factors Influencing Fidelity to a Calorie Posting Policy in Public Hospitals: A Mixed Methods Study

Background: Labelling menus with nutrition information has increasingly become an important obesity policy option. While much research to-date has focused on determining its effectiveness, few studies report the extent to which menu labelling is implemented as designed. The aim of this study was to explore factors influencing fidelity to a calorie posting policy in Irish acute public hospitals.

Methods: A mixed methods sequential explanatory study design was employed, with a nested case study for the qualitative component. Quantitative data on implementation fidelity at hospitals were analysed first and informed case sampling in the follow-on qualitative phase. Maximum variation sampling was used to select four hospitals with high and low levels of implementation and variation in terms of geographic location, hospital size, complexity of care provided and hospital type. Data were collected using structured observations, unstructured non-participant observations and in-depth semi-structured interviews. The Consolidated Framework for Implementation Research guided qualitative data collection and analysis. Using framework analysis, factors influencing implementation were identified. A triangulation protocol was used to integrate fidelity findings from multiple sources. Data on influencing factors and fidelity were then combined using joint displays for within and cross-case analysis.

Results: Quantitative fidelity data showed seven hospitals were categorised as low implementers and 28 hospitals were high implementers of the policy. Across the four hospitals selected as cases, qualitative analysis revealed factors influencing implementation and fidelity were multiple, and operated independently and in combination. Factors were related to the internal hospital environment (e.g., leadership support, access to knowledge and information, perceived importance of calorie posting implementation), external hospital environment (e.g., national policy, monitoring), features of the calorie posting policy (e.g., availability of supporting materials), and the implementation process (e.g., engaging relevant stakeholders). Integrated analysis of fidelity indicated a pattern of partial adherence to the calorie posting policy across the four hospitals. Across all hospitals, there was a consistent pattern of low adherence to calorie posting across all menu items on sale, low adherence to calorie information displayed per standard portion or per meal, low adherence to standardised recipes/portions, and inaccurate calorie information.

Conclusion: Efforts to maximise fidelity require multi-level, multi-component strategies in order to reduce or mitigate barriers and to leverage facilitators. Future research should examine the relative importance of calorie posting determinants and the association between implementation strategies and shifts in fidelity to intervention core components.

Fidelity assessment of nurse-led non-pharmacological package of care for knee pain in the package development phase of a feasibility randomised controlled trial based in secondary care: a mixed methods study

OBJECTIVES

To evaluate fidelity of delivery of a nurse-led non-pharmacological complex intervention for knee pain.

SETTING

Secondary care. Single-centre study.

STUDY DESIGN

Mixed methods study.

PARTICIPANTS

Eighteen adults with chronic knee pain.

INCLUSION CRITERIA

Age >40 years, knee pain present for longer than 3 months, knee pain for most days of the previous month, at least moderate pain in two of the five domains of Western Ontario and McMaster Universities Osteoarthritis Index pain scale.

INTERVENTIONS

Nurse-led non-pharmacological intervention comprising assessment, education, exercise, use of hot/cold treatments, footwear modification, walking aids and weight-loss advice (if required).

OUTCOMES

Primary: fidelity of delivery of intervention, secondary: nurses' experience of delivering intervention.

METHODS

Each intervention session with every participant was video recorded and formed part of fidelity assessment. Fidelity checklists were completed by the research nurse after each session and by an independent researcher, after viewing the video-recordings blinded to nurse ratings. Fidelity scores (%), percentage agreement and 95% Confidence Intervals (CI) were calculated. Two semi-structured interviews were conducted with the research nurse.

RESULTS

Fourteen participants completed all visits. 62 treatment sessions took place. Nurse self-report and assessor video rating scores for all 62 treatment sessions were included in fidelity assessment. Overall fidelity was higher on nurse self-report (97.7%) than on objective video-rating (84.2%). Percentage agreement between nurse self-report and video-rating was 73.3% (95% CI 71.3 to 75.3). Fidelity was lowest for advice on footwear and walking aids. The nurse reported difficulty advising on thermal treatments, footwear and walking aids, and did not feel confident negotiating achievable and realistic goals with participants.

CONCLUSIONS

A trained research nurse can deliver most components of a non-pharmacological intervention for knee pain to a high degree of fidelity. Future research should assess intervention fidelity in a routine clinical setting, and examine its clinical and cost-effectiveness.

TRIAL REGISTRATION NUMBER

NCT03670706.

Social groupwork for promoting psychological well-being of adolescents enrolled in sponsorship programs

Background: The dearth of data on adolescents highlighted in the UN's data disaggregation against the agenda 'no one left behind' calls for research on 'the second decade'. Moreover, India is a country with the world's largest adolescent population, and as such, studies and policies for developing competencies of adolescents are crucial to the country's development; interventions instilling confidence to aspire to a better future in underprivileged adolescents are vital to mitigate inequity. Methods: This intervention study adopted a quasi-experimental design to measure the effectiveness of social groupwork in raising the psychological well-being of adolescents in child sponsorship programs in Kerala. Forty adolescents from a Child Sponsorship Program (CSP) center in Kochi were recruited for the study. Those suggested by the CSP center considering their poor academic performance and behavior problems were allocated to the intervention group and the rest to the comparison group.  The intervention was designed in response to the information garnered through a preliminary study and administered to the intervention group (n=20). We conducted pre-test and post-test for both the intervention group and comparison group (n=20). Results: Comparison between pre- and post-measurements carried out using paired sample t-test for the intervention group and comparison group separately gave a p-value of <0.05 for the intervention group and >0.05 for the comparison group. Thus, it was proved that psychological well-being of participants in the intervention group was raised significantly due to the social group work intervention. Conclusions: Applying refined granularity, this research adds data specifically on adolescents enrolled in child sponsorship programs and sets a blueprint for social groupwork to improve their psychological well-being. Proposing a conceptual framework for child sponsorship programs, this study recommends further research in all aspects of its functioning, and interventions at group, family, and community levels, for the well-being and empowerment of marginalized adolescents.

Intervention Therapies to Reduce Pain-Related Fear in Fibromyalgia Syndrome: A Systematic Review of Randomized Clinical Trials

OBJECTIVE

This systematic review aimed to evaluate the effectiveness of different interventions at reducing pain-related fear in people with fibromyalgia and to analyze whether the included trials reported their interventions in full detail.

DESIGN

Systematic review.

SETTING

No restrictions.

METHODS

The Cochrane Library, CINAHL, EMBASE, PsycINFO, PubMed, and Scopus were searched from their inception to April 2020, along with manual searches and a gray literature search. Randomized clinical trials were included if they assessed pain-related fear constructs as the primary or secondary outcome in adults with fibromyalgia. Two reviewers independently performed the study selection, data extraction, risk-of-bias assessment, Template for Intervention Description and Replication (TIDieR) checklist assessment, and grading the quality of evidence.

RESULTS

Twelve randomized clinical trials satisfied the eligibility criteria, including 11 cohorts with a total sample of 1,441 participants. Exercise, multicomponent, and psychological interventions were more effective than controls were in reducing kinesiophobia. However, there were no differences in decreasing kinesiophobia when self-management and electrotherapy were used. There were also no differences between groups with regard to the rest of the interventions and pain-related constructs (fear-avoidance beliefs, fear of pain, and pain-related anxiety). However, a serious risk of bias and a very serious risk of imprecision were detected across the included trials. This caused the overall certainty of the judged evidence to be low and very low. Additionally, the included trials reported insufficient details to allow the full replication of their interventions.

CONCLUSIONS

This systematic review shows that there are promising interventions, such as exercise, multicomponent, and psychological therapies, that may decrease one specific type of fear in people with fibromyalgia, i.e., kinesiophobia. However, because of the low-very low certainty of the evidence found, a call for action is needed to improve the quality of randomized clinical trials, which will lead to more definitive information about the clinical efficacy of interventions in this field.

Fitness facility staff demonstrate high fidelity when implementing an evidence-based diabetes prevention program

Translating evidence-based diabetes prevention programs into the community is needed to make promising interventions accessible to individuals at-risk of type 2 diabetes. To increase the likelihood of successful translation, implementation evaluations should be conducted to understand program outcomes and provide feedback for future scale-up sites. The purpose of this research was to examine the delivery of, and engagement with, an evidence-based diet and exercise diabetes prevention program when delivered by fitness facility staff within a community organization. Ten staff from a community organization were trained to deliver the diabetes prevention program. Between August 2019-March 2020, 26 clients enrolled in the program and were assigned to one of the ten staff. Three fidelity components were accessed. First, staff completed session-specific fidelity checklists (n = 156). Second, two audio-recorded counseling sessions from all clients underwent an independent coder fidelity check (n = 49). Third, staff recorded client goals on session-specific fidelity checklists and all goals were independently assessed for (a) staff goal-setting fidelity, (b) client intervention receipt, and (c) client goal enactment by two coders (n = 285). Average self-reported fidelity was 90% for all six sessions. Independent coder scores for both counseling sessions were 83% and 81%. Overall staff helped clients create goals in line with program content and had a goal achievement of 78%. The program was implemented with high fidelity by staff at a community organization and clients engaged with the program. Findings increase confidence that program effects are due to the intervention itself and provide feedback to refine implementation strategies to support future scale-up efforts.

Fidelity of primary care nurses' delivery of a behavioural change intervention enhancing physical activity in patients at risk of cardiovascular disease: an observational study

OBJECTIVE

To evaluate the fidelity of delivery of a nurse-led intervention to enhance physical activity in patients at risk for cardiovascular diseases, the Activate intervention, by assessing: (1) self-reported fidelity of delivery; (2) observed fidelity of delivery; (3) quality of delivery of the Activate intervention and (4) nurses' beliefs about their capability, motivation, confidence and effectiveness towards delivering the Activate intervention, including behavioural change techniques.

DESIGN

An observational study.

SETTING

General practices in the Netherlands.

PARTICIPANTS

Primary care nurses (n=20) from 16 general practices.

PRIMARY AND SECONDARY OUTCOME MEASURES

Nurses' self-reported fidelity was evaluated using checklists (n=282), and the observed fidelity and quality of delivery were examined using audiorecordings of consultations of the delivery of the Activate intervention (n=42). Nurses' beliefs towards delivering the intervention were assessed using questionnaires (n=72).

RESULTS

The self-reported fidelity was 88.1% and observed fidelity was 85.4%, representing high fidelity. The observed fidelity of applied behavioural change techniques was moderate (75.0%). The observed quality of delivery was sufficient and varied among nurses (mean 2.9; SD 4.4; range 0-4). Nurses' beliefs about their capability, motivation, confidence and effectiveness towards delivering the intervention increased over time.

CONCLUSIONS

Nurses delivered most intervention components as intended with sufficient quality. Nurses believed they were capable, motivated and confident to deliver the intervention. They believed the intervention was effective to increase patients' physical activity level. Despite the high fidelity and moderate fidelity of applied behavioural change techniques, the varying quality of delivery within and across nurses might have diluted the effectiveness of the Activate intervention.

TRIAL REGISTRATION NUMBER

NCT02725203.

Assessing fidelity of a community based psychosocial intervention for people with mild dementia within a large randomised controlled trial

BACKGROUND

Understanding intervention delivery as intended, particularly in complex interventions, should be underpinned by good quality fidelity assessment. We present the findings from a fidelity assessment embedded as part of a trial of a complex community-based psychosocial intervention, Journeying through Dementia (JtD). The intervention was designed to equip individuals with the knowledge and skills to successfully self-manage, maintain independence, and live well with dementia and involves both group and individual sessions. The methodological challenges of developing a conceptual framework for fidelity assessment and creating and applying purposely designed measures derived from this framework are discussed to inform future studies.

METHODS

A conceptual fidelity framework was created out of core components of the intervention (including the intervention manual and training for delivery), associated trial protocols and pre-defined fidelity standards and criteria against which intervention delivery and receipt could be measured. Fidelity data collection tools were designed and piloted for reliability and usability. Data collection in four selected sites (fidelity sites) was via non-participatory observations of the group aspect of the intervention, attendance registers and interventionist (facilitator and supervisor) self-report.

RESULTS

Interventionists from all four fidelity sites attended intervention training. The majority of group participants at the four sites (71%) received the therapeutic dose of 10 out of 16 sessions. Weekly group meeting attendance (including at 'out of venue' sessions) was excellent at 80%. Additionally, all but one individual session was attended by the participants who completed the intervention. It proved feasible to create tools derived from the fidelity framework to assess in-venue group aspects of this complex intervention. Results of fidelity assessment of the observed groups were good with substantial inter-rater reliability between researchers KAPPA 0.68 95% CI (0.58-0.78). Self-report by interventionists concurred with researcher assessments.

CONCLUSIONS

There was good fidelity to training and delivery of the group aspect of the intervention at four sites. However, the methodological challenges of assessing all aspects of this complex intervention could not be overcome due to practicalities, assessment methods and ethical considerations. Questions remain regarding how we can assess fidelity in community-based complex interventions without impacting upon intervention or trial delivery.

TRIAL REGISTRATION

ISRCTN17993825 .

Enhancing the translation of health behaviour change research into practice: a selective conceptual review of the synergy between implementation science and health psychology

Health psychology is at the forefront of developing and disseminating evidence, theories, and methods that have improved the understanding of health behaviour change. However, current dissemination approaches may be insufficient for promoting broader application and impact of this evidence to benefit the health of patients and the public. Nevertheless, behaviour change theory/methods typically directed towards health behaviours are now used in implementation science to understand and support behaviour change in individuals at different health system levels whose own behaviour impacts delivering evidence-based health behaviour change interventions. Despite contributing to implementation science, health psychology is perhaps doing less to draw from it. A redoubled focus on implementation science in health psychology could provide novel prospects for enhancing the impact of health behaviour change evidence. We report a Health Psychology Review-specific review-of-reviews of trials of health behaviour change interventions published from inception to April 2020. We identified 34 reviews and assessed whether implementation readiness of behaviour change interventions was discussed. We then narratively review how implementation science has integrated theory/methods from health psychology and related discipline. Finally, we demonstrate how greater synergy between implementation science and health psychology could promote greater follow-through on advances made in the science of health behaviour change.

How Has Intervention Fidelity Been Assessed in Smoking Cessation Interventions? A Systematic Review

INTRODUCTION

Intervention fidelity concerns the degree to which interventions are implemented as intended. Fidelity frameworks propose fidelity is a multidimensional concept relevant at intervention designer, provider, and recipient levels; yet the extent to which it is assessed multidimensionally is unclear. Smoking cessation interventions are complex, including multiple components, often delivered over multiple sessions and/or at scale in clinical practice; this increases susceptibility variation in the fidelity with which they are delivered. This review examined the extent to which five dimensions from the Behaviour Change Consortium fidelity framework (design, training, delivery, receipt, and enactment) were assessed in fidelity assessments of smoking cessation interventions (randomised control trials (RCTs)).

METHODS

Five electronic databases were searched using terms "smoking cessation," "interventions," "fidelity," and "randomised control trials." Eligible studies included RCTs of smoking cessation behavioural interventions, published post 2006 after publication of the framework, reporting assessment of fidelity. The data extraction form was structured around the framework, which specifies a number of items regarding assessment and reporting of each dimension. Data extraction included study characteristics, dimensions assessed, data collection, and analysis strategies. A score per dimension was calculated, indicating its presence.

RESULTS

55 studies were reviewed. There was a wide variability in data collection approaches used to assess fidelity. Fidelity of delivery was the most commonly assessed and linked to the intervention outcomes (73% of the studies). Fidelity of enactment scored the highest according to the framework (average of 92.7%), and fidelity of training scored the lowest (average of 37.1%). Only a quarter of studies linked fidelity data to outcomes (27%).

CONCLUSION

There is wide variability in methodological and analytical approaches that precludes comparison and synthesis. In order to realise the potential of fidelity investigations to increase scientific confidence in the interpretation of observed trial outcomes, studies should include analyses of the association between fidelity data and outcomes. Findings have highlighted recommendations for improving fidelity evaluations and reporting practices.

Implementation, mechanisms of impact and key contextual factors involved in outcomes of the Modification of Diet, Exercise and Lifestyle (MODEL) randomised controlled trial in Australian adults: protocol for a mixed-method process evaluation

INTRODUCTION

The Modification of Diet, Exercise and Lifestyle (MODEL) study aims to examine the impact of providing visualisation and pictorial representation of advanced structural vascular disease (abdominal aortic calcification), on 'healthful' improvements to diet and lifestyle. This paper reports the protocol for the process evaluation for the MODEL study.

METHODS AND ANALYSIS

The overall aim of the process evaluation is to understand the processes that took place during participation in the MODEL study trial and which elements were effective or ineffective for influencing 'healthful' behavioural change, and possible ways of improvement to inform wider implementation strategies. A mixed-method approach will be employed with the use of structured questionnaires and semistructured in-depth interviews. All 200 participants enrolled in the trial will undertake the quantitative component of the study and maximum variation sampling will be used to select a subsample for the qualitative component. The sample size for the qualitative component will be determined based on analytical saturation. Interviews will be digitally recorded and transcribed verbatim. Qualitative data will be analysed thematically and reported according to the Consolidated Criteria for Reporting Qualitative Research (COREQ) guidelines.

ETHICS AND DISSEMINATION

The MODEL study process evaluation has received approval from Edith Cowan University Human Research Ethics Committee (Project Number: 20513 HODGSON). Written informed consent will be obtained from all participants before they are included in the study. The study results will be shared with the individuals and institutions associated with this study as well as academic audiences through peer-reviewed publication and probable presentation at conferences.

TRIAL REGISTRATION NUMBER

ACTRN12618001087246.

Healthy together: A systematic review of theory and techniques used in health interventions for persons with chronic neurological conditions and their caregivers

OBJECTIVE

To evaluate the level of theory application and use of behaviour change techniques (BCTs) in dyadic health interventions for persons with chronic neurological conditions (CNCs) and their caregivers.

METHODS

A systematic review of five databases was conducted to locate articles published before January 2019. Methodological quality was assessed, study characteristics, theory application and BCTs were narratively summarized.

RESULTS

More than half of the studies identified (59% [16/27]) did not mention theory, and only 22% (6/27) were explicitly theory-based. Across the 27 studies, two to 17 BCTs (mean = 6.8 ± 4.02) were used. Common BCTs were related to intervention implementation (e.g., credible source), knowledge (e.g., instruction on how to perform behaviour) and skill development (e.g., behavioural practice/rehearsal).

CONCLUSIONS

Researchers need to incorporate theory-based dyadic techniques that target both people with CNCs and their caregivers into the design and implementation of future health interventions.

PRACTICE IMPLICATIONS

Health professionals require explicitly theory-based interventions to provide dyads with CNCs techniques that they can apply in their daily life to the benefit of each individual and the partnership.

Intervention Fidelity Within Trials of Infant Feeding Behavioral Interventions to Prevent Childhood Obesity: A Systematic Review

Background

Intervention fidelity refers to whether an intervention has been implemented as intended. Trials of infant feeding behavioral interventions to prevent childhood obesity show inconsistent evidence of effectiveness. However, intervention fidelity has not been previously explored within these trials, limiting interpretation of findings.

Purpose

To review the use and/or reporting of strategies to enhance and assess intervention fidelity within trials of infant feeding interventions to prevent childhood obesity, and their association with study quality, effectiveness, and publication year.

Methods

Seven electronic databases were searched, with articles screened for inclusion by two reviewers. The National Institutes of Health Behaviour Change Consortium fidelity checklist was used to assess use and/or reporting of fidelity strategies across five domains (design, provider training, delivery, receipt, and enactment).

Results

Ten trials (16 papers) were identified. Average use/reporting of fidelity strategies was moderate (54%), ranging from 28.9% to 76.7%. Levels of use/reporting ranged from 15.9% in the domain of provider training to 95% for enactment. No association was found between these levels and study quality, effectiveness, or publication year.

Conclusions

The moderate use/reporting of fidelity strategies within trials of infant feeding interventions suggests that previous findings of inconsistent effectiveness may not fully reflect the intended interventions. The review highlights key considerations for improving future research, both in the area of behavioral infant feeding and wider behavior change literature. This includes improving reporting across all fidelity domains and ensuring an enhanced focus on provider training and control group content to optimize the translation of research into practice.

PROSPERO Registration number

CRD42016033492.

Focusing on fidelity: narrative review and recommendations for improving intervention fidelity within trials of health behaviour change interventions

Background: Interventions to change behaviour have substantial potential to impact positively on individual and overall public health. Despite an increasing focus on health behaviour change intervention research, interventions do not always have the desired effect on outcomes, while others have diluted effects once implemented into real-life settings. There is little investment into understanding how or why such interventions work or do not work. Methodological inadequacies of trials of behavioural interventions have been previously suggested as a barrier to the quality and advancement of behavioural research, with intervention fidelity acknowledged as a key area for improvement. However, there is much ambiguity regarding the terminology and conceptualisation of intervention fidelity and a lack of practical guidance regarding how to address it sufficiently, particularly within trials of complex behavioural interventions. Objectives: This article outlines specific issues concerning intervention fidelity within trials of health behaviour change interventions and suggests practical considerations and specific recommendations for researchers, with examples from the literature presented. Conclusions: Recommendations pertain to (1) clarifying how fidelity is defined and conceptualised, (2) considering fidelity beyond intervention delivery, (3) considering strategies to both enhance and assess fidelity, (4) making use of existing frameworks and guidance, (5) considering the quality and comprehensiveness of fidelity assessment strategies, (6) considering the balance between fidelity and adaptation and (7) reporting the use of fidelity enhancement and assessment strategies and their results. Suggestions for future research to improve our understanding of, and ability to, address fidelity in behaviour change interventions are also provided.

Developing quality fidelity and engagement measures for complex health interventions

OBJECTIVES

To understand whether interventions are effective, we need to know whether the interventions are delivered as planned (with fidelity) and engaged with. To measure fidelity and engagement effectively, high-quality measures are needed. We outline a five-step method which can be used to develop quality measures of fidelity and engagement for complex health interventions. We provide examples from a fidelity study conducted within an evaluation of an intervention aimed to increase independence in dementia.

METHODS

We propose five steps that can be systematically used to develop fidelity checklists for researchers, providers, and participants to measure fidelity and engagement. These steps include the following: (1) reviewing previous measures, (2) analysing intervention components and developing a framework outlining the content of the intervention, (3) developing fidelity checklists and coding guidelines, (4) obtaining feedback about the content and wording of checklists and guidelines, and (5) piloting and refining checklists and coding guidelines to assess and improve reliability.

RESULTS

Three fidelity checklists that can be used reliably were developed to measure fidelity of and engagement with, the Promoting Independence in Dementia (PRIDE) intervention. As these measures were designed to be used by researchers, providers, and participants, we developed two versions of the checklists: one for participants and one for researchers and providers.

CONCLUSIONS

The five steps that we propose can be used to develop psychometrically robust and implementable measures of fidelity and engagement for complex health interventions that can be used by different target audiences. By considering quality when developing measures, we can be more confident in the interpretation of intervention outcomes drawn from fidelity and engagement studies. Statement of contribution What is already known on the subject? Fidelity and engagement can be measured using a range of methods, such as observation and self-report. Studies seldom report psychometric and implementation qualities of fidelity measures. What does this study add? A method for developing fidelity and engagement measures for complex health interventions. Guidance on how to consider quality when developing fidelity and engagement measures.

Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention

Background

Interpreting data about intervention effectiveness requires an understanding of which intervention components were delivered and whether they were delivered as planned (fidelity of delivery). These studies aimed to develop a reliable measure for assessing fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention (COTiD-UK) (Study 1) and measure fidelity of delivery of COTiD-UK across sessions, sites and occupational therapists (Study 2).

Methods

The studies used a longitudinal observational design nested within a multi-site randomised controlled trial. Where practicable, all intervention sessions were audio-recorded. Fidelity checklists and coding guidelines were developed, piloted and refined until good agreement was achieved between two coders. Ten percent of sessions were purposively sampled from 12 sites and 31 occupational therapists. Transcripts were coded using checklists developed in Study 1; 10% of sets of intervention session transcripts were double coded to ensure that agreement was maintained. Percentages of components that were delivered were calculated for each session, site and occupational therapist.

Results

A reliable measure of fidelity of delivery for COTiD-UK was developed after several rounds of piloting and amendments. COTiD-UK was delivered with moderate fidelity across all six sessions (range: 52.4–75.5%). The mean range of fidelity varied across sites (26.7–91.2%) and occupational therapists (26.7–94.1%).

Conclusions

A reliable, systematic method for measuring fidelity of delivery of COTiD-UK was developed and applied, and can be adapted for use in similar interventions. As COTiD-UK was delivered with moderate fidelity, there is a reasonable degree of confidence that intervention effects were attributable to COTiD-UK.

Weight gain prevention content delivered to mothers: Lessons from an intervention embedded in a community organization

BACKGROUND

Transparent reporting of the intervention content study participants receive is particularly important for dissemination and implementation of evidence-based interventions to address obesity. This study explores intervention delivery and perceptions of content when an intervention is embedded within an organization's usual practice and associations with weight outcomes.

METHODS

This is a secondary analysis from the Healthy Eating and Active Living Taught at Home (HEALTH) randomized trial. HEALTH is a weight gain prevention intervention embedded within a national home visiting programme (Parents as Teachers, PAT). To be consistent with PAT practice, HEALTH has a suggested but also flexible home visit structure. Therefore, the number and frequency of home visits are determined by the family's needs and preferences based on the parent educator's professional judgement. The proportion of participants who received each curriculum core lesson was explored among the 105 families randomized to the HEALTH intervention group, as were mean parent educator perception ratings of the visits (5-point Likert-type scale). A chi-square test was used to examine the association between utilization (ie, low: 1-6, middle: 7-12, or high: 13-18 visits) category and weight maintenance.

RESULTS

Mothers received on average 13.3 (standard deviation 6.2) core visits. Mean parent educator perception of the mothers' response (out of 5) ranged from 3.99 to 4.27; educators' perception of their own experience with the lesson ranged from 4.13 to 4.34. Among mothers who maintained their weight, 13% were low, 22% were middle, and 65% were high utilizers, while among mothers who gained weight, 3%, 31%, and 67% were low, middle, and high utilizers, respectively; this difference was not statistically significant.

CONCLUSIONS

This study identified wide variation in the visits families received from the curriculum but minimal variation in visit perceptions. Future studies could explore whether there are optimal patterns for visit content, associated with successful outcomes.

Translating a walking intervention for health professional delivery within primary care: A mixed-methods treatment fidelity assessment

Objectives

Existing fidelity studies of physical activity interventions are limited in methodological quality and rigour, particularly those delivered by health care providers in clinical settings. The present study aimed to enhance and assess the fidelity of a walking intervention delivered by health care providers within general practice in line with the NIH Behavior Change Consortium treatment fidelity framework.

Design

Two practice nurses and six health care assistants delivered a theory‐based walking intervention to 63 patients in their own practices. A cross‐sectional mixed‐methods study assessed fidelity related to treatment delivery and treatment receipt, from the perspectives of health care providers and patients.

Methods

All providers received training and demonstrated delivery competence prior to the trial. Delivery of intervention content was coded from audio‐recordings using a standardized checklist. Qualitative interviews with 12 patients were conducted to assess patient perspectives of treatment receipt and analysed using framework analysis.

Results

Overall, 78% of intervention components were delivered as per the protocol (range 36–91%), with greater fidelity for components requiring active engagement from patients (e.g., completion of worksheets). The qualitative data highlighted differences in patients’ comprehension of specific intervention components. Understanding of, and engagement with, motivational components aimed at improving self‐efficacy was poorer than for volitional planning components.

Conclusions

High levels of fidelity of delivery were demonstrated. However, patient‐, provider‐, and component‐level factors impacted on treatment delivery and receipt. We recommend that methods for the enhancement and assessment of treatment fidelity are consistently implemented to enhance the rigour of physical activity intervention research.

Primary care management of cardiovascular risk for people with severe mental illnesses: the Primrose research programme including cluster RCT

Background

Effective interventions are needed to prevent cardiovascular disease (CVD) in people with severe mental illnesses (SMI) because their risk of CVD is higher than that of the general population.

Objectives

(1) Develop and validate risk models for predicting CVD events in people with SMI and evaluate their cost-effectiveness, (2) develop an intervention to reduce levels of cholesterol and CVD risk in SMI and (3) test the clinical effectiveness and cost-effectiveness of this new intervention in primary care.

Design

Mixed methods with patient and public involvement throughout. The mixed methods were (1) a prospective cohort and risk score validation study and cost-effectiveness modelling, (2) development work (focus groups, updated systematic review of interventions, primary care database studies investigating statin prescribing and effectiveness) and (3) cluster randomised controlled trial (RCT) assessing the clinical effectiveness and cost-effectiveness of a new practitioner-led intervention, and fidelity assessment of audio-recorded appointments.

Setting

General practices across England.

Participants

All studies included adults with SMI (schizophrenia, bipolar disorder or other non-organic psychosis). The RCT included adults with SMI and two or more CVD risk factors.

Interventions

The intervention consisted of 8–12 appointments with a practice nurse/health-care assistant over 6 months, involving collaborative behavioural approaches to CVD risk factors. The intervention was compared with routine practice with a general practitioner (GP).

Main outcome measures

The primary outcome for the risk score work was CVD events, in the cost-effectiveness modelling it was quality-adjusted life-years (QALYs) and in the RCT it was level of total cholesterol.

Data sources

Databases studies used The Health Improvement Network (THIN). Intervention development work included focus groups and systematic reviews. The RCT collected patient self-reported and routine NHS GP data. Intervention appointments were audio-recorded.

Results

Two CVD risk score models were developed and validated in 38,824 people with SMI in THIN: the Primrose lipid model requiring cholesterol levels, and the Primrose body mass index (BMI) model with no blood test. These models performed better than published Cox Framingham models. In health economic modelling, the Primrose BMI model was most cost-effective when used as an algorithm to drive statin prescriptions. Focus groups identified barriers to, and facilitators of, reducing CVD risk in SMI including patient engagement and motivation, staff confidence, involving supportive others, goal-setting and continuity of care. Findings were synthesised with evidence from updated systematic reviews to create the Primrose intervention and training programme. THIN cohort studies in 16,854 people with SMI demonstrated that statins effectively reduced levels of cholesterol, with similar effect sizes to those in general population studies over 12–24 months (mean decrease 1.2 mmol/l). Cluster RCT: 76 GP practices were randomised to the Primrose intervention (n = 38) or treatment as usual (TAU) (n = 38). The primary outcome (level of cholesterol) was analysed for 137 out of 155 participants in Primrose and 152 out of 172 in TAU. There was no difference in levels of cholesterol at 12 months [5.4 mmol/l Primrose vs. 5.5 mmol/l TAU; coefficient 0.03; 95% confidence interval (CI) –0.22 to 0.29], nor in secondary outcomes related to cardiometabolic parameters, well-being or medication adherence. Mean cholesterol levels decreased over 12 months in both arms (–0.22 mmol/l Primrose vs. –0.39 mmol/l TAU). There was a significant reduction in the cost of inpatient mental health attendances (–£799, 95% CI –£1480 to –£117) and total health-care costs (–£895, 95% CI –£1631 to –£160; p = 0.012) in the intervention group, but no significant difference in QALYs (–0.011, 95% CI –0.034 to 0.011). A total of 69% of patients attended two or more Primrose appointments. Audiotapes revealed moderate fidelity to intervention delivery (67.7%). Statin prescribing and adherence was rarely addressed.

Limitations

RCT participants and practices may not represent all UK practices. CVD care in the TAU arm may have been enhanced by trial procedures involving CVD risk screening and feedback.

Conclusions

SMI-specific CVD risk scores better predict new CVD if used to guide statin prescribing in SMI. Statins are effective in reducing levels of cholesterol in people with SMI in UK clinical practice. This primary care RCT evaluated an evidence-based practitioner-led intervention that was well attended by patients and intervention components were delivered. No superiority was shown for the new intervention over TAU for level of cholesterol, but cholesterol levels decreased over 12 months in both arms and the intervention showed fewer inpatient admissions. There was no difference in cholesterol levels between the intervention and TAU arms, which might reflect better than standard general practice care in TAU, heterogeneity in intervention delivery or suboptimal emphasis on statins.

Future work

The new risk score should be updated, deployed and tested in different settings and compared with the latest versions of CVD risk scores in different countries. Future research on CVD risk interventions should emphasise statin prescriptions more. The mechanism behind lower costs with the Primrose intervention needs exploring, including SMI-related training and offering frequent support to people with SMI in primary care.

Trial registration

Current Controlled Trials ISRCTN13762819.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 7, No. 2. See the NIHR Journals Library website for further project information. Professor David Osborn is supported by the University College London Hospital NIHR Biomedical Research Centre and he was also in part supported by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) North Thames at Barts Health NHS Trust.

eHealth-Based Behavioral Intervention for Increasing Physical Activity in Persons With Multiple Sclerosis: Fidelity Protocol for a Randomized Controlled Trial

Background

The rate of physical activity is substantially lower in persons with multiple sclerosis (MS) than in the general population. This problem can be reversed through rigorous and reproducible delivery of behavioral interventions that target lifestyle physical activity in MS. These interventions are, in part, based on a series of phase II randomized controlled trials (RCTs) supporting the efficacy of an internet-delivered behavioral intervention, which is based on social cognitive theory (SCT) for increasing physical activity in MS.

Objective

This paper outlines the strategies and monitoring plan developed based on the National Institutes of Health Behavior Change Consortium (NIH BCC) treatment fidelity workgroup that will be implemented in a phase III RCT.

Methods

The Behavioral Intervention for Physical Activity in Multiple Sclerosis (BIPAMS) study is a phase III RCT that examines the effectiveness of an internet-delivered behavioral intervention based on SCT and is supported by video calls with a behavioral coach for increasing physical activity in MS. BIPAMS includes a 6-month treatment condition and 6-month follow-up. The BIPAMS fidelity protocol includes the five areas outlined by the NIH BCC. The study design draws on the SCT behavior-change strategy, ensures a consistent dose within groups, and plans for implementation setbacks. Provider training in theory and content will be consistent between groups with monitoring plans in place such as expert auditing of calls to ensure potential drift is addressed. Delivery of treatment will be monitored through the study website and training will focus on avoiding cross-contamination between conditions. Receipt of treatment will be monitored via coaching call notes and website monitoring. Lastly, enactment of treatment for behavioral and cognitive skills will be monitored through coaching call notes among other strategies. The specific strategies and monitoring plans will be consistent between conditions within the constraints of utilizing existing evidence-based interventions.

Results

Enrollment began in February 2018 and will end in September 2019. The study results will be reported in late 2020.

Conclusions

Fidelity-reporting guidelines provided by the NIH BCC were published in 2004, but protocols are scarce. This is the first fidelity-monitoring plan involving an electronic health behavioral intervention for increasing physical activity in MS. This paper provides a model for other researchers utilizing the NIH BCC recommendations to optimize the rigor and reproducibility of behavioral interventions in MS.

Trial Registration

ClinicalTrials.gov NCT03490240; https://www.clinicaltrials.gov/ct2/show/NCT03490240.

International Registered Report Identifier (IRRID)

DERR1-10.2196/12319

Nurses' perceptions towards the delivery and feasibility of a behaviour change intervention to enhance physical activity in patients at risk for cardiovascular disease in primary care: a qualitative study

Background

Self-management support is widely accepted for the management of chronic conditions. Self-management often requires behaviour change in patients, in which primary care nurses play a pivotal role. To support patients in changing their behaviour, the structured behaviour change Activate intervention was developed. This intervention aims to enhance physical activity in patients at risk for cardiovascular disease in primary care as well as to enhance nurses’ role in supporting these patients. This study aimed to evaluate nurses’ perceptions towards the delivery and feasibility of the Activate intervention.

Methods

A qualitative study nested within a cluster-randomised controlled trial using semistructured interviews was conducted and thematically analysed. Fourteen nurses who delivered the Activate intervention participated.

Results

Three key themes emerged concerning nurses’ perceptions of delivering the intervention: nurses’ engagement towards delivering the intervention; acquiring knowledge and skills; and dealing with adherence to the consultation structure. Three key themes were identified concerning the feasibility of the intervention: expectations towards the use of the intervention in routine practice; perceptions towards the feasibility of the training programme; and enabling personal development.

Conclusions

Delivering a behaviour change intervention is challenged by the complexity of changing nurses’ consultation style, including acquiring corresponding knowledge and skills. The findings have increased the understanding of the effectiveness of the Activate trial and will guide the development and evaluation of future behaviour change interventions delivered by nurses in primary care.

Trial registration

ClinicalTrials.gov NCT02725203.

Electronic supplementary material

The online version of this article (10.1186/s12875-018-0888-1) contains supplementary material, which is available to authorized users.

Developing Behavior Change Interventions for Self-Management in Chronic Illness: An Integrative Overview

More people than ever are living longer with chronic conditions such as obesity, type 2 diabetes, and heart disease. Behavior change for effective self-management can improve health outcomes and quality of life in people living with such chronic illnesses. The science of developing behavior change interventions with impact for patients aims to optimize the reach, effectiveness, adoption, implementation, and maintenance of interventions and rigorous evaluation of outcomes and processes of behavior change. The development of new services and technologies offers opportunities to enhance the scope of delivery of interventions to support behavior change and self-management at scale. Herein, we review key contemporary approaches to intervention development, provide a critical overview, and integrate these approaches into a pragmatic, user-friendly framework to rigorously guide decision-making in behavior change intervention development. Moreover, we highlight novel emerging methods for rapid and agile intervention development. On-going progress in the science of intervention development is needed to remain in step with such new developments and to continue to leverage behavioral science's capacity to contribute to optimizing interventions, modify behavior, and facilitate self-management in individuals living with chronic illness.

Web-Based Intervention Using Behavioral Activation and Physical Activity for Adults With Depression (The eMotion Study): Pilot Randomized Controlled Trial

Background

Physical activity is a potentially effective treatment for depression and depressive relapse. However, promoting physical activity in people with depression is challenging. Interventions informed by theory and evidence are therefore needed to support people with depression to become more physically active. eMotion is a Web-based intervention combining behavioral activation and physical activity promotion for people in the community with symptoms of depression.

Objective

The objectives were to assess the feasibility and acceptability of delivering eMotion to people in the community with symptoms of depression and to explore outcomes.

Methods

Participants with elevated depressive symptoms were recruited from the community through various methods (eg, social media) and randomized to eMotion or a waiting list control group for 8 weeks. eMotion is an administratively supported weekly modular program that helps people use key behavior change techniques (eg, graded tasks, action planning, and self-monitoring) to re-engage in routine, pleasurable, and necessary activities, with a focus on physical activities. Feasibility data were collected that included the following: recruitment and trial retention rates; fidelity of intervention delivery, receipt, and enactment; and acceptability of the intervention and data collection procedures. Data were collected for the primary (depression) and secondary outcomes (eg, anxiety, physical activity, fidelity, and client satisfaction) at baseline and 2 months postrandomization using self-reported Web-based questionnaires and accelerometers. Delivery fidelity (logins, modules accessed, time spent) was tracked using Web usage statistics. Exploratory analyses were conducted on the primary and secondary outcomes.

Results

Of the 183 people who contacted the research team, 62 were recruited and randomized. The mean baseline score was 14.6 (SD 3.2) on the 8-item Patient Health Questionnaire depression scale (PHQ-8). Of those randomized, 52 participants provided accelerometer-recorded physical activity data at baseline that showed a median of 35.8 (interquartile range [IQR] 0.0-98.6) minutes of moderate-to-vigorous physical activity (MVPA) recorded in at least 10-minute bouts per week, with only 13% (7/52) people achieving guideline levels (150 minutes of MVPA per week). In total, 81% (50/62) of participants provided follow-up data for the primary outcome (PHQ-8), but only 39% (24/62) provided follow-up accelerometer data. Within the intervention group, the median number of logins, modules accessed, and total minutes spent on eMotion was 3 (IQR 2.0-8.0), 3 (IQR 2.0-5.0), and 41.3 (IQR 18.9-90.4), respectively. Acceptability was mixed. Exploratory data analysis showed that PHQ-8 levels were lower for the intervention group than for the control group at 2 months postrandomization (adjusted mean difference −3.6, 95% CI −6.1 to −1.1).

Conclusions

It was feasible to deliver eMotion in UK communities to inactive populations. eMotion has the potential to be effective and is ready for testing in a full-scale trial. Further work is needed to improve engagement with both the intervention and data collection procedures.

Trial Registration

ClinicalTrials.gov NCT03084055; https://clinicaltrials.gov/ct2/show/NCT03084055 (Archived by WebCite at http://www.webcitation.org/6zoyM8UXa)

An assessment of physiotherapist's delivery of behaviour change techniques within the SOLAS feasibility trial

OBJECTIVES

To investigate physiotherapist's (PTs) fidelity to 31 protocol-listed behaviour change techniques (BCTs) during a group-based self-management intervention. This study also explored the PTs delivery of these BCTs beyond the present or absent dichotomy, using a third variable, partial delivery (i.e., attempted).

DESIGN

Assessment of the intervention arm of the Self-management of Osteoarthritis and Low back pain through Activity and Skills (SOLAS) cluster, randomized controlled feasibility trial, using quantitative methods.

METHODS

Eight PTs delivered six SOLAS classes each, of which 50% were audio-recorded and transcribed. Transcripts were coded by two raters using the Behaviour Change Technique Taxonomy v1 and an intervention-specific manual and assessed for the delivery (i.e., full, partial, or absent) of the 31 BCTs and their target behaviours. Fidelity was calculated as fully delivered BCTs listed as a percentage of those due to take place within each class.

RESULTS

Physiotherapists delivered a mean 20.5 BCTs per class (68.3%; range = 64.9-72.4%). Of these, 17 BCTs were fully delivered in each class representing moderate fidelity to the protocol (56.8%; range = 53.5-59.3%). A further 3.5 BCTs per class (11.5%; range = 8.7-14.8%) were partially delivered. BCTs associated with 'goals and planning' were often poorly delivered.

CONCLUSIONS

Delivering the SOLAS intervention BCTs with high fidelity was not feasible. The assessment of partial delivery of BCTs provided greater insight into the techniques that should be removed from the protocol or that may require further training. Complex interventions should consider a list of 'core' or mandatory BCTs alongside 'optional' BCTs, depending on the target behaviour, and the needs of individual participants. Statement of contribution What is already known on this subject? BCTs are the smallest active components of behavioural interventions, yet typically their effectiveness is determined through meta-analyses. Attempted delivery of BCTs is often unaccounted for yet may provide valuable insight into difficulty with delivery. There is a need to investigate BCT implementation beyond simple presence/absence to identify protocol refinements or required BCT training. What does this study add? BCT delivery was assessed in greater depth than previous research, including partial delivery. Highlights the need for appropriate training in BCTs that are difficult to deliver, particularly those associated with 'goals and planning' Highlights the need for intervention-specific criteria as to what constitutes 'high', 'moderate', and 'low' fidelity.

Evaluating the effectiveness of behavior change techniques in health-related behavior: a scoping review of methods used

Behavior change interventions typically contain multiple potentially active components: behavior change techniques (BCTs). Identifying which specific BCTs or BCT combinations have the potential to be effective for a given behavior in a given context presents a major challenge. The aim of this study was to review the methods that have been used to identify effective BCTs for given behaviors in given contexts and evaluate their strengths and limitations. A scoping review was conducted of studies that had sought to identify effective BCTs. Articles referring to "behavio(u)r change technique(s)" in the abstract/text were located, and ones that involved identification of effective BCTs were selected. The methods reported were coded. The methods were analyzed in general terms using "PASS" criteria: Practicability (facility to apply the method appropriately), Applicability (facility to generalize from findings to contexts and populations of interest), Sensitivity (facility to identify effective BCTs), and Specificity (facility to rule out ineffective BCTs). A sample of 10% of the studies reviewed was then evaluated using these criteria to assess how far the strengths and limitations identified in principle were borne out in practice. One hundred and thirty-five studies were identified. The methods used in those studies were experimental manipulation of BCTs, observational studies comparing outcomes in the presence or absence of BCTs, meta-analyses of BCT comparisons, meta-regressions evaluating effect sizes with and without specific BCTs, reviews of BCTs found in effective interventions, and meta-classification and regression trees. The limitations of each method meant that only weak conclusions could be drawn regarding the effectiveness of specific BCTs or BCT combinations. Methods for identifying effective BCTs linked to target behavior and context all have important inherent limitations. A strategy needs to be developed that can systematically combine the strengths of the different methods and that can link these constructs in an ontology of behavior change interventions.

Start2quit: a randomised clinical controlled trial to evaluate the effectiveness and cost-effectiveness of using personal tailored risk information and taster sessions to increase the uptake of the NHS Stop Smoking Services

BACKGROUND

The NHS Stop Smoking Services (SSSs) offer help to smokers who want to quit. However, the proportion of smokers attending the SSSs is low and current figures show a continuing downward trend. This research addressed the problem of how to motivate more smokers to accept help to quit.

OBJECTIVES

To assess the relative effectiveness, and cost-effectiveness, of an intervention consisting of proactive recruitment by a brief computer-tailored personal risk letter and an invitation to a 'Come and Try it' taster session to provide information about the SSSs, compared with a standard generic letter advertising the service, in terms of attendance at the SSSs of at least one session and validated 7-day point prevalent abstinence at the 6-month follow-up.

DESIGN

Randomised controlled trial of a complex intervention with follow-up 6 months after the date of randomisation.

SETTING

SSSs and general practices in England.

PARTICIPANTS

All smokers aged ≥ 16 years identified from medical records in participating practices who were motivated to quit and who had not attended the SSS in the previous 12 months. Participants were randomised in the ratio 3 : 2 (intervention to control) by a computer program.

INTERVENTIONS

Intervention - brief personalised and tailored letter sent from the general practitioner using information obtained from the screening questionnaire and from medical records, and an invitation to attend a taster session, run by the local SSS. Control - standard generic letter from the general practice advertising the local SSS and the therapies available, and asking the smoker to contact the service to make an appointment.

MAIN OUTCOME MEASURES

(1) Proportion of people attending the first session of a 6-week course over a period of 6 months from the receipt of the invitation letter, measured by records of attendance at the SSSs; (2) 7-day point prevalent abstinence at the 6-month follow-up, validated by salivary cotinine analysis; and (3) cost-effectiveness of the intervention.

RESULTS

Eighteen SSSs and 99 practices within the SSS areas participated; 4384 participants were randomised to the intervention (n = 2636) or control (n = 1748). One participant withdrew and 4383 were analysed. The proportion of people attending the first session of a SSS course was significantly higher in the intervention group than in the control group [17.4% vs. 9.0%; unadjusted odds ratio (OR) 2.12, 95% confidence interval (CI) 1.75 to 2.57; p < 0.001]. The validated 7-day point prevalent abstinence at the 6-month follow-up was significantly higher in the intervention group than in the control group (9.0% vs. 5.6%; unadjusted OR 1.68, 95% CI 1.32 to 2.15; p < 0.001), as was the validated 3-month prolonged abstinence and all other periods of abstinence measured by self-report. Using the National Institute for Health and Care Excellence decision-making threshold range of £20,000-30,000 per quality-adjusted life-year gained, the probability that the intervention was more cost-effective than the control was up to 27% at 6 months and > 86% over a lifetime horizon.

LIMITATIONS

Participating SSSs may not be representative of all SSSs in England. Recruitment was low, at 4%.

CONCLUSIONS

The Start2quit trial added to evidence that a proactive approach with an intensive intervention to deliver personalised risk information and offer a no-commitment introductory session can be successful in reaching more smokers and increasing the uptake of the SSS and quit rates. The intervention appears less likely to be cost-effective in the short term, but is highly likely to be cost-effective over a lifetime horizon.

FUTURE WORK

Further research could assess the separate effects of these components.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN76561916.

FUNDING DETAILS

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 3. See the NIHR Journals Library website for further project information.

Addressing Intervention Fidelity Within Physical Therapy Research and Clinical Practice

Intervention fidelity is a key component of the design and conduct of physical therapy research, defined as "the methodological strategies used to enhance and monitor the reliability and validity of behavioral interventions." This includes enhancing and assessing the extent to which an intervention is implemented as intended by its developers, including how they envisage the participants or patients to interact with the intervention. The authors of this Viewpoint focus predominantly on the fidelity of intervention delivery; highlight the importance of intervention fidelity for the physical therapy profession and its relevance for both physical therapy researchers and practitioners; and explore potential barriers to enhancing and assessing the fidelity of intervention delivery in physical therapy research. J Orthop Sports Phys Ther 2017;47(12):895-898. doi:10.2519/jospt.2017.0609.

Measures of fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions: A systematic review of measure quality

PURPOSE

Understanding the effectiveness of complex, face-to-face health behaviour change interventions requires high-quality measures to assess fidelity of delivery and engagement. This systematic review aimed to (1) identify the types of measures used to monitor fidelity of delivery of, and engagement with, complex, face-to-face health behaviour change interventions and (2) describe the reporting of psychometric and implementation qualities.

METHODS

Electronic databases were searched, systematic reviews and reference lists were hand-searched, and 21 experts were contacted to identify articles. Studies that quantitatively measured fidelity of delivery of, and/or engagement with, a complex, face-to-face health behaviour change intervention for adults were included. Data on interventions, measures, and psychometric and implementation qualities were extracted and synthesized using narrative analysis.

RESULTS

Sixty-six studies were included: 24 measured both fidelity of delivery and engagement, 20 measured fidelity of delivery, and 22 measured engagement. Measures of fidelity of delivery included observation (n = 17; 38.6%), self-report (n = 15; 34%), quantitatively rated qualitative interviews (n = 1; 2.3%), or multiple measures (n = 11; 25%). Measures of engagement included self-report (n = 18; 39.1%), intervention records (n = 11; 24%), or multiple measures (n = 17; 37%). Fifty-one studies (77%) reported at least one psychometric or implementation quality; 49 studies (74.2%) reported at least one psychometric quality, and 17 studies (25.8%) reported at least one implementation quality.

CONCLUSION

Fewer than half of the reviewed studies measured both fidelity of delivery of, and engagement with complex, face-to-face health behaviour change interventions. More studies reported psychometric qualities than implementation qualities. Interpretation of intervention outcomes from fidelity of delivery and engagement measurements may be limited due to a lack of reporting of psychometric and implementation qualities. Statement of contribution What is already known on this subject? Evidence of fidelity and engagement is needed to understand effectiveness of complex interventions Evidence of fidelity and engagement are rarely reported High-quality measures are needed to measure fidelity and engagement What does this study add? Evidence that indicators of quality of measures are reported in some studies Evidence that psychometric qualities are reported more frequently than implementation qualities A recommendation for intervention evaluations to report indicators of quality of fidelity and engagement measures.

Development and validation of the ASPIRE-VA coaching fidelity checklist (ACFC): a tool to help ensure delivery of high-quality weight management interventions

Practical and valid instruments are needed to assess fidelity of coaching for weight loss. The purpose of this study was to develop and validate the ASPIRE Coaching Fidelity Checklist (ACFC). Classical test theory guided ACFC development. Principal component analyses were used to determine item groupings. Psychometric properties, internal consistency, and inter-rater reliability were evaluated for each subscale. Criterion validity was tested by predicting weight loss as a function of coaching fidelity. The final 19-item ACFC consists of two domains (session process and session structure) and five subscales (sets goals and monitor progress, assess and personalize self-regulatory content, manages the session, creates a supportive and empathetic climate, and stays on track). Four of five subscales showed high internal consistency (Cronbach alphas > 0.70) for group-based coaching; only two of five subscales had high internal reliability for phone-based coaching. All five sub-scales were positively and significantly associated with weight loss for group- but not for phone-based coaching. The ACFC is a reliable and valid instrument that can be used to assess fidelity and guide skill-building for weight management interventionists.

Assessment of fidelity in individual level behaviour change interventions promoting physical activity among adults: a systematic review

BACKGROUND

Behaviour change interventions that promote physical activity have major implications for health and well-being. Measuring intervention fidelity is crucial in determining the extent to which an intervention is delivered as intended, therefore increasing scientific confidence about effectiveness. However, we lack a clear overview of how well intervention fidelity is typically assessed in physical activity trials.

METHODS

A systematic literature search was conducted to identify peer - reviewed physical activity promotion trials that explicitly measured intervention fidelity. Methods used to assess intervention fidelity were categorised, narratively synthesised and critiqued using assessment criteria from NIH Behaviour Change Consortium (BCC) Treatment Fidelity Framework (design, training, delivery, receipt and enactment).

RESULTS

Twenty eight articles reporting of twenty one studies used a wide variety of approaches to measure intervention fidelity. Delivery was the most common domain of intervention fidelity measured. Approaches used to measure fidelity across all domains varied from researcher coding of observational data (using checklists or scales) to participant self-report measures. There was considerable heterogeneity of methodological approaches to data collection with respect to instruments used, attention to psychometric properties, rater-selection, observational method and sampling strategies.

CONCLUSIONS

In the field of physical activity interventions, fidelity measurement is highly heterogeneous both conceptually and methodologically. Clearer articulation of the core domains of intervention fidelity, along with appropriate measurement approaches for each domain are needed to improve the methodological quality of fidelity assessment in physical activity interventions. Recommendations are provided on how this situation can be improved.

Using mixed methods to assess fidelity of delivery and its influencing factors in a complex self-management intervention for people with osteoarthritis and low back pain

OBJECTIVES AND DESIGN

Despite an increasing awareness of the importance of fidelity of delivery within complex behaviour change interventions, it is often poorly assessed. This mixed methods study aimed to establish the fidelity of delivery of a complex self-management intervention and explore the reasons for these findings using a convergent/triangulation design.

SETTING

Feasibility trial of the Self-management of Osteoarthritis and Low back pain through Activity and Skills (SOLAS) intervention (ISRCTN49875385), delivered in primary care physiotherapy.

METHODS AND OUTCOMES

60 SOLAS sessions were delivered across seven sites by nine physiotherapists. Fidelity of delivery of prespecified intervention components was evaluated using (1) audio-recordings (n=60), direct observations (n=24) and self-report checklists (n=60) and (2) individual interviews with physiotherapists (n=9). Quantitatively, fidelity scores were calculated using percentage means and SD of components delivered. Associations between fidelity scores and physiotherapist variables were analysed using Spearman's correlations. Interviews were analysed using thematic analysis to explore potential reasons for fidelity scores. Integration of quantitative and qualitative data occurred at an interpretation level using triangulation.

RESULTS

Quantitatively, fidelity scores were high for all assessment methods; with self-report (92.7%) consistently higher than direct observations (82.7%) or audio-recordings (81.7%). There was significant variation between physiotherapists' individual scores (69.8% - 100%). Both qualitative and quantitative data (from physiotherapist variables) found that physiotherapists' knowledge (Spearman's association at p=0.003) and previous experience (p=0.008) were factors that influenced their fidelity. The qualitative data also postulated participant-level (eg, individual needs) and programme-level factors (eg, resources) as additional elements that influenced fidelity.

CONCLUSION

The intervention was delivered with high fidelity. This study contributes to the limited evidence regarding fidelity assessment methods within complex behaviour change interventions. The findings suggest a combination of quantitative methods is suitable for the assessment of fidelity of delivery. A mixed methods approach provided a more insightful understanding of fidelity and its influencing factors.

TRIAL REGISTRATION NUMBER

ISRCTN49875385; Pre-results.

Randomised controlled feasibility study of a school-based multi-level intervention to increase physical activity and decrease sedentary behaviour among vocational school students

Background

No school-based physical activity (PA) interventions among older adolescents have demonstrated long-term effectiveness, and few of them so far have addressed sedentary behaviour (SB). Based on behavioural theories and evidence, we designed a multi-level intervention to increase PA and decrease SB among vocational school students. This study investigates feasibility and acceptability of two main intervention components and research procedures. We also examine uptake of behaviour change techniques (BCTs) by the participants.

Methods

Design was an outcome assessor blinded, cluster-randomised controlled trial. Four classes of students (matched pairs) were randomised into one intervention and one control arm. The intervention consisted of (1) a 6-h group-based intervention for students, (2) two 2-h training workshops to reduce their students’ sitting in class for teachers, and (3) provision of light PA equipment in classrooms. At baseline (T1), mid-intervention (T2) at 3 weeks, post-intervention (T3) and 6 months after baseline (T4) we measured hypothesised psychosocial mediators and self-reported PA and sitting. Objective assessment of PA and SB (7-day accelerometry) was conducted at T1, T3 and T4. Body composition (bioimpedance) was measured at T1 and T4. Students and teachers in the intervention arm filled in acceptability questionnaires at T3.

Results

Recruitment rate was 64% (students) and 88.9% (teachers), and at T3, all post-intervention measurements were completed by 33 students (retention 76.7%) and 15 teachers (retention 93.8%). Acceptability ratings of sessions were high (students M = 6.29, scale 1–7), and data collection procedures were feasible. Intervention arm students reported increased use of BCTs, but uptake of some key BCTs was suboptimal. BCT use correlated highly with objective measures of PA. Based on both self-report and student evaluation, teachers in the intervention arm increased the use of sitting reduction strategies at post-intervention and T4 follow-up (p < .05).

Conclusions

We detected willingness of the target groups to participate, good response rates to questionnaires, adequate retention, as well as acceptability of the trial protocol. Investigation of BCT use among students helped further enhance intervention procedures to promote BCT use. After making necessary modifications identified, intervention effectiveness can next be tested in a definitive trial.

Trial registration

ISRCTN34534846. Registered 23 May 2014. Retrospectively registered.

Electronic supplementary material

The online version of this article (doi:10.1186/s12966-017-0484-0) contains supplementary material, which is available to authorized users.

Assessing the fidelity of delivery of an intervention to increase attendance at the English Stop Smoking Services

BACKGROUND

Implementation fidelity refers to the extent to which a proposed intervention is enacted as designed and is necessary to determine how much the intervention in question is the primary mechanism in any changes observed. Start2quit was a randomised controlled trial that aimed to improve attendance at the English Stop Smoking Service (SSS). The complex intervention combining computer-tailored personal risk letters and no-commitment ("taster") sessions aimed at encouraging attendance at the SSS doubled attendance at the SSS and significantly increased abstinence rates, although attendance and abstinence varied between participating SSSs. Assessment of the fidelity of the delivery of the taster sessions to the protocol was embedded into the trial and is the focus of this study.

METHODS

Eighteen SSSs participated in the study. Taster sessions were delivered by SSS advisors in the area. Of the 131 sessions delivered, 93 (71 %) were recorded and 41 (31.3 %) were selected for transcription and analysis. The taster session protocol contained 73 specified behaviours, which were independently classified into component behaviour change techniques (BCTs) using an established taxonomy for smoking cessation. All transcripts were coded by two authors with 25 % additionally coded by a third. The fidelity of each taster session was expressed as the percentage of overall protocol-specified behaviours that were delivered. Adherence to each BCT was measured as the number of behaviours applied by the advisors within each BCT divided by the total number classified within each.

RESULTS

Adherence of protocol-specified behaviours was relatively high (median 71.23 %), though there was considerable variation (28.76 to 95.89 %) in individual sessions. Median fidelity to specific BCTs across sessions also varied from 50 to 100 %. Shorter sessions, sessions run jointly by two advisors, by female advisors, or by advisors aged 45 to 54 were associated with higher levels of adherence. There was no association between adherence and subsequent attendance at the SSS.

CONCLUSIONS

These results suggest that the delivery of the intervention of this study is not likely to have been impacted by issues of fidelity. As such, we can have greater confidence that variability in the main outcome is not due to variability in SSS advisor adherence to the protocol of the taster sessions.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN76561916.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

BACKGROUND

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

METHODS

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

RESULTS

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

CONCLUSIONS

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Adaptations in a Community-Based Family Intervention: Replication of Two Coding Schemes

Although program adaptation is a reality in community-based implementations of evidence-based programs, much of the discussion about adaptation remains theoretical. The primary aim of this study was to replicate two coding systems to examine adaptations in large-scale, community-based disseminations of the Strengthening Families Program for Parents and Youth 10-14, a family-based substance use prevention program. Our second aim was to explore intersections between various dimensions of facilitator-reported adaptations from these two coding systems. Our results indicate that only a few types of adaptations and a few reasons accounted for a majority (over 70 %) of all reported adaptations. We also found that most adaptations were logistical, reactive, and not aligned with program's goals. In many ways, our findings replicate those of the original studies, suggesting the two coding systems are robust even when applied to self-reported data collected from community-based implementations. Our findings on the associations between adaptation dimensions can inform future studies assessing the relationship between adaptations and program outcomes. Studies of local adaptations, like the present one, should help researchers, program developers, and policymakers better understand the issues faced by implementers and guide efforts related to program development, transferability, and sustainability.

Behaviour change techniques: the development and evaluation of a taxonomic method for reporting and describing behaviour change interventions (a suite of five studies involving consensus methods, randomised controlled trials and analysis of qualitative data)

BACKGROUND

Meeting global health challenges requires effective behaviour change interventions (BCIs). This depends on advancing the science of behaviour change which, in turn, depends on accurate intervention reporting. Current reporting often lacks detail, preventing accurate replication and implementation. Recent developments have specified intervention content into behaviour change techniques (BCTs) - the 'active ingredients', for example goal-setting, self-monitoring of behaviour. BCTs are 'the smallest components compatible with retaining the postulated active ingredients, i.e. the proposed mechanisms of change. They can be used alone or in combination with other BCTs' (Michie S, Johnston M. Theories and techniques of behaviour change: developing a cumulative science of behaviour change. Health Psychol Rev 2012;6:1-6). Domain-specific taxonomies of BCTs have been developed, for example healthy eating and physical activity, smoking cessation and alcohol consumption. We need to build on these to develop an internationally shared language for specifying and developing interventions. This technology can be used for synthesising evidence, implementing effective interventions and testing theory. It has enormous potential added value for science and global health.

OBJECTIVE

(1) To develop a method of specifying content of BCIs in terms of component BCTs; (2) to lay a foundation for a comprehensive methodology applicable to different types of complex interventions; (3) to develop resources to support application of the taxonomy; and (4) to achieve multidisciplinary and international acceptance for future development.

DESIGN AND PARTICIPANTS

Four hundred participants (systematic reviewers, researchers, practitioners, policy-makers) from 12 countries engaged in investigating, designing and/or delivering BCIs. Development of the taxonomy involved a Delphi procedure, an iterative process of revisions and consultation with 41 international experts; hierarchical structure of the list was developed using inductive 'bottom-up' and theory-driven 'top-down' open-sort procedures (n = 36); training in use of the taxonomy (1-day workshops and distance group tutorials) (n = 161) was evaluated by changes in intercoder reliability and validity (agreement with expert consensus); evaluating the taxonomy for coding interventions was assessed by reliability (intercoder; test-retest) and validity (n = 40 trained coders); and evaluating the taxonomy for writing descriptions was assessed by reliability (intercoder; test-retest) and by experimentally testing its value (n = 190).

RESULTS

Ninety-three distinct, non-overlapping BCTs with clear labels and definitions formed Behaviour Change Technique Taxonomy version 1 (BCTTv1). BCTs clustered into 16 groupings using a 'bottom-up' open-sort procedure; there was overlap between these and groupings produced by a theory-driven, 'top-down' procedure. Both training methods improved validity (both p < 0.05), doubled the proportion of coders achieving competence and improved confidence in identifying BCTs in workshops (both p < 0.001) but did not improve intercoder reliability. Good intercoder reliability was observed for 80 of the 93 BCTs. Good within-coder agreement was observed after 1 month (p < 0.001). Validity was good for 14 of 15 BCTs in the descriptions. The usefulness of BCTTv1 to report descriptions of observed interventions had mixed results.

CONCLUSIONS

The developed taxonomy (BCTTv1) provides a methodology for identifying content of complex BCIs and a foundation for international cross-disciplinary collaboration for developing more effective interventions to improve health. Further work is needed to examine its usefulness for reporting interventions.

FUNDING

This project was funded by the Medical Research Council Ref: G0901474/1. Funding also came from the Peninsula Collaboration for Leadership in Applied Health Research and Care.

What Are Effective Program Characteristics of Self-Management Interventions in Patients With Heart Failure? An Individual Patient Data Meta-analysis

BACKGROUND

To identify those characteristics of self-management interventions in patients with heart failure (HF) that are effective in influencing health-related quality of life, mortality, and hospitalizations.

METHODS AND RESULTS

Randomized trials on self-management interventions conducted between January 1985 and June 2013 were identified and individual patient data were requested for meta-analysis. Generalized mixed effects models and Cox proportional hazard models including frailty terms were used to assess the relation between characteristics of interventions and health-related outcomes. Twenty randomized trials (5624 patients) were included. Longer intervention duration reduced mortality risk (hazard ratio 0.99, 95% confidence interval [CI] 0.97-0.999 per month increase in duration), risk of HF-related hospitalization (hazard ratio 0.98, 95% CI 0.96-0.99), and HF-related hospitalization at 6 months (risk ratio 0.96, 95% CI 0.92-0.995). Although results were not consistent across outcomes, interventions comprising standardized training of interventionists, peer contact, log keeping, or goal-setting skills appeared less effective than interventions without these characteristics.

CONCLUSION

No specific program characteristics were consistently associated with better effects of self-management interventions, but longer duration seemed to improve the effect of self-management interventions on several outcomes. Future research using factorial trial designs and process evaluations is needed to understand the working mechanism of specific program characteristics of self-management interventions in HF patients.