Enhancing Behavior Change Technique Coding Methods: Identifying Behavioral Targets and Delivery Styles in Smoking Cessation Trials

Estimating the true effectiveness of smoking cessation interventions under variable comparator conditions: A systematic review and meta-regression

BACKGROUND AND AIMS

Behavioural smoking cessation trials have used comparators that vary considerably between trials. Although some previous meta-analyses made attempts to account for variability in comparators, these relied on subsets of trials and incomplete data on comparators. This study aimed to estimate the relative effectiveness of (individual) smoking cessation interventions while accounting for variability in comparators using comprehensive data on experimental and comparator interventions.

METHODS

A systematic review and meta-regression was conducted including 172 randomised controlled trials with at least 6 months follow-up and biochemically verified smoking cessation. Authors were contacted to obtain unpublished information. This information was coded in terms of active content and attributes of the study population and methods. Meta-regression was used to create a model predicting smoking cessation outcomes. This model was used to re-estimate intervention effects, as if all interventions have been evaluated against the same comparators. Outcome measures included log odds of smoking cessation for the meta-regression models and smoking cessation differences and ratios to compare relative effectiveness.

RESULTS

The meta-regression model predicted smoking cessation rates well (pseudo R2  = 0.44). Standardising the comparator had substantial impact on conclusions regarding the (relative) effectiveness of trials and types of intervention. Compared with a 'no support comparator', self-help was 1.33 times (95% CI = 1.16-1.49), brief physician advice 1.61 times (95% CI = 1.31-1.90), nurse individual counselling 1.76 times (95% CI = 1.62-1.90), psychologist individual counselling 2.04 times (95% CI = 1.95-2.15) and group psychologist interventions 2.06 times (95% CI = 1.92-2.20) more effective. Notably, more elaborate experimental interventions (e.g. psychologist counselling) were typically compared with more elaborate comparators, masking their effectiveness.

CONCLUSIONS

Comparator variability and underreporting of comparators obscures the interpretation, comparison and generalisability of behavioural smoking cessation trials. Comparator variability should, therefore, be taken into account when interpreting and synthesising evidence from trials. Otherwise, policymakers, practitioners and researchers may draw incorrect conclusions about the (cost) effectiveness of smoking cessation interventions and their constituent components.

Gwet's AC1 is not a substitute for Cohen's kappa - A comparison of basic properties

Gwet's AC1 has been proposed as an alternative to Cohen's kappa in evaluating the agreement between two binary ratings. This approach is becoming increasingly popular, and researchers have been criticized for still using Cohen's kappa. However, a rigorous discussion of properties of Gwet's AC1 is still missing. In this paper several basic properties of Gwet's AC1 are investigated and compared with those of Cohen's kappa, in particular the dependence on the prevalence of positive ratings for a given agreement rate and the behaviour in case of no association or maximal disagreement. Both approaches compare the observed agreement rate with a comparative number. Cohen's kappa uses an expected agreement rate as comparator, whereas Gwet's AC1 uses an expected disagreement rate. Consequently, for a fixed agreement rate, Gwet's AC1 increases with increasing difference of the prevalence of positive ratings from 0.5. In contrast, Cohen's kappa decreases. Gwet's AC1 can take positive and negative values in the case of no association between the two raters, whereas Cohen's kappa is 0. Due to these fundamental differences, Gwet's AC1 should not be seen as a substitute for Cohen's kappa. In particular, the verbal classification of kappa values by Landis & Koch should not be applied to Gwet's AC1.

Ivers N. Surfacing the causal assumptions and active ingredients of healthcare quality improvement interventions: An application to primary care opioid prescribing

Background

Efforts to maximize the impact of healthcare improvement interventions are hampered when intervention components are not well defined or described, precluding the ability to understand how and why interventions are expected to work.

Method

We partnered with two organizations delivering province-wide quality improvement interventions to establish how they envisaged their interventions lead to change (their underlying causal assumptions) and to identify active ingredients (behavior change techniques [BCTs]). The interventions assessed were an audit and feedback report and an academic detailing program. Both focused on supporting safer opioid prescribing in primary care in Ontario, Canada. Data collection involved semi-structured interviews with intervention developers (n = 8) and a content analysis of intervention documents. Analyses unpacked and articulated how the interventions were intended to achieve change and how this was operationalized.

Results

Developers anticipated that the feedback report would provide physicians with a clear understanding of their own prescribing patterns in comparison to others. In the feedback report, we found an emphasis on BCTs consistent with that assumption (feedback on behavior; social comparison). The detailing was designed to provide tailored support to enable physicians to overcome barriers to change and to gradually enact specific practice changes for patients based on improved communication. In the detailing materials, we found an emphasis on instructions on how to perform the behavior, for a range of behaviors (e.g., tapering opioids, treating opioid use disorder). The materials were supplemented by detailer-enacted BCTs (e.g., social support [practical]; goal setting [behavior]; review behavioral goal[s]).

Conclusions

The interventions included a small range of BCTs addressing various clinical behaviors. This work provides a methodological example of how to apply a behavioral lens to surface the active ingredients, target clinical behaviors, and causal assumptions of existing large-scale improvement interventions that could be applied in other contexts to optimize effectiveness and facilitate scale and spread.

Pragmatic evaluation of methods for retrieving unpublished information on comparator interventions in a systematic review of smoking cessation trials

OBJECTIVE

Reporting of the content and delivery characteristics of comparator interventions in published articles is often incomplete. This study examines the feasibility and validity of two methods for collecting additional information on comparator interventions from trial authors.

METHODS & MEASURES

In a systematic review of smoking cessation trials (IC-Smoke), all trial authors were asked to send unpublished comparator intervention materials and complete a specially-developed comparator intervention checklist. All published and additionally obtained information from authors were coded for behaviour change techniques (BCTs) and other characteristics (type of comparator, provider, provider training, delivery mode and treatment duration). To assess representativeness, we assessed the amount of additional information obtained from trial authors compared with the amount that was published. We examined known-group and convergent validity of comparator intervention data when using only published or also unpublished information.

RESULTS

Additional information were obtained from 91/136 (67%) of trial authors. Representativeness, known-group and convergent validity improved substantially based on the data collected by means of the comparator intervention checklist, but not by requesting authors to send any existing comparator materials.

CONCLUSIONS

Requesting authors for unpublished comparator intervention data, using specially-developed checklists and unpublished materials, substantially improves the quality of data available for systematic reviews.

Behavior Change Interventions for Health Promotion in Physical Therapist Research and Practice: An Integrative Approach

There is an increasing focus on health promotion in physical therapist research and practice. A clinical model (Health-Focused Physical Therapy Model) was developed for identifying major steps in the delivery of health promotion focusing on adoption of healthy lifestyle behaviors. One of the primary steps within this model is the design and delivery of behavior change interventions. Such interventions involve coordinated sets of activities that target change in a specific pattern of unhealthy behavior (eg, physical inactivity, smoking). This Perspective contends that the science and practice of behavior change interventions can be significantly advanced in the field of physical therapy (implementation science) through the integration of behavior change frameworks and techniques within the context of an experimental medicine approach for health behavior change. This perspective presents the integration of the Theoretical Domains Framework, the Behavior Change Wheel, including the Capability Opportunity Motivation-Behavior core system, and the Behavior Change Technique Taxonomy as a comprehensive approach for designing and delivering behavior change interventions in physical therapy. An experimental medicine approach is described, outlining a 4-step process in the design, delivery, and evaluation of behavior change interventions that can be applied to health promotion in physical therapist research and practice. The proposed integrative approach can advance public health and health promotion through healthy lifestyle behavior change in the field of physical therapy.

Identifying active ingredients, working mechanisms and fidelity characteristics reported in smoking cessation interventions in Dutch primary care: a systematic review

Background

Evidence-based smoking cessation interventions provided by healthcare professionals can be successful in helping citizens to quit smoking. Yet, evidence is needed about the active ingredients of these interventions, how these ingredients work and how they are implemented in practice. Such knowledge is required to effectively support healthcare professionals to optimally put evidence-based smoking cessation interventions to (inter)national practice.

Objective

To identify active ingredients (including behavior change techniques), mechanisms of action and implementation fidelity reported in smoking cessation interventions in Dutch primary care settings and to relate these to intervention effectiveness.

Methods

A systematic review was conducted by searching nine national intervention or funding databases, five international scientific databases and consulting 17 national smoking cessation experts. Out of 1066 identified manuscripts, 40 interventions were eligible for this review. Based on published protocols, information regarding behavior change techniques and mechanisms of action was systematically abstracted. Additionally, information regarding study characteristics and other active ingredients, effects on smoking behavior and implementation fidelity was abstracted. Comparative effectiveness concerning abstracted intervention characteristics was qualitatively explored.

Results

Active ingredients, mechanisms of action and implementation fidelity were moderately to poorly reported. Interventions applying behavior change techniques and interventions with a single behavioral target (i.e. smoking-only versus multiple behaviors) seemed to provide stronger evidence for successfully changing smoking behavior.

Conclusion

Attention to and reporting on interventions’ active ingredients (e.g. behavior change techniques), mechanisms of action and implementation fidelity are prerequisites for developing more effective evidence-based smoking cessation interventions to be successfully implemented in primary healthcare.

Implications

This systematic review provides an overview of smoking cessation interventions in Dutch primary care settings, identified since the year 2000. Smoking cessation support is offered in various forms, but our qualitative findings show that interventions including more behavior change techniques and interventions targeting only smoking cessation (compared to multiple behaviors) might be more effective. Results also show that—based on available intervention reports—it is difficult to distinguish patterns of active ingredients (such as behavior change techniques), mechanisms of action and fidelity of implementation in relation to interventions’ effectiveness. This means (quality of) reporting on these intervention characteristics should improve.

Underreporting of the active content of behavioural interventions: a systematic review and meta-analysis of randomised trials of smoking cessation interventions

Despite its importance, underreporting of the active content of experimental and comparator interventions in published literature has not been previously examined for behavioural trials. We assessed completeness and variability in reporting in 142 randomised controlled trials of behavioural interventions for smoking cessation published between 1/1996 and 11/2015. Two coders reliably identified the potential active components of experimental and comparator interventions (activities targeting behaviours key to smoking cessation and qualifying as behaviour change techniques, BCTs) in published, and in unpublished materials obtained from study authors directly. Unpublished materials were obtained for 129/204 (63%) experimental and 93/142 (65%) comparator groups. For those, only 35% (1200/3403) of experimental and 26% (491/1891) of comparator BCTs could be identified in published materials. Reporting quality (#published BCTs/#total BCTs) varied considerably between trials and between groups within trials. Experimental (vs. comparator) interventions were better reported (B(SE) = 0.34 (0.11), p < .001). Unpublished materials were more often obtained for recent studies (B(SE) = 0.093 (0.03), p = .003) published in behavioural (vs. medical) journals (B(SE) = 1.03 (0.41), p = .012). This high variability in underreporting of active content compromises reader's ability to interpret the effects of individual trials, compare and explain intervention effects in evidence syntheses, and estimate the additional benefit of an experimental intervention in other settings.

Behavior Change Techniques in Physical Activity Interventions for Multiple Sclerosis

OBJECTIVE

To identify and summarize the behavior change techniques (BCTs) included in behavior change interventions for promoting physical activity in persons with multiple sclerosis (MS).

DATA SOURCES

PubMed, PsycINFO, Cumulative Index to Nursing and Allied Health Complete, Scopus, and Embase were initially searched in November 2019, and data extraction began in June 2020.

STUDY SELECTION

The inclusion criteria for studies were: adults older than 18 years with diagnosed MS, English language, clinical trial designs (ie, pre-post or randomized controlled trials), group or individual interventions, and home or community-based settings wherein physical activity was defined as a primary or secondary outcome. Exclusion criteria for studies included protocol manuscripts pending results, case studies, studies focused on populations with multiple chronic diseases, and interventions targeting multiple behaviors. Two researchers completed screening for study selection, and a third researcher served as a referee. Of the initially identified 8681 studies, 54 studies met selection criteria.

DATA EXTRACTION

Data extraction was completed by 3 researchers. Each article was coded by 2 of the 3 researchers, and a fourth researcher resolved discrepancies. Data extracted from each paper included study title, authors, country, year, sample size, study design, intervention details, physical activity outcomes, and BCTs.

DATA SYNTHESIS

Thirty-eight unique behavior change interventions were identified, and 53 of the 93 possible BCTs were included across the studies. The mean number of BCTs per study was 15, and studies and effect sizes across studies ranged from 0.04-1.49.

CONCLUSIONS

This review provides a comprehensive overview of BCTs as the active ingredients in behavior change interventions targeting physical activity in MS. Results from this study provide a compendium for future intervention development for increasing physical activity and improving overall health in MS.

Behaviour change techniques associated with smoking cessation in intervention and comparator groups of randomized controlled trials: a systematic review and meta-regression

AIMS

To estimate the strengths of associations between use of behaviour change techniques (BCTs) and clusters of BCTs in behavioural smoking cessation interventions and comparators with smoking cessation rates.

METHOD

Systematic review and meta-regression of biochemically verified smoking cessation rates on BCTs in interventions and comparators in randomized controlled trials, adjusting for a priori-defined potential confounding variables, together with moderation analyses. Studies were drawn from the Cochrane Tobacco Addiction Group Specialised Register. Data were extracted from published and unpublished (i.e. obtained from study authors) study materials by two independent coders. Adequately described intervention (k = 143) and comparator (k = 92) groups were included in the analyses (n = 43 992 participants). Using bivariate mixed-effects meta-regressions, while controlling for key a priori confounders, we regressed smoking cessation on (a) three BCT groupings consistent with dual-process theory (i.e. associative, reflective motivational and self-regulatory), (b) 17 expert-derived BCT groupings (i.e. BCT taxonomy version 1 clusters) and (c) individual BCTs from the BCT taxonomy version 1.

RESULTS

Among person-delivered interventions, higher smoking cessation rates were predicted by BCTs targeting associative and self-regulatory processes (B = 0.034, 0.041, P < 0.05), and by three individual BCTs (prompting commitment, social reward, identity associated with changed behaviour). Among written interventions, BCTs targeting taxonomy cluster 10a (rewards) predicted higher smoking cessation (B = 0.394, P < 0.05). Moderation effects were observed for nicotine dependence, mental health status and mode of delivery.

CONCLUSIONS

Among person-delivered behavioural smoking cessation interventions, specific behaviour change techniques and clusters of techniques are associated with higher success rates.

Variability and effectiveness of comparator group interventions in smoking cessation trials: a systematic review and meta-analysis

AIMS

To examine variability and effectiveness of interventions provided to comparator (control) groups in smoking cessation trials.

METHODS

Systematic review with meta-analysis of randomized controlled trials (RCTs) of behavioral interventions for smoking cessation, with or without stop-smoking medication. We searched the Cochrane Tobacco Addiction Group Specialized Register for RCTs with objective outcomes measured at ≥ 6 months. Study authors were contacted to obtain comprehensive descriptions of their comparator interventions. Meta-regression analyses examined the relationships of smoking cessation rates with stop-smoking medication and behavior change techniques.

RESULTS

One hundred and four of 142 eligible comparator groups (n = 23 706) had complete data and were included in analyses. There was considerable variability in the number of behavior change techniques delivered [mean = 15.97, standard deviation (SD) = 13.54, range = 0-45] and the provision of smoking cessation medication (43% of groups received medication) throughout and within categories of comparator groups (e.g. usual care, brief advice). Higher smoking cessation rates were predicted by provision of medication [B = 0.334, 95% confidence interval (CI) = 0.030-0.638, P = 0.031] and number of behavior change techniques included (B = 0.020, 95% CI = 0.008-0.032, P < 0.001). Modelled cessation rates in comparator groups that received the most intensive support were 15 percentage points higher than those that received the least (23 versus 8%).

CONCLUSIONS

Interventions delivered to comparator groups in smoking cessation randomized controlled trials vary considerably in content, and cessation rates are strongly predicted by stop-smoking medication and number of behavior change techniques delivered.

What Competences Are Required to Deliver Person-Person Behaviour Change Interventions: Development of a Health Behaviour Change Competency Framework

BACKGROUND

The competence of the person delivering person-to-person behaviour change interventions may influence the effectiveness of the intervention. However, we lack a framework for describing the range of competences involved. The objective of the current work was to develop a competency framework for health behaviour change interventions.

METHOD

A preliminary framework was developed by two judges rating the relevance of items in the competency framework for cognitive behaviour therapies; adding relevant items from reviews and other competency frameworks; and obtaining feedback from potential users on a draft framework. The Health Behaviour Change Competency Framework (HBCCF) was used to analyse the competency content of smoking cessation manuals.

RESULTS

Judges identified 194 competency items as relevant, which were organised into two domains: foundation (12 competency topics comprising 56 competencies) and behaviour change (12 topics, 54 competencies); several of the 54 and 56 competencies were composed of sub-competencies (84 subcompetencies in total). Smoking cessation manuals included 14 competency topics from the foundation and behaviour change competency domains.

CONCLUSION

The HBCCF provides a structured method for assessing and reporting competency to deliver behaviour change interventions. It can be applied to assess a practitioner's competency and training needs and to identify the competencies needed for a particular intervention. To date, it has been used in self-assessments and in developing training programmes. We propose the HBCCF as a practical tool for researchers, employers, and those who design and provide training. We envisage the HBCFF maturing and adapting as evidence that identifies the essential elements required for the effective delivery of behaviour change interventions emerges.

A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions

Objectives

Our aim was to conduct a systematic review to determine which technology-driven diabetes prevention interventions were effective in producing clinically significant weight loss, and to identify the behaviour change techniques and digital features frequently used in effective interventions.

Methods

We searched five databases (CINAHL, EMBASE, MEDLINE, PsychINFO, and Pubmed) from inception to September 2018 and reviewed 19 experimental and non-experimental studies of 21 technology-driven diet plus physical activity interventions for adults (≥18 years) at risk of developing type 2 diabetes. Behaviour change techniques were coded using the BCT taxonomy v1, and digital features were identified via thematic analysis of intervention descriptions.

Results

Sixty-three per cent of interventions were effective in the short term (achieving ≥3% weight loss at ≤6 months), using an average of 5.6 more behaviour change techniques than non-effective interventions, and 33% were effective in the long term (achieving ≥5% weight loss at ≥12 months), using 3.7 more behaviour change techniques than non-effective interventions. The techniques of social support (unspecified), goal setting (outcome/behaviour), feedback on behaviour, and self-monitoring of outcome(s) of behaviour were identified in over 90% of effective interventions. Interventions containing digital features that facilitated health and lifestyle education, behaviour/outcome tracking, and/or online health coaching were most effective.

Conclusion

The integration of specific behaviour change techniques and digital features may optimise digital diabetes prevention interventions to achieve clinically significant weight loss. Additional research is needed to identify the mechanisms in which behaviour change techniques and digital features directly influence physical activity, dietary behaviours, and intervention engagement.

The effectiveness of health professional-delivered interventions during the first 1000 days to prevent overweight/obesity in children: A systematic review

Childhood obesity is a global public health challenge. Early prevention, particularly during the first 1000 days, is advocated. Health professionals have a role to play in obesity prevention efforts, in part due to the multiple routine contacts they have with parents. We synthesized the evidence for the effectiveness of obesity prevention interventions delivered by health professionals during this time period, as reviews to date have not examined effectiveness by intervention provider. We also explored what behaviour change theories and/or techniques were associated with more effective intervention outcomes. Eleven electronic databases and three trial registers were searched from inception to 04 April 2019. A total of 180 studies, describing 39 trials involving 46 intervention arms, were included. While the number of interventions has grown considerably, we found some evidence for the effectiveness of health professional-delivered interventions during the first 1000 days. Only four interventions were effective on a primary (adiposity/weight) and secondary (behavioural) outcome measure. Twenty-two were effective on a behavioural outcome only. Several methodological limitations were noted, impacting on efforts to establish the active ingredients of interventions. Future work should focus on the conduct and reporting of interventions.