Development of an Intervention Setting Ontology for behaviour change: Specifying where interventions take place

Improving retrospective intervention descriptions: Lessons learned from research on type 2 diabetes programmes in the United Kingdom and the Republic of Ireland

In recent years, multiple countries worldwide have implemented behavioural interventions within national healthcare systems. Describing the content of these interventions is critical to improve their implementation, replication, and effectiveness, as well as to advance behavioural science. Tools, such as the Behaviour Change Technique Taxonomy, can enhance the quality of intervention description and reporting. As interventions are frequently developed without the use of such tools, retrospective coding of existing interventions to accurately characterise their content is becoming more common. However, the use of these tools for retrospective coding poses various challenges, the discussion of which has been neglected to date. This commentary discusses the challenges encountered when retrospectively describing the content of five nationally implemented programmes for type 2 diabetes in the United Kingdom and the Republic of Ireland and suggests recommendations to tackle these challenges. We present important methodological, practical, and ethical considerations for researchers to reflect on, relevant to the retrospective description of existing interventions. Specifically, we discuss (i) the importance of positive relationships and collaboration with intervention stakeholders, (ii) the practical and ethical considerations when analysing the content of implemented interventions, (iii) the independence of research teams and the potential for misclassification of intervention content, and (iv) the challenges associated with the analysis of intervention content using behavioural science tools. There is a growing demand for more robust approaches to address the methodological, practical, and ethical challenges associated with such studies. The present commentary describes key issues to be considered by research teams, as well as concrete recommendations to improve the retrospective characterisation of intervention content.

An ontology of mechanisms of action in behaviour change interventions

Background

Behaviour change interventions influence behaviour through causal processes called "mechanisms of action" (MoAs). Reports of such interventions and their evaluations often use inconsistent or ambiguous terminology, creating problems for searching, evidence synthesis and theory development. This inconsistency includes the reporting of MoAs. An ontology can help address these challenges by serving as a classification system that labels and defines MoAs and their relationships. The aim of this study was to develop an ontology of MoAs of behaviour change interventions.

Methods

To develop the MoA Ontology, we (1) defined the ontology's scope; (2) identified, labelled and defined the ontology's entities; (3) refined the ontology by annotating (i.e., coding) MoAs in intervention reports; (4) refined the ontology via stakeholder review of the ontology's comprehensiveness and clarity; (5) tested whether researchers could reliably apply the ontology to annotate MoAs in intervention evaluation reports; (6) refined the relationships between entities; (7) reviewed the alignment of the MoA Ontology with other relevant ontologies, (8) reviewed the ontology's alignment with the Theories and Techniques Tool; and (9) published a machine-readable version of the ontology.

Results

An MoA was defined as "a process that is causally active in the relationship between a behaviour change intervention scenario and its outcome behaviour". We created an initial MoA Ontology with 261 entities through Steps 2-5. Inter-rater reliability for annotating study reports using these entities was α=0.68 ("acceptable") for researchers familiar with the ontology and α=0.47 for researchers unfamiliar with it. As a result of additional revisions (Steps 6-8), 23 further entities were added to the ontology resulting in 284 entities organised in seven hierarchical levels.

Conclusions

The MoA Ontology extensively captures MoAs of behaviour change interventions. The ontology can serve as a controlled vocabulary for MoAs to consistently describe and synthesise evidence about MoAs across diverse sources.

The Behaviour Change Technique Ontology: Transforming the Behaviour Change Technique Taxonomy v1

Background

The Behaviour Change Technique Taxonomy v1 (BCTTv1) specifies the potentially active content of behaviour change interventions. Evaluation of BCTTv1 showed the need to extend it into a formal ontology, improve its labels and definitions, add BCTs and subdivide existing BCTs. We aimed to develop a Behaviour Change Technique Ontology (BCTO) that would meet these needs.

Methods

The BCTO was developed by: (1) collating and synthesising feedback from multiple sources; (2) extracting information from published studies and classification systems; (3) multiple iterations of reviewing and refining entities, and their labels, definitions and relationships; (4) refining the ontology via expert stakeholder review of its comprehensiveness and clarity; (5) testing whether researchers could reliably apply the ontology to identify BCTs in intervention reports; and (6) making it available online and creating a computer-readable version.

Results

Initially there were 282 proposed changes to BCTTv1. Following first-round review, 19 BCTs were split into two or more BCTs, 27 new BCTs were added and 26 BCTs were moved into a different group, giving 161 BCTs hierarchically organised into 12 logically defined higher-level groups in up to five hierarchical levels. Following expert stakeholder review, the refined ontology had 247 BCTs hierarchically organised into 20 higher-level groups. Independent annotations of intervention evaluation reports by researchers familiar and unfamiliar with the ontology resulted in good levels of inter-rater reliability (0.82 and 0.79, respectively). Following revision informed by this exercise, 34 BCTs were added, resulting in the first published version of the BCTO containing 281 BCTs organised into 20 higher-level groups over five hierarchical levels.

Discussion

The BCTO provides a standard terminology and comprehensive classification system for the content of behaviour change interventions that can be reliably used to describe interventions. The development and maintenance of an ontology is an iterative and ongoing process; no ontology is ever 'finished'. The BCTO will continue to evolve and grow (e.g. new BCTs or improved definitions) as a result of user feedback and new available evidence.

Describing the content of trial recruitment interventions using the TIDieR reporting checklist: a systematic methodology review

BACKGROUND

Recruiting participants to clinical trials is an ongoing challenge, and relatively little is known about what recruitment strategies lead to better recruitment. Recruitment interventions can be considered complex interventions, often involving multiple components, targeting a variety of groups, and tailoring to different groups. We used the Template for Intervention Description and Replication (TIDieR) reporting checklist (which comprises 12 items recommended for reporting complex interventions) to guide the assessment of how recruitment interventions are described. We aimed to (1) examine to what extent we could identify information about each TIDieR item within recruitment intervention studies, and (2) observe additional detail for each item to describe useful variation among these studies.

METHODS

We identified randomized, nested recruitment intervention studies providing recruitment or willingness to participate rates from two sources: a Cochrane review of trials evaluating strategies to improve recruitment to randomized trials, and the Online Resource for Research in Clinical triAls database. First, we assessed to what extent authors reported information about each TIDieR item. Second, we developed descriptive categorical variables for 7 TIDieR items and extracting relevant quotes for the other 5 items.

RESULTS

We assessed 122 recruitment intervention studies. We were able to extract information relevant to most TIDieR items (e.g., brief rationale, materials, procedure) with the exception of a few items that were only rarely reported (e.g., tailoring, modifications, planned/actual fidelity). The descriptive variables provided a useful overview of study characteristics, with most studies using various forms of informational interventions (55%) delivered at a single time point (90%), often by a member of the research team (59%) in a clinical care setting (41%).

CONCLUSIONS

Our TIDieR-based variables provide a useful description of the core elements of complex trial recruitment interventions. Recruitment intervention studies report core elements of complex interventions variably; some process elements (e.g., mode of delivery, location) are almost always described, while others (e.g., duration, fidelity) are reported infrequently, with little indication of a reason for their absence. Future research should explore whether these TIDieR-based variables can form the basis of an approach to better reporting of elements of successful recruitment interventions.

Interventions Promoting Condom Use Among Youth: A Systematic Review

In many European and other high-income, Western countries, condom use has been decreasing among youth. A variety of promotional strategies to increase condom use exists. Our systematic review aimed to identify effective elements in interventions aimed at increasing condom use in youth. We searched databases (2010-2021) for intervention studies promoting condom use among youth in Western, high-income countries. The primary outcome was condom use; the secondary outcome was sexually transmitted infection (STI) diagnoses. Effectiveness per intervention was defined based on the percentage of comparisons that showed significant increases in condom use and significant decreases in STIs. We compared the effectiveness of interventions for different participant-, intervention- and methodological characteristics. We included 74 papers describing 85 interventions in the review. Overall, the median intervention effectiveness was 33.3% (interquartile range = 0%-66.7%) for condom use and 0% (interquartile range = 0%-100%) for STI diagnoses. Intervention effectiveness for condom use was significantly higher in interventions tailored towards females and males specifically, compared with interventions applied to both sexes combined. Our findings show the difficulty in designing effective interventions to increase condom use among youth. Interventions aimed at either females or males were more effective in increasing condom use.

A data extraction template for the behaviour change intervention ontology

Background

The Behaviour Change Intervention Ontology (BCIO) aims to improve the clarity, completeness and consistency of reporting within intervention descriptions and evidence synthesis. However, a recommended method for transparently annotating intervention evaluation reports using the BCIO does not currently exist. This study aimed to develop a data extraction template for annotating using the BCIO.

Methods

The BCIO data extraction template was developed in four stages: i) scoping review of papers citing component ontologies within the BCIO, ii) development of a draft template, iii) piloting and revising the template, and iv) dissemination and maintenance of the template.

Results

A prototype data extraction template using Microsoft Excel was developed based on BCIO annotations from 14 papers. The 'BCIO data extraction template v1' was produced following piloting and revision, incorporating a facility for user feedback.

Discussion

This data extraction template provides a single, accessible resource to extract all necessary characteristics of behaviour change intervention scenarios. It can be used to annotate the presence of BCIO entities for evidence synthesis, including systematic reviews. In the future, we will update this template based on feedback from the community, additions of newly published ontologies within the BCIO, and revisions to existing ontologies.

Specifying how intervention content is communicated: Development of a Style of Delivery Ontology

Background: Investigating and enhancing the effectiveness of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. We need to understand not only their content, that is the specific techniques, but also the source, mode, schedule, and style in which this content is delivered. Delivery style refers to the manner by which content is communicated to intervention participants. This paper reports the development of an ontology for specifying the style of delivery of interventions that depend on communication. This forms part of the Behaviour Change Intervention Ontology, which aims to cover all aspects of behaviour change intervention scenarios. Methods: The Style of Delivery Ontology was developed following methods for ontology development used in the Human Behaviour-Change Project, with seven key steps: 1) defining the scope of the ontology, 2) identifying key entities and developing their preliminary definitions by reviewing 100 behaviour change intervention evaluation reports and existing classification systems, 3) refining the ontology by piloting the ontology through annotations of 100 reports, 4) stakeholder review by eight behavioural science and public health experts, 5) inter-rater reliability testing through annotating 100 reports using the ontology, 6) specifying ontological relationships between entities, and 7) disseminating and maintaining the ontology. Results: The resulting ontology is a five-level hierarchical structure comprising 145 unique entities relevant to style of delivery. Key areas include communication processes, communication styles, and attributes of objects used in communication processes. Inter-rater reliability for annotating intervention evaluation reports was α=0.77 (good) for those familiar with the ontology and α=0.62 (acceptable) for those unfamiliar with it. Conclusions: The Style of Delivery Ontology can be used for both annotating and describing behaviour change interventions in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions.

Rethinking how and when to report descriptions of behavior change content within interventions: a case study of an ongoing physical activity trial (ready steady 3.0)

Specifications of what and how much health behavior change (BC) content within research interventions are needed to advance BC science, its implementation, and dissemination. We analyzed the types and dosages of the smallest potentially active BC ingredients and associated behavioral prescriptions intended to be delivered in an ongoing physical activity optimization trial for older adults (Ready Steady 3.0 [RS3]). We defined BC types as behavior change techniques (BCT) and behavioral prescriptions. Our protocol integrated the BCT Taxonomy coding procedures with BCT roles (primary or secondary) and, when relevant, linkages to behavioral prescriptions. Primary BCTs targeted theoretical mechanisms of action, whereas secondary BCTs supported primary BCT delivery. Behavioral prescriptions represented what participants were encouraged to do with each primary BCT in RS3 (ascertain, practice, implement). We assessed dosage parameters of duration, frequency, and amount in each BCT and prescription. Results provided a catalog of in-depth, multidimensional content specifications with 12 primary BCTs, each supported by 2-7 secondary BCTs, with dosages ranging from 2 to 8 weeks, 1 to 8 contacts, and 5 to 451 minutes. Minutes spent on behavioral prescriptions varied: ascertain (1 to 41), practice (5 to 315), and implement (0 to 38). Results can be organized and summarized in varied ways (e.g., by content component) to strengthen future assessments of RS3 fidelity and intervention refinement. Results highlight potential benefits of this early, integrated approach to analyzing BC content and frames questions about how such information might be incorporated and disseminated with reporting research outcomes.

Theoretical components of smoking cessation interventions for persons with physical disabilities: A scoping review

Rationale Persons with physical disabilities report higher cigarette smoking rates and a lower likelihood of accessing health services (e.g., smoking cessation services). Explicit and systematic application of behaviour change theory may be a promising approach to addressing these inequities and developing impactful smoking cessation interventions for persons with physical disabilities.

OBJECTIVE

This scoping review aimed to explore how behaviour change theory and intervention components have been used to design smoking cessation interventions for persons with physical disabilities.

METHODS

Electronic databases (Medline, Embase, PsycINFO, CINAHL, Web of Science) were systematically searched. Smoking cessation interventions for persons with physical disabilities were identified. Behaviour change theory and intervention components, including behaviour change techniques, intervention functions, mode of delivery, intervention source, and setting, were extracted from the included articles.

RESULTS

Among the eleven included articles, there were nine unique smoking cessation interventions for persons with physical disabilities. Three interventions mentioned theory, but none of these articles explicitly applied or tested the theory. Intervention components were consistently combined to deliver pharmacotherapy and behavioural counselling-based interventions.

CONCLUSION

The results of this review highlight the scarcity of theory-based smoking cessation interventions for persons with physical disabilities. While the interventions were not theory-based, they were evidence-based and aligned with recommendations for smoking cessation treatment (i.e., behavioural counselling plus pharmacotherapy). Future research should take a theory-based approach to intervention development to enhance the likelihood that smoking cessation interventions for persons with physical disabilities are effective, replicable, and equitable.

The co-development of a linguistic and culturally tailored tele-retinopathy screening intervention for immigrants living with diabetes from China and African-Caribbean countries in Ottawa, Canada

BACKGROUND

Diabetic retinopathy is a sight-threatening ocular complication of diabetes. Screening is an effective way to reduce severe complications, but screening attendance rates are often low, particularly for newcomers and immigrants to Canada and people from cultural and linguistic minority groups. Building on previous work, in partnership with patient and health system stakeholders, we co-developed a linguistically and culturally tailored tele-retinopathy screening intervention for people living with diabetes who recently immigrated to Canada from either China or African-Caribbean countries.

METHODS

Following an environmental scan of diabetes eye care pathways in Ottawa, we conducted co-development workshops using a nominal group technique to create and prioritize personas of individuals requiring screening and identify barriers to screening that each persona may face. Next, we used the Theoretical Domains Framework to categorize the barriers/enablers and then mapped these categories to potential evidence-informed behaviour change techniques. Finally with these techniques in mind, participants prioritized strategies and channels of delivery, developed intervention content, and clarified actions required by different actors to overcome anticipated intervention delivery barriers.

RESULTS

We carried out iterative co-development workshops with Mandarin and French-speaking individuals living with diabetes (i.e., patients in the community) who immigrated to Canada from China and African-Caribbean countries (n = 13), patient partners (n = 7), and health system partners (n = 6) recruited from community health centres in Ottawa. Patients in the community co-development workshops were conducted in Mandarin or French. Together, we prioritized five barriers to attending diabetic retinopathy screening: language (TDF Domains: skills, social influences), retinopathy familiarity (knowledge, beliefs about consequences), physician barriers regarding communication for screening (social influences), lack of publicity about screening (knowledge, environmental context and resources), and fitting screening around other activities (environmental context and resources). The resulting intervention included the following behaviour change techniques to address prioritized local barriers: information about health consequence, providing instructions on how to attend screening, prompts/cues, adding objects to the environment, social support, and restructuring the social environment. Operationalized delivery channels incorporated language support, pre-booking screening and sending reminders, social support via social media and community champions, and providing using flyers and videos as delivery channels.

CONCLUSION

Working with intervention users and stakeholders, we co-developed a culturally and linguistically relevant tele-retinopathy intervention to address barriers to attending diabetic retinopathy screening and increase uptake among two under-served groups.

Content and quality of physical activity ontologies: a systematic review

INTRODUCTION

Ontologies are a formal way to represent knowledge in a particular field and have the potential to transform the field of health promotion and digital interventions. However, few researchers in physical activity (PA) are familiar with ontologies, and the field can be difficult to navigate. This systematic review aims to (1) identify ontologies in the field of PA, (2) assess their content and (3) assess their quality.

METHODS

Databases were searched for ontologies on PA. Ontologies were included if they described PA or sedentary behavior, and were available in English language. We coded whether ontologies covered the user profile, activity, or context domain. For the assessment of quality, we used 12 criteria informed by the Open Biological and Biomedical Ontology (OBO) Foundry principles of good ontology practice.

RESULTS

Twenty-eight ontologies met the inclusion criteria. All ontologies covered PA, and 19 included information on the user profile. Context was covered by 17 ontologies (physical context, n = 12; temporal context, n = 14; social context: n = 5). Ontologies met an average of 4.3 out of 12 quality criteria. No ontology met all quality criteria.

DISCUSSION

This review did not identify a single comprehensive ontology of PA that allowed reuse. Nonetheless, several ontologies may serve as a good starting point for the promotion of PA. We provide several recommendations about the identification, evaluation, and adaptation of ontologies for their further development and use.

Understanding tailoring to support the implementation of evidence-based interventions in healthcare: The CUSTOMISE research programme protocol

Although there are effective evidence-based interventions (EBIs) to prevent, treat and coordinate care for chronic conditions they may not be adopted widely and when adopted, implementation challenges can limit their impact.  Implementation strategies are "methods or techniques used to enhance the adoption, implementation, and sustainment of a clinical program or practice". There is some evidence to suggest that to be more effective,  strategies should be tailored; that is, selected and designed to address specific determinants which may influence implementation in a given context. Despite the growing popularity of tailoring the concept is ill-defined, and the way in which tailoring is applied can vary across studies or lack detail when reported. There has been less focus on the part of tailoring where stakeholders prioritise determinants and select strategies, and the way in which theory, evidence and stakeholders' perspectives should be combined to make decisions during the process. Typically, tailoring is evaluated based on the effectiveness of the tailored strategy, we do not have a clear sense of the mechanisms through which tailoring works, or how to measure the "success" of the tailoring process. We lack an understanding of how stakeholders can be involved effectively in tailoring and the influence of different approaches on the outcome of tailoring. Our research programme, CUSTOMISE (Comparing and Understanding Tailoring Methods for Implementation Strategies in healthcare) will address some of these outstanding questions and generate evidence on  the feasibility, acceptability, and efficiency of different tailoring approaches, and build capacity in implementation science in Ireland, developing and delivering training and supports for, and network of, researchers and implementation practitioners. The evidence generated across the studies conducted as part of CUSTOMISE will bring greater clarity, consistency, coherence, and transparency to tailoring, a key process in implementation science.

Behaviour change techniques taxonomy v1: Feedback to inform the development of an ontology

Background: To build cumulative evidence about what works in behaviour change interventions, efforts have been made to develop classification systems for specifying the content of interventions. The Behaviour Change Techniques (BCT) Taxonomy v1 (BCTTv1) is one of the most widely used classifications of behaviour change techniques across a variety of behaviours. The BCTTv1 was intentionally named version 1 to allow for further revisions to the taxonomy. This study aimed to gather data to improve the BCTTv1 and provide recommendations for developing it into a more elaborated knowledge structure, an ontology.  Methods: Feedback from users of BCTTv1 about limitations and proposed improvements was collected through the BCT website, user survey, researchers and experts involved in the Human Behaviour-Change Project, and a consultation. In addition, relevant published research reports and other classification systems of BCTs were analysed. These data were synthesised to produce recommendations to inform the development of an ontology of BCTs. Results: A total of 282 comments from six sources were reviewed and synthesised into four categories of suggestions: additional BCTs, amendments to labels and definitions of specific BCTs, amendments to the groupings, and general improvements. Feedback suggested some lack of clarity regarding understanding and identifying techniques from labels, definitions, and examples; distinctions and relations between BCTs; and knowing what they would look like in practice. Three recommendations to improve the BCTTv1 resulted from this analysis: to review the label and definition of each BCT, the 16 groupings of BCTs, and the examples illustrating BCTs. Conclusions : This review of feedback about BCTTv1 identified the need to improve the precision and knowledge structure of the current taxonomy. A BCT ontology would enable the specification of relationships between BCTs, more precise definitions, and allow better interoperability with other ontologies. This ontology will be developed as part of the Human Behaviour-Change Project.

Behaviour change techniques taxonomy v1: Feedback to inform the development of an ontology

Background: To build cumulative evidence about what works in behaviour change interventions, efforts have been made to develop classification systems for specifying the content of interventions. The Behaviour Change Techniques (BCT) Taxonomy v1 (BCTTv1) is one of the most widely used classifications of behaviour change techniques across a variety of behaviours. The BCTTv1 was intentionally named version 1 to allow for further revisions to the taxonomy. This study aimed to gather data to improve the BCTTv1 and provide recommendations for developing it into a more elaborated knowledge structure, an ontology.  Methods: Feedback from users of BCTTv1 about limitations and proposed improvements was collected through the BCT website, user survey, researchers and experts involved in the Human Behaviour-Change Project, and a consultation. In addition, relevant published research reports and other classification systems of BCTs were analysed. These data were synthesised to produce recommendations to inform the development of an ontology of BCTs. Results: A total of 282 comments from six sources were reviewed and synthesised into four categories of suggestions: additional BCTs, amendments to labels and definitions of specific BCTs, amendments to the groupings, and general improvements. Feedback suggested some lack of clarity regarding understanding and identifying techniques from labels, definitions, and examples; distinctions and relations between BCTs; and knowing what they would look like in practice. Three recommendations to improve the BCTTv1 resulted from this analysis: to review the label and definition of each BCT, the 16 groupings of BCTs, and the examples illustrating BCTs. Conclusions : This review of feedback about BCTTv1 identified the need to improve the precision and knowledge structure of the current taxonomy. A BCT ontology would enable the specification of relationships between BCTs, more precise definitions, and allow better interoperability with other ontologies. This ontology will be developed as part of the Human Behaviour-Change Project.

Developing a medication adherence technologies repository: proposed structure and protocol for an online real-time Delphi study

INTRODUCTION

An online interactive repository of available medication adherence technologies may facilitate their selection and adoption by different stakeholders. Developing a repository is among the main objectives of the European Network to Advance Best practices and technoLogy on medication adherencE (ENABLE) COST Action (CA19132). However, meeting the needs of diverse stakeholders requires careful consideration of the repository structure.

METHODS AND ANALYSIS

A real-time online Delphi study by stakeholders from 39 countries with research, practice, policy, patient representation and technology development backgrounds will be conducted. Eleven ENABLE members from 9 European countries formed an interdisciplinary steering committee to develop the repository structure, prepare study protocol and perform it. Definitions of medication adherence technologies and their attributes were developed iteratively through literature review, discussions within the steering committee and ENABLE Action members, following ontology development recommendations. Three domains (product and provider information (D1), medication adherence descriptors (D2) and evaluation and implementation (D3)) branching in 13 attribute groups are proposed: product and provider information, target use scenarios, target health conditions, medication regimen, medication adherence management components, monitoring/measurement methods and targets, intervention modes of delivery, target behaviour determinants, behaviour change techniques, intervention providers, intervention settings, quality indicators and implementation indicators. Stakeholders will evaluate the proposed definition and attributes' relevance, clarity and completeness and have multiple opportunities to reconsider their evaluations based on aggregated feedback in real-time. Data collection will stop when the predetermined response rate will be achieved. We will quantify agreement and perform analyses of process indicators on the whole sample and per stakeholder group.

ETHICS AND DISSEMINATION

Ethical approval for the COST ENABLE activities was granted by the Malaga Regional Research Ethics Committee. The Delphi protocol was considered compliant regarding data protection and security by the Data Protection Officer from University of Basel. Findings from the Delphi study will form the basis for the ENABLE repository structure and related activities.

Mindfulness for smoking cessation

BACKGROUND

Mindfulness-based smoking cessation interventions may aid smoking cessation by teaching individuals to pay attention to, and work mindfully with, negative affective states, cravings, and other symptoms of nicotine withdrawal. Types of mindfulness-based interventions include mindfulness training, which involves training in meditation; acceptance and commitment therapy (ACT); distress tolerance training; and yoga.

OBJECTIVES

To assess the efficacy of mindfulness-based interventions for smoking cessation among people who smoke, and whether these interventions have an effect on mental health outcomes.

SEARCH METHODS

We searched the Cochrane Tobacco Addiction Group's specialised register, CENTRAL, MEDLINE, Embase, PsycINFO, and trial registries to 15 April 2021. We also employed an automated search strategy, developed as part of the Human Behaviour Change Project, using Microsoft Academic.

SELECTION CRITERIA

We included randomised controlled trials (RCTs) and cluster-RCTs that compared a mindfulness-based intervention for smoking cessation with another smoking cessation programme or no treatment, and assessed smoking cessation at six months or longer. We excluded studies that solely recruited pregnant women.

DATA COLLECTION AND ANALYSIS

We followed standard Cochrane methods. We measured smoking cessation at the longest time point, using the most rigorous definition available, on an intention-to-treat basis. We calculated risk ratios (RRs) and 95% confidence intervals (CIs) for smoking cessation for each study, where possible. We grouped eligible studies according to the type of intervention and type of comparator. We carried out meta-analyses where appropriate, using Mantel-Haenszel random-effects models. We summarised mental health outcomes narratively.

MAIN RESULTS

We included 21 studies, with 8186 participants. Most recruited adults from the community, and the majority (15 studies) were conducted in the USA. We judged four of the studies to be at low risk of bias, nine at unclear risk, and eight at high risk. Mindfulness-based interventions varied considerably in design and content, as did comparators, therefore, we pooled small groups of relatively comparable studies. We did not detect a clear benefit or harm of mindfulness training interventions on quit rates compared with intensity-matched smoking cessation treatment (RR 0.99, 95% CI 0.67 to 1.46; I² = 0%; 3 studies, 542 participants; low-certainty evidence), less intensive smoking cessation treatment (RR 1.19, 95% CI 0.65 to 2.19; I² = 60%; 5 studies, 813 participants; very low-certainty evidence), or no treatment (RR 0.81, 95% CI 0.43 to 1.53; 1 study, 325 participants; low-certainty evidence). In each comparison, the 95% CI encompassed benefit (i.e. higher quit rates), harm (i.e. lower quit rates) and no difference. In one study of mindfulness-based relapse prevention, we did not detect a clear benefit or harm of the intervention over no treatment (RR 1.43, 95% CI 0.56 to 3.67; 86 participants; very low-certainty evidence). We did not detect a clear benefit or harm of ACT on quit rates compared with less intensive behavioural treatments, including nicotine replacement therapy alone (RR 1.27, 95% CI 0.53 to 3.02; 1 study, 102 participants; low-certainty evidence), brief advice (RR 1.27, 95% CI 0.59 to 2.75; 1 study, 144 participants; very low-certainty evidence), or less intensive ACT (RR 1.00, 95% CI 0.50 to 2.01; 1 study, 100 participants; low-certainty evidence). There was a high level of heterogeneity (I² = 82%) across studies comparing ACT with intensity-matched smoking cessation treatments, meaning it was not appropriate to report a pooled result. We did not detect a clear benefit or harm of distress tolerance training on quit rates compared with intensity-matched smoking cessation treatment (RR 0.87, 95% CI 0.26 to 2.98; 1 study, 69 participants; low-certainty evidence) or less intensive smoking cessation treatment (RR 1.63, 95% CI 0.33 to 8.08; 1 study, 49 participants; low-certainty evidence). We did not detect a clear benefit or harm of yoga on quit rates compared with intensity-matched smoking cessation treatment (RR 1.44, 95% CI 0.40 to 5.16; 1 study, 55 participants; very low-certainty evidence). Excluding studies at high risk of bias did not substantially alter the results, nor did using complete case data as opposed to using data from all participants randomised. Nine studies reported on changes in mental health and well-being, including depression, anxiety, perceived stress, and negative and positive affect. Variation in measures and methodological differences between studies meant we could not meta-analyse these data. One study found a greater reduction in perceived stress in participants who received a face-to-face mindfulness training programme versus an intensity-matched programme. However, the remaining eight studies found no clinically meaningful differences in mental health and well-being between participants who received mindfulness-based treatments and participants who received another treatment or no treatment (very low-certainty evidence).

AUTHORS' CONCLUSIONS

We did not detect a clear benefit of mindfulness-based smoking cessation interventions for increasing smoking quit rates or changing mental health and well-being. This was the case when compared with intensity-matched smoking cessation treatment, less intensive smoking cessation treatment, or no treatment. However, the evidence was of low and very low certainty due to risk of bias, inconsistency, and imprecision, meaning future evidence may very likely change our interpretation of the results. Further RCTs of mindfulness-based interventions for smoking cessation compared with active comparators are needed. There is also a need for more consistent reporting of mental health and well-being outcomes in studies of mindfulness-based interventions for smoking cessation.

Progress in conducting and reporting behaviour change intervention studies: a prospective retrospection

BACKGROUND

ehaviour change is a key to addressing many health and healthcare problems and interventions have been designed to improve health outcomes. These behaviour change interventions have been evaluated in many ways, including randomised controlled trials, and over recent decades there has been considerable progress in the conduct and reporting these studies. This paper is a personal retrospection on the changes occurring that have resulted in our current improved methods and their potential for future advancement.

ADVANCES

There has been steady development of methods for conducting trials, including advances in statistical methods enabled by increase computing power and programmes, greater attention to the recruitment of participants and in the specification of outcomes. Trial reporting has improved, largely due to publication of guidelines for reporting interventions and trials, but until recently the reporting of behaviour change interventions has been quite limited. Developments in the specification of active ingredients of these interventions, the behaviour change techniques, has transformed our ability to report interventions in a manner that facilitates evidence synthesis and enables replication and implementation. However, further work using ontological approaches is needed to adequately represent the evidence contained in the mass of accumulated studies. Meanwhile, attention is gradually being paid to the comparator groups in trials leading to better reporting but with continuing challenges about how control groups are selected.

CONCLUSIONS

These developments are important for the advancements of behavioural science - but also in consolidating the expertise needed to address global social, environmental and health challenges.

Why and how to engage expert stakeholders in ontology development: insights from social and behavioural sciences

BACKGROUND

Incorporating the feedback of expert stakeholders in ontology development is important to ensure content is appropriate, comprehensive, meets community needs and is interoperable with other ontologies and classification systems. However, domain experts are often not formally engaged in ontology development, and there is little available guidance on how this involvement should best be conducted and managed. Social and behavioural science studies often involve expert feedback in the development of tools and classification systems but have had little engagement with ontology development. This paper aims to (i) demonstrate how expert feedback can enhance ontology development, and (ii) provide practical recommendations on how to conduct expert feedback in ontology development using methodologies from the social and behavioural sciences.

MAIN BODY

Considerations for selecting methods for engaging stakeholders are presented. Mailing lists and issue trackers as existing methods used frequently in ontology development are discussed. Advisory boards and working groups, feedback tasks, consensus exercises, discussions and workshops are presented as potential methods from social and behavioural sciences to incorporate in ontology development.

CONCLUSIONS

A variety of methods from the social and behavioural sciences exist to enable feedback from expert stakeholders in ontology development. Engaging domain experts in ontology development enables depth and clarity in ontology development, whilst also establishing advocates for an ontology upon its completion.

Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology

Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational , Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions.

Artificial Intelligence and Behavioral Science Through the Looking Glass: Challenges for Real-World Application

BACKGROUND

Artificial Intelligence (AI) is transforming the process of scientific research. AI, coupled with availability of large datasets and increasing computational power, is accelerating progress in areas such as genetics, climate change and astronomy [NeurIPS 2019 Workshop Tackling Climate Change with Machine Learning, Vancouver, Canada; Hausen R, Robertson BE. Morpheus: A deep learning framework for the pixel-level analysis of astronomical image data. Astrophys J Suppl Ser. 2020;248:20; Dias R, Torkamani A. AI in clinical and genomic diagnostics. Genome Med. 2019;11:70.]. The application of AI in behavioral science is still in its infancy and realizing the promise of AI requires adapting current practices.

PURPOSES

By using AI to synthesize and interpret behavior change intervention evaluation report findings at a scale beyond human capability, the HBCP seeks to improve the efficiency and effectiveness of research activities. We explore challenges facing AI adoption in behavioral science through the lens of lessons learned during the Human Behaviour-Change Project (HBCP).

METHODS

The project used an iterative cycle of development and testing of AI algorithms. Using a corpus of published research reports of randomized controlled trials of behavioral interventions, behavioral science experts annotated occurrences of interventions and outcomes. AI algorithms were trained to recognize natural language patterns associated with interventions and outcomes from the expert human annotations. Once trained, the AI algorithms were used to predict outcomes for interventions that were checked by behavioral scientists.

RESULTS

Intervention reports contain many items of information needing to be extracted and these are expressed in hugely variable and idiosyncratic language used in research reports to convey information makes developing algorithms to extract all the information with near perfect accuracy impractical. However, statistical matching algorithms combined with advanced machine learning approaches created reasonably accurate outcome predictions from incomplete data.

CONCLUSIONS

AI holds promise for achieving the goal of predicting outcomes of behavior change interventions, based on information that is automatically extracted from intervention evaluation reports. This information can be used to train knowledge systems using machine learning and reasoning algorithms.

Representation of behaviour change interventions and their evaluation: Development of the Upper Level of the Behaviour Change Intervention Ontology

Background: Behaviour change interventions (BCI), their contexts and evaluation methods are heterogeneous, making it difficult to synthesise evidence and make recommendations for real-world policy and practice. Ontologies provide a means for addressing this. They represent knowledge formally as entities and relationships using a common language able to cross disciplinary boundaries and topic domains. This paper reports the development of the upper level of the Behaviour Change Intervention Ontology (BCIO), which provides a systematic way to characterise BCIs, their contexts and their evaluations. Methods: Development took place in four steps. (1) Entities and relationships were identified by behavioural and social science experts, based on their knowledge of evidence and theory, and their practical experience of behaviour change interventions and evaluations. (2) The outputs of the first step were critically examined by a wider group of experts, including the study ontology expert and those experienced in annotating relevant literature using the initial ontology entities. The outputs of the second step were tested by (3) feedback from three external international experts in ontologies and (4) application of the prototype upper-level BCIO to annotating published reports; this informed the final development of the upper-level BCIO. Results: The final upper-level BCIO specifies 42 entities, including the BCI scenario, elaborated across 21 entities and 7 relationship types, and the BCI evaluation study comprising 10 entities and 9 relationship types. BCI scenario entities include the behaviour change intervention (content and delivery), outcome behaviour, mechanism of action, and its context, which includes population and setting. These entities have corresponding entities relating to the planning and reporting of interventions and their evaluations. Conclusions: The upper level of the BCIO provides a comprehensive and systematic framework for representing BCIs, their contexts and their evaluations.

Ontologies relevant to behaviour change interventions: a method for their development

Background: Behaviour and behaviour change are integral to many aspects of wellbeing and sustainability. However, reporting behaviour change interventions accurately and synthesising evidence about effective interventions is hindered by lacking a shared, scientific terminology to describe intervention characteristics. Ontologies are standardised frameworks that provide controlled vocabularies to help unify and connect scientific fields. To date, there is no published guidance on the specific methods required to develop ontologies relevant to behaviour change. We report the creation and refinement of a method for developing ontologies that make up the Behaviour Change Intervention Ontology (BCIO). Aims: (1) To describe the development method of the BCIO and explain its rationale; (2) To provide guidance on implementing the activities within the development method. Method and results: The method for developing ontologies relevant to behaviour change interventions was constructed by considering principles of good practice in ontology development and identifying key activities required to follow those principles. The method's details were refined through application to developing two ontologies. The resulting ontology development method involved: (1) defining the ontology's scope; (2) identifying key entities; (3) refining the ontology through an iterative process of literature annotation, discussion and revision; (4) expert stakeholder review; (5) testing inter-rater reliability; (6) specifying relationships between entities, and; (7) disseminating and maintaining the ontology. Guidance is provided for conducting relevant activities for each step.  Conclusions: We have developed a detailed method for creating ontologies relevant to behaviour change interventions, together with practical guidance for each step, reflecting principles of good practice in ontology development. The most novel aspects of the method are the use of formal mechanisms for literature annotation and expert stakeholder review to develop and improve the ontology content. We suggest the mnemonic SELAR3, representing the method's first six steps as Scope, Entities, Literature Annotation, Review, Reliability, Relationships.

Ontologies relevant to behaviour change interventions: a method for their development

Background: Behaviour and behaviour change are integral to many aspects of wellbeing and sustainability. However, reporting behaviour change interventions accurately and synthesising evidence about effective interventions is hindered by lacking a shared, scientific terminology to describe intervention characteristics. Ontologies are knowledge structures that provide controlled vocabularies to help unify and connect scientific fields. To date, there is no published guidance on the specific methods required to develop ontologies relevant to behaviour change. We report the creation and refinement of a method for developing ontologies that make up the Behaviour Change Intervention Ontology (BCIO). Aims: (1) To describe the development method of the BCIO and explain its rationale; (2) To provide guidance on implementing the activities within the development method. Method and results: The method for developing ontologies relevant to behaviour change interventions was constructed by considering principles of good practice in ontology development and identifying key activities required to follow those principles. The method's details were refined through application to developing two ontologies. The resulting ontology development method involved: (1) defining the ontology's scope; (2) identifying key entities; (3) refining the ontology through an iterative process of literature annotation, discussion and revision; (4) expert stakeholder review; (5) testing inter-rater reliability; (6) specifying relationships between entities, and; (7) disseminating and maintaining the ontology. Guidance is provided for conducting relevant activities for each step.  Conclusions: We have developed a detailed method for creating ontologies relevant to behaviour change interventions, together with practical guidance for each step, reflecting principles of good practice in ontology development. The most novel aspects of the method are the use of formal mechanisms for literature annotation and expert stakeholder review to develop and improve the ontology content. We suggest the mnemonic SELAR3, representing the method's first six steps as Scope, Entities, Literature Annotation, Review, Reliability, Relationships.

Delivering Behaviour Change Interventions: Development of a Mode of Delivery Ontology

Background: Investigating and improving the effects of behaviour change interventions requires detailed and consistent specification of all aspects of interventions. An important feature of interventions is the way in which these are delivered, i.e. their mode of delivery. This paper describes an ontology for specifying the mode of delivery of interventions, which forms part of the Behaviour Change Intervention Ontology, currently being developed in the Wellcome Trust funded Human Behaviour-Change Project. Methods: The Mode of Delivery Ontology was developed in an iterative process of annotating behaviour change interventions evaluation reports, and consulting with expert stakeholders. It consisted of seven steps: 1) annotation of 110 intervention reports to develop a preliminary classification of modes of delivery; 2) open review from international experts (n=25); 3) second round of annotations with 55 reports to test inter-rater reliability and identify limitations; 4) second round of expert review feedback (n=16); 5) final round of testing of the refined ontology by two annotators familiar and two annotators unfamiliar with the ontology; 6) specification of ontological relationships between entities; and 7) transformation into a machine-readable format using the Web Ontology Language (OWL) language and publishing online. Results: The resulting ontology is a four-level hierarchical structure comprising 65 unique modes of delivery, organised by 15 upper-level classes: Informational , Environmental change, Somatic, Somatic alteration, Individual-based/ Pair-based /Group-based, Uni-directional/Interactional, Synchronous/ Asynchronous, Push/ Pull, Gamification, Arts feature. Relationships between entities consist of is_a. Inter-rater reliability of the Mode of Delivery Ontology for annotating intervention evaluation reports was a=0.80 (very good) for those familiar with the ontology and a= 0.58 (acceptable) for those unfamiliar with it. Conclusion: The ontology can be used for both annotating and writing behaviour change intervention evaluation reports in a consistent and coherent manner, thereby improving evidence comparison, synthesis, replication, and implementation of effective interventions.

Ontologies relevant to behaviour change interventions: a method for their development

Background: Behaviour and behaviour change are integral to many aspects of wellbeing and sustainability. However, reporting behaviour change interventions accurately and synthesising evidence about effective interventions is hindered by lacking a shared, scientific terminology to describe intervention characteristics. Ontologies are knowledge structures that provide controlled vocabularies to help unify and connect scientific fields. To date, there is no published guidance on the specific methods required to develop ontologies relevant to behaviour change. We report the creation and refinement of a method for developing ontologies that make up the Behaviour Change Intervention Ontology (BCIO). Aims: (1) To describe the development method of the BCIO and explain its rationale; (2) To provide guidance on implementing the activities within the development method. Method and results: The method for developing ontologies relevant to behaviour change interventions was constructed by considering principles of good practice in ontology development and identifying key activities required to follow those principles. The method's details were refined through application to developing two ontologies. The resulting ontology development method involved: (1) defining the ontology's scope; (2) identifying key entities; (3) refining the ontology through an iterative process of literature annotation, discussion and revision; (4) expert stakeholder review; (5) testing inter-rater reliability; (6) specifying relationships between entities, and; (7) disseminating and maintaining the ontology. Guidance is provided for conducting relevant activities for each step.  Conclusions: We have developed a detailed method for creating ontologies relevant to behaviour change interventions, together with practical guidance for each step, reflecting principles of good practice in ontology development. The most novel aspects of the method are the use of formal mechanisms for literature annotation and expert stakeholder review to develop and improve the ontology content. We suggest the mnemonic SELAR3, representing the method's first six steps as Scope, Entities, Literature Annotation, Review, Reliability, Relationships.

Representation of behaviour change interventions and their evaluation: Development of the Upper Level of the Behaviour Change Intervention Ontology

Background: Behaviour change interventions (BCI), their contexts and evaluation methods are heterogeneous, making it difficult to synthesise evidence and make recommendations for real-world policy and practice. Ontologies provide a means for addressing this. They represent knowledge formally as entities and relationships using a common language able to cross disciplinary boundaries and topic domains. This paper reports the development of the upper level of the Behaviour Change Intervention Ontology (BCIO), which provides a systematic way to characterise BCIs, their contexts and their evaluations. Methods: Development took place in four steps. (1) Entities and relationships were identified by behavioural and social science experts, based on their knowledge of evidence and theory, and their practical experience of behaviour change interventions and evaluations. (2) The outputs of the first step were critically examined by a wider group of experts, including the study ontology expert and those experienced in annotating relevant literature using the initial ontology entities. The outputs of the second step were tested by (3) feedback from three external international experts in ontologies and (4) application of the prototype upper-level BCIO to annotating published reports; this informed the final development of the upper-level BCIO. Results: The final upper-level BCIO specifies 42 entities, including the BCI scenario, elaborated across 21 entities and 7 relationship types, and the BCI evaluation study comprising 10 entities and 9 relationship types. BCI scenario entities include the behaviour change intervention (content and delivery), outcome behaviour, mechanism of action, and its context, which includes population and setting. These entities have corresponding entities relating to the planning and reporting of interventions and their evaluations. Conclusions: The upper level of the BCIO provides a comprehensive and systematic framework for representing BCIs, their contexts and their evaluations.