Assessing effective interventions to improve trial retention: do they contain behaviour change techniques?

Effectiveness of pharmacist-led antimicrobial stewardship programs in perioperative settings: A systematic review and meta-analysis

OBJECTIVE

We sought to characterize and evaluate the effectiveness of pharmacist-led AMS interventions in improving antimicrobial use and subsequent surgical site infections (SSI) in perioperative settings.

METHODS

A systematic review and meta-analysis was conducted by searching PubMed, Embase and CINAHL. Two independent reviewers extracted the data using the Descriptive Elements of Pharmacist Intervention Characterization Tool and undertook quality assessment using the Crowe Critical Appraisal. A meta-analysis was conducted using a random-effect model.

RESULTS

Eleven studies were included in this review. Pharmacists were found to have various roles in AMS, including educational sessions, ward rounds, audits and feedback, and guidelines development. The discussion of interventions lacked details on the development. A meta-analysis revealed that pharmacist-led AMS programs in perioperative settings was associated with a significant improvement in antibiotic selection (OR 4.29; 95 % CI 2.52-7.30), administration time (OR 4.93; 95 % CI 2.05-11.84), duration (OR 5.27; 95 % CI 1.58-17.55), and SSI (OR 0.51; 95 % CI 0.34-0.77).

CONCLUSION

Pharmacist-led AMS programs were effective in improving antimicrobial prescribing while reducing SSI; however most studies were of moderate quality. Studies lacked the utilization of theory to develop interventions, therefore, it is not clear whether theory-derived interventions are more effective than those without a theoretical element. High-quality, multicomponent, theory-derived, interventional studies using appropriate methodology and standardized data collection, are needed.

Move&Connect-Caregivers: A virtual group intervention for caregivers of youth experiencing persisting symptoms after concussion

Caregivers play a critical role in supporting youth experiencing persisting symptoms after concussion (PSAC). However, there are limited empirically validated interventions tailored to the specific needs of caregivers, such as improving concussion knowledge and supporting psychosocial wellbeing. This study aims to describe the development of a virtual group intervention for caregivers of youth experiencing PSAC, Move&Connect-Caregivers (M&C-C), and examine its feasibility. Nine mothers participated across two M&C-C groups. Feasibility metrics and semi-structured interviews were collected and analyzed using descriptive and qualitative content analysis. Results suggest that M&C-C is a feasible intervention. By merging social support, concussion psychoeducation, and active skill building, M&C-C is meaningful for caregivers supporting their children experiencing PSAC.

Methods for pragmatic randomized clinical trials of pain therapies: IMMPACT statement

ABSTRACT

Pragmatic, randomized, controlled trials hold the potential to directly inform clinical decision making and health policy regarding the treatment of people experiencing pain. Pragmatic trials are designed to replicate or are embedded within routine clinical care and are increasingly valued to bridge the gap between trial research and clinical practice, especially in multidimensional conditions, such as pain and in nonpharmacological intervention research. To maximize the potential of pragmatic trials in pain research, the careful consideration of each methodological decision is required. Trials aligned with routine practice pose several challenges, such as determining and enrolling appropriate study participants, deciding on the appropriate level of flexibility in treatment delivery, integrating information on concomitant treatments and adherence, and choosing comparator conditions and outcome measures. Ensuring data quality in real-world clinical settings is another challenging goal. Furthermore, current trials in the field would benefit from analysis methods that allow for a differentiated understanding of effects across patient subgroups and improved reporting of methods and context, which is required to assess the generalizability of findings. At the same time, a range of novel methodological approaches provide opportunities for enhanced efficiency and relevance of pragmatic trials to stakeholders and clinical decision making. In this study, best-practice considerations for these and other concerns in pragmatic trials of pain treatments are offered and a number of promising solutions discussed. The basis of these recommendations was an Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) meeting organized by the Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks.

Using behavioral science to increase core outcome set use in trials

OBJECTIVES

Core outcome sets (COS) are agreed sets of outcomes for use in clinical trials, which can increase standardization and reduce heterogeneity of outcomes in research. Using a COS, or not, is a behavior that can potentially be increased using behavioral strategies. The aim of this study was to identify behavioral intervention components to potentially increase use of COS in trials.

METHODS

This project was informed by the Behavior Change Wheel framework. Two reviewers extracted barriers and facilitators to COS use from four recently published studies examining COS use in trials. Barriers and facilitators were coded to the Capability, Opportunity, Motivation-Behavior (COM-B) model, which forms part of the Behavior Change Wheel. COM-B findings were mapped to intervention functions by two reviewers, and then mapped to behavior change techniques (BCTs). Full-team Affordability, Practicability, Effectiveness/Cost-effectiveness, Acceptability, Side effects/Safety, Equity ratings were used to reach consensus on intervention functions and BCTs. BCTs were operationalized using examples of tangible potential applications and were categorized based on similarity.

RESULTS

Barriers and facilitators were identified for all capability, opportunity and motivation aspects of the COM-B model. Five intervention functions (education, training, enablement, persuasion, and modeling) and 15 BCTs were identified. Thirty-six BCT examples were developed, including providing information on benefits of COS for health research, and information choosing COS. BCT examples are categorized by approaches related to "workshops," "guidance," "audio/visual resources," and "other resources."

CONCLUSION

Study findings represent diverse ways to potentially increase COS use in trials. Future work is needed to examine effects of these behavioral intervention components on COS use. If effective, increased use of COS can improve outcome reporting and minimize outcome heterogeneity and research waste.

Implementing multicomponent, eHealth-based behaviour change support within a dietary intervention trial improves adherence to study-related behaviours in healthy young adults

BACKGROUND

Behaviour change science is proposed to improve participant retention and enhance the validity of trials. However, researchers seldom systematically consider and implement behaviour change strategies within trials for this purpose. The objective of this article is to evaluate how an eHealth behaviour change support (BCS) program enhances young adults' adherence to behaviours required within a dietary intervention.

METHODS

The Nine Principles framework was used to develop BCS to implement across both arms of a 10-week randomised parallel-group intervention to enhance adherence to (i) eating healthily and (ii) reporting dietary intake. Key components of the BCS included access to a dietitian-led Facebook group, text reminders, and food delivery. Effectiveness was measured using the following analyses of the 78 participants who completed the study; pre-post change in targeted dietary habits over time using a subscore of the Healthy Diet Habits Index, questionnaire to assess change in perception of barriers to eating healthily over time, Facebook group engagement, and impact evaluation of the BCS. Participants received a dietary reporting score out of 100 to assess adherence across the 10 weeks.

RESULTS

The total Healthy Diet Habits Index subscore out of 16 significantly increased from baseline to week 10 (10.6 ± 2.6 to 11.2 ± 2.6, p value < 0.05), driven primarily by an increase in vegetable consumption. Overall adherence to reporting was high across the 10 weeks, with the total population mean reporting score 90.4 ± 14.6 out of 100. Relatively low Facebook engagement was observed. Adding objects to the environment, prompts/cues and removing reward appeared to be effective components of the BCS for enhancing adherence to the target behaviours.

CONCLUSION

Using a behaviour change framework to support the design of randomised trials is a promising way to enhance participant adherence to study requirements that are typically considered burdensome, such as dietary reporting. It also enables researchers to identify and replicate effective components of BCS, including behaviour change techniques and modes of delivery. Further research into the use of different behaviour change frameworks for this purpose is warranted.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04869163; https://clinicaltrials.gov/ct2/show/NCT04869163 . (03/05/2021).

Developing strategies to address disparities in retention communication during the consent discussion: development of a behavioural intervention

BACKGROUND

Clinical trials are essential to evidence-based medicine. Their success relies on recruitment and retention of participants: problems with either can affect validity of results. Past research on improving trials has focused on recruitment, with less on retention, and even less considering retention at the point of recruitment, i.e., what retention-relevant information is shared during consent processes. The behaviour of trial staff communicating this information during consent is likely to contribute to retention. So, developing approaches to mitigate issues in retention at the point of consent is necessary. In this study, we describe the development of a behavioural intervention targeting the communication of information important to retention during the consent process.

METHODS

We applied the Theoretical Domains Framework and Behaviour Change Wheel to develop an intervention aimed at changing the retention communication behaviours of trial staff. Building on findings from an interview study to understand the barriers/facilitators to retention communication during consent, we identified behaviour change techniques that could moderate them. These techniques were grouped into potential intervention categories and presented to a co-design group of trial staff and public partners to discuss how they might be packaged into an intervention. An intervention was presented to these same stakeholders and assessed for acceptability through a survey based on the Theoretical Framework of Acceptability.

RESULTS

Twenty-six behaviour change techniques were identified with potential to change communication of retention-information at consent. Six trial stakeholders in the co-design group discussed means for implementing these techniques and agreed the available techniques could be most effective within a series of meetings focussed on best practices for communicating retention at consent. The proposed intervention was deemed acceptable through survey results.

CONCLUSION

We have developed an intervention aimed at facilitating the communication of retention at informed consent through a behavioural approach. This intervention will be delivered to trial staff and will add to the available strategies for trials to improve retention.

A Technology-Supported Guidance Model to Support the Development of Critical Thinking among Undergraduate Nursing Students in Clinical Practice: A Concurrent, Exploratory, Flexible, Multi-Method Feasibility Study (Preprint)

BACKGROUND

There is widespread recognition and acceptance of the need for critical thinking in nursing education, as it is necessary to provide high-quality nursing. The Technology-Supported Guidance Model (TSGM) intervention was conducted during clinical practice among undergraduate nursing students and aimed to support the development of critical thinking. A major element of this newly developed intervention is an app, Technology-Optimized Practice Process in Nursing (TOPP‑N), combined with the daily guidance of nursing students from nurse preceptors and summative assessments based on the Assessment of Clinical Education.

OBJECTIVE

The main objective of this study was to assess the feasibility of a newly developed intervention, TSGM, among undergraduate nursing students, nurse preceptors, and nurse educators. Further objectives were to assess the primary and secondary outcome measures, recruitment strategy, and data collection strategy and to identify the potential causes of dropout and barriers to participant recruitment, retention, intervention fidelity, and adherence to the intervention.

METHODS

This study was designed as a concurrent, exploratory, flexible, and multimethod feasibility study of the TSGM intervention that included quantitative and qualitative data from nursing students, nurse preceptors, and nurse educators. The primary outcome measures were the feasibility and acceptability of the intervention. The secondary outcomes included the suitability and acceptance of the outcome measures (critical thinking, self-efficacy, clinical learning environment, metacognition and self-regulation, technology acceptance, and competence of mentors); data collection strategy; recruitment strategy; challenges related to dropouts; and hindrances to recruitment, retention, and intervention fidelity and adherence.

RESULTS

Nursing students, nurse preceptors, and nurse educators had varied experiences with the TSGM intervention. We identified factors that make the intervention feasible and challenging and may influence the feasibility, acceptability, dropout rate, adherence, and fidelity of the intervention. We also identified areas for future improvement of the intervention.

CONCLUSIONS

The use of a newly developed intervention, TSGM, is feasible and accepted by undergraduate nursing students, nurse preceptors, and nurse educators; however, refinement and improvement of the intervention and the TOPP‑N app, improvement in intervention management, and mitigation of negative factors are necessary before a randomized controlled trial can be performed.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/31646.

Behavioral Change Factors and Retention in Web-Based Interventions for Informal Caregivers of People Living With Dementia: Scoping Review

BACKGROUND

Web-based interventions aimed at supporting informal caregivers of people living with dementia have the potential to improve caregivers' well-being and psychological health. However, few interventions are widely implemented for this population, and none of the prior reviews have systematically examined the use of behavior change techniques (BCTs), theories, and agents in web-based interventions for informal caregivers of people living with dementia. To better understand this implementation gap, we reviewed the literature to map behavioral factors (BCTs, theories, and agents) deployed in the studies. Furthermore, because there is an emerging consensus that retention could be shaped by participant characteristics and behavioral factors, we explored relationships between these features and retention rates across studies.

OBJECTIVE

We pursued 3 objectives: to map behavioral factors involved in the web-based interventions for informal caregivers of people living with dementia; to examine the relationship between behavioral change elements and retention in the studies; and to examine the relationship between participant characteristics (gender, age, and spouse or adult children caregiver proportion) and study retention.

METHODS

We conducted a literature review using the following keywords and their corresponding Medical Subject Headings terms: dementia, caregivers, and web-based intervention. The time limits were January 1998 to March 2022. Using the BCTv1 taxonomy, which specifies active behavioral components in interventions, 2 coders collected, summarized, and analyzed the frequency distributions of BCTs. Similarly, they abstracted and analyzed participant characteristics, behavior change theories, behavior change agents, and retention rates in the studies.

RESULTS

The average age was 61.5 (SD 7.4) years, and the average proportion of spousal informal caregivers, adult children informal caregivers, and retention rates were 51.2% (SD 24.8%), 44.8% (SD 22%), and 70.4% (SD 17%), respectively. Only 53% (17/32) of the studies used behavior change theories, but 81% (26/32) included behavior change agents. The most common BCTv1 clusters were shaping knowledge and social support. The median number of BCTv1 clusters was 5 (IQR 3). We observed a negative correlation between the proportion of spousal informal caregivers and the retention rate (r=-0.45; P=.02) and between the number of BCTv1 clusters and retention rates (r=-0.47; P=.01). We also found that the proportion of adult children informal caregivers in the study was significantly and positively correlated with the retention rate (r=0.5; P=.03). No other participant characteristics or behavioral factors were associated with retention rates.

CONCLUSIONS

We found that almost half of the studies were not informed by behavior change theories. In addition, spousal involvement and a higher number of BCTs were each associated with lower retention rates, while the involvement of adult children caregivers in the study was associated with higher retention. In planning future studies, researchers should consider matching participant characteristics with their intended intervention as the alignment might improve their retention rates.

Evaluating a motivational and psycho-educational self-help intervention for athletes with mild eating disorder symptoms: A mixed methods feasibility study

OBJECTIVE

The primary aim was to assess the feasibility of undertaking a study evaluating the novel Motivational and Psycho-Educational Self-Help Programme for Athletes with Mild Eating Disorder Symptoms (MOPED-A). A mixed-methods approach was adopted to explore the feasibility of recruiting and retaining participants, and to evaluate the acceptability of measures, procedures and the intervention. A secondary aim was to explore the potential efficacy of MOPED-A in reducing athletes' eating disorder symptoms.

METHOD

Thirty-five athletes were recruited. Participation involved completing MOPED-A over a 6-week period and completing self-report measures at baseline (T1), post-intervention (T2) and 4-week follow-up (T3). A subsample (n = 15) completed an interview at T2.

RESULTS

Retention was good throughout the study (n = 28; 80%). Quantitative and qualitative feedback suggested the format, delivery, content and dosage of MOPED-A were acceptable. Athletes valued that the intervention was tailored to them, and this facilitated both participation and completion. Over a third of participants reported disclosing their eating difficulties and deciding to seek further support. Large reductions in eating disorder symptoms were detected at T2 and sustained at T3.

CONCLUSIONS

The MOPED-A intervention can be feasibly implemented, is acceptable to participants, and demonstrates potential for reducing symptoms in athletes. A larger, controlled trial is warranted.

Effects of financial incentives on volunteering for clinical trials: A randomized vignette experiment

BACKGROUND

Financial incentives may aid recruitment to clinical trials, but evidence regarding risk/burden-driven variability in participant preferences for incentives is limited. We developed and tested a framework to support real-world decisions on recruitment budget.

METHODS

We included two phases: an Anchoring Survey, to ensure we could capture perceived unpleasantness on a range of life events, and a Vignette Experiment, to explore relationships between financial incentives and participants' perceived risk/burden and willingness to participate in high- and low-risk/burden versions of five vignettes drawn from common research activities. We compared vignette ratings to identify similarly rated life events from the Anchoring Survey to contextualize ratings of study risk.

RESULTS

In our Anchoring Survey (n = 643), mean ratings (scale 1 = lowest risk/burden to 5 = highest risk/burden) indicated that the questions made sense to participants, with highest risk assigned to losing house in a fire (4.72), and lowest risk assigned to having blood pressure taken (1.13). In the Vignette Experiment (n = 534), logistic regression indicated that amount of offered financial incentive and perceived risk/burden level were the top two drivers of willingness to participate in four of the five vignettes. Comparison of event ratings in the Anchoring Survey with the Vignette Experiment ratings suggested reasonable concordance on severity of risk/burden.

CONCLUSIONS

We demonstrated feasibility of a framework for assessing participant perceptions of risk for study activities and discerned directionality of relationship between financial incentives and willingness to participate. Future work will explore use of this framework as an evidence-gathering approach for gauging appropriate incentives in real-world study contexts.

Behavior change factors and retention in dietary interventions for older adults: scoping review

BACKGROUND AND OBJECTIVES

Although poor diet is a major driver of morbidity and mortality in people 60 and older, few dietary interventions are widely implemented for this population. We mapped behavior change theories, agents, and techniques in dietary interventions for adults 60+ and explored relationships between these factors and ability to retain at least 80% of the study participants.

RESEARCH DESIGN AND METHODS

We conducted a scoping review using MEDLINE, CINAHL, and Web of Science through April 2021 for dietary interventions in adults 60 and older. We collated, summarized, and calculated frequency distributions of behavior change theories, behavior change agents, and behavior change techniques (BCTs) using BCTv1 taxonomy with regard to participant retention across 43 studies.

RESULTS

Only 49% and 30% of the studies reported behavior theory and change agents respectively. Of the studies reporting on theory and agents, the most common were social cognitive theory and the related mechanism of self-efficacy. The most common BCTv1 were "shaping knowledge" and "goals and planning." Several BCTv1 such as "antecedents" and "reward and threat" and evidence for concordance between BCTs and change agents were more common in interventions with higher retention rates.

DISCUSSION AND IMPLICATIONS

Mechanistically concordant studies with BCTs that involve resource allocation and positive reinforcement through rewards may be advantageous for retention in dietary intervention for older adults. Future studies should continue developing theory and mechanism-oriented research. Furthermore, future studies should consider diversifying the portfolio of currently deployed BCTs and strengthening a concordance between BCTs and mechanisms of change.

Using a behavioural approach to explore the factors that affect questionnaire return within a clinical trial: a qualitative study based on the theoretical domains framework

Objectives

To identify barriers and enablers to participant retention in trials requiring questionnaire return using the theoretical domains framework (TDF).

Study design and setting

We identified and subsequently invited participants who did not return at least one questionnaire during their participation in a clinical trial for one-to-one semi-structured telephone interviews. We used a behavioural framework (TDF) to explore whether any of the behavioural domains (eg, beliefs about consequences, emotion) affected questionnaire return. Thereafter, we generated a series of belief statements which summarised the content of participants’ main responses and coded these under separate themes.

Participants

We distributed invites to 279 eligible individuals and subsequently interviewed 9 participants who took part in the C-Gall trial. The C-Gall trial required participants to complete five postal questionnaires during their participation.

Results

Nine participants were interviewed. We developed 7 overarching themes which were relevant for returning postal questionnaires and identified both barriers and enablers from 11 core domains: knowledge; beliefs about consequences; environmental context and resources; reinforcement; emotion; beliefs about capabilities; behavioural regulation; social professional role and identity; skills; intentions and goals. Relevant content coded under these salient domains were categorised into seven key themes: unclear expectations of trial participation, personal attributes for questionnaire return, commitment to returning questionnaires given other priorities, sources of support in returning the questionnaires, individual preferences for presentation mode and timing of the questionnaires, internal and external strategies to encourage questionnaire return and the significance of questionnaire non-return.

Conclusion

We demonstrate how a behavioural approach may be useful for clinical trials associated with significant participation burden (e.g. trials that require multiple questionnaire responses), acting as the essential groundwork for the development of appropriate evidence-based solutions to combat retention issues.

Trial registration number

55215960; Pre-results.

Why trials lose participants: A multitrial investigation of participants' perspectives using the theoretical domains framework

OBJECTIVES

To use the Theoretical Domains Framework (TDF) to identify barriers and enablers to participant retention in trials requiring questionnaire return and/or attendance at follow-up clinics.

STUDY DESIGN AND SETTING

We invited participants (n = 607) from five pragmatic effectiveness trials, who missed at least one follow-up time point (by not returning a questionnaire and/or not attending a clinic visit), to take part in semistructured telephone interviews. The TDF informed both data collection and analysis. To establish what barriers and enablers most likely influence the target behavior the domain relevance threshold was set at >75% of participants mentioning the domain.

RESULTS

Sixteen participants (out of 25 showing interest) were interviewed. Overall, seven theoretical domains were identified as both barriers and enablers to the target behaviors of attending clinic appointments and returning postal questionnaires. Barriers frequently reported in relation to both target behaviours stemmed from participants' knowledge, beliefs about their capabilities and the consequences of performing (or not performing) the behavior. Two domains were identified as salient for questionnaire return only: goals; and memory, attention and decision-making. Emotion was identified as relevant for clinic attendance only.

CONCLUSION

This is the first study informed by behavioural science to explore trial participants' accounts of trial retention. Findings will serve as a guiding framework when designing trials to limit barriers and enhance enablers of retention within clinical trials.

The ACTTION Guide to Clinical Trials of Pain Treatments, part II: mitigating bias, maximizing value

Summaries of the articles included in part II of the ACTTION Guide to Clinical Trials of Pain Treatments are followed by brief overviews of methodologic considerations involving precision pain medicine, pragmatic clinical trials, real world evidence, and patient engagement in clinical trials.

Retaining participants in community-based health research: a case example on standardized planning and reporting

Background

Effective strategies for participant retention are critical in health research to ensure validity, generalizability and efficient use of resources. Yet standardized guidelines for planning and reporting on retention efforts have been lacking. As with randomized controlled trial (RCT) and systematic review (SR) protocols, retention protocols are an opportunity to improve transparency and rigor. An RCT being conducted in British Columbia (BC), Canada provides a case example for developing a priori retention frameworks for use in protocol planning and reporting.

Methods

The BC Healthy Connections Project RCT is examining the effectiveness of a nurse home-visiting program in improving child and maternal outcomes compared with existing services. Participants (N = 739) were girls and young women preparing to parent for the first time and experiencing socioeconomic disadvantage. Quantitative data were collected upon trial entry during pregnancy and during five follow-up interviews until participants’ children reached age 2 years. A framework was developed to guide retention of this study population throughout the RCT. We reviewed relevant literature and mapped essential retention activities across the study planning, recruitment and maintenance phases. Interview completion rates were tracked.

Results

Results from 3302 follow-up interviews (in-person/telephone) conducted over 4 years indicate high completion rates: 90% (n = 667) at 34 weeks gestation; and 91% (n = 676), 85% (n = 626), 80% (n = 594) and 83% (n = 613) at 2, 10, 18 and 24 months postpartum, respectively. Almost all participants (99%, n = 732) provided ongoing consent to access administrative health data. These results provide preliminary data on the success of the framework.

Conclusions

Our retention results are encouraging given that participants were experiencing considerable socioeconomic disadvantage. Standardized retention planning and reporting may therefore be feasible for health research in general, using the framework we have developed. Use of standardized retention protocols should be encouraged in research to promote consistency across diverse studies, as now happens with RCT and SR protocols. Beyond this, successful retention approaches may help inform health policy-makers and practitioners who also need to better reach, engage and retain underserved populations.

Trial registration

ClinicalTrials.gov, NCT01672060. Registered on 24 August 2012.