Using theory to synthesise evidence from behaviour change interventions: the example of audit and feedback

Understanding money-management behaviour and its potential determinants among undergraduate students: A scoping review

BACKGROUND

University students typically face acute financial pressure, which can adversely impact mental health, wellbeing, and academic outcomes. This scoping review of qualitative and quantitative studies aimed to identify distinct money-management behaviours, and psychological determinants, to inform future interventions.

METHODS

Two electronic databases were searched for observational studies focusing on money-management behaviours and their correlates (in quantitative studies) or reflections on experiences of such behaviours (qualitative studies). Of 789 unique papers identified, 12 papers, reporting 10 distinct studies (six quantitative, two qualitative, two mixed-methods), were entered into review. We inductively categorised all behaviours and psychological correlates, and narratively synthesised findings.

RESULTS

We documented 15 distinct money-management behaviours, which fitted five higher-order categories: budgeting, saving (i.e., building funds), spending, borrowing, and settling debts. Twenty-two distinct potential correlates were observed, which fitted six categories: personality characteristics, financial beliefs and knowledge, attitudes, affective responses, self-efficacy and control, and social influences. Financial beliefs and knowledge, attitudes, self-efficacy and control, and social support from parents and peers were generally associated with 'better' money management practices.

CONCLUSION

Heterogeneity in behaviours and correlates studied precluded definitive conclusions. Future studies should more comprehensively adopt theories and concepts from behavioural science, to distinguish between different money-management behaviours, identify which behaviours have most impact on students, and establish which specific determinants are most related to which money-management behaviours.

Researching big IT in the UK National Health Service: A systematic review of theory-based studies

OBJECTIVE

To identify and discuss theory-based studies of large-scale health information technology programs in the UK National Health Service.

MATERIALS AND METHODS

Using the PRISMA systematic review framework, we searched Scopus, PubMed and CINAHL databases from inception to March 2022 for theory-based studies of large-scale health IT implementations. We undertook detailed full-text analyses of papers meeting our inclusion criteria.

RESULTS

Forty-six studies were included after assessment for eligibility, of which twenty-five applied theories from the information systems arena (socio-technical approaches, normalization process theory, user acceptance theories, diffusion of innovation), twelve from sociology (structuration theory, actor-network theory, institutional theory), while nine adopted other theories. Most investigated England's National Program for IT (2002-2011), exploring various technologies among which electronic records predominated. Research themes were categorized into user factors, program factors, process outcomes, clinical impact, technology, and organizational factors. Most research was qualitative, often using a case study strategy with a longitudinal or cross-sectional approach. Data were typically collected through interviews, observation, and document analysis; sampling was generally purposive; and most studies used thematic or related analyses. Theories were generally applied in a superficial or fragmentary manner; and articles frequently lacked detail on how theoretical constructs and relationships aided organization, analysis, and interpretation of data.

CONCLUSION

Theory-based studies of large NHS IT programs are relatively uncommon. As large healthcare programs evolve over a long timeframe in complex and dynamic environments, wider adoption of theory-based methods could strengthen the explanatory and predictive utility of research findings across multiple evaluation studies. Our review has confirmed earlier suggestions for theory selection, and we suggest there is scope for more explicit use of such theoretical constructs to strengthen the conceptual foundations of health informatics research. Additionally, the challenges of large national health informatics programs afford wide-ranging opportunities to test, refine, and adapt sociological and information systems theories.

Development of an interdisciplinary training program about chronic pain management with a cognitive behavioural approach for healthcare professionals: part of a hybrid effectiveness-implementation study

BACKGROUND

Many applied postgraduate pain training programs are monodisciplinary, whereas interdisciplinary training programs potentially improve interdisciplinary collaboration, which is favourable for managing patients with chronic pain. However, limited research exists on the development and impact of interdisciplinary training programs, particularly in the context of chronic pain.

METHODS

This study aimed to describe the development and implementation of an interdisciplinary training program regarding the management of patients with chronic pain, which is part of a type 1 hybrid effectiveness-implementation study. The targeted groups included medical doctors, nurses, psychologists, physiotherapists, occupational therapists, dentists and pharmacists. An interdisciplinary expert panel was organised to provide its perception of the importance of formulated competencies for integrating biopsychosocial pain management with a cognitive behavioural approach into clinical practice. They were also asked to provide their perception of the extent to which healthcare professionals already possess the competencies in their clinical practice. Additionally, the expert panel was asked to formulate the barriers and needs relating to training content and the implementation of biopsychosocial chronic pain management with a cognitive behavioural approach in clinical practice, which was complemented with a literature search. This was used to develop and adapt the training program to the barriers and needs of stakeholders.

RESULTS

The interdisciplinary expert panel considered the competencies as very important. Additionally, they perceived a relatively low level of healthcare professionals' possession of the competencies in their clinical practice. A wide variety of barriers and needs for stakeholders were formulated and organized within the Theoretical Domain Framework linked to the COM-B domains; 'capability', 'opportunity', and 'motivation'. The developed interdisciplinary training program, including two workshops of seven hours each and two e-learning modules, aimed to improve HCP's competencies for integrating biopsychosocial chronic pain management with a cognitive behavioural approach into clinical practice.

CONCLUSION

We designed an interdisciplinary training program, based on formulated barriers regarding the management of patients with chronic pain that can be used as a foundation for developing and enhancing the quality of future training programs.

Promoting informed decision making about maternal pertussis vaccination: the systematic development of an online tailored decision aid and a centering-based group antenatal care intervention

Introduction

Maintaining and enhancing vaccine confidence continues to be a challenge. Making an informed decision not only helps to avoid potential future regret but also reduces susceptibility to misinformation. There is an urgent need for interventions that facilitate informed decision-making about vaccines. This paper describes the systematic development of two interventions designed to promote informed decision making and indirectly, acceptance of maternal pertussis vaccination (MPV) in the Netherlands.

Materials and methods

The 6-step Intervention Mapping (IM) protocol was used for the development of an online tailored decision aid and Centering Pregnancy-based Group Antenatal Care (CP) intervention. A needs assessment was done using empirical literature and conducting a survey and focus groups (1), intervention objectives were formulated at the behavior and determinants levels (2), theoretical methods of behavior change were selected and translated into practical applications (3), which were further developed into the two interventions using user-centered design (4). Finally, plans were developed for implementation (5), and evaluation (6) of the interventions.

Results

The needs assessment showed that pregnant women often based their decision about MPV on information sourced online and conversations with their partners, obstetric care providers, and peers. Responding to these findings, we systematically developed two interactive, theory-based interventions. We created an online tailored decision aid, subjecting it to four iterations of testing among pregnant women, including those with low literacy levels. Participants evaluated prototypes of the intervention positively on relevance and usability. In addition, a CP intervention was developed with midwives.

Conclusion

Using IM resulted in the creation of an online decision aid and CP intervention to promote informed decision making regarding MPV. This description of the systematic development of the interventions not only serves to illustrate design rationales, it will also aid the interpretation of the evaluation of the interventions, the development of future interventions promoting informed decision and acceptance of vaccines, and comparisons with other interventions.

Cluster-randomized implementation trial of two facilitation strategies to implement a novel information and communications technology at the Veterans Health Administration

BACKGROUND

Information and communication technologies (ICTs) improve quality and efficiency of healthcare, but effective practices for implementing new ICTs are unknown. From 2019 to 2021, the Veterans Health Administration (VHA) implemented FLOW3, an ICT that facilitates prosthetic limb care. The goal of this study was to compare the impact of two facilitation strategies on FLOW3 adoption, implementation, and sustainment.

METHODS

FLOW3 is a computerized workflow management system comprised of three applications that facilitate the three steps for prosthesis authorization. During VHA's implementation of FLOW3, we randomized 60 VHA sites to basic or enhanced facilitation groups. Basic facilitation included a manualized training toolkit and office hours. Enhanced facilitation included basic facilitation plus monthly learning collaboratives and site-specific performance reports. Outcomes included time to adoption of FLOW3 and complete FLOW3 utilization rates during implementation and sustainment periods. We compared outcomes between sites assigned to basic versus enhanced facilitation groups. Results were calculated using both intent-to-treat (ITT) and dose-response analyses. The dose-response analysis used a per-protocol approach and required sites in the enhanced facilitation group to join two of six learning collaboratives; sites that attended fewer were reassigned to the basic group.

RESULTS

Randomization assigned 30 sites to enhanced facilitation and 30 to basic. Eighteen of 30 randomized sites were included in the enhanced facilitation group for dose-response analysis. During the implementation period, enhanced facilitation sites were significantly more likely to completely utilize FLOW3 than basic facilitation sites (HR: 0.17; 95% CI: 1.18, 4.53, p = 0.02) based on ITT analysis. In the dose-response analysis, the enhanced group was 2.32 (95% CI: 1.18, 4.53) times more likely to adopt FLOW3 than basic group (p = 0.014).

CONCLUSIONS

Enhanced facilitation including a learning collaborative and customized feedback demonstrated greater likelihood for sites to complete a prosthetics consult using FLOW3 throughout our study. We identified statistically significant differences in likelihood of adoption using the dose-response analysis and complete utilization rate using ITT analysis during the implementation period. All sites that implemented FLOW3 demonstrated improvement in completion rate during the sustainment period, but the difference between facilitation groups was not statistically significant. Further study to understand sustainability is warranted.

Behaviour change techniques in physical activity-focused interventions for young people at risk of problematic substance use: A systematic review and meta-analysis

AIM

This systematic review investigates behaviour change techniques in interventions promoting physical activity for young people aged 12-25 years at heightened risk of problematic substance use, and the effect of these techniques on physical activity participation and substance use outcomes.

METHODS

Four databases (PsycINFO, CINAHL, SPORTDiscus and Medline) were searched between November 2020 and November 2022 for randomized and non-randomized controlled studies according to inclusion criteria. Meta-analyses were calculated using weighted, standardized averages of effect sizes (Hedges' g).

RESULTS

Twenty-eight studies were included, 14 studies in the meta-analysis (intervention n = 1328; control n = 845). Reported BCTs included behavioural instructions, social comparison and goal setting. There was a significant effect of behaviour change techniques on combined substance use outcomes, such as cravings and consumption, for interventions reporting multiple behaviour change techniques (g = -0.33, p < .001, 95% CI [-0.50,-0.16]) or one single behaviour change technique (g = -1.84, p < .001, 95% CI [-2.89,-0.8]). Limitations include unexplained variance and limited reporting of relevant behaviour change technique data in the included studies.

CONCLUSION

The results indicate that using behaviour change techniques in interventions that promote physical activity for young people has an effect on substance use. Further research needs to be completed comparing the impact of the number and type of behaviour change technique, and improved reporting of intervention content is required.

Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals

BACKGROUND

Audit and feedback (A&F) is among the most widely used implementation strategies, providing healthcare professionals with summaries of their practice performance to prompt behaviour change and optimize care. Wide variability in effectiveness of A&F has spurred efforts to explore why some A&F interventions are more effective than others. Unpacking the variability of the content of A&F interventions in terms of their component behaviours change techniques (BCTs) may help advance our understanding of how A&F works best. This study aimed to systematically specify BCTs in A&F interventions targeting healthcare professional practice change.

METHODS

We conducted a directed content analysis of intervention descriptions in 287 randomized trials included in an ongoing Cochrane systematic review update of A&F interventions (searched up to June 2020). Three trained researchers identified and categorized BCTs in all trial arms (treatment & control/comparator) using the 93-item BCT Taxonomy version 1. The original BCT definitions and examples in the taxonomy were adapted to include A&F-specific decision rules and examples. Two additional BCTs ('Education (unspecified)' and 'Feedback (unspecified)') were added, such that 95 BCTs were considered for coding.

RESULTS

In total, 47/95 BCTs (49%) were identified across 360 treatment arms at least once (median = 5.0, IQR = 2.3, range = 129 per arm). The most common BCTs were 'Feedback on behaviour' (present 89% of the time; e.g. feedback on drug prescribing), 'Instruction on how to perform the behaviour' (71%; e.g. issuing a clinical guideline), 'Social comparison' (52%; e.g. feedback on performance of peers), 'Credible source' (41%; e.g. endorsements from respected professional body), and 'Education (unspecified)' (31%; e.g. giving a lecture to staff). A total of 130/287 (45%) control/comparator arms contained at least one BCT (median = 2.0, IQR = 3.0, range = 0-15 per arm), of which the most common were identical to those identified in treatment arms.

CONCLUSIONS

A&F interventions to improve healthcare professional practice include a moderate range of BCTs, focusing predominantly on providing behavioural feedback, sharing guidelines, peer comparison data, education, and leveraging credible sources. We encourage the use of our A&F-specific list of BCTs to improve knowledge of what is being delivered in A&F interventions. Our study provides a basis for exploring which BCTs are associated with intervention effectiveness.

TRIAL REGISTRATIONS

N/A.

Types and effects of feedback for emergency ambulance staff: a systematic mixed studies review and meta-analysis

BACKGROUND

Extensive research has been conducted into the effects of feedback interventions within many areas of healthcare, but prehospital emergency care has been relatively neglected. Exploratory work suggests that enhancing feedback and follow-up to emergency medical service (EMS) staff might provide staff with closure and improve clinical performance. Our aim was to summarise the literature on the types of feedback received by EMS professionals and its effects on the quality and safety of patient care, staff well-being and professional development.

METHODS

A systematic review and meta-analysis, including primary research studies of any method published in peer-reviewed journals. Studies were included if they contained information on systematic feedback to emergency ambulance staff regarding their performance. Databases searched from inception were MEDLINE, Embase, AMED, PsycINFO, HMIC, CINAHL and Web of Science, with searches last updated on 2 August 2022. Study quality was appraised using the Mixed Methods Appraisal Tool. Data analysis followed a convergent integrated design involving simultaneous narrative synthesis and random effects multilevel meta-analyses.

RESULTS

The search strategy yielded 3183 articles, with 48 studies meeting inclusion criteria after title/abstract screening and full-text review. Interventions were categorised as audit and feedback (n=31), peer-to-peer feedback (n=3), postevent debriefing (n=2), incident-prompted feedback (n=1), patient outcome feedback (n=1) or a combination thereof (n=4). Feedback was found to have a moderate positive effect on quality of care and professional development with a pooled effect of d=0.50 (95% CI 0.34, 0.67). Feedback to EMS professionals had large effects in improving documentation (d=0.73 (0.00, 1.45)) and protocol adherence (d=0.68 (0.12, 1.24)), as well as small effects in enhancing cardiac arrest performance (d=0.46 (0.06, 0.86)), clinical decision-making (d=0.47 (0.23, 0.72)), ambulance times (d=0.43 (0.12, 0.74)) and survival rates (d=0.22 (0.11, 0.33)). The between-study heterogeneity variance was estimated at σ2=0.32 (95% CI 0.22, 0.50), with an I2 value of 99% (95% CI 98%, 99%), indicating substantial statistical heterogeneity.

CONCLUSION

This review demonstrated that the evidence base currently does not support a clear single point estimate of the pooled effect of feedback to EMS staff as a single intervention type due to study heterogeneity. Further research is needed to provide guidance and frameworks supporting better design and evaluation of feedback interventions within EMS.

PROSPERO REGISTRATION NUMBER

CRD42020162600.

A Social Cognitive Assessment of Workplace Sedentary Behavior among a Sample of University Employees

Sedentary behavior (SB) is an important public health concern. Adults working in desk-based occupations spend a considerable proportion of the workday sitting. More information is needed regarding the factors that contribute to occupational SB. The aim of this study was to assess the utility of social cognitive theory (SCT) to explain work-related SB using a quantitative, cross-sectional design by administering an online questionnaire. Participants included 381 full-time employees at a large, public university in the south-central United States. Hierarchical multiple linear regression was used to determine the relationship between SCT constructs and SB. Mean work-related SB was 5.95 (SD = 1.30) h/8 h workday. In model 1, 9.6% of the total variance in SB was accounted for by standing desk ownership and physical activity level (p = 0.001; R2 = 0.096). In model 2, SCT constructs led to a statistically significant R2 increase of 4.9% (p < 0.001), where standing desk ownership, physical activity, and self-efficacy explained 13.3% of the variance in work-related SB. Findings from this study suggest that self-efficacy may be an important factor in explaining variation in occupational SB. Public health researchers and practitioners should consider strategies to address self-efficacy when developing workplace interventions to target occupational SB.

Cognitive perspectives on maintaining physicians' medical expertise: I. Reimagining Maintenance of Certification to promote lifelong learning

Until recently, physicians in the USA who were board-certified in a specialty needed to take a summative test every 6-10 years. However, the 24 Member Boards of the American Board of Medical Specialties are in the process of switching toward much more frequent assessments, which we refer to as longitudinal assessment. The goal of longitudinal assessments is to provide formative feedback to physicians to help them learn content they do not know as well as serve an evaluation for board certification. We present five articles collectively covering the science behind this change, the likely outcomes, and some open questions. This initial article introduces the context behind this change. This article also discusses various forms of lifelong learning opportunities that can help physicians stay current, including longitudinal assessment, and the pros and cons of each.

Behaviour change, the itchy spot of healthcare quality improvement: How can psychology theory and skills help to scratch the itch?

Despite the clear utility and transferability, National Health Service (NHS) quality improvement initiatives have yet to benefit fully from what is already known within health psychology. Thus far, evidence from established, seminal behaviour change theory and practice have been ignored in favour of newly developed models and frameworks. Further, whilst there is a growing interest in what is commonly referred to as 'human factors' of change and improvement, there is scant transferability of known psychologically informed implementation skills into routine NHS Improvement practice. The science and practice of healthcare improvement is growing, and the behaviour change aspect is critical to sustainable outcomes. Therefore, this paper offers practical guidance on how seminal psychological behaviour change theory and motivational interviewing (a person-centred skills-based approach specifically developed to support people through change) can be combined to better address individual and organisational change within a healthcare improvement context.

Quality improvement strategies for diabetes care: Effects on outcomes for adults living with diabetes

BACKGROUND

There is a large body of evidence evaluating quality improvement (QI) programmes to improve care for adults living with diabetes. These programmes are often comprised of multiple QI strategies, which may be implemented in various combinations. Decision-makers planning to implement or evaluate a new QI programme, or both, need reliable evidence on the relative effectiveness of different QI strategies (individually and in combination) for different patient populations.

OBJECTIVES

To update existing systematic reviews of diabetes QI programmes and apply novel meta-analytical techniques to estimate the effectiveness of QI strategies (individually and in combination) on diabetes quality of care.

SEARCH METHODS

We searched databases (CENTRAL, MEDLINE, Embase and CINAHL) and trials registers (ClinicalTrials.gov and WHO ICTRP) to 4 June 2019. We conducted a top-up search to 23 September 2021; we screened these search results and 42 studies meeting our eligibility criteria are available in the awaiting classification section.

SELECTION CRITERIA

We included randomised trials that assessed a QI programme to improve care in outpatient settings for people living with diabetes. QI programmes needed to evaluate at least one system- or provider-targeted QI strategy alone or in combination with a patient-targeted strategy. - System-targeted: case management (CM); team changes (TC); electronic patient registry (EPR); facilitated relay of clinical information (FR); continuous quality improvement (CQI). - Provider-targeted: audit and feedback (AF); clinician education (CE); clinician reminders (CR); financial incentives (FI). - Patient-targeted: patient education (PE); promotion of self-management (PSM); patient reminders (PR). Patient-targeted QI strategies needed to occur with a minimum of one provider or system-targeted strategy.

DATA COLLECTION AND ANALYSIS

We dual-screened search results and abstracted data on study design, study population and QI strategies. We assessed the impact of the programmes on 13 measures of diabetes care, including: glycaemic control (e.g. mean glycated haemoglobin (HbA1c)); cardiovascular risk factor management (e.g. mean systolic blood pressure (SBP), low-density lipoprotein cholesterol (LDL-C), proportion of people living with diabetes that quit smoking or receiving cardiovascular medications); and screening/prevention of microvascular complications (e.g. proportion of patients receiving retinopathy or foot screening); and harms (e.g. proportion of patients experiencing adverse hypoglycaemia or hyperglycaemia). We modelled the association of each QI strategy with outcomes using a series of hierarchical multivariable meta-regression models in a Bayesian framework. The previous version of this review identified that different strategies were more or less effective depending on baseline levels of outcomes. To explore this further, we extended the main additive model for continuous outcomes (HbA1c, SBP and LDL-C) to include an interaction term between each strategy and average baseline risk for each study (baseline thresholds were based on a data-driven approach; we used the median of all baseline values reported in the trials). Based on model diagnostics, the baseline interaction models for HbA1c, SBP and LDL-C performed better than the main model and are therefore presented as the primary analyses for these outcomes. Based on the model results, we qualitatively ordered each QI strategy within three tiers (Top, Middle, Bottom) based on its magnitude of effect relative to the other QI strategies, where 'Top' indicates that the QI strategy was likely one of the most effective strategies for that specific outcome. Secondary analyses explored the sensitivity of results to choices in model specification and priors.  Additional information about the methods and results of the review are available as Appendices in an online repository. This review will be maintained as a living systematic review; we will update our syntheses as more data become available.

MAIN RESULTS

We identified 553 trials (428 patient-randomised and 125 cluster-randomised trials), including a total of 412,161 participants. Of the included studies, 66% involved people living with type 2 diabetes only. Participants were 50% female and the median age of participants was 58.4 years. The mean duration of follow-up was 12.5 months. HbA1c was the commonest reported outcome; screening outcomes and outcomes related to cardiovascular medications, smoking and harms were reported infrequently. The most frequently evaluated QI strategies across all study arms were PE, PSM and CM, while the least frequently evaluated QI strategies included AF, FI and CQI. Our confidence in the evidence is limited due to a lack of information on how studies were conducted.  Four QI strategies (CM, TC, PE, PSM) were consistently identified as 'Top' across the majority of outcomes. All QI strategies were ranked as 'Top' for at least one key outcome. The majority of effects of individual QI strategies were modest, but when used in combination could result in meaningful population-level improvements across the majority of outcomes. The median number of QI strategies in multicomponent QI programmes was three.  Combinations of the three most effective QI strategies were estimated to lead to the below effects:  - PR + PSM + CE: decrease in HbA1c by 0.41% (credibility interval (CrI) -0.61 to -0.22) when baseline HbA1c < 8.3%; - CM + PE + EPR: decrease in HbA1c by 0.62% (CrI -0.84 to -0.39) when baseline HbA1c > 8.3%;  - PE + TC + PSM: reduction in SBP by 2.14 mmHg (CrI -3.80 to -0.52) when baseline SBP < 136 mmHg; - CM + TC + PSM: reduction in SBP by 4.39 mmHg (CrI -6.20 to -2.56) when baseline SBP > 136 mmHg;  - TC + PE + CM: LDL-C lowering of 5.73 mg/dL (CrI -7.93 to -3.61) when baseline LDL < 107 mg/dL; - TC + CM + CR: LDL-C lowering by 5.52 mg/dL (CrI -9.24 to -1.89) when baseline LDL > 107 mg/dL. Assuming a baseline screening rate of 50%, the three most effective QI strategies were estimated to lead to an absolute improvement of 33% in retinopathy screening (PE + PR + TC) and 38% absolute increase in foot screening (PE + TC + Other).

AUTHORS' CONCLUSIONS

There is a significant body of evidence about QI programmes to improve the management of diabetes. Multicomponent QI programmes for diabetes care (comprised of effective QI strategies) may achieve meaningful population-level improvements across the majority of outcomes. For health system decision-makers, the evidence summarised in this review can be used to identify strategies to include in QI programmes. For researchers, this synthesis identifies higher-priority QI strategies to examine in further research regarding how to optimise their evaluation and effects. We will maintain this as a living systematic review.

Behavioural change interventions encouraging clinicians to reduce carbon emissions in clinical activity: a systematic review

BACKGROUND

Clinical activity accounts for 70-80% of the carbon footprint of healthcare. A critical component of reducing emissions is shifting clinical behaviour towards reducing, avoiding, or replacing carbon-intensive healthcare. The objective of this systematic review was to find, map and assess behaviour change interventions that have been implemented in healthcare settings to encourage clinicians to reduce greenhouse gas emissions from their clinical activity.

METHODS

Studies eligible for inclusion were those reporting on a behaviour change intervention to reduce carbon emissions via changes in healthcare workplace behaviour. Six databases were searched in November 2021 (updated February 2022). A pre-determined template was used to extract data from the studies, and risk of bias was assessed. The behaviour change techniques (BCTs) used in the interventions were coded using the BCT Taxonomy.

RESULTS

Six full-text studies were included in this review, and 14 conference abstracts. All studies used a before-after intervention design. The majority were UK studies (n = 15), followed by US (n = 3) and Australia (n = 2). Of the full-text studies, four focused on reducing the emissions associated with anaesthesia, and two aimed at reducing unnecessary test ordering. Of the conference abstracts, 13 focused on anaesthetic gas usage, and one on respiratory inhalers. The most common BCTs used were social support, salience of consequences, restructuring the physical environment, prompts and cues, feedback on outcome of behaviour, and information about environmental consequences. All studies reported success of their interventions in reducing carbon emissions, prescribing, ordering, and financial costs; however, only two studies reported the magnitude and significance of their intervention's success. All studies scored at least one item as unclear or at risk of bias.

CONCLUSION

Most interventions to date have targeted anaesthesia or pathology test ordering in hospital settings. Due to the diverse study outcomes and consequent inability to pool the results, this review is descriptive only, limiting our ability to conclude the effectiveness of interventions. Multiple BCTs were used in each study but these were not compared, evaluated, or used systematically. All studies lacked rigour in study design and measurement of outcomes.

REVIEW REGISTRATION

The study was registered on Prospero (ID number CRD42021272526) (Breth-Petersen et al., Prospero 2021: CRD42021272526).

Characterizing the Gaps Between Best-Practice Implementation Strategies and Real-world Implementation: Qualitative Study Among Family Physicians Who Engaged With Audit and Feedback Reports

BACKGROUND

In Ontario, Canada, a government agency known as Ontario Health is responsible for making audit and feedback reports available to all family physicians to encourage ongoing quality improvement. The confidential report provides summary data on 3 key areas of practice: safe prescription, cancer screening, and diabetes management.

OBJECTIVE

This report was redesigned to improve its usability in line with evidence. The objective of this study was to explore how the redesign was perceived, with an emphasis on recipients' understanding of the report and their engagement with it.

METHODS

We conducted qualitative semistructured interviews with family physicians who had experience with both versions of the report recruited through purposeful and snowball sampling. We analyzed the transcripts following an emergent and iterative approach.

RESULTS

Saturation was reached after 17 family physicians participated. In total, 2 key themes emerged as factors that affected the perceived usability of the report: alignment between the report and the recipients' expectations and capacity to engage in quality improvement. Family physicians expected the report and its quality indicators to reflect best practices and to be valid and accurate. They also expected the report to offer feedback on the clinical activities they perceived to be within their control to change. Furthermore, family physicians expected the goal of the report to be aligned with their perspective on feasible quality improvement activities. Most of these expectations were not met, limiting the perceived usability of the report. The capacity to engage with audit and feedback was hindered by several organizational and physician-level barriers, including the lack of fit with the existing workflow, competing priorities, time constraints, and insufficient skills for bridging the gaps between their data and the corresponding desired actions.

CONCLUSIONS

Despite recognized improvements in the design of the report to better align with best practices, it was not perceived as highly usable. Improvements in the presentation of the data could not overcome misalignment with family physicians' expectations or the limited capacity to engage with the report. Integrating iterative evaluations informed by user-centered design can complement evidence-based guidance for implementation strategies. Creating a space for bringing together audit and feedback designers and recipients may help improve usability and effectiveness.

Using Health Behavior Theory to Address COVID-19 Vaccine Hesitancy: A Scoping Review of Communication and Messaging Interventions

Vaccine hesitancy has been among the most vexing challenges during the COVID-19 pandemic, ultimately leading to maladaptive health behaviors such as vaccine delay and refusal. A variety of approaches have been employed to address this problem, including communication and messaging interventions targeting the underlying determinants of vaccine hesitancy. However, there exists no published evidence synthesis examining how such interventions are using health behavior theory to address COVID-19 vaccine hesitancy. The purpose of this study was to conduct a scoping review of health communication and messaging interventions aimed at addressing COVID-19 vaccine hesitancy, and to systematically evaluate the use of health behavior theory in the design of these interventions. The review followed a five-step iterative framework proposed by Levac and colleagues. Comprehensive searches using an exhaustive list of keyword combinations were used across three online databases to identify articles to screen for inclusion. A structured, validated coding scheme was then applied to assess the use of health behavior theory. Additional study data were extracted using a separate structured form. A total of 36 articles published between January 2020 and February 2022 met inclusion criteria and were included in the review. Ten studies (27.7%) did not mention or use health behavior theory at all. Most studies (n = 26) at least mentioned theory or theory-relevant constructs, with 26 different theories and 52 different theoretical constructs represented in the sample. Although theory and theoretical determinants of vaccination behavior were often mentioned, few studies used theory to specify and target causal pathways of behavior change, and only one study targeted misinformation as a determinant of vaccine hesitancy. The findings from this review provide critical insight into the state of theory-based intervention design and point to significant gaps in the literature to prioritize in future research.

Automated Digital Interventions and Smoking Cessation: Systematic Review and Meta-analysis Relating Efficiency to a Psychological Theory of Intervention Perspective

BACKGROUND

Smoking remains a highly significant preventable global public health problem. In this context, digital interventions offer great advantages in terms of a lack of biological side effects, possibility of automatic delivery, and consequent human resource savings relative to traditional interventions. Such interventions have been studied in randomized controlled trials (RCTs) but have not been systematically reviewed with the inclusion of text-based and multiplatform-based interventions. In addition, this area has not been evaluated from the perspective of the psychological theoretical basis of intervention.

OBJECTIVE

The aim of this paper is to assess the efficiency of digital interventions in RCT studies of smoking cessation and to evaluate the effectiveness of the strategies used for digital interventions.

METHODS

An electronic search of RCTs was conducted using PubMed, Embase, and the Cochrane Library by June 30, 2021. Eligible studies had to compare automated digital intervention (ADI) to the use of a self-help guideline or no intervention. Participants were current smokers (aged 16 years or older). As the main outcome, abstinence after endpoint was extracted from the studies. Systematic review and meta-analysis were conducted to assess the efficiency of ADIs. Metaregressions were conducted to assess the relationship between intervention theory and effectiveness.

RESULTS

A total of 19 trials (15,472 participants) were included in the analysis. The overall abstinence rate (95% CI) at the endpoint was 17.8% (17.0-18.7). The overall risk ratio of the intervention group compared to the controls at the endpoint was 17.8% (17.0-18.7). Cochrane risk-of-bias tool for randomized trials (ROB 2) suggested that most of the studies had a low risk of bias (56.3%). Psychological theory-related constructs or predictors, which refer to other theory-based concepts (rather than only behavioral theory) such as craving or anxiety, are associated with effectiveness.

CONCLUSIONS

This study found that ADI had a clear positive effect compared to self-help guidelines or to no intervention, and effectiveness was associated with theory-related constructs or predictors. ADIs should be promoted by policy makers and clinical practitioners to address the huge gap between the need for smoking cessation and availability of traditional treatment resources. Possible increases in ADI efficiency may be achieved by optimally integrating psychotherapeutic theories and techniques.

TRIAL REGISTRATION

PROSPERO CRD42021256593; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=256593.

'Give me something meaningful': GPs perspectives on how to improve an audit and feedback report provided by health insurers - an exploratory qualitative study

BACKGROUND

Audit and feedback (A&F) is a valuable quality improvement strategy, which can contribute to de-implementation of low-value care. In the Netherlands, all health insurers collaboratively provide A&F to general practitioners (GPs), the 'Primary Care Practice Report' (PCPR). Unfortunately, the use of this report by GPs is limited. This study examined the thoughts of GPs on the usability of the PCPR and GPs recommendations for improving the PCPR.

METHOD

We used an interpretative qualitative design, with think-aloud tasks to uncover thoughts of GPs on the usability of the PCPR and semistructured interview questions to ask GPs' recommendations for improvement of the PCPR. Interviews were audiorecorded and transcribed ad verbatim. Data were analysed using thematic content analysis.

RESULTS

We identified two main themes: 'poor usability of the PCPR', and 'minimal motivation to change based on the PCPR'. The GPs found the usability of the PCPR poor due to the feedback not being clinically meaningful, the data not being recent, individual and reliable, the performance comparators offer insufficient guidance to assess clinical performance, the results are not discussed with peers and the definitions and visuals are unclear. The GPs recommended improving these issues. The GPs motivation to change based on the PCPR was minimal.

CONCLUSIONS

The GPs evaluated the PCPR as poorly usable and were minimally motivated to change. The PCPR seems developed from the perspective of the reports' commissioners, health insurers, and does not meet known criteria for effective A&F design and user-centred design. Importantly, the GPs did state that well-designed feedback could contribute to their motivation to improve clinical performance.Furthermore, the GPs stated that they receive a multitude of A&F reports, which they hardly use. Thus, we see a need for policy makers to invest in less, but more usable A&F reports.

The Influence of Health Behavior Theory on Implementation Practice and Science: Brief Review and Commentary

As research defines new treatments and policies to improve the health of patients, an increasing challenge has been to translate these insights into routine clinical practice to benefit patients and society. An important exploration is how theories of human behavior change fit into the science of implementation and quality improvement. In this paper, we begin with a brief review of the intellectual roots of implementation science and quality improvement, followed by a discussion of how theories and principles of behavior change can inform both goals and challenges in using behavior change theories. The insights offered through health behavior change theory have led to changes in how we plan for implementation and select, develop, design and tailor implementation interventions and strategies. While the degree to which organizational and external contexts influence the behavior of providers in these organizations varies widely, some degree of context external to the individual is important and needs adequate consideration. In short, health behavior change theory is essential but not sufficient to integrate in most implementation efforts, where priority must be given to both individual factors and contexts in which individuals operate.

Anaesthesia personnels' perspectives on digital anaesthesia information management systems - a qualitative study

Background

In Norway, the anaesthesia team normally consists of a nurse anaesthetist and an anaesthetist. Digital anesthesia information management systems (AIMS) that collect patient information directly from the anaesthesia workstation, and transmit the data into documentation systems have recently been implemented in Norway. Earlier studies have indicated that implementation of digital AIMS impacts the clinical workflow patterns and distracts the anaesthesia providers. These studies have mainly had a quantitative design and focused on functionality, installation designs, benefits and challenges associated with implementing and using AIMS. Hence, the aim of this study was to qualitatively explore anaesthesia personnel’s perspectives on implementing and using digital AIMS.

Methods

The study had an exploratory and descriptive design. The study was conducted within three non-university hospitals in Southern Norway. Qualitative, individual interviews with nurse anaesthetists (n = 9) and anaesthetists (n = 9) were conducted in the period September to December 2020. Data were analysed using qualitative content analysis according to the recommendations of Graneheim and Lundman.

Results

Four categories were identified: 1) Balance between clinical assessment and monitoring, 2) Vigilance in relation to the patient, 3) The nurse-physician collaboration, and 4) Software issues. Participants described that anaesthesia included a continuous balance between clinical assessment and monitoring. They experienced that the digital AIMS had an impact on their vigilance in relation to the patient during anaesthesia. The digital AIMS affected the nurse-physician collaboration. Moreover, participants emphasised a lack of user participation and aspects of user-friendliness regarding the implementation of digital AIMS.

Conclusion

Digital AIMS impacts vigilance in relation to the patient. Hence, collaboration and acceptance of the mutual responsibility between nurse anaesthetists and anaesthetists for both clinical observation and digital AIMS administration is essential. Anaesthesia personnel should be included in development and implementation processes to facilitate implementation.

Evaluating implementation strategies to support documentation of veterans' care preferences

OBJECTIVE

To evaluate the effectiveness of feedback reports and feedback reports + external facilitation on completion of life-sustaining treatment (LST) note the template and durable medical orders. This quality improvement program supported the national roll-out of the Veterans Health Administration (VA) LST Decisions Initiative (LSTDI), which aims to ensure that seriously-ill veterans have care goals and LST decisions elicited and documented.

DATA SOURCES

Primary data from national databases for VA nursing homes (called Community Living Centers [CLCs]) from 2018 to 2020.

STUDY DESIGN

In one project, we distributed monthly feedback reports summarizing LST template completion rates to 12 sites as the sole implementation strategy. In the second involving five sites, we distributed similar feedback reports and provided robust external facilitation, which included coaching, education, and learning collaboratives. For each project, principal component analyses matched intervention to comparison sites, and interrupted time series/segmented regression analyses evaluated the differences in LSTDI template completion rates between intervention and comparison sites.

DATA COLLECTION METHODS

Data were extracted from national databases in addition to interviews and surveys in a mixed-methods process evaluation.

PRINCIPAL FINDINGS

LSTDI template completion rose from 0% to about 80% throughout the study period in both projects' intervention and comparison CLCs. There were small but statistically significant differences for feedback reports alone (comparison sites performed better, coefficient estimate 3.48, standard error 0.99 for the difference between groups in change in trend) and feedback reports + external facilitation (intervention sites performed better, coefficient estimate -2.38, standard error 0.72).

CONCLUSIONS

Feedback reports + external facilitation was associated with a small but statistically significant improvement in outcomes compared with comparison sites. The large increases in completion rates are likely due to the well-planned national roll-out of the LSTDI. This finding suggests that when dissemination and support for widespread implementation are present and system-mandated, significant enhancements in the adoption of evidence-based practices may require more intensive support.

Efficacy of a theory-driven program to implement alcohol screening and brief interventions in primary health-care: a cluster randomized controlled trial

BACKGROUND AND AIMS

Screening and brief interventions (SBI) in primary health-care practices (PHCP) are effective in reducing reported alcohol consumption, but have not been routinely implemented. Most programs seeking to improve implementation rates have lacked a theoretical rationale. This study aimed to test whether a theory-based intervention for PHCPs could significantly increase alcohol SBI delivery.

DESIGN

Two-arm, cluster-randomized controlled, parallel, 12-month follow-up, trial.

SETTING

PHCPs in Portugal.

PARTICIPANTS

Staff from 12 PHCPs (n = 222, 81.1% women): nurses (35.6%), general practitioners (28.8%), receptionists (26.1%) and family medicine residents (9.5%); patients screened for alcohol use: intervention n = 8062; controls n = 58.

INTERVENTION AND COMPARATOR

PHCPs were randomized to receive a training and support program (n = 6; 110 participants) tailored to the barriers and facilitators for implementing alcohol SBIs following the principles of the Behavior Change Wheel/Theoretical Domains Framework approach, or to a waiting-list control (n = 6; 112 participants). Training was delivered over the first 12 weeks of the trial.

MEASUREMENTS

The primary outcome was the proportion of eligible patients screened (unit of analysis: patient list). Secondary outcomes included the brief intervention (BI) rate per screen-positive patient and the population-based BI rate (unit of analysis: patient list), and changes in health providers' perceptions of barriers to implementation and alcohol-related knowledge (unit of analysis: health provider).

FINDINGS

The implementation program had a significant effect on the screening activity in the intervention practices compared with control practices at the 12-month follow-up (21.7% vs. 0.16%, intention-to-treat analysis, p = 0.003). Although no significant difference was found on the BI rate per screen-positive patient (intervention 85.7% vs. control 63.6%, p = 0.55, Bayes factor = 0.28), the intervention was effective in increasing the population-based BI rate (intervention 0.69% vs. control 0.02%, p = 0.006). Health providers in the intervention arm reported fewer barriers to SBI implementation and higher levels of alcohol-related knowledge at 12-month follow-up than those in control practices.

CONCLUSION

A theory-based implementation program, which included training and support activities, significantly increased alcohol screening and population-based brief intervention rates in primary care.

Improving the Development and Implementation of Audit and Feedback Systems to Support Health Care Workers in Limiting Antimicrobial Resistance in the Hospital: Scoping Review

BACKGROUND

For eHealth technologies in general and audit and feedback (AF) systems specifically, integrating interdisciplinary theoretical underpinnings is essential, as it increases the likelihood of achieving desired outcomes by ensuring a fit among eHealth technology, stakeholders, and their context. In addition, reporting on the development and implementation process of AF systems, including substantiations of choices, enables the identification of best practices and accumulation of knowledge across studies but is often not elaborated on in publications.

OBJECTIVE

This scoping review aims to provide insights into the development and implementation strategies for AF systems for a real-world problem that threatens modern health care-antimicrobial resistance-and provide an interdisciplinary conceptual framework that can serve as a checklist and guidance for making informed choices in the development and implementation of future AF systems.

METHODS

A scoping review was conducted by querying PubMed, Scopus, Web of Science, IEEE Xplore Digital Library, and Embase (≥2010) for studies describing either the development or implementation process, or both, of an AF system for antimicrobial resistance or infections in hospitals. Studies reporting only on effectiveness or impact were excluded. A total of 3 independent reviewers performed the study selection, and 2 reviewers constructed the conceptual framework through the axial and selective coding of often-used theories, models, and frameworks (TMFs) from the literature on AF and eHealth development and implementation. Subsequently, the conceptual framework was used for the systematic extraction and interpretation of the studies' descriptions of AF systems and their development and implementation.

RESULTS

The search resulted in 2125 studies that were screened for eligibility, of which 12 (0.56%); 2012-2020) were included. These studies described the development and implementation processes heterogeneously in terms of study aims, study targets, target groups, methods, and theoretical underpinnings. Few studies have explicitly explained how choices for the development and implementation of AF systems were substantiated by the TMFs. The conceptual framework provided insights into what is reported on the development and implementation process and revealed underreported AF system constructs (eg, AF system design; engagement with the AF system; and comparison, goal setting, and action planning) and development and implementation (eg, champions) constructs.

CONCLUSIONS

This scoping review showed the current heterogeneous reporting of AF systems and their development and implementation processes and exemplified how interdisciplinary TMFs can (and should) be balanced in a conceptual framework to capture relevant AF systems and development and implementation constructs. Thereby, it provides a concrete checklist and overall guidance that supports the professionalization and harmonization of AF system development and implementation. For the development and implementation of future AF systems and other eHealth technologies, researchers and health care workers should be supported in selecting and integrating TMFs into their development and implementation process and encouraged to explicitly report on theoretical underpinnings and the substantiation of choices.

Healthcare professionals' perspective on delivering personalised and holistic care: using the Theoretical Domains Framework

Background

Interventions to improve personalised and holistic care delivery by healthcare professionals are more likely to be effective if they target the factors influencing specific behaviours. This study reports on the development and testing of a questionnaire to identify perspectives of healthcare professionals’ personalised and holistic care behaviours based on the Theoretical Domains Framework.

Methods

The study was conducted in public health services in Victoria, Australia. The questionnaire was developed and pilot-tested with behaviour change researchers and healthcare professionals. Doctors, nurses and midwives were recruited via notices and email invitations from Safer Care Victoria's website and mailing lists of healthcare professionals and invited to completed the questionnaire online (hosted on Qualtrics). Health services administrators and allied health professionals were excluded from the study. Confirmatory factor analysis was undertaken to generate the model of best fit and group differences were tested using univariate tests.

Results

One hundred and four healthcare professionals from public health services in Victoria, Australia, completed the 39-item questionnaire focusing on specific personalised and holistic care behaviours. The final model consisted of 13 factors and 39 items, and CFA produced an acceptable fit, as well as adequate levels of discriminant validity and internal consistency (α = 0.60 to 0.84). Seven domains, “social influence”, “motivation & goals”, “environmental context and resources’, “skills”, ‘beliefs about consequences”, “behaviour regulation” and “nature of behaviour” were identified. Significant differences in the factors influencing these behaviours were found in groups with different years of experience and role seniority. These findings suggest that future interventions need to be targeted to specific groups.

Conclusion

This study identified the specific behaviours and the factors associated with performance of personalised and holistic care among healthcare professionals. The findings suggest several interventions and policy functions may be taken to improve personalised and holistic care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-07630-1.

Enhanced feedback interventions to promote evidence-based blood transfusion guidance and reduce unnecessary use of blood components: the AFFINITIE research programme including two cluster factorial RCTs

Background

Blood transfusion is a common but costly treatment. Repeated national audits in the UK suggest that up to one-fifth of transfusions are unnecessary when judged against recommendations for good clinical practice. Audit and feedback seeks to improve patient care and outcomes by comparing clinical care against explicit standards. It is widely used internationally in quality improvement. Audit and feedback generally has modest but variable effects on patient care. A considerable scope exists to improve the impact that audit and feedback has, particularly through head-to-head trials comparing different ways of delivering feedback.

Objectives

The AFFINITIE (Development & Evaluation of Audit and Feedback INterventions to Increase evidence-based Transfusion practIcE) programme aimed to design and evaluate enhanced feedback interventions, within a national blood transfusion audit programme, to promote evidence-based guidance and reduce the unnecessary use of blood components. We developed, piloted and refined two feedback interventions, ‘enhanced content’ and ‘enhanced follow-on’ (workstream 1), evaluated the effectiveness and cost-effectiveness of the two feedback interventions compared with standard feedback practice (workstream 2), examined intervention fidelity and contextual influences (workstream 3) and developed general implementation recommendations and tools for other audit and feedback programmes (workstream 4).

Design

Interviews, observations and documentary analysis in four purposively sampled hospitals explored contemporary practice and opportunities for strengthening feedback. We developed two interventions: ‘enhanced content’, to improve the clarity and utility of feedback reports, and ‘enhanced follow-on’, to help hospital staff with action-planning (workstream 1). We conducted two linked 2 × 2 factorial cross-sectional cluster-randomised trials within transfusion audits for major surgery and haematological oncology, respectively (workstream 2). We randomised hospital clusters (the organisational level at which hospital transfusion teams operate) to enhanced or standard content or enhanced or standard follow-on. Outcome assessment was masked to assignment. Decision-analytic modelling evaluated the costs, benefits and cost-effectiveness of the feedback interventions in both trials from the perspective of the NHS. A parallel process evaluation used semistructured interviews, documentary analyses and web analytics to assess the fidelity of delivery, receipt and enactment and to identify contextual influences (workstream 3). We explored ways of improving the impact of national audits with their representatives (workstream 4).

Setting and participants

All NHS hospital trusts and health boards participating in the National Comparative Audit of Blood Transfusions were invited to take part. Among 189 hospital trusts and health boards screened, 152 hospital clusters participated in the surgical audit. Among 187 hospital trusts and health boards screened, 141 hospital clusters participated in the haematology audit.

Interventions

‘Enhanced content’ aimed to ensure that the content and format of feedback reports were consistent with behaviour change theory and evidence. ‘Enhanced follow-on’ comprised a web-based toolkit and telephone support to facilitate local dissemination, planning and response to feedback.

Main outcome measures

Proportions of acceptable transfusions, based on existing evidence and guidance and algorithmically derived from national audit data.

Data sources

Trial primary outcomes were derived from manually collected, patient-level audit data. Secondary outcomes included routinely collected data for blood transfusion.

Results

With regard to the transfusions in the major surgery audit, 135 (89%) hospital clusters participated from 152 invited. We randomised 69 and 66 clusters to enhanced and standard content, respectively, and 68 and 67 clusters to enhanced and standard follow-on, respectively. We analysed a total of 2222 patient outcomes at 12 months in 54 and 58 (enhanced and standard content, respectively) and 54 and 58 (enhanced and standard follow-on, respectively) hospital clusters. With regard to the haematology audit, 134 hospital clusters (95%) participated from 141 invited. We randomised 66 and 68 clusters to enhanced and standard content, respectively, and 67 clusters to both enhanced and standard follow-on. We analysed a total of 3859 patient outcomes at 12 months in 61 and 61 (enhanced and standard content, respectively) and 63 and 59 (enhanced and standard follow-on) hospital clusters. We found no effect of either of the enhanced feedback interventions in either trial across all outcomes. Incremental enhanced intervention costs ranged from £18 to £248 per site. The enhanced feedback interventions were dominated by the standard intervention in cost-effectiveness analyses. The interventions were delivered as designed and intended, but subsequent local engagement was low. Although the enhancements were generally acceptable, doubts about the credibility of the blood transfusion audits undermined the case for change.

Limitations

Limitations included the number of participating clusters; loss to follow-up of trial clusters, reducing statistical power and validity; incomplete audit and cost data contributing to outcome measures; participant self-selection; reporting; missing data related to additional staff activity generated in response to receiving feedback; and recall biases in the process evaluation interviews.

Conclusions

The enhanced feedback interventions were acceptable to recipients but were more costly and no more effective than standard feedback in reducing unnecessary use of blood components, and, therefore, should not be recommended on economic grounds.

Future work

We have demonstrated the feasibility of embedding ambitious large-scale rigorous research within national audit programmes. Further head-to-head comparisons of different feedback interventions are needed in these programmes to identify cost-effective ways of increasing the impact of the interventions.

Trial registration

This trial is registered as ISRCTN15490813.

Funding

This project was funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research programme and will be published in full in Programme Grants for Applied Research; Vol. 10, No. 2. See the NIHR Journals Library website for further project information.

How can behavioural science contribute to qualitative research on antimicrobial stewardship in primary care?

Antibiotic use (and misuse) accelerates antimicrobial resistance (AMR), and addressing this complex problem necessitates behaviour change related to infection prevention and management and to antibiotic prescribing and use. As most antibiotic courses are prescribed in primary care, a key focus of antimicrobial stewardship (AMS) is on changing behaviours outside of hospital. Behavioural science draws on behaviour change theories, techniques and methods developed in health psychology, and can be used to help understand and change behaviours related to AMR/AMS. Qualitative methodologies can be used together with a behavioural science approach to explore influences on behaviour and develop and evaluate behavioural interventions. This paper provides an overview of how the behavioural science approach, together with qualitative methods, can contribute and add value to AMS projects. First, it introduces and explains the relevance of the behavioural science approach to AMR/AMS. Second, it provides an overview of behaviour change 'tools': behaviour change theories/models, behavioural determinants and behaviour change techniques. Third, it explains how behavioural methods can be used to: (i) define a clinical problem in behavioural terms and identify behavioural influences; (ii) develop and implement behavioural AMS interventions; and (iii) evaluate them. These are illustrated with examples of using qualitative methods in AMS studies in primary care. Finally, the paper concludes by summarizing the main contributions of taking the behavioural science approach to qualitative AMS research in primary care and discussing the key implications and future directions for research and practice.

Effectiveness of Enhanced Performance Feedback on Appropriate Use of Blood Transfusions: A Comparison of 2 Cluster Randomized Trials

IMPORTANCE

Auditing and feedback are frequently used to improve patient care. However, it remains unclear how to optimize feedback effectiveness for the appropriate use of treatments such as blood transfusion, a common but costly procedure that is more often overused than underused.

OBJECTIVE

To evaluate 2 theoretically informed feedback interventions to improve the appropriate use of blood transfusions.

DESIGN, SETTING, AND PARTICIPANTS

Two sequential, linked 2 × 2 cluster randomized trials were performed in hospitals in the UK participating in national audits of transfusion for perioperative anemia and management of hematological disorders. Data were collected for a surgical trial from October 1, 2014, to October 31, 2016, with follow-up completed on October 31, 2016. Data were collected for a hematological trial through follow-up from July 1, 2015, to June 30, 2017. Trial data were analyzed from November 1, 2016, to June 1, 2019.

INTERVENTIONS

Hospitals were randomized to standard content or enhanced content to improve feedback clarity and usability and to standard support or enhanced support for staff to act on feedback.

MAIN OUTCOMES AND MEASURES

The primary end point was appropriateness of transfusions audited at 12 months. Secondary end points included volume of transfusions (aiming for reductions at patient and cluster levels) and transfusion-related adverse events and reactions.

RESULTS

One hundred thirty-five of 152 eligible clusters participated in the surgical audit (2714 patients; mean [SD] age, 74.9 [14.0] years; 1809 women [66.7%]), and 134 of 141 participated in the hematological audit (4439 patients; median age, 72.0 [IQR, 64.0-80.0] years; 2641 men [59.5%]). Fifty-seven of 69 clusters (82.6%) in the surgical audit randomized to enhanced content downloaded reports compared with 52 of 66 clusters (78.8%) randomized to standard reports. Fifty-nine of 68 clusters (86.8%) randomized to enhanced support logged onto the toolkit. The proportion of patients with appropriate transfusions was 0.184 for standard content and 0.176 for enhanced content (adjusted odds ratio [OR], 0.91 [97.5% CI, 0.61-1.36]) and 0.181 for standard support and 0.180 for enhanced support (adjusted OR, 1.05 [97.5% CI, 0.68-1.61]). For the hematological audit, 53 of 66 clusters (80.3%) randomized to enhanced content downloaded the reports compared with 53 of 68 clusters (77.9%) randomized to standard content. Forty-nine of 67 clusters sites (73.1%) assigned to enhanced support logged into the toolkit at least once. The proportion of patients with appropriate transfusions was 0.744 for standard content and 0.714 for enhanced content (adjusted OR, 0.81 [97.5% CI, 0.56-1.12]), and 0.739 for standard support and 0.721 for enhanced support (adjusted OR, 0.96 [97.5% CI, 0.67-1.38]).

CONCLUSIONS AND RELEVANCE

This comparison of cluster randomized trials found that interventions to improve feedback usability and guide local action were no more effective than standard feedback in increasing the appropriate use of blood transfusions. Auditing and feedback delivered at scale is a complex and costly program; therefore, effective responses may depend on developing robust local quality improvement arrangements, which can be evaluated using rigorous experimental designs embedded within national programs.

TRIAL REGISTRATION

isrctn.org Identifier: ISRCTN15490813.

Evaluations of Continuing Health Provider Education Focused on Opioid Prescribing: A Scoping Review

PURPOSE

Continuing health provider education (HPE) is an important intervention supported by health policy to counter the opioid epidemic; knowledge regarding appropriate program design and evaluation is lacking. The authors aim to provide a comprehensive understanding of evaluations of opioid-related continuing HPE programs and their appropriateness as interventions to improve population health.

METHOD

In January 2020, the authors conducted a systematic search of 7 databases, seeking studies of HPE programs on opioid analgesic prescribing and overdose prevention. Reviewers independently screened the titles and abstracts of all studies and then assessed the full texts of all studies potentially eligible for inclusion. The authors extracted a range of data using categories for evaluating complex programs: the use of theory, program purpose, inputs, activities, outputs, outcomes, and industry involvement. Results were reported in a narrative synthesis.

RESULTS

Thirty-nine reports on 32 distinct HPE programs met inclusion criteria. Of these 32, 31 (97%) were U.S./Canadian programs and 28 (88%) were reported after 2010. Measurements of changes in knowledge and confidence were common. Performance outcomes were less common and typically self-reported. Most studies (n = 27 [84%]) used concerns of opioid-related harms at the population health level to justify the educational intervention, but only 5 (16%) measured patient- or population-level outcomes directly related to the educational programs. Six programs (19%) had direct or indirect opioid manufacturer involvement.

CONCLUSIONS

Continuing HPE has been promoted as an important means of addressing population-level opioid-related harms by policymakers and educators, yet published evaluations of HPE programs focusing on opioid analgesics inadequately evaluate patient- or population-level outcomes. Instead, they primarily focus on self-reported performance outcomes. Conceptual models are needed to guide the development and evaluation of continuing HPE programs intended to have population health benefits.

Development and evaluation of the red flag campaign for the primary prevention of sexual and dating violence on college campuses

Objective Sexual and dating violence (SV/DV) on college campuses is a pervasive problem with far-reaching implications for public health. This paper describes the development and evaluation of a widely disseminated SV/DV primary prevention program, the Red Flag Campaign (RFC). Participants and Methods: An online survey was administered to 203 freshmen at a southeastern US university, of whom 82% reported exposure to the RFC in the previous month. Results: College students exposed to the RFC reported greater efficacy for intervening as a bystander compared to those students who were not exposed. These results held when looking at exposure to RFC messages specifically, but not RFC events. Conclusions: This evaluation offers preliminary evidence that the RFC is effective at increasing determinants of prosocial bystander behavior, the enactment of which could reduce SV/DV on college campuses. Implications and recommendations for college personnel implementing the RFC are discussed.

Performance feedback on the quality of care in hospitals performing thrombectomy for ischemic stroke (PERFEQTOS): protocol of a stepped wedge cluster randomized trial

Background

Although the provision of performance feedback to healthcare professionals based on data from quality registries is common practice in many fields of medicine, observational studies of its effect on the quality of care have shown mixed results. The objective of this study is to evaluate the effect of performance feedback on the quality of care for acute ischemic stroke.

Methods

PERFEQTOS is a stepped wedge cluster randomized trial in 13 hospitals in the Netherlands providing endovascular thrombectomy for ischemic stroke. The primary outcome is the hospital’s door-to-groin time. The study starts with a 6-month period in which none of the hospitals receives the performance feedback intervention. Subsequently, every 6 months, three or four hospitals are randomized to cross over from the control to the intervention conditions, until all hospitals receive the feedback intervention. The feedback intervention consists of a dashboard with quarterly reports on patient characteristics, structure, process, and outcome indicators related to patients with ischemic stroke treated with endovascular thrombectomy. Hospitals can compare their present performance with their own performance in the past and with other hospitals. The performance feedback is provided to local quality improvement teams in each hospital, who define their own targets on specific indicators and develop performance improvement plans. The impact of the performance feedback and improvement plans will be evaluated by comparing the primary outcome before and after the intervention.

Discussion

This study will provide evidence on the effectiveness of performance feedback to healthcare providers. The results will be actively disseminated through peer-reviewed journals, conference presentations, and various stakeholder engagement activities.

Trial registration

Netherlands Trial Register NL9090. Registered on December 3, 2020

Supplementary Information

The online version contains supplementary material available at 10.1186/s13063-021-05819-z.

Nonlinear Associations Between Cumulative Dietary Risk Factors and Cardiovascular Diseases, Cancer, and All-Cause Mortality: A Prospective Cohort Study From UK Biobank

OBJECTIVE

To develop a score from cumulative dietary risk factors and examine its nonlinear associations with cardiovascular disease (CVD) and cancer incidence and mortality, as well as all-cause mortality.

PATIENTS AND METHODS

There were 422,702 participants from UK Biobank included in this prospective study. Cumulative dietary risk factors were represented using a score ranging from 0 (healthiest) to 9 (least healthy). This was derived from 9 food items based on current UK guidelines using baseline data. Associations between the cumulative score and health outcomes were investigated using nonlinear penalized cubic splines fitted in Cox proportional hazard models. Follow-up was conducted until June 2020 for mortality, and for incidence, up to June 2020 in England and March 2017 in Wales and Scotland.

RESULTS

The median follow-up period was 9.0 years for incidence outcomes and 9.3 years for mortality outcomes. Each 1-point increment in the cumulative dietary risk factors score was associated with higher risk for incidence and mortality of the outcomes studied. The highest risks were identified for mortality due to heart failure (8.0% higher), CVD, and ischemic heart disease (both 7.0% higher). In addition, a higher diet score accounted for 18.8% of all deaths, 4.47% of incident cases of CVD, 25.5% of CVD deaths, 7.7% of incident cancers, and 18.2% of all cancer deaths.

CONCLUSION

Our findings show that dietary risk factors contributed to a large proportion of CVD and cancer events, as well as deaths, among those who did not meet most dietary recommendations.

Practice nurse-supported weight self-management delivered within the national child immunisation programme for postnatal women: a feasibility cluster RCT

BACKGROUND

Pregnancy is a high-risk time for excessive weight gain. The rising prevalence of obesity in women, combined with excess weight gain during pregnancy, means that there are more women with obesity in the postnatal period. This can have adverse health consequences for women in later life and increases the health risks during subsequent pregnancies.

OBJECTIVE

The primary aim was to produce evidence of whether or not a Phase III trial of a brief weight management intervention, in which postnatal women are encouraged by practice nurses as part of the national child immunisation programme to self-monitor their weight and use an online weight management programme, is feasible and acceptable.

DESIGN

The research involved a cluster randomised controlled feasibility trial and two semistructured interview studies with intervention participants and practice nurses who delivered the intervention. Trial data were collected at baseline and 3 months later. The interview studies took place after trial follow-up.

SETTING

The trial took place in Birmingham, UK.

PARTICIPANTS

Twenty-eight postnatal women who were overweight/obese were recruited via Birmingham Women's Hospital or general practices. Nine intervention participants and seven nurses were interviewed.

INTERVENTIONS

The intervention was delivered in the context of the national child immunisation programme. The intervention group were offered brief support that encouraged self-management of weight when they attended their practice to have their child immunised at 2, 3 and 4 months of age. The intervention involved the provision of motivation and support by nurses to encourage participants to make healthier lifestyle choices through self-monitoring of weight and signposting to an online weight management programme. The role of the nurse was to provide regular external accountability for weight loss. Women were asked to weigh themselves weekly and record this on a record card in their child's health record ('red book') or using the online programme. The behavioural goal was for women to lose 0.5-1 kg per week. The usual-care group received a healthy lifestyle leaflet.

MAIN OUTCOME MEASURES

The primary outcome was the feasibility of a Phase III trial to test the effectiveness of the intervention, as assessed against three traffic-light stop-go criteria (recruitment, adherence to regular self-weighing and registration with an online weight management programme).

RESULTS

The traffic-light criteria results were red for recruitment (28/80, 35% of target), amber for registration with the online weight loss programme (9/16, 56%) and green for adherence to weekly self-weighing (10/16, 63%). Nurses delivered the intervention with high fidelity. In the qualitative studies, participants indicated that the intervention was acceptable to them and they welcomed receiving support to lose weight at their child immunisation appointments. Although nurses raised some caveats to implementation, they felt that the intervention was easy to deliver and that it would motivate postnatal women to lose weight.

LIMITATIONS

Fewer participants were recruited than planned.

CONCLUSIONS

Although women and practice nurses responded well to the intervention and adherence to self-weighing was high, recruitment was challenging and there is scope to improve engagement with the intervention.

FUTURE WORK

Future research should focus on investigating other methods of recruitment and, thereafter, testing the effectiveness of the intervention.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN12209332.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 49. See the NIHR Journals Library website for further project information.

Development of an online tool for linking behavior change techniques and mechanisms of action based on triangulation of findings from literature synthesis and expert consensus

Researchers, practitioners, and policymakers develop interventions to change behavior based on their understanding of how behavior change techniques (BCTs) impact the determinants of behavior. A transparent, systematic, and accessible method of linking BCTs with the processes through which they change behavior (i.e., their mechanisms of action [MoAs]) would advance the understanding of intervention effects and improve theory and intervention development. The purpose of this study is to triangulate evidence for hypothesized BCT-MoA links obtained in two previous studies and present the results in an interactive, online tool. Two previous studies generated evidence on links between 56 BCTs and 26 MoAs based on their frequency in literature synthesis and on expert consensus. Concordance between the findings of the two studies was examined using multilevel modeling. Uncertainties and differences between the two studies were reconciled by 16 behavior change experts using consensus development methods. The resulting evidence was used to generate an online tool. The two studies showed concordance for 25 of the 26 MoAs and agreement for 37 links and for 460 "nonlinks." A further 55 links were resolved by consensus (total of 92 [37 + 55] hypothesized BCT-MoA links). Full data on 1,456 possible links was incorporated into the online interactive Theory and Technique Tool (https://theoryandtechniquetool.humanbehaviourchange.org/). This triangulation of two distinct sources of evidence provides guidance on how BCTs may affect the mechanisms that change behavior and is available as a resource for behavior change intervention designers, researchers and theorists, supporting intervention design, research synthesis, and collaborative research.

An exploratory analysis to identify behavior change techniques of implementation interventions associated with the implementation of healthy canteen policies

Empirical studies to disentangle the effects of multicomponent implementation interventions are needed to inform the development of future interventions. This study aims to examine which behavior change techniques (BCTs) primarily targeting canteen manager are associated with school's healthy canteen policy implementation. This is a secondary data analysis from three randomized controlled trials assessing the impact of a "high," "medium," and "low" intensity intervention primarily targeting canteen managers on school's implementation of a healthy canteen policy. The policy required primary schools to remove all "red" (less healthy items) or "banned" (sugar sweetened beverages) items from regular sale and ensure that "green" (healthier items) dominated the menu (>50%). The delivery of BCTs were retrospectively coded. We undertook an elastic net regularized logistic regression with all BCTs in a single model. Five k-fold cross-validation elastic net models were conducted. The percentage of times each strategy remained across 1,000 replications was calculated. For no "red" or "banned" items (n = 162), the strongest BCTs were: problem solving, goal setting (behavior), and review behavior goals. These BCTs were identified in 100% of replications as a strong predictor in the cross-validation elastic net models. For the outcome relating to >50% "green" items, the BCTs problem solving, instruction on how to perform behavior and demonstration of behavior were the strongest predictors. Two strategies were identified in 100% of replications as a strong (i.e., problem solving) or weak predictor (i.e., feedback on behavior). This study identified unique BCTs associated with the implementation of a healthy canteen policy.

Enhancing the translation of health behaviour change research into practice: a selective conceptual review of the synergy between implementation science and health psychology

Health psychology is at the forefront of developing and disseminating evidence, theories, and methods that have improved the understanding of health behaviour change. However, current dissemination approaches may be insufficient for promoting broader application and impact of this evidence to benefit the health of patients and the public. Nevertheless, behaviour change theory/methods typically directed towards health behaviours are now used in implementation science to understand and support behaviour change in individuals at different health system levels whose own behaviour impacts delivering evidence-based health behaviour change interventions. Despite contributing to implementation science, health psychology is perhaps doing less to draw from it. A redoubled focus on implementation science in health psychology could provide novel prospects for enhancing the impact of health behaviour change evidence. We report a Health Psychology Review-specific review-of-reviews of trials of health behaviour change interventions published from inception to April 2020. We identified 34 reviews and assessed whether implementation readiness of behaviour change interventions was discussed. We then narratively review how implementation science has integrated theory/methods from health psychology and related discipline. Finally, we demonstrate how greater synergy between implementation science and health psychology could promote greater follow-through on advances made in the science of health behaviour change.

How effective are social norms interventions in changing the clinical behaviours of healthcare workers? A systematic review and meta-analysis

BACKGROUND

Healthcare workers perform clinical behaviours which impact on patient diagnoses, care, treatment and recovery. Some methods of supporting healthcare workers in changing their behaviour make use of social norms by exposing healthcare workers to the beliefs, values, attitudes or behaviours of a reference group or person. This review aimed to evaluate evidence on (i) the effect of social norms interventions on healthcare worker clinical behaviour change and (ii) the contexts, modes of delivery and behaviour change techniques (BCTs) associated with effectiveness.

METHODS

Systematic review and meta-analysis of randomised controlled trials. Searches were undertaken in seven databases. The primary outcome was compliance with a desired healthcare worker clinical behaviour and the secondary outcome was patient health outcomes. Outcomes were converted into standardised mean differences (SMDs). We performed meta-analyses and presented forest plots, stratified by five social norms BCTs (social comparison, credible source, social reward, social incentive and information about others' approval). Sources of variation in social norms BCTs, context and mode of delivery were explored using forest plots, meta-regression and network meta-analysis.

RESULTS

Combined data from 116 trials suggested that social norms interventions were associated with an improvement in healthcare worker clinical behaviour outcomes of 0.08 SMDs (95%CI 0.07 to 0.10) (n = 100 comparisons), and an improvement in patient health outcomes of 0.17 SMDs (95%CI 0.14 to 0.20) (n = 14), on average. Heterogeneity was high, with an overall I² of 85.4% (healthcare worker clinical behaviour) and 91.5% (patient health outcomes). Credible source was more effective on average, compared to control conditions (SMD 0.30, 95%CI 0.13 to 0.47, n = 7). Social comparison also appeared effective, both on its own (SMD 0.05, 95%CI 0.03 to 0.08, n = 33) and with other BCTs, and seemed particularly effective when combined with prompts/cues (0.33, 95%CI 0.22 to 0.44, n = 5).

CONCLUSIONS

Social norms interventions appeared to be an effective method of changing the clinical behaviour of healthcare workers and have a positive effect on patient health outcomes in a variety of health service contexts. Although the overall result is modest and variable, there is the potential for social norms interventions to be applied at large scale.

TRIAL REGISTRATION

PROSPERO CRD42016045718 .

Developing an evidence-based online method of linking behaviour change techniques and theoretical mechanisms of action: a multiple methods study

Background

Many global health challenges may be targeted by changing people’s behaviour. Behaviours including cigarette smoking, physical inactivity and alcohol misuse, as well as certain dietary behaviours, contribute to deaths and disability by increasing the risk of cancers, cardiovascular diseases and diabetes. Interventions have been designed to change these health behaviours with a view to reducing these health risks. However, the effectiveness of these interventions has been quite variable and further information is needed to enhance their success. More information is needed about the specific processes that underlie the effectiveness of intervention strategies.

Aim

Researchers have developed a taxonomy of 93 behaviour change techniques (i.e. the active components of an intervention that bring about behavioural change), but little is known regarding their potential mechanisms of action (i.e. the processes through which a behaviour change technique affects behaviour). We therefore aimed to examine links between behaviour change techniques and mechanisms of action.

Method

First, we conducted a literature synthesis study of 277 behaviour change intervention studies, from which we extracted information on links, described by authors, between behaviour change techniques and mechanisms of action, and identified an average of 10 links per intervention report. Second, behaviour change experts (n = 105) were engaged in a three-round consensus study in which they discussed and rated their confidence in the presence/absence of ‘links’ and ‘non-links’ between commonly used behaviour change techniques (n = 61) and a set of mechanisms of action (n = 26). Ninety links and 460 ‘non-links’ reached the pre-set threshold of 80% agreement. To enhance the validity of these results, a third study was conducted that triangulated the findings of the first two studies. Discrepancies and uncertainties between the studies were included in a reconciliation consensus study with a new group of experts (n = 25). The final results identified 92 definite behaviour change technique–mechanism of action links and 465 definite non-links. In a fourth study, we examined whether or not groups of behaviour change techniques used together frequently across interventions revealed shared theoretical underpinnings. We found that experts agreed on the underlying theory for three groups of behaviour change techniques.

Results

Our results are potentially useful to policy-makers and practitioners in selecting behaviour change techniques to include in behaviour change interventions. However, our data do not demonstrate that the behaviour change techniques are effective in targeting the mechanism of action; rather, the links identified may be the ‘best bets’ for interventions that are effective in changing mechanisms of action, and the non-links are unlikely to be effective. Researchers examining effectiveness of interventions in either primary studies or evidence syntheses may consider these links for further investigation.

Conclusion

To make our results usable by researchers, practitioners and policy-makers, they are available in an online interactive tool, which enables discussion and collaboration (https://theoryandtechniquetool.humanbehaviourchange.org/); accessed 1 March 2020. This work, building on previous work to develop the behaviour change technique taxonomy, is part of an ongoing programme of work: the Human Behaviour Change Project (www.humanbehaviourchange.org/; accessed 1 March 2020).

Funding

This project was funded by the Medical Research Council via its Methodology Panel: ‘Developing methodology for designing and evaluating theory-based complex interventions: an ontology for linking behaviour change techniques to theory’ (reference MR/L011115/1).

Social norms interventions to change clinical behaviour in health workers: a systematic review and meta-analysis

Background

A social norms intervention seeks to change the clinical behaviour of a target health worker by exposing them to the values, beliefs, attitudes or behaviours of a reference group or person. These low-cost interventions can be used to encourage health workers to follow recommended professional practice.

Objective

To summarise evidence on whether or not social norms interventions are effective in encouraging health worker behaviour change, and to identify the most effective social norms interventions.

Design

A systematic review and meta-analysis of randomised controlled trials.

Data sources

The following databases were searched on 24 July 2018: Ovid MEDLINE (1946 to week 2 July 2018), EMBASE (1974 to 3 July 2018), Cumulative Index to Nursing and Allied Health Literature (1937 to July 2018), British Nursing Index (2008 to July 2018), ISI Web of Science (1900 to present), PsycINFO (1806 to week 3 July 2018) and Cochrane trials (up to July 2018).

Participants

Health workers took part in the study.

Interventions

Behaviour change interventions based on social norms.

Outcome measures

Health worker clinical behaviour, for example prescribing (primary outcome), and patient health outcomes, for example blood test results (secondary), converted into a standardised mean difference.

Methods

Titles and abstracts were reviewed against the inclusion criteria to exclude any that were clearly ineligible. Two reviewers independently screened the remaining full texts to identify relevant papers. Two reviewers extracted data independently, coded for behaviour change techniques and assessed quality using the Cochrane risk-of-bias tool. We performed a meta-analysis and presented forest plots, stratified by behaviour change technique. Sources of variation were explored using metaregression and network meta-analysis.

Results

A total of 4428 abstracts were screened, 477 full texts were screened and findings were based on 106 studies. Most studies were in primary care or hospitals, targeting prescribing, ordering of tests and communication with patients. The interventions included social comparison (in which information is given on how peers behave) and credible source (which refers to communication from a well-respected person in support of the behaviour). Combined data suggested that interventions that included social norms components were associated with an improvement in health worker behaviour of 0.08 standardised mean differences (95% confidence interval 0.07 to 0.10 standardised mean differences) (n = 100 comparisons), and an improvement in patient outcomes of 0.17 standardised mean differences (95% confidence interval 0.14 to 0.20) (n = 14), on average. Heterogeneity was high, with an overall I 2 of 85.4% (primary) and 91.5% (secondary). Network meta-analysis suggested that three types of social norms intervention were most effective, on average, compared with control: credible source (0.30 standardised mean differences, 95% confidence interval 0.13 to 0.47); social comparison combined with social reward (0.39 standardised mean differences, 95% confidence interval 0.15 to 0.64); and social comparison combined with prompts and cues (0.33 standardised mean differences, 95% confidence interval 0.22 to 0.44).

Limitations

The large number of studies prevented us from requesting additional information from authors. The trials varied in design, context and setting, and we combined different types of outcome to provide an overall summary of evidence, resulting in a very heterogeneous review.

Conclusions

Social norms interventions are an effective method of changing clinical behaviour in a variety of health service contexts. Although the overall result was modest and very variable, there is the potential for social norms interventions to be scaled up to target the behaviour of a large population of health workers and resulting patient outcomes.

Future work

Development of optimised credible source and social comparison behaviour change interventions, including qualitative research on acceptability and feasibility.

Study registration

This study is registered as PROSPERO CRD42016045718.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 41. See the NIHR Journals Library website for further project information.

Variability in cesarean delivery rates among individual labor and delivery nurses compared to physicians at three attribution time points

OBJECTIVE

To examine the variability in the cesarean delivery (CD) rates of individual labor and delivery nurses compared with physicians at three attribution time points.

DATA SOURCES

Medical record data from nine hospitals in Washington State from January 2016 through September 2018.

STUDY DESIGN

Retrospective, observational cohort design using an aggregated database of birth records.

DATA COLLECTION/EXTRACTION METHODS

Chart-abstracted clinical data from a subset of nulliparous, term, singleton, vertex births attributed at admission, labor management, and delivery to nurses and physicians. Two classification methods were used to categorize nurse- and physician-level CD rates at three attribution time points and the reliability of these methods compared.

PRINCIPAL FINDINGS

The sample included 12 556 births, 319 nurses, and 126 physicians. Overall, variation in nurse-level CD rates did not differ significantly across the three attribution time points, and the extent of variation was similar to that observed in physicians. However, agreement between attribution time points varied between 35 percent and 65 percent when classifying individual nurses into the top and bottom deciles. The average reliability of nurse-level CD rates was 32 percent at admission (IQR 22.0 percent to 38.7 percent), 32.6 percent at labor (IQR 23.1 percent to 40.9 percent), and 29.3 percent (IQR 20.9 percent to 35.8 percent) at delivery. The average reliability of physician-level CD rates was higher: 54.2 percent (IQR 38.7 percent to 71.4 percent) at admission, 62.5 percent (IQR 49.0 percent to 79.6 percent) at labor management, and 66.1 percent (IQR 53.7 percent to 81.2 percent) at delivery.

CONCLUSION

Feedback on nurse-level CD rates as part of routine clinical quality audits can provide insight into nurse performance in the context of other individual-level and unit-level information. To reliably distinguish individual nurse performance, larger sample sizes are needed.

Digital Behavior Change Interventions for Younger Children With Chronic Health Conditions: Systematic Review

Background

The prevalence of chronic health conditions in childhood is increasing, and behavioral interventions can support the management of these conditions. Compared with face-to-face treatment, the use of digital interventions may be more cost-effective, appealing, and accessible, but there has been inadequate attention to their use with younger populations (children aged 5-12 years).

Objective

This systematic review aims to (1) identify effective digital interventions, (2) report the characteristics of promising interventions, and (3) describe the user’s experience of the digital intervention.

Methods

A total of 4 databases were searched (Excerpta Medica Database [EMBASE], PsycINFO, Medical Literature Analysis and Retrieval System Online [MEDLINE], and the Cochrane Library) between January 2014 and January 2019. The inclusion criteria for studies were as follows: (1) children aged between 5 and 12 years, (2) interventions for behavior change, (3) randomized controlled trials, (4) digital interventions, and (5) chronic health conditions. Two researchers independently double reviewed papers to assess eligibility, extract data, and assess quality.

Results

Searches run in the databases identified 2643 papers. We identified 17 eligible interventions. The most promising interventions (having a beneficial effect and low risk of bias) were 3 targeting overweight or obesity, using exergaming or social media, and 2 for anxiety, using web-based cognitive behavioral therapy (CBT). Characteristics of promising interventions included gaming features, therapist support, and parental involvement. Most were purely behavioral interventions (rather than CBT or third wave), typically using the behavior change techniques (BCTs) feedback and monitoring, shaping knowledge, repetition and substitution, and reward. Three papers included qualitative data on the user’s experience. We developed the following themes: parental involvement, connection with a health professional is important for engagement, technological affordances and barriers, and child-centered design.

Conclusions

Of the 17 eligible interventions, digital interventions for anxiety and overweight or obesity had the greatest promise. Using qualitative methods during digital intervention development and evaluation may lead to more meaningful, usable, feasible, and engaging interventions, especially for this underresearched younger population. The following characteristics could be considered when developing digital interventions for younger children: involvement of parents, gaming features, additional therapist support, behavioral (rather than cognitive) approaches, and particular BCTs (feedback and monitoring, shaping knowledge, repetition and substitution, and reward). This review suggests a model for improving the conceptualization and reporting of behavioral interventions involving children and parents.

The Development of the MedEx IMPACT Intervention: A Patient-Centered, Evidenced-Based and Theoretically-Informed Physical Activity Behavior Change Intervention for Individuals Living With and Beyond Cancer

Regular physical activity (PA) can address many of the negative side effects experienced by individuals following cancer treatment and support the optimization of physical and psychosocial well-being. However, many survivors of cancer are not sufficiently active to achieve these health benefits. The purpose of this study was to describe the development of a physical activity behavior change (PABC) intervention, MedEx IMPACT (IMprove Physical Activity after Cancer Treatment), which aims to increase cancer survivors’ PA levels. A review of the literature and focus groups with survivors of cancer were conducted in order to generate recommendations to inform the intervention development process. This process was guided and informed by: (1) the Medical Research Council’s (MRC) framework for the development, evaluation, and implementation of complex interventions, (2) the Behaviour Change Wheel (BCW), and (3) the Theoretical Domains Framework (TDF). Recommendations for strategies to support habitual PA and adherence to community-based exercise programs, generated by survivors of cancer who participated in 7 focus groups (n = 41), were synthesized with 13 statements of findings that were generated from 10 studies included within the review of the literature. Detailed mapping exercises are presented which outline the link between these sources, the MRC framework, the BCW and TDF, and the intervention content. MedEx IMPACT is the first PABC intervention for survivors of cancer to be developed through the application of the MRC framework, BCW, and TDF. The next phase in this research is to test the acceptability and effectiveness of MedEx IMPACT.

Interventions to improve appropriate antibiotic prescribing in long-term care facilities: a systematic review

BACKGROUND

Overuse of antibiotics has contributed to antimicrobial resistance; a growing public health threat. In long-term care facilities, levels of inappropriate prescribing are as high as 75%. Numerous interventions targeting long-term care facilities' antimicrobial stewardship have been reported with varying, and largely unexplained, effects. Therefore, this review aimed to apply behavioural science frameworks to specify the component behaviour change techniques of stewardship interventions in long-term care facilities and identify those components associated with improved outcomes.

METHOD

A systematic review (CRD42018103803) was conducted through electronic database searches. Two behavioural science frameworks, the Behaviour Change Wheel and Behaviour Change Technique Taxonomy were used to classify intervention descriptions into intervention types and component behaviour change techniques used. Study design and outcome heterogeneity prevented meta-analysis and meta-regression. Interventions were categorised as 'very promising' (all outcomes statistically significant), 'quite promising' (some outcomes statistically significant), or 'not promising' (no outcomes statistically significant). 'Promise ratios' (PR) were calculated for identified intervention types and behaviour change techniques by dividing the number of (very or quite) promising interventions featuring the intervention type or behaviour change technique by the number of interventions featuring the intervention type or behaviour change technique that were not promising. Promising intervention types and behaviour change techniques were defined as those with a PR ≥ 2.

RESULTS

Twenty studies (of19 interventions) were included. Seven interventions (37%) were 'very promising', eight 'quite promising' (42%) and four 'not promising' (21%). Most promising intervention types were 'persuasion' (n = 12; promise ratio (PR) = 5.0), 'enablement' (n = 16; PR = 4.33) and 'education' (n = 19; PR = 3.75). Most promising behaviour change techniques were 'feedback on behaviour' (n = 9; PR = 8.0) and 'restructuring the social environment' (e.g. staff role changes; n = 8; PR = 7.0).

CONCLUSION

Systematic identification of the active ingredients of antimicrobial stewardship in long-term care facilities was facilitated through the application of behavioural science frameworks. Incorporating environmental restructuring and performance feedback may be promising intervention strategies for antimicrobial stewardship interventions within long-term care facilities.

Codesigning a Mental Health Discharge and Transitions of Care Intervention: A Modified Nominal Group Technique

BACKGROUND

Discharge from acute mental health services has long been associated with mortality, risk, and related adverse outcomes for patients. Many of the interventions that currently aim to reduce adverse outcomes focus on a single group of healthcare professionals within a single healthcare setting. A recent systematic review highlights very few robust interventions that specifically aim to improve communication across services. However the importance of promoting interagency working and improving information flow between services is continually highlighted as a key priority.

METHODS

Using a novel codesign and experience based approach we worked with a multistakeholder group to develop possible solutions to reduce the adverse outcomes commonly associated with discharge from acute mental health services. This utilized a modified Nominal Group Technique and creative problem solving method to follow a four-stage process: Problem Identification, Solution Generation, Decision-Making, Prioritization and Implementation. Thirty-two healthcare professionals and an expert by lived experienced engaged with the process that took place over two stakeholder events.

RESULTS

Stakeholders at the first event identified and agreed upon 24 potential ideas to improve discharge from acute mental health services. These were refined at the second event to four elements of an interagency intervention: a multiagency 'Discharge Team' (with designated discharge coordinator), inclusive technology enabled team meetings, universal documentation and a patient generated discharge plan.

CONCLUSION

This is the first study to codesign an interagency mental health discharge intervention based around a discharge team. We developed a model for working that places a greater focus on a patient generated discharge plan, interagency working, and information flow. A pilot of the proposed intervention is now needed to test the feasibility and effectiveness in reducing adverse outcomes.

Facilitating action planning within audit and feedback interventions: a mixed-methods process evaluation of an action implementation toolbox in intensive care

Background

Audit and feedback (A&F) is more effective if it facilitates action planning, but little is known about how best to do this. We developed an electronic A&F intervention with an action implementation toolbox to improve pain management in intensive care units (ICUs); the toolbox contained suggested actions for improvement. A head-to-head randomised trial demonstrated that the toolbox moderately increased the intervention’s effectiveness when compared with A&F only.

Objective

To understand the mechanisms through which A&F with action implementation toolbox facilitates action planning by ICUs to increase A&F effectiveness.

Methods

We extracted all individual actions from action plans developed by ICUs that received A&F with (n = 10) and without (n = 11) toolbox for 6 months and classified them using Clinical Performance Feedback Intervention Theory. We held semi-structured interviews with participants during the trial. We compared the number and type of planned and completed actions between study groups and explored barriers and facilitators to effective action planning.

Results

ICUs with toolbox planned more actions directly aimed at improving practice (p = 0.037) and targeted a wider range of practice determinants compared to ICUs without toolbox. ICUs with toolbox also completed more actions during the study period, but not significantly (p = 0.142). ICUs without toolbox reported more difficulties in identifying what actions they could take. Regardless of the toolbox, all ICUs still experienced barriers relating to the feedback (low controllability, accuracy) and organisational context (competing priorities, resources, cost).

Conclusions

The toolbox helped health professionals to broaden their mindset about actions they could take to change clinical practice. Without the toolbox, professionals tended to focus more on feedback verification and exploring solutions without developing intentions for actual change. All feedback recipients experienced organisational barriers that inhibited eventual completion of actions.

Trial registration

ClinicalTrials.gov, NCT02922101. Registered on 26 September 2016.

Electronic supplementary material

The online version of this article (10.1186/s13012-019-0937-8) contains supplementary material, which is available to authorized users.

Implementation of eHealth Interventions Across the HIV Care Cascade: a Review of Recent Research

PURPOSE OF REVIEW

We review recent implementation science focusing on eHealth interventions to improve outcomes along the HIV care cascade. We highlight several gaps in the eHealth implementation literature and propose areas for future study.

RECENT FINDINGS

We identified 17 studies conducted in North America, Europe, and sub-Saharan Africa assessing the acceptability, appropriateness, adoption, cost, feasibility, fidelity, penetration, or sustainability of eHealth interventions targeting the HIV care cascade. Most interventions used SMS messages to improve cascade outcomes. Feasibility research has demonstrated the importance of adaptability for intervention scale-up and delivery. Key gaps in the literature remain related to predictors of the adoption of eHealth interventions by health facilities and staff. In addition, no studies explored sustainability and few used theoretical frameworks for implementation research or validated measures of implementation outcomes. We propose next steps for the future of eHealth implementation research to inform the delivery, scale-up, and maintenance of eHealth interventions in the real world.

Your Personal Motivator is with You: A Systematic Review of Mobile Phone Applications Aiming at Increasing Physical Activity

BACKGROUND

Literature shows mixed evidence about the power of mobile phone applications to foster physical activity. A systematic integration that offers insights into which mobile phone application techniques can or cannot foster physical activity is lacking, as is a theoretical integration of current research.

OBJECTIVES

We performed a systematic review guided by a theoretical framework focusing on effects that certain mobile phone application techniques have on physical activity, to improve our understanding of what techniques are more or less effective.

METHODS

We identified articles by searching EBSCO Business Source Complete, Science Direct, PsycINFO, Springer, PLoS ONE, Taylor and Francis, IEEE, Social Science Citation Index, Science Citation Index Expanded, PUBMED, MEDLINE, and Google Scholar. We considered articles if (1) they referred to the use of mobile phone applications to promote physical activity; (2) their methodological approach allowed one to derive appropriate results (e.g., intervention-based approach, observational study); (3) they were published in peer-reviewed journals or conference proceedings; and (4) they were written in English. The literature search resulted in 41 usable studies. Meta-synthesis and vote counting were applied to analyze these studies.

RESULTS

Based on the ratio of supportive versus non-supportive evidence in both the qualitative and the quantitative studies, we propose the following descending rank order for the effectiveness of application techniques to foster physical activity. This is tentative in nature because the current overall small body of literature made coming to definite conclusions difficult: (1) feedback, (2) goal setting and its sub-forms, (3) competition, social sharing with familiar users in both segregated and social network groups, and (4) social sharing with strangers in segregated groups, reward, and social sharing with strangers in social network groups. Rewards in particular provided mixed results, and social sharing with strangers in segregated and social network groups seemed rather ineffective but may work under special conditions that need to be identified in additional research. One limitation of our study was that our results are mostly derived from qualitative studies, since quantitative studies are underrepresented in the field.

CONCLUSION

Several mobile phone application techniques were identified that have the potential to foster physical activity, whereas others were identified that are unlikely to increase physical activity. Major avenues for future research include more theoretical development and more quantitative studies, among others.

The impact of social norms interventions on clinical behaviour change among health workers: protocol for a systematic review and meta-analysis

BACKGROUND

Health workers routinely carry out clinical behaviours, such as prescribing, test-ordering or hand-washing, which impact on patient diagnoses, care, treatment and recovery. Social norms are the implicit or explicit rules that a group uses to determine values, beliefs, attitudes and behaviours. A social norms intervention seeks to change the clinical behaviour of a target health worker by exposing them to the values, beliefs, attitudes or behaviours of a reference group or person. This study aims to find out whether or not social norms interventions are effective ways of encouraging health workers to carry out desired behaviours and to identify which types of social norms intervention, if any, are most effective.

METHODS

A systematic review will be conducted. The inclusion criteria are a population of health professionals, a social norms intervention that seeks to change a clinical behaviour, and randomised controlled trials. Searches will be undertaken in MEDLINE, EMBASE, CINAHL, British Nursing Index, ISI Web of Science, PsycINFO and Cochrane trials. Titles and abstracts will be reviewed against the inclusion criteria to exclude any that are clearly ineligible. Two reviewers will independently screen all the remaining full texts to identify relevant papers. For studies which meet our inclusion criteria, two reviewers will extract data independently, code for behaviour change techniques and assess quality using the Cochrane risk of bias tool. The primary outcome measure will be compliance with desired behaviour. To assess the effect of social norms on the behaviour of health workers, we will perform fixed effects meta-analysis and present forest plots, stratified by behaviour change technique. We will explore sources of variation using meta-regression and may use multi-component-based network meta-analysis to explore which forms of social norms are more likely to be effective, if our data meet the necessary requirements.

DISCUSSION

The study will provide evidence regarding the effectiveness of different methods of applying social norms to change the clinical behaviour of health professionals. We will disseminate the research to academics, health workers and members of the public and use the findings from the review to plan future research on the use of social norms with health workers.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42016045718. Future protocol changes will be clearly stated in PROSPERO.

Qualitative process evaluation of the Perioperative Quality Improvement Programme (PQIP): study protocol

INTRODUCTION

The Perioperative Quality Improvement Programme (PQIP) is designed to measure complications after major elective surgery and improve these through feedback of data to clinicians. Previous research suggests that despite the significant resources which go into collecting data for national clinical audits, the information they contain is not always used effectively to improve local services.

METHODS AND ANALYSIS

We will conduct a formative process evaluation of PQIP comprising a multisited qualitative study to analyse PQIP's programme theory, barriers, facilitators and wider contextual factors that influence implementation. The research will be carried out with the PQIP project team and six National Health Service (NHS) Trusts in England, selected according to geographical location, type of hospital, size and level of engagement with PQIP. We will include one Trust which has not expressed interest in the PQIP for comparison and to explore the role of secular trend in any changes in practice. We will use semi-structured interviews (up to 144 in Trusts and 12 with the project team), non-participant observations (up to 150  hours) and documentary analysis. We will track the lifecycle of perioperative data, exploring the transformations it undergoes from creation to use. We will use framework analysis with categories both from our research questions and from themes emerging from the data.

ETHICS AND DISSEMINATION

Ethical approval has been granted from the University College London Research Ethics Committee (ref 10375/001). Permissions to conduct research at NHS Trusts have been granted by local Research and Development offices in coordination with the Health Research Authority. We will follow guidelines for data security, confidentiality and information governance. Findings will be shared at regular time points with the PQIP project team to inform the implementation of the programme, and with participating NHS Trusts to help them reflect on how they currently use data for improvement of perioperative services.

Deconstructing Weight Management Interventions for Young Adults: Looking Inside the Black Box of the EARLY Consortium Trials

OBJECTIVE

The goal of the present study was to deconstruct the 17 treatment arms used in the Early Adult Reduction of weight through LifestYle (EARLY) weight management trials.

METHODS

Intervention materials were coded to reflect behavioral domains and behavior change techniques (BCTs) within those domains planned for each treatment arm. The analytical hierarchy process was employed to determine an emphasis profile of domains in each intervention.

RESULTS

The intervention arms used BCTs from all of the 16 domains, with an average of 29.3 BCTs per intervention arm. All 12 of the interventions included BCTs from the six domains of Goals and Planning, Feedback and Monitoring, Social Support, Shaping Knowledge, Natural Consequences, and Comparison of Outcomes; 11 of the 12 interventions shared 15 BCTs in common across those six domains.

CONCLUSIONS

Weight management interventions are complex. The shared set of BCTs used in the EARLY trials may represent a core intervention that could be studied to determine the required emphases of BCTs and whether additional BCTs add to or detract from efficacy. Deconstructing interventions will aid in reproducibility and understanding of active ingredients.

Measurement without management: qualitative evaluation of a voluntary audit & feedback intervention for primary care teams

Background

The use of clinical performance feedback to support quality improvement (QI) activities is based on the sound rationale that measurement is necessary to improve quality of care. However, concerns persist about the reliability of this strategy, known as Audit and Feedback (A&F) to support QI. If successfully implemented, A&F should reflect an iterative, self-regulating QI process. Whether and how real-world A&F initiatives result in this type of feedback loop are scarcely reported. This study aimed to identify barriers or facilitators to implementation in a team-based primary care context.

Methods

Semi-structured interviews were conducted with key informants from team-based primary care practices in Ontario, Canada. At the time of data collection, practices could have received up to three iterations of the voluntary A&F initiative. Interviews explored whether, how, and why practices used the feedback to guide their QI activities. The Consolidated Framework for Implementation Research was used to code transcripts and the resulting frameworks were analyzed inductively to generate key themes.

Results

Twenty-five individuals representing 18 primary care teams participated in the study. Analysis of how the A&F intervention was used revealed that implementation reflected an incomplete feedback loop. Participation was facilitated by the reliance on an external resource to facilitate the practice audit. The frequency of feedback, concerns with data validity, the design of the feedback report, the resource requirements to participate, and the team relationship were all identified as barriers to implementation of A&F.

Conclusions

The implementation of a real-world, voluntary A&F initiative did not lead to desired QI activities despite substantial investments in performance measurement. In small primary care teams, it may take long periods of time to develop capacity for QI and future evaluations may reveal shifts in the implementation state of the initiative. Findings from the present study demonstrate that the potential mechanism of action of A&F may be deceptively clear; in practice, moving from measurement to action can be complex.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4226-7) contains supplementary material, which is available to authorized users.