Guiding the design and selection of interventions to influence the implementation of evidence-based practice: an experimental simulation of a complex intervention trial

A randomised fractional factorial screening experiment to predict effective features of audit and feedback

BACKGROUND

Audit and feedback aims to improve patient care by comparing healthcare performance against explicit standards. It is used to monitor and improve patient care, including through National Clinical Audit (NCA) programmes in the UK. Variability in effectiveness of audit and feedback is attributed to intervention design; separate randomised trials to address multiple questions about how to optimise effectiveness would be inefficient. We evaluated different feedback modifications to identify leading candidates for further "real-world" evaluation.

METHODS

Using an online fractional factorial screening experiment, we randomised recipients of feedback from five UK NCAs to different combinations of six feedback modifications applied within an audit report excerpt: use effective comparators, provide multimodal feedback, recommend specific actions, provide optional detail, incorporate the patient voice, and minimise cognitive load. Outcomes, assessed immediately after exposure to the online modifications, included intention to enact audit standards (primary outcome, ranked on a scale of -3 to +3, tailored to the NCA), comprehension, user experience, and engagement.

RESULTS

We randomised 1241 participants (clinicians, managers, and audit staff) between April and October 2019. Inappropriate repeated participant completion occurred; we conservatively excluded participant entries during the relevant period, leaving a primary analysis population of 638 (51.4%) participants. None of the six feedback modifications had an independent effect on intention across the five NCAs. We observed both synergistic and antagonistic effects across outcomes when modifications were combined; the specific NCA and whether recipients had a clinical role had dominant influences on outcome, and there was an antagonistic interaction between multimodal feedback and optional detail. Among clinical participants, predicted intention ranged from 1.22 (95% confidence interval 0.72, 1.72) for the least effective combination in which multimodal feedback, optional detail, and reduced cognitive load were applied within the audit report, up to 2.40 (95% CI 1.88, 2.93) for the most effective combination including multimodal feedback, specific actions, patient voice, and reduced cognitive load.

CONCLUSION

Potentially important synergistic and antagonistic effects were identified across combinations of feedback modifications, audit programmes, and recipients, suggesting that feedback designers must explicitly consider how different features of feedback may interact to achieve (or undermine) the desired effects.

TRIAL REGISTRATION

International Standard Randomised Controlled Trial Number: ISRCTN41584028.

Barriers and facilitators to implementation of direct fruit and vegetables provision interventions in kindergartens and schools: a qualitative systematic review applying the consolidated framework for implementation research (CFIR)

BACKGROUND

Although children's intake of fruit and vegetables has seen a recent rise, almost half of adolescents do not eat even one piece of fruit or vegetables per day. One way to address this problem is through interventions that provide fruit and vegetables directly to children in kindergartens and schools. For such interventions to meet their intended goals, what is important to consider in addition to impact is implementation. Our objective is to systematically review qualitative results reporting on the determinants (barriers and facilitators) to implementation of interventions that entail direct provision of fruit and vegetables in kindergarten and school settings and conduct a framework analysis of those results using the Consolidated Framework for Implementation Research (CFIR).

METHODS

A systematic search was designed and run in November 2019 for: MEDLINE (Ovid), Embase (Ovid), PsychINFO (Ovid), ERIC (Ovid), Cochrane Library Reviews and Cochrane Library Trials. A keyword search of the journal Implementation Science was completed. Screening of titles and abstracts (n = 5427) and full texts (n = 227), led to 14 included articles. Coding and analysis were done using the framework method and CFIR.

RESULTS

The following CFIR constructs were found relevant: 1) intervention characteristics domain: 'design quality and packaging', 'adaptability' 'cost'; 2) outer setting: 'cosmopolitanism', 'external policy and incentives' 'patients' needs and resources'; 3) inner setting: 'implementation climate', 'readiness for implementation' and 'structural characteristics'; 4) characteristics of individuals: 'individual stage of change', 'knowledge and beliefs about the intervention' 5) process: 'engaging', 'executing' and 'reflecting and evaluating'. The review stresses the dual role of parents as both supporting the implementation and targets of the intervention, which could have implications for the design and implementation of future fruit and vegetables interventions. Positive child perceptions of the value of the intervention and perceived behavior change due to the intervention were reported as relevant facilitators to implementation across several studies, and should be taken into consideration in future design efforts.

CONCLUSIONS

CFIR offers a systematic way to identify and organize barriers and facilitators to implementation of interventions in the kindergarten and school setting. Revisions are encouraged to allow adequate space for perceptions of various implementation actors and the target group.

PROSPERO REGISTRATION

CRD42020167697.

Exploring attitudes about evidence-based practice among speech-language pathologists: A survey of Japan and Malaysia

Purpose: To investigate speech-language pathologists' current perceptions, previous training experiences, resources, barriers, and training needs in terms of evidence-based practices (EBPs) in two Asian countries.Method: Their knowledge and attitudes about EBP were explored using an online questionnaire. A descriptive analysis was conducted with consideration of the effect of demographic variables on knowledge and attitudes about EBP.Result: Malaysian speech-language pathologists (n = 98) displayed more positive attitudes toward EBPs, with a significantly higher (t (143) = 5.91, p < .01) total mean score (Mean = 120.7, SD = 11) compared to the Japanese speech-language pathologists (n = 47, Mean = 107.8, SD = 13.5). Malaysian practitioners who were female, worked full-time, and worked in government settings reported higher motivation to develop EBP skills. Japanese practitioners who worked in private sectors reported higher EBPs training needs than those in government settings. In both countries, speech-language pathologists with higher education levels tended to express fewer perceived barriers towards EBP.Conclusion: Findings could help local governance and speech-language pathologist associations to understand the current practices and professional development needs of speech-language pathologists, leading to more effective training programs and educating employers and managers who can reinforce EBP among practitioners.

Attitude theory and measurement in implementation science: a secondary review of empirical studies and opportunities for advancement

BACKGROUND

Implementation science studies often express interest in "attitudes," a term borrowed from psychology. In psychology, attitude research has an established methodological and theoretical base, which we briefly summarize here. We then review implementation studies designed to measure attitudes and compare their definitions and methods with those from psychology.

METHODS

A recent review identified 46 studies empirically examining factors associated with implementation. For each of these studies, we evaluated whether authors included attitudes as a construct of interest, and if so, whether and how the construct was defined, measured, and analyzed.

RESULTS

Most of the articles (29/46 [63%]) mention attitudes as an implementation factor. Six articles include a definition of the construct. Nineteen studies were designed to measure attitudes but lacked clarity in describing how attitudes were measured. Those that explained their measurement approach used methods that differed from one another and from validated methods in social psychology. Few articles described associated analyses or provided results specific to attitudes. Despite the lack of specificity regarding relevant measurement, analysis, and results, the articles often included causal conclusions about the role of attitudes.

CONCLUSIONS

Attitudes may be an important construct to implementation scientists, but studies to date are ambiguous in their definitions of attitudes and inconsistent in the methods used to measure and analyze attitudes. We discuss how implementation studies can apply psychology's standardized definitions, validated measurement approaches, and causal models that include attitudes. This application of attitude theory and methods could offer implementation research valuable scientific opportunities.

Preschool teachers' selection of social communication interventions for children with autism: An application of the theory of planned behavior

LAY ABSTRACT

Preschool special educators' are more likely to choose an educational practice to teach a young child with autism a social communication skill if they have positive beliefs about it. We asked preschool special educators to read a description of an autistic student and their social communication goal and imagine they were the student's teacher. We then asked them to pick one of five practices to teach the student. We also asked them questions to understand their attitudes about, confidence in their ability to use, and their perception of their coworkers' support of each practice. There are many research-based practices that a teacher could use to help children learn, and preschool teachers often make these decisions for their students. Teachers' beliefs varied in how supportive they were of each practice, and research shows people are more likely to do something that their beliefs support. In this study, they had more supportive beliefs and were more likely to use some practices, like naturalistic intervention, than other practices, like discrete trial teaching. By knowing this, researchers can help teachers use practices that their beliefs support and help change teachers' beliefs to be supportive of a practice they may need to use.

Knowledge of and adherence to radiographic guidelines for low back pain: a survey of chiropractors in Newfoundland and Labrador, Canada

Background

Low back pain (LBP) rarely requires routine imaging of the lumbar spine in the primary care setting, as serious spinal pathology is rare. Despite evidence-based clinical practice guidelines recommending delaying imaging in the absence of red flags, chiropractors commonly order imaging outside of these guidelines. The purpose of this study was to survey chiropractors to determine the level of knowledge, adherence to, and beliefs about, clinical practice guidelines related to the use of lumbar radiography for LBP in Newfoundland and Labrador (NL), Canada.

Methods

A cross-sectional survey of chiropractors in NL (n = 69) was conducted between May and June 2018, including questions on demographics, awareness of radiographic guidelines, and beliefs about radiographs for LBP. We assessed behavioural simulation using clinical vignettes to determine levels of adherence to LBP guideline recommendations.

Results

The response rate was 77% (n = 53). Half of the participants stated they were aware of current radiographic guideline recommendations, and one quarter of participants indicated they did not use guidelines to inform clinical decisions. The majority of participants agreed that x-rays of the lumbar spine are useful for patients with suspected pathology, are indicated when a patient is non-responsive to 4 weeks of conservative treatment for LBP, and when there are neurological signs associated with LBP. However, a small proportion indicated that there is a role for full spine x-rays (~ 21%), x-rays to evaluate patients with acute LBP (~ 13%), and that patient expectations play a role in decision making (4%). Adherence rate to radiographic guidelines measured using clinical vignettes was 75%.

Conclusions

While many chiropractors in this sample reported being unsure of specific radiographic guidelines, the majority of respondents adhered to guideline recommendations measured using clinical vignettes. Nonetheless, a small proportion still hold beliefs about radiographs for LBP that are discordant with current radiographic guidelines. Future research should aim to determine barriers to guideline uptake in this population in order to design and evaluate tailored knowledge translation strategies to reduce unnecessary LBP imaging.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12998-020-00361-2.

Understanding hand hygiene behaviour in the intensive care unit to inform interventions: an interview study

BACKGROUND

Improving hand hygiene (HH) compliance is one of the most important, but elusive, goals of infection control. The purpose of this study was to use the capability (C), opportunity (O), motivation (M), and behaviour (B; COM-B) model and the theoretical domains framework (TDF) to gain an understanding of the barriers and enablers of HH behaviours in an intensive care unit (ICU) in order to identify specific interventions to improve HH compliance.

METHODS

A semi-structured interview schedule was developed based upon the COM-B model. This schedule was used to interview a total of 26 ICU staff: 12 ICU nurses, 11 anaesthetic specialist registrars, and three anaesthetic senior house officers.

RESULTS

Participants were confident in their capabilities to carry out appropriate HH behaviours. The vast majority of participants reported having the necessary knowledge and skills, and believed they were capable of carrying out appropriate HH behaviours. Social influence was regarded as being important in encouraging HH compliance by the interviewees- particularly by nurses. The participants were motivated to carry out HH behaviours, and it was recognised that HH was an important part of their job and is important in preventing infection. It is recommended that staff are provided with targeted HH training, in which individuals receive direct and individualised feedback on actual performance and are provided guidance on how to address deficiencies in HH compliance at the bedside at the time at which the HH behaviour is performed. Modelling of appropriate HH behaviours by senior leaders is also suggested, particularly by senior doctors. Finally, appropriate levels of staffing are a factor that must be considered if HH compliance is to be improved.

CONCLUSIONS

This study has demonstrated that short interviews with ICU staff, founded on appropriate behavioural change frameworks, can provide an understanding of HH behaviour. This understanding can then be applied to design interventions appropriately tailored to the needs of a specific unit, which will have an increased likelihood of improving HH compliance.

A systematic review of empirical studies examining mechanisms of implementation in health

BACKGROUND

Understanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms.

METHODS

We systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms "mechanism," "mediator," or "moderator." Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality.

RESULTS

Search strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms.

CONCLUSIONS

Researchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.

A systematic review of empirical studies examining mechanisms of implementation in health

BACKGROUND

Understanding the mechanisms of implementation strategies (i.e., the processes by which strategies produce desired effects) is important for research to understand why a strategy did or did not achieve its intended effect, and it is important for practice to ensure strategies are designed and selected to directly target determinants or barriers. This study is a systematic review to characterize how mechanisms are conceptualized and measured, how they are studied and evaluated, and how much evidence exists for specific mechanisms.

METHODS

We systematically searched PubMed and CINAHL Plus for implementation studies published between January 1990 and August 2018 that included the terms "mechanism," "mediator," or "moderator." Two authors independently reviewed title and abstracts and then full texts for fit with our inclusion criteria of empirical studies of implementation in health care contexts. Authors extracted data regarding general study information, methods, results, and study design and mechanisms-specific information. Authors used the Mixed Methods Appraisal Tool to assess study quality.

RESULTS

Search strategies produced 2277 articles, of which 183 were included for full text review. From these we included for data extraction 39 articles plus an additional seven articles were hand-entered from only other review of implementation mechanisms (total = 46 included articles). Most included studies employed quantitative methods (73.9%), while 10.9% were qualitative and 15.2% were mixed methods. Nine unique versions of models testing mechanisms emerged. Fifty-three percent of the studies met half or fewer of the quality indicators. The majority of studies (84.8%) only met three or fewer of the seven criteria stipulated for establishing mechanisms.

CONCLUSIONS

Researchers have undertaken a multitude of approaches to pursue mechanistic implementation research, but our review revealed substantive conceptual, methodological, and measurement issues that must be addressed in order to advance this critical research agenda. To move the field forward, there is need for greater precision to achieve conceptual clarity, attempts to generate testable hypotheses about how and why variables are related, and use of concrete behavioral indicators of proximal outcomes in the case of quantitative research and more directed inquiry in the case of qualitative research.

Assessment of healthcare workers' behavior in implementing a newborn screening program for congenital hypothyroidism in Perak, Malaysia

Purpose

The aim of this study is to assess healthcare workers' behavior on the congenital hypothyroidism screening program implementation based on a framework protocol and its associated factors.

Design/methodology/approach

A cross-sectional study was conducted using the multistage random sampling method in recruiting health clinic workers and purposive sampling techniques for hospital workers. The demographics, providers' characteristic, occupational profile, attitude, perceived behavior control (PBC), knowledge, behavioral intention and adherence to protocol were gathered using validated and reliable self-administered questionnaires.

Findings

Partial intention to adhere to protocol was 25.7%. Weak attitude (adjusted odds ratio [AOR]: 5.48, 95% confidence interval [CI]: 3.32–9.06), low PBC score (AOR: 0.91, 95% CI: 0.86–0.95) and low knowledge score (AOR: 0.85, 95% CI: 0.75–0.96) were associated with partial intention to adhere to protocol. In the self-rated adherence assessment, 92.6% of participants from health clinics, 79.1% from pediatric and 61.1% from pathology were found not adhering to protocol. There was a significant association between intention and adherence to protocol.

Research limitations/implications

Documentations and observations in assessing program implementation were limited to perform in the present study. Using self-rated instruments and focusing on healthcare workers alone did not provide a comprehensive assessment.

Practical implications

Availability of a training module at site and regular refreshing course training should be made available to harness knowledge, attitude and behavioral perception in implementing the program activities.

Originality/value

Integrating the Logical Framework Approach in assessing program implementation and application of the Theory of Planned Behavior and Attitude, Subjective Norms, Self-Efficacy Model in this study were beneficial.

Psychometric evaluation of a measure of factors influencing hand hygiene behaviour to inform intervention

BACKGROUND

Although the hand hygiene (HH) procedure is simple, the related behaviour is complex and is not readily understood, explained or changed. There is a need for practical tools to provide data that can guide healthcare managers and practitioners not only on the 'what' (the standards that must be met), but also the 'how' (guidance on how to achieve the standards).

AIM

To develop a valid questionnaire to evaluate attitudes to the factors that influence engagement in HH behaviour that can be readily completed, administered and analysed by healthcare professionals to identify appropriate intervention strategies. Construct validity was assessed using confirmatory factor analysis, predictive validity was assessed through comparison with self-reported HH behaviour, and convergent validity was assessed through direct unit-level observation of HH behaviour.

METHODS

The Capability, Opportunity, Motivation-Behaviour (COM-B) model was used to design a 25-item questionnaire that was distributed to intensive care unit (ICU) personnel in Ireland. Direct observation of HH behaviour was carried out at two ICUs.

FINDINGS

In total, 292 responses to the survey (response rate 41.0%) were included in the analysis. Confirmatory factor analysis resulted in a 17-item questionnaire. Multiple regression revealed that a model including capability, opportunity and motivation was a significant predictor of self-reported behavioural intention [F(3,209)=22.58, P<0.001]. However, the opportunity factor was not found to make a significant contribution to the regression model.

CONCLUSION

The COM-B HH questionnaire is reliable and valid, and provides data to support the development and evaluation of HH interventions that meet the needs of specific healthcare units.

Sustainability of public health interventions: where are the gaps?

The current scholarly focus on implementation science is meant to ensure that public health interventions are effectively embedded in their settings. Part of this conversation includes understanding how to support the sustainability of beneficial interventions so that limited resources are maximised, long-term public health outcomes are realised, community support is not lost, and ethical research standards are maintained. However, the concept of sustainability is confusing because of variations in terminology and a lack of agreed upon measurement frameworks, as well as methodological challenges. This commentary explores the challenges around the sustainability of public health interventions, with particular attention to definitions and frameworks like Normalization Process Theory and the Dynamic Sustainability Framework. We propose one important recommendation to direct attention to the sustainability of public health interventions, that is, the use of theoretically informed approaches to guide the design, development, implementation, evaluation and sustainability of public health interventions.

Developing a framework to evaluate knowledge into action interventions

BACKGROUND

There are many challenges in delivering and evaluating knowledge for healthcare, but the lack of clear routes from knowledge to practice is a root cause of failures in safety within healthcare. Various types and sources of knowledge are relevant at different levels within the healthcare system. These need to be delivered in a timely way that is useful and actionable for those providing services or developing policies. How knowledge is taken up and used through networks and relationships, and the difficulties in attributing change to knowledge-based interventions, present challenges to understanding how knowledge into action (K2A) work influences healthcare outcomes. This makes it difficult to demonstrate the importance of K2A work, and harness support for its development and resourcing. This paper presents the results from a project commissioned by NHS Education for Scotland (NES) and Healthcare Improvement Scotland (HIS) to create an evaluation framework to help understand the NHS Scotland Knowledge into Action model.

METHODS

The team took a developmental approach to creating an evaluation framework that would be useful and practical. This included a literature review to ensure the evaluation was evidence-based; adaptation of contribution analysis for K2A project; action research with K2A project leads to refine the work and develop suitable measures.

RESULTS

Principles for evaluation and an evaluation framework based on contribution analysis were developed and implemented on a trial project. An outcomes chain was developed for the K2A programme and specific projects. This was used to design, collect and collate evidence of the K2A intervention. Data collected routinely by the intervention was supplemented with specific feedback measures from K2A project users.

CONCLUSIONS

The evaluation approach allowed for scrutiny of both processes and outcomes and was adaptable to projects on different scales. This framework has proved useful as a planning, reflecting and evaluation tool for K2A, and could be more widely used to evidence the ways in which knowledge to action work helps improve healthcare outcomes.

Investigating the use of an electronic hand hygiene monitoring and prompt device: influence and acceptability

Introduction

Hand hygiene (HH) prevents the transmission of healthcare-associated infections. Electronic HH monitoring and prompt devices have been developed to overcome problems with monitoring HH and to improve compliance. Devices monitor room entry and exit and soap use through communication between ceiling sensors and badges worn by practitioners and the badges sense alcohol rub.

Objectives

To investigate (1) the impact of devices on HH compliance, (2) how devices influence behaviour and (3) the experience and opinions of practitioners on the use devices.

Methods

HH compliance was monitored (before, during and after system installation) by observations and alcohol rub usage. Compliance during installation was also monitored by the device. Healthcare practitioner interviews (n = 12) explored how the device influenced behaviour and experiences and opinions of wearing the device.

Results

HH compliance improved during the period the device was installed. Practitioners reported the device increased their awareness, enhancing their empathy for patients and encouraged patients and colleagues to prompt when HH was needed. Practitioners' reported better HH, gaming the system and feelings of irritation.

Conclusion

HH prompt and monitoring systems seem to improve compliance but improvements may be undermined by practitioner irritation and system gaming.

The relationship between the implementation and effectiveness of a nationwide physical activity telephone counseling service for adults with spinal cord injury

PURPOSE

Get in Motion (GIM) is an evidence-based telephone counseling service that promotes leisure-time physical activity (LTPA) among Canadian adults with spinal cord injury (SCI). The first phase of GIM sustained intentions for, and increased participation in, LTPA; however, it is unclear how GIM led to these outcomes. The purpose of this study was to explore the implementation correlates of change in LTPA intentions and behavior in the second phase of GIM.

METHODS

The frequency, duration, and content of counseling sessions were tailored to meet clients' (N = 46; 50.0% male; 50.0% paraplegia; 51.46 (SD 12.36) years old) needs and preferences. Intervention dose and content were monitored using Counseling Session Checklists. Clients self-reported their intentions for and actual aerobic and strength-training LTPA participation at baseline, 2-, 4-, and 6-months, and their perceptions of service quality at 6-months.

RESULTS

The second phase of GIM effectively sustained LTPA intentions and increased time spent on moderate-to-vigorous strength-training and total LTPA. Increases in clients' moderate-to-vigorous aerobic LTPA were significantly positively related to intervention dose, intervention content (both informational and behavioral strategies), and clients' perceptions of service credibility.

CONCLUSIONS

This study identified intervention dose and content as key implementation variables for an LTPA telephone counseling service for adults with SCI. Implications for Rehabilitation An evidence- and theory-based telephone counseling service can effectively sustain LTPA intentions and increase LTPA behavior among adults with SCI. The first two months of the service are a critical period for enhancing LTPA participation and for minimizing dropouts. The provision of both informational and behavioral strategies is important for increasing aerobic LTPA levels among adults with SCI.

Reducing patient delay in Acute Coronary Syndrome (RAPiD): research protocol for a web-based randomized controlled trial examining the effect of a behaviour change intervention

AIMS

To evaluate the efficacy of a behaviour change technique-based intervention and compare two possible modes of delivery (text + visual and text-only) with usual care.

BACKGROUND

Patient delay prevents many people from achieving optimal benefit of time-dependent treatments for acute coronary syndrome. Reducing delay would reduce mortality and morbidity, but interventions to change behaviour have had mixed results. Systematic inclusion of behaviour change techniques or a visual mode of delivery might improve the efficacy of interventions.

DESIGN

A three-arm web-based, parallel randomized controlled trial of a theory-based intervention.

METHODS

The intervention comprises 12 behaviour change techniques systematically identified following systematic review and a consensus exercise undertaken with behaviour change experts. We aim to recruit n = 177 participants who have experienced acute coronary syndrome in the previous 6 months from a National Health Service Hospital. Consenting participants will be randomly allocated in equal numbers to one of three study groups: i) usual care, ii) usual care plus text-only behaviour change technique-based intervention or iii) usual care plus text + visual behaviour change technique-based intervention. The primary outcome will be the change in intention to phone an ambulance immediately with symptoms of acute coronary syndrome ≥15-minute duration, assessed using two randomized series of eight scenarios representing varied symptoms before and after delivery of the interventions or control condition (usual care). Funding granted January 2014.

DISCUSSION

Positive results changing intentions would lead to a randomized controlled trial of the behaviour change intervention in clinical practice, assessing patient delay in the event of actual symptoms.

TRIAL REGISTRATION

Registered at ClinicalTrials.gov: NCT02820103.

How Effective are Behavior Change Interventions Based on the Theory of Planned Behavior?

Abstract. The theory of planned behavior (TPB) is a prominent framework for predicting and explaining behavior in a variety of domains. The theory is also increasingly being used as a framework for conducting behavior change interventions. In this meta-analysis, we identified 82 papers reporting results of 123 interventions in a variety of disciplines. Our analysis confirmed the effectiveness of TPB-based interventions, with a mean effect size of .50 for changes in behavior and effect sizes ranging from .14 to .68 for changes in antecedent variables (behavioral, normative, and control beliefs, attitude, subjective norm, perceived behavioral control, and intention). Further analyses revealed that the interventions’ effectiveness varied for the diverse behavior change methods. In addition, interventions conducted in public and with groups were more successful than interventions in private locations or focusing on individuals. Finally, we identified gender and education as well as behavioral domain as moderators of the interventions’ effectiveness.

The development and implementation of a theory-informed, integrated mother-child intervention in rural Uganda

RATIONALE

A randomised cluster effectiveness trial of a parenting intervention in rural Uganda found benefits to child development among children 12-36 months, relevant parenting practices related to stimulation, hygiene and diet, and prevented the worsening of mothers' depressive symptoms. An examination of underlying implementation processes allows researchers and program developers to determine whether the program was implemented as intended and highlight barriers and facilitators that may influence replication and scale-up.

OBJECTIVES

The objectives of this study were to describe and critically examine (a) perceived barriers and facilitators related to implementation processes of intervention content, training and supervision and delivery from the perspectives of delivery agents and supervisors; (b) perceived barriers and facilitators related to enactment of practices from the perspective of intervention mothers participating in the parenting program; and c) whether the program was implemented as intended.

METHODS

Semi-structured interviews were conducted at midline with peer delivery agents (n = 12) and intervention mothers (n = 31) and at endline with supervisors (n = 4). Content analysis was used to analyze qualitative data in terms of barriers and facilitators of intervention content, training and supervision, delivery and enactment. Additionally, mothers' recall and enactment of practices were coded and analyzed statistically. Monitoring of group sessions and home visits were examined to reveal whether the program was implemented as intended.

RESULTS

Among the program's five key messages, 'love and respect' targeting maternal psychological well-being was the most practiced by mothers, easiest to implement by delivery agents, and mothers reported the most internal facilitators for this message. A detailed manual and structured monitoring forms were perceived to facilitate training, intervention delivery, and supervision. Interactive and active strategies based on social-cognitive learning theory were reported as facilitators to intervention delivery. Only program attendance, but not barriers, facilitators or message recall, was significantly positively related to message enactment. Monitoring of group sessions and home visits showed that the program was largely implemented as intended.

CONCLUSIONS

This implementation assessment revealed a number of important barriers and facilitators from the perspectives of delivery agents, supervisors and program participants. The methods and results are useful to examining and informing the content, delivery, and scaling up of the current program as well as future mother-child interventions in LMIC settings.

Fast tracking the design of theory-based KT interventions through a consensus process

BACKGROUND

Despite available evidence for optimal management of spinal pain, poor adherence to guidelines and wide variations in healthcare services persist. One of the objectives of the Canadian Chiropractic Guideline Initiative is to develop and evaluate targeted theory- and evidence-informed interventions to improve the management of non-specific neck pain by chiropractors. In order to systematically develop a knowledge translation (KT) intervention underpinned by the Theoretical Domains Framework (TDF), we explored the factors perceived to influence the use of multimodal care to manage non-specific neck pain, and mapped behaviour change techniques to key theoretical domains.

METHODS

Individual telephone interviews exploring beliefs about managing neck pain were conducted with a purposive sample of 13 chiropractors. The interview guide was based upon the TDF. Interviews were digitally recorded, transcribed verbatim and analysed by two independent assessors using thematic content analysis. A 15-member expert panel formally met to design a KT intervention.

RESULTS

Nine TDF domains were identified as likely relevant. Key beliefs (and relevant domains of the TDF) included the following: influence of formal training, colleagues and patients on clinicians (Social Influences); availability of educational material (Environmental Context and Resources); and better clinical outcomes reinforcing the use of multimodal care (Reinforcement). Facilitating factors considered important included better communication (Skills); audits of patients' treatment-related outcomes (Behavioural Regulation); awareness and agreement with guidelines (Knowledge); and tailoring of multimodal care (Memory, Attention and Decision Processes). Clinicians conveyed conflicting beliefs about perceived threats to professional autonomy (Social/Professional Role and Identity) and speed of recovery from either applying or ignoring the practice recommendations (Beliefs about Consequences). The expert panel mapped behaviour change techniques to key theoretical domains and identified relevant KT strategies and modes of delivery to increase the use of multimodal care among chiropractors.

CONCLUSIONS

A multifaceted KT educational intervention targeting chiropractors' management of neck pain was developed. The KT intervention consisted of an online education webinar series, clinical vignettes and a video underpinned by the Brief Action Planning model. The intervention was designed to reflect key theoretical domains, behaviour change techniques and intervention components. The effectiveness of the proposed intervention remains to be tested.

Perceived difficulty and appropriateness of decision making by General Practitioners: a systematic review of scenario studies

BACKGROUND

Health-care quality in primary care depends largely on the appropriateness of General Practitioners' (GPs; Primary Care or Family Physicians) decisions, which may be influenced by how difficult they perceive decisions to be. Patient scenarios (clinical or case vignettes) are widely used to investigate GPs' decision making. This review aimed to identify the extent to which perceived decision difficulty, decision appropriateness, and their relationship have been assessed in scenario studies of GPs' decision making; identify possible determinants of difficulty and appropriateness; and investigate the relationship between difficulty and appropriateness.

METHODS

MEDLINE, EMBASE, PsycINFO, the Cochrane Library and Web of Science were searched for scenario studies of GPs' decision making. One author completed article screening. Ten percent of titles and abstracts were checked by an independent volunteer, resulting in 91% agreement. Data on decision difficulty and appropriateness were extracted by one author and descriptively synthesised. Chi-squared tests were used to explore associations between decision appropriateness, decision type and decision appropriateness assessment method.

RESULTS

Of 152 included studies, 66 assessed decision appropriateness and five assessed perceived difficulty. While no studies assessed the relationship between perceived difficulty and appropriateness, one study objectively varied the difficulty of the scenarios and assessed the relationship between a measure of objective difficulty and appropriateness. Across 38 studies where calculations were possible, 62% of the decisions were appropriate as defined by the appropriateness standard used. Chi-squared tests identified statistically significant associations between decision appropriateness, decision type and decision appropriateness assessment method. Findings suggested a negative relationship between decision difficulty and appropriateness, while interventions may have the potential to reduce perceived difficulty.

CONCLUSIONS

Scenario-based research into GPs' decisions rarely considers the relationship between perceived decision difficulty and decision appropriateness. The links between these decisional components require further investigation.

Development of a simple 12-item theory-based instrument to assess the impact of continuing professional development on clinical behavioral intentions

BACKGROUND

Decision-makers in organizations providing continuing professional development (CPD) have identified the need for routine assessment of its impact on practice. We sought to develop a theory-based instrument for evaluating the impact of CPD activities on health professionals' clinical behavioral intentions.

METHODS AND FINDINGS

Our multipronged study had four phases. 1) We systematically reviewed the literature for instruments that used socio-cognitive theories to assess healthcare professionals' clinically-oriented behavioral intentions and/or behaviors; we extracted items relating to the theoretical constructs of an integrated model of healthcare professionals' behaviors and removed duplicates. 2) A committee of researchers and CPD decision-makers selected a pool of items relevant to CPD. 3) An international group of experts (n = 70) reached consensus on the most relevant items using electronic Delphi surveys. 4) We created a preliminary instrument with the items found most relevant and assessed its factorial validity, internal consistency and reliability (weighted kappa) over a two-week period among 138 physicians attending a CPD activity. Out of 72 potentially relevant instruments, 47 were analyzed. Of the 1218 items extracted from these, 16% were discarded as improperly phrased and 70% discarded as duplicates. Mapping the remaining items onto the constructs of the integrated model of healthcare professionals' behaviors yielded a minimum of 18 and a maximum of 275 items per construct. The partnership committee retained 61 items covering all seven constructs. Two iterations of the Delphi process produced consensus on a provisional 40-item questionnaire. Exploratory factorial analysis following test-retest resulted in a 12-item questionnaire. Cronbach's coefficients for the constructs varied from 0.77 to 0.85.

CONCLUSION

A 12-item theory-based instrument for assessing the impact of CPD activities on health professionals' clinical behavioral intentions showed adequate validity and reliability. Further studies could assess its responsiveness to behavior change following CPD activities and its capacity to predict health professionals' clinical performance.

'Changing minds': determining the effectiveness and key ingredients of an educational intervention to enhance healthcare professionals' intentions to prescribe physical activity to patients with physical disabilities

Background

Healthcare professionals (HCPs) are vital conduits of leisure-time physical activity (LTPA) information; however, few discuss LTPA with their patients with disabilities. ‘Changing Minds, Changing Lives’ (CMCL) is a nationwide, theory- and evidence-based seminar aimed at increasing LTPA-discussion among HCPs by enhancing their attitudes, subjective norms, perceived behavioural control (PBC), and intentions. The purposes of the current study were to: examine the effectiveness and short- and long-term maintenance of a CMCL seminar on HCPs’ social cognitions to discuss LTPA; and explore key implementation variables that predict changes in HCPs’ social cognitions.

Methods

Prior-to, as well as immediately, one, and six months following a CMCL seminar, 97 HCPs (M_age ± SD = 36.23 ± 10.42; 69.0% female; 97.9% Caucasian; 38.1% rehabilitation therapists; years in profession = 11.56 ± 9.94) from five Canadian provinces completed questionnaires that assessed the Theory of Planned Behaviour constructs with regard to discussing LTPA with their patients with a physical disability. Key presenter characteristics and intervention delivery components were extracted from presenter demographic questionnaires and seminar checklists, respectively. Separate repeated-measures ANOVAs and post-hoc t-tests evaluated changes in HCPs’ social cognitions. Hierarchical multiple regressions were conducted to predict intentions and to understand which implementation variables may help explain significant changes in social cognitions.

Results

Significant increases in HCPs’ social cognitions for discussing LTPA were reported from pre- to post-seminar (ps <0.002); however, increases were not maintained at follow-up. PBC emerged as the strongest predictor of participants’ post-CMCL intentions (β = 0.45, p <0.001). Although several implementation characteristics were related to changes in perceptions, the number of seminars the presenter delivered was the only significant negative predictor of post-seminar PBC (β = -0.18, p <0.05).

Conclusions

Future iterations of the CMCL intervention should include additional strategies to sustain improvements in HCPs’ social cognitions over time. Future CMCL evaluations should measure additional implementation variables so that the key ingredients for ‘Changing Minds’ can continue to be investigated.

Paper-based and web-based intervention modeling experiments identified the same predictors of general practitioners' antibiotic-prescribing behavior

OBJECTIVES

To evaluate the robustness of the intervention modeling experiment (IME) methodology as a way of developing and testing behavioral change interventions before a full-scale trial by replicating an earlier paper-based IME.

STUDY DESIGN AND SETTING

Web-based questionnaire and clinical scenario study. General practitioners across Scotland were invited to complete the questionnaire and scenarios, which were then used to identify predictors of antibiotic-prescribing behavior. These predictors were compared with the predictors identified in an earlier paper-based IME and used to develop a new intervention.

RESULTS

Two hundred seventy general practitioners completed the questionnaires and scenarios. The constructs that predicted simulated behavior and intention were attitude, perceived behavioral control, risk perception/anticipated consequences, and self-efficacy, which match the targets identified in the earlier paper-based IME. The choice of persuasive communication as an intervention in the earlier IME was also confirmed. Additionally, a new intervention, an action plan, was developed.

CONCLUSION

A web-based IME replicated the findings of an earlier paper-based IME, which provides confidence in the IME methodology. The interventions will now be evaluated in the next stage of the IME, a web-based randomized controlled trial.

Improving population-level maternal health: a hard nut to crack? Long term findings and reflections on a 16-community randomised trial in Australia to improve maternal emotional and physical health after birth [ISRCTN03464021]

BACKGROUND

Community level interventions to improve maternal and child health have been supported and well evaluated in resource poor settings, but less so in developed countries. PRISM--Program of Resources, Information and Support for Mothers--was a primary care and community-based cluster-randomised trial in sixteen municipalities in Victoria, Australia, which aimed to reduce depression in mothers and improve their physical health. The aim of this paper is to report the longer term outcomes of PRISM and to reflect on lessons learned from this universal community intervention to improve maternal health.

METHODS

Maternal health outcome data in PRISM were collected by postal questionnaire at six months and two years. At two years, the main outcome measures included the Edinburgh Postnatal Depression Scale (EPDS) and the SF-36. Secondary outcome measures included the Experience of Motherhood Scale (EOM) and the Parenting Stress Index (PSI). A primary intention to treat analysis was conducted, adjusting for the randomisation by cluster.

RESULTS

7,169/18,424 (39%) women responded to the postal questionnaire at two years -3,894 (40%) in the intervention arm and 3,275 (38%) in the comparison arm. Respondents were mostly representative on available population data comparisons. There were no differences in depression prevalence (EPDS≥13) between the intervention and comparison arms (13.4% vs 13.1%; ORadj = 1.06, 95%CI 0.91-1.24). Nor did women's mental health (MCS: 48.6 vs 49.1) or physical health scores (PCS: 49.1 vs 49.0) on the SF-36 differ between the trial arms.

CONCLUSION

Improvement in maternal mental and physical health outcomes at the population level in the early years after childbirth remains a largely unmet challenge. Despite the lack of effectiveness of PRISM intervention strategies, important lessons about systems change, sustained investment and contextual understanding of the workability of intervention strategies can be drawn from the experience of PRISM. Trial Registration. Controlled-Trials.com ISRCTN03464021.

Development of a theory-based instrument to identify barriers and levers to best hand hygiene practice among healthcare practitioners

Background

A theoretical approach to assessing the barriers and levers to evidence-based practice (EBP) with subsequent tailoring of theoretically informed strategies to address these may go some way to positively influencing the delay in implementing research findings into practice. Hand hygiene is one such example of EBP, chosen for this study due to its importance in preventing death through healthcare associated infections (HCAI). The development of an instrument to assess barriers and levers to hand hygiene and to allow the subsequent tailoring of theoretically informed implementation strategies is reported here.

Methods

A comprehensive list of barriers and levers to hand hygiene were categorised to the Theoretical Domains Framework (TDF) in a Delphi survey. These items formed the basis of an instrument that was tested to establish validity and reliability. The relationship between self-reported compliance with hand hygiene and barriers and levers to hand hygiene was also examined along with compliance according to where the barriers and levers fit within the domains of the TDF framework.

Results

A 33-item instrument that tested well for internal consistency (α = 0.84) and construct validity (χ²/df = 1.9 [p < 0.01], RMSEA = 0.05 and CFA = 0.84) was developed. The relationship between self-reported compliance with hand hygiene moderately correlated with barriers identified by participants (total barrier score) (r = 0.41, n = 276, p <0.001). The greater the number of barriers reported, the lower the level of compliance. A one-way between groups multivariate analysis of variance was performed to investigate differences between those adopting high or low compliance with hand hygiene. Compliance was highest for this sample of participants among practitioners with high levels of motivation, strong beliefs about capabilities, when there were positive social influences, when hand hygiene was central to participants’ sense of professional identity and was easier to remember to do.

Conclusions

This study has produced encouraging findings suggesting the potential for improved hand hygiene and resulting effects on the human and financial costs of healthcare associated infection. This study identifies a further potential use for the TDF.

Impact of environmental olfactory cues on hand hygiene behaviour in a simulated hospital environment: a randomized study

This study investigated the impact of a fresh scent on the rate of hand hygiene compliance (HHC) among novice healthcare providers. In all, 165 participants examined a standardized patient with one sample exposed to fresh scent (N = 79) and the other exposed to the standard environment (N = 86). Hand hygiene behaviours were tracked before patient contact using video surveillance. The standard environment group had an HHC rate of 51% whereas participants in the fresh scent group had a higher HHC rate of 80% (P < 0.001). These data demonstrate that hand hygiene behaviour may be subconsciously influenced by cues in the environment.

Comparison of high and low intensity contact between secondary and primary care to detect people at ultra-high risk for psychosis: study protocol for a theory-based, cluster randomized controlled trial

BACKGROUND

The early detection and referral to specialized services of young people at ultra-high risk (UHR) for psychosis may reduce the duration of untreated psychosis and, therefore, improve prognosis. General practitioners (GPs) are usually the healthcare professionals contacted first on the help-seeking pathway of these individuals.

METHODS/DESIGN

This is a cluster randomized controlled trial (cRCT) of primary care practices in Cambridgeshire and Peterborough, UK. Practices are randomly allocated into two groups in order to establish which is the most effective and cost-effective way to identify people at UHR for psychosis. One group will receive postal information about the local early intervention in psychosis service, including how to identify young people who may be in the early stages of a psychotic illness. The second group will receive the same information plus an additional, ongoing theory-based educational intervention with dedicated liaison practitioners to train clinical staff at each site. The primary outcome of this trial is count data over a 2-year period: the yield - number of UHR for psychosis referrals to a specialist early intervention in psychosis service - per primary care practice.

DISCUSSION

There is little guidance on the essential components of effective and cost-effective educational interventions in primary mental health care. Furthermore, no study has demonstrated an effect of a theory-based intervention to help GPs identify young people at UHR for psychosis. This study protocol is underpinned by a robust scientific rationale that intends to address these limitations.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN70185866.

Developing an active implementation model for a chronic disease management program

Background

Introduction and diffusion of new disease management programs in healthcare is usually slow, but active theory-driven implementation seems to outperform other implementation strategies. However, we have only scarce evidence on the feasibility and real effect of such strategies in complex primary care settings where municipalities, general practitioners and hospitals should work together. The Central Denmark Region recently implemented a disease management program for chronic obstructive pulmonary disease (COPD) which presented an opportunity to test an active implementation model against the usual implementation model. The aim of the present paper is to describe the development of an active implementation model using the Medical Research Council’s model for complex interventions and the Chronic Care Model.

Methods

We used the Medical Research Council’s five-stage model for developing complex interventions to design an implementation model for a disease management program for COPD. First, literature on implementing change in general practice was scrutinised and empirical knowledge was assessed for suitability. In phase I, the intervention was developed; and in phases II and III, it was tested in a block- and cluster-randomised study. In phase IV, we evaluated the feasibility for others to use our active implementation model.

Results

The Chronic Care Model was identified as a model for designing efficient implementation elements. These elements were combined into a multifaceted intervention, and a timeline for the trial in a randomised study was decided upon in accordance with the five stages in the Medical Research Council’s model; this was captured in a PaTPlot, which allowed us to focus on the structure and the timing of the intervention. The implementation strategies identified as efficient were use of the Breakthrough Series, academic detailing, provision of patient material and meetings between providers. The active implementation model was tested in a randomised trial (results reported elsewhere).

Conclusion

The combination of the theoretical model for complex interventions and the Chronic Care Model and the chosen specific implementation strategies proved feasible for a practice-based active implementation model for a chronic-disease-management-program for COPD. Using the Medical Research Council’s model added transparency to the design phase which further facilitated the process of implementing the program.

Trial registration: http://www.clinicaltrials.gov/(NCT01228708).

Evaluation of a theory-informed implementation intervention for the management of acute low back pain in general medical practice: the IMPLEMENT cluster randomised trial

INTRODUCTION

This cluster randomised trial evaluated an intervention to decrease x-ray referrals and increase giving advice to stay active for people with acute low back pain (LBP) in general practice.

METHODS

General practices were randomised to either access to a guideline for acute LBP (control) or facilitated interactive workshops (intervention). We measured behavioural predictors (e.g. knowledge, attitudes and intentions) and fear avoidance beliefs. We were unable to recruit sufficient patients to measure our original primary outcomes so we introduced other outcomes measured at the general practitioner (GP) level: behavioural simulation (clinical decision about vignettes) and rates of x-ray and CT-scan (medical administrative data). All those not involved in the delivery of the intervention were blinded to allocation.

RESULTS

47 practices (53 GPs) were randomised to the control and 45 practices (59 GPs) to the intervention. The number of GPs available for analysis at 12 months varied by outcome due to missing confounder information; a minimum of 38 GPs were available from the intervention group, and a minimum of 40 GPs from the control group. For the behavioural constructs, although effect estimates were small, the intervention group GPs had greater intention of practising consistent with the guideline for the clinical behaviour of x-ray referral. For behavioural simulation, intervention group GPs were more likely to adhere to guideline recommendations about x-ray (OR 1.76, 95%CI 1.01, 3.05) and more likely to give advice to stay active (OR 4.49, 95%CI 1.90 to 10.60). Imaging referral was not statistically significantly different between groups and the potential importance of effects was unclear; rate ratio 0.87 (95%CI 0.68, 1.10) for x-ray or CT-scan.

CONCLUSIONS

The intervention led to small changes in GP intention to practice in a manner that is consistent with an evidence-based guideline, but it did not result in statistically significant changes in actual behaviour.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN012606000098538.

Specifying content and mechanisms of change in interventions to change professionals' practice: an illustration from the Good Goals study in occupational therapy

BACKGROUND

It is widely agreed that interventions to change professionals' practice need to be clearly specified. This involves (1) selecting and defining the intervention techniques, (2) operationalising the techniques and deciding their delivery, and (3) formulating hypotheses about the mechanisms through which the techniques are thought to result in change. Descriptions of methods to achieve these objectives are limited. This paper reports methods and illustrates outputs from a study to meet these objectives, specifically from the Good Goals study to improve occupational therapists' caseload management practice.

METHODS

(1) Behaviour change techniques were identified and selected from an existing matrix that maps techniques to determinants. An existing coding manual was used to define the techniques. (2) A team of occupational therapists generated context-relevant, acceptable modes of delivery for the techniques; these data were compared and contrasted with previously collected data, literature on caseload management, and the aims of the intervention. (3) Hypotheses about the mechanisms of change were formulated by drawing on the matrix and on theories of behaviour change.

RESULTS

(1) Eight behaviour change techniques were selected: goal specified; self-monitoring; contract; graded tasks; increasing skills (problem solving, decision making, goal setting); coping skills; rehearsal of relevant skills; social processes of encouragement, support, and pressure; demonstration by others; and feedback. (2) A range of modes of delivery were generated (e.g., graded tasks' consisting of series of clinical cases and situations that become increasingly difficult). Conditions for acceptable delivery were identified (e.g., 'self-monitoring' was acceptable only if delivered at team level). The modes of delivery were specified as face-to-face training, task sheets, group tasks, DVDs, and team-based weekly meetings. (3) The eight techniques were hypothesized to target caseload management practice through eleven mediating variables. Three domains were hypothesized to be most likely to change: beliefs about capabilities, motivation and goals, and behavioural regulation.

CONCLUSIONS

The project provides an exemplar of a systematic and reportable development of a quality-improvement intervention, with its methods likely to be applicable to other projects. A subsequent study of the intervention has provided early indication that use of systematic methods to specify interventions may help to maximize acceptability and effectiveness.

Explaining clinical behaviors using multiple theoretical models

Background

In the field of implementation research, there is an increased interest in use of theory when designing implementation research studies involving behavior change. In 2003, we initiated a series of five studies to establish a scientific rationale for interventions to translate research findings into clinical practice by exploring the performance of a number of different, commonly used, overlapping behavioral theories and models. We reflect on the strengths and weaknesses of the methods, the performance of the theories, and consider where these methods sit alongside the range of methods for studying healthcare professional behavior change.

Methods

These were five studies of the theory-based cognitions and clinical behaviors (taking dental radiographs, performing dental restorations, placing fissure sealants, managing upper respiratory tract infections without prescribing antibiotics, managing low back pain without ordering lumbar spine x-rays) of random samples of primary care dentists and physicians. Measures were derived for the explanatory theoretical constructs in the Theory of Planned Behavior (TPB), Social Cognitive Theory (SCT), and Illness Representations specified by the Common Sense Self Regulation Model (CSSRM). We constructed self-report measures of two constructs from Learning Theory (LT), a measure of Implementation Intentions (II), and the Precaution Adoption Process. We collected data on theory-based cognitions (explanatory measures) and two interim outcome measures (stated behavioral intention and simulated behavior) by postal questionnaire survey during the 12-month period to which objective measures of behavior (collected from routine administrative sources) were related. Planned analyses explored the predictive value of theories in explaining variance in intention, behavioral simulation and behavior.

Results

Response rates across the five surveys ranged from 21% to 48%; we achieved the target sample size for three of the five surveys. For the predictor variables, the mean construct scores were above the mid-point on the scale with median values across the five behaviors generally being above four out of seven and the range being from 1.53 to 6.01. Across all of the theories, the highest proportion of the variance explained was always for intention and the lowest was for behavior. The Knowledge-Attitudes-Behavior Model performed poorly across all behaviors and dependent variables; CSSRM also performed poorly. For TPB, SCT, II, and LT across the five behaviors, we predicted median R² of 25% to 42.6% for intention, 6.2% to 16% for behavioral simulation, and 2.4% to 6.3% for behavior.

Conclusions

We operationalized multiple theories measuring across five behaviors. Continuing challenges that emerge from our work are: better specification of behaviors, better operationalization of theories; how best to appropriately extend the range of theories; further assessment of the value of theories in different settings and groups; exploring the implications of these methods for the management of chronic diseases; and moving to experimental designs to allow an understanding of behavior change.

Using documents to investigate links between implementation and sustainability in a complex community intervention: the PRISM study

The increasing imperative to find what works in health services has meant a rise in research trialing interventions deemed 'complex'. While the strength of these interventions comes from taking a 'whole of problem' approach using multiple and inter-linking strategies, ways of examining implementation are under-explored. Building sustainability is an important part of implementing complex intervention research, but this too has received little exploration in the implementation literature. This paper explores issues of implementation and sustainability by examining the case of PRISM (Program of Resources, Information and Support for Mothers), a community randomised trial in Victoria, Australia aimed at improving maternal health and wellbeing. It examines documents placed on the project website. Three groups of documents relating to implementation of the intervention were examined - implementation reports, media reports and community newsletters. Analysing these documents allowed a focus on the 'work' of the intervention - who does the work and what activities comprise the work - in order to examine implementation as it relates to sustainability. Document analysis provides a useful way of considering implementation and sustainability of complex intervention research. It can 'value add' to findings from process evaluation and extend our understanding of an intervention beyond outcome measures. Analysis of the documents in this case provides insights into why sustainability of an intervention may be difficult to achieve during implementation.

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

Management of people with acute low-back pain: a survey of Australian chiropractors

Introduction

Chiropractors commonly provide care to people with acute low-back pain (LBP). The aim of this survey was to determine how chiropractors intend to support and manage people with acute LBP and if this management is in accordance with two recommendations from an Australian evidence-based acute LBP guideline. The two recommendations were directed at minimising the use of plain x-ray and encouraging the patient to stay active.

Methods

This is a cross sectional survey of chiropractors in Australia. This paper is part of the ALIGN study in which a targeted implementation strategy was developed to improve the management of acute LBP in a chiropractic setting. This implementation strategy was subsequently tested in a cluster randomised controlled trial. In this survey phase of the ALIGN study we approached a random sample of 880 chiropractors in three States of Australia. The mailed questionnaire consisted of five patient vignettes designed to represent people who would typically present to chiropractors with acute LBP. Four vignettes represented people who, according to the guideline, would not require a plain lumbar x-ray, and one vignette represented a person with a suspected vertebral fracture. Respondents were asked, for each vignette, to indicate which investigation(s) they would order, and which intervention(s) they would recommend or undertake.

Results

Of the 880 chiropractors approached, 137 were deemed ineligible to participate, mostly because they were not currently practising, or mail was returned to sender. We received completed questionnaires from 274 chiropractors (response rate of 37%). Male chiropractors made up 66% of respondents, 75% practised in an urban location and their mean number of years in practice was 15. Across the four vignettes where an x-ray was not indicated 68% (95% Confidence Intervals (CI): 64%, 71%) of chiropractors responded that they would order or take an x-ray. In addition 51% (95%CI: 47%, 56%) indicated they would give advice to stay active when it was indicated. For the vignette where a fracture was suspected, 95% (95% CI: 91%, 97%) of chiropractors would order an x-ray.

Conclusion

The intention of chiropractors surveyed in this study shows low adherence to two recommendations from an evidence-based guideline for acute LBP. Quality of care for these patients could be improved through effective implementation of evidence-based guidelines. Further research to find cost-effective methods to increase implementation is warranted.

Current practices and intention to provide alcohol-related health advice in primary dental care

OBJECTIVES

To determine whether general dental practitioners (GDPs) currently provide alcohol-related advice (ARA) and to inform the development of an intervention, should one be required.

METHOD

Cross-sectional postal survey of a random sample of 300 GDPs in Scotland. The questionnaire assessed beliefs derived from psychological models that explain behaviour in terms of beliefs that are amenable to change, and so may inform development of an intervention to encourage the provision of ARA.

RESULTS

Sixty percent of GDPs responded. Eighty-three percent of participating GDPs (145/175) had not provided ARA to patients in the previous ten working days. Attitude (perceived consequences), control beliefs (perceived difficulty), subjective norm (perceived social pressure), and self-efficacy (confidence) significantly predicted intention to provide ARA. Alcohol-related knowledge or personal alcohol behaviour did not predict intention to provide ARA.

CONCLUSIONS

There is scope to increase the provision of ARA in primary care dentistry and this study identified predictive beliefs, which could be targeted to encourage this behaviour. The next phase is to develop and test an intervention to encourage GDPs to provide ARA.

A health insurance company-initiated practice support intervention for optimizing acid-suppressing drug prescriptions in primary care

BACKGROUND

A health insurance-initiated programme to improve cost-effectiveness of acid-suppressing drugs (ASDs).

AIM

To evaluate the effect of two different interventions of general practitioner support in reducing drug prescription.

MATERIALS AND METHODS

A sequential cluster randomized controlled trial with 90 participating general practitioners in a telephone support (TS) group or practice visit (PV) group. TS group received support in phase-1 (first 6 months), but served as control group in phase-2 (6-12 months period). PV group received no intervention in phase-1, serving as the control group for the TS group, but received support in phase-2. Prescription data were extracted from Agis Health Insurance Database. Outcomes were the proportion of responders to drug reduction and the number of defined daily dose (DDD). Differences in users and DDD were analysed using multilevel regression analysis.

RESULTS

At baseline, 3424 patients used ASD chronically (211 DDDs, on average). The difference between TS and control groups among responders was 3.2% [95% confidence interval (CI): 0.8; 5.6] and relative risk was 1.26 (95% CI: 1.06; 1.51). The difference between PV and control groups was not relevant (0.4%, 95% CI: -1.99; 2.79 and relative risk: 1.01, 95% CI: 0.82; 1.20). The difference in DDD per patient was -3.0 (95% CI: -8.9; 2.9) and -5.82 (95% CI: -12.4; 0.73), respectively.

CONCLUSION

This health insurance company-initiated intervention had a moderate effect on ASD prescription. In contrast to TS, PVs did not seem to reduce ASD prescription rates.

Can self-reported disability assessment behaviour of insurance physicians be explained? Applying the ASE model

Background

Very little is known about the attitudes and views that might underlie and explain the variation in occupational disability assessment behaviour between insurance physicians. In an earlier study we presented an adjusted ASE model (Attitude, Social norm, Self-efficacy) to identify the determinants of the disability assessment behaviour among insurance physicians. The research question of this study is how Attitude, Social norm, Self-efficacy and Intention shape the behaviour that insurance physicians themselves report with regard to the process (Behaviour: process) and content of the assessment (Behaviour: assessment) while taking account of Knowledge and Barriers.

Methods

This study was based on 231 questionnaires filled in by insurance physicians, resulting into 48 scales and dimension scores. The number of variables was reduced by a separate estimation of each of the theoretical ASE constructs as a latent variable in a measurement model. The saved factor scores of these latent variables were treated as observed variables when we estimated a path model with Lisrel to confirm the ASE model. We estimated latent ASE constructs for most of the assigned scales and dimensions. All could be described and interpreted. We used these constructs to build a path model that showed a good fit.

Results

Contrary to our initial expectations, we did not find direct effects for Attitude on Intention and for Intention on self reported assessment behaviour in the model. This may well have been due to the operationalization of the concept of 'Intention'. We did, however, find that Attitude had a positive direct effect on Behaviour: process and Behaviour: Assessment and that Intention had a negative direct effect on Behaviour: process.

Conclusion

A path model pointed to the existence of relationships between Attitude on the one hand and self-reported behaviour by insurance physicians with regard to process and content of occupational disability assessments on the other hand. In addition, Intention was only related to the self reported behaviour with regard to the process of occupational disability assessments. These findings provide some evidence of the relevance of the ASE model in this setting. Further research is needed to determine whether the ASE variables measured for insurance physicians are related to the real practice outcomes of occupational disability assessments.

Instrument development, data collection, and characteristics of practices, staff, and measures in the Improving Quality of Care in Diabetes (iQuaD) Study

Background

Type 2 diabetes is an increasingly prevalent chronic illness and an important cause of avoidable mortality. Patients are managed by the integrated activities of clinical and non-clinical members of primary care teams. This study aimed to: investigate theoretically-based organisational, team, and individual factors determining the multiple behaviours needed to manage diabetes; and identify multilevel determinants of different diabetes management behaviours and potential interventions to improve them. This paper describes the instrument development, study recruitment, characteristics of the study participating practices and their constituent healthcare professionals and administrative staff and reports descriptive analyses of the data collected.

Methods

The study was a predictive study over a 12-month period. Practices (N = 99) were recruited from within the UK Medical Research Council General Practice Research Framework. We identified six behaviours chosen to cover a range of clinical activities (prescribing, non-prescribing), reflect decisions that were not necessarily straightforward (controlling blood pressure that was above target despite other drug treatment), and reflect recommended best practice as described by national guidelines. Practice attributes and a wide range of individually reported measures were assessed at baseline; measures of clinical outcome were collected over the ensuing 12 months, and a number of proxy measures of behaviour were collected at baseline and at 12 months. Data were collected by telephone interview, postal questionnaire (organisational and clinical) to practice staff, postal questionnaire to patients, and by computer data extraction query.

Results

All 99 practices completed a telephone interview and responded to baseline questionnaires. The organisational questionnaire was completed by 931/1236 (75.3%) administrative staff, 423/529 (80.0%) primary care doctors, and 255/314 (81.2%) nurses. Clinical questionnaires were completed by 326/361 (90.3%) primary care doctors and 163/186 (87.6%) nurses. At a practice level, we achieved response rates of 100% from clinicians in 40 practices and > 80% from clinicians in 67 practices. All measures had satisfactory internal consistency (alpha coefficient range from 0.61 to 0.97; Pearson correlation coefficient (two item measures) 0.32 to 0.81); scores were generally consistent with good practice. Measures of behaviour showed relatively high rates of performance of the six behaviours, but with considerable variability within and across the behaviours and measures.

Discussion

We have assembled an unparalleled data set from clinicians reporting on their cognitions in relation to the performance of six clinical behaviours involved in the management of people with one chronic disease (diabetes mellitus), using a range of organisational and individual level measures as well as information on the structure of the practice teams and across a large number of UK primary care practices. We would welcome approaches from other researchers to collaborate on the analysis of this data.

Developing and evaluating interventions to reduce inappropriate prescribing by general practitioners of antibiotics for upper respiratory tract infections: a randomised controlled trial to compare paper-based and web-based modelling experiments

BACKGROUND

Much implementation research is focused on full-scale trials with little evidence of preceding modelling work. The Medical Research Council Framework for developing and evaluating complex interventions has argued for more and better theoretical and exploratory work prior to a trial as a means of improving intervention development. Intervention modelling experiments (IMEs) are a way of exploring and refining an intervention before moving to a full-scale trial. They do this by delivering key elements of the intervention in a simulation that approximates clinical practice by, for example, presenting general practitioners (GPs) with a clinical scenario about making a treatment decision.

METHODS

The current proposal will run a full, web-based IME involving 250 GPs that will advance the methodology of IMEs by directly comparing results with an earlier paper-based IME. Moreover, the web-based IME will evaluate an intervention that can be put into a full-scale trial that aims to reduce antibiotic prescribing for upper respiratory tract infections in primary care. The study will also include a trial of email versus postal invitations to participate.

DISCUSSION

More effective behaviour change interventions are needed and this study will develop one such intervention and a system to model and test future interventions. This system will be applicable to any situation in the National Health Service where behaviour needs to be modified, including interventions aimed directly at the public.

TRIAL REGISTRATION

ClinicalTrials (NCT): NCT01206738.

Does the use of a theoretical approach tell us more about hand hygiene behaviour? The barriers and levers to hand hygiene

Background: Despite many strategies employed to improve hand hygiene, compliance remains low at around 50%. Two reasons have been identified for this. First, implementation strategies are rarely tailored according to assessed barriers and levers to best practice. Secondly there is a lack of explicit theoretical basis for the assessment of these barriers and levers to practice. Aim: This paper reports barriers and levers to hand hygiene and an evaluation of the use of theory in assessing barriers and levers to hand hygiene. Methods: Identification of barriers and levers occurred through interviews, questionnaires and focus groups. In each case two different question schedules were used, one based on psychological theory and the other with no explicit theoretical underpinning. Results: Although there was considerable overlap in the barriers and levers identified using the two schedules there were also marked differences. Conclusions: Identification of further barriers and levers may help us address lack of compliance with hand hygiene. Using a theoretical framework may prompt the identification of barriers that people may not ordinarily report but which have an important impact on behaviour, particularly emotion.

Applying evidence in practice: A qualitative case study of the factors affecting residents’ decisions

Patient care based on best available evidence is increasingly viewed as the hallmark of good quality medical diagnosis and treatment, yet its uptake is often slow and uneven and the reasons underlying the slow diffusion of evidence-based guidelines remain elusive. The authors report a qualitative study conducted at a major US teaching hospital which sought to discover the reasons why an evidence-based anticoagulation guideline appeared to be applied irregularly, with problematic results. Using a theoretical framework derived from Rogers’ work on the diffusion of innovation, this article describes the ways in which a group of residents evaluated and applied evidence in the context of caring for their patients. Future work in evidence-based practice can benefit from a greater emphasis on studies that use multi-method, qualitative designs to explore the complex ways in which people interact with information and the changes that ensue from its use.

Targeting educational interventions to clinician's stage of change

This before-after mixed-method study assessed the effect of a diabetes education and self-efficacy training workshop on clinician knowledge, intention and self-efficacy. This workshop demonstrated and narrowed a knowledge gap but did not change intention or self-efficacy. Neither the intervention nor the measured outcomes were targeted to clinicians' stage of change.

Applying multiple models to predict clinicians' behavioural intention and objective behaviour when managing children's teeth

This study used multiple theoretical approaches simultaneously to predict an objectively measured clinical behaviour. The six theoretical approaches were: The Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Action Planning (AP) and the Precaution Adoption Process (PAP), with knowledge as an additional predictor. Data on variables from these models were collected by postal survey. Data on the outcome behaviour, the evidence-based practice of placing fissure sealants, was collected from clinical records. Participants were 133 dentists (64% male) in Scotland. Variables found to predict the behaviour were: intention, attitude, perceived behavioural control, risk perception, outcome expectancies, self efficacy, habit, anticipated consequences, experienced consequences and action planning. The TPB, SCT, AP, OLT and PAP significantly predicted behaviour but the CS-SRM did not. A combined (Stepwise) regression model included only intention and action planning. Post hoc analyses showed action planning mediated effect of intention on behaviour. Taking a theory-based approach creates a replicable methodology for identifying factors predictive of clinical behaviour and for the design and choice of interventions to modify practice as new evidence emerges, increasing current options for improving health outcomes through influencing the implementation of best practice.

Improving professional practice in the disclosure of a diagnosis of dementia: a modeling experiment to evaluate a theory-based intervention

BACKGROUND

Among health professionals, there is wide variation in the practice of disclosing a diagnosis of dementia to patients.

PURPOSE

The purpose of this study was to evaluate the effect of one theory-based and two pragmatic interventions on intention to perform three behaviors, namely (1) finding out what the patient already knows or suspects about their diagnosis; (2) using the actual words "dementia" or "Alzheimer's disease" when talking to the patient (i.e., the use of explicit terminology); (3) exploring what the diagnosis means to the patient.

METHOD

Within an intervention-modeling process, members of old-age mental health teams in England were sent postal questionnaires measuring psychological variables. Respondents were randomized by team to one of four groups to receive: theory-based intervention; evidence-based communication; patient-based intervention; or no intervention (control). Interventions were delivered as pen-and-paper exercises at the start of a second postal questionnaire that remeasured the same psychological variables. The outcome measures were intention and scenario-based behavioral simulation.

RESULTS

Responses were received from 644 of 1,103 (58%) individuals from 179 of 205 (87%) mental health teams. There were no significant differences in terms of intention or simulated behavior between the trial groups. The theory-based intervention significantly increased scores for attitudes to (p = 0.03) and perceived behavioral control (p = 0.001) for the behavior of "finding out what the patient already knows or suspects about their diagnosis."

CONCLUSIONS

The intervention had a limited effect. This may be partly explained by clinical or methodological factors. The use of a systematic intervention modeling process allows clearer understanding of the next appropriate steps which should involve further evaluation of the interventions using an interactive delivery method in a less selected group of study participants.