A randomized trial of Evidence-based OutReach (EBOR): rationale and design

A realist synthesis of educational outreach visiting and integrated academic detailing to influence prescribing in ambulatory care: why relationships and dialogue matter

BACKGROUND

Many quality improvement initiatives in healthcare employ educational outreach visits, integrating academic detailing to bridge evidence-practice gaps and accelerate knowledge translation. Replicability of their outcomes in different contexts varies, and what makes some visiting programmes more successful than others is unclear.

OBJECTIVE

We conducted a realist synthesis to develop theories of what makes educational outreach visiting integrating academic detailing work, for whom, under which circumstances and why, focusing on the clinician-visitor interaction when influencing prescribing of medicines in ambulatory care settings.

METHODS

The realist review was performed in accordance with RAMESES standards. An initial programme theory was generated, academic databases and grey literature were screened for documents with detail on contexts, intervention and outcomes. Using realist logic of analysis, data from 43 documents were synthesised in the generation of a refined programme theory, supported by additional theoretical frameworks of learning and communication.

RESULTS

Twenty-seven interdependent context-mechanism-outcome configurations explain how clinicians engage with educational outreach visits integrating academic detailing through programme design, what matters in programme design and the educational visitor-clinician interaction and how influence extends beyond the visit. They suggest that in addition to relevance, credibility and trustworthiness of a visit's contents, communication and clinical skills of educational visitors, the relationship between the educational visitor and clinician, built on a dialogue of learning from and sense-making with each other, creates conditions of critical thinking which are conducive to facilitating prescribing practice change when necessary.

CONCLUSION

This realist synthesis elucidates that the quality of clinician-educational visitor interactions is pivotal to educational outreach visiting programmes. Building and sustaining relationships, and establishing an open dialogue are important; neglecting these undermines the impact of visits. Educational visitors can facilitate clinicians' reflection on practice and influence their prescribing. Clinicians value the discussion of individualised, tailored information and advice they can translate into their practice.

PROSPERO REGISTRATION NUMBER

CRD42021258199.

Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact

OBJECTIVES

This study proposes methods for blending design components of clinical effectiveness and implementation research. Such blending can provide benefits over pursuing these lines of research independently; for example, more rapid translational gains, more effective implementation strategies, and more useful information for decision makers. This study proposes a "hybrid effectiveness-implementation" typology, describes a rationale for their use, outlines the design decisions that must be faced, and provides several real-world examples.

RESULTS

An effectiveness-implementation hybrid design is one that takes a dual focus a priori in assessing clinical effectiveness and implementation. We propose 3 hybrid types: (1) testing effects of a clinical intervention on relevant outcomes while observing and gathering information on implementation; (2) dual testing of clinical and implementation interventions/strategies; and (3) testing of an implementation strategy while observing and gathering information on the clinical intervention's impact on relevant outcomes.

CONCLUSIONS

The hybrid typology proposed herein must be considered a construct still in evolution. Although traditional clinical effectiveness and implementation trials are likely to remain the most common approach to moving a clinical intervention through from efficacy research to public health impact, judicious use of the proposed hybrid designs could speed the translation of research findings into routine practice.

How effective are pharmacists who work with medical practitioners? A study of interventions intended to influence prescribing

Objective

This study was designed to describe the interventions made by pharmacists working within different therapeutic areas in medical practices in primary care and to estimate the effects on prescribing.

Method

All medical practices and community pharmacists in one health authority area in England were invited to participate. Pharmacists were allocated to work with specific practices and training was provided in musculoskeletal, respiratory and anxiolytic/hypnotic (sedative) prescribing. Pharmacists negotiated and agreed with their medical practice the type of interventions which would meet the practice's needs. Pharmacists were remunerated to provide a maximum of eight three-hour sessions in each medical practice on each therapeutic area over a 12-month period. Details of all interventions were recorded by each pharmacist and countersigned by a practice GP. A summary form was then sent to the health authority. Analysis of prescribing data before and after intervention in all practices was carried out using a predictive model to calculate estimated costs.

Key findings

Twenty-seven pharmacists working with 39 medical practices participated in the study. Pharmacist interventions resulted in 165 dose changes, 368 drug changes, 470 drug discontinuations and 1,042 patient reviews. On average, £3.99 was saved for each musculoskeletal intervention made. This compared with an additional cost of £15.50 and £17.92 for each intervention in sedative and respiratory prescribing, respectively. Analysis of prescribing data showed that the total spend in musculoskeletal and sedative prescribing in participating practices one year after intervention was lower than that predicted.

Conclusion

Accurate recording of individual interventions with reasons, outcomes and direct cost consequences allows purchasers to make more informed decisions about the potential benefits of practice pharmacists. This method may, however, underestimate the pharmacist's indirect impact on prescribing since it does not take into account any educational effect on prescribers.

Educational Interventions for Implementation of Arthritis Clinical Practice Guidelines in Primary Care: Effects on Health Professional Behavior

Objective.

The dissemination and adoption of clinical practice guidelines (CPG) has been suggested as one method for improving arthritis care delivery. This article provides a review and synthesis of studies evaluating the influence of educational programs designed to implement CPG for osteoarthritis (OA) and rheumatoid arthritis (RA) in primary care.

Methods.

A systematic literature search was conducted to identify relevant educational interventions that reported behavioral outcomes that ensured actual knowledge utilization in primary care. A standardized approach was used to assess the quality of the individual studies and a modified version of the Philadelphia Panel methodology allowed for grading of studies based on strength of design, clinical relevance, and statistical significance.

Results.

The search identified 485 articles; 7 studies were selected for review. In OA, peer facilitated workshops with nurse case-management support for patients decreased the number of referrals to orthopedics by 23%, and educational outreach by trained physicians improved prescribing of analgesics. Interprofessional peer facilitated workshops were successful in increasing referrals to rehabilitation services for people with OA and RA.

Conclusion.

There was sparse literature on educational programs for the implementation of arthritis CPG in the primary care environment. Future studies are needed to evaluate which specific organizational, provider, patient, and system level factors influence the uptake of arthritis CPG in primary care.

Changing clinicians' behavior: a randomized controlled trial of fees and education

The fissure-sealing of newly erupted molars is an effective caries prevention treatment, but remains underutilized. Two plausible reasons are the financial disincentive produced by the dental remuneration system, and dentists' lack of awareness of evidence-based practice. The primary hypothesis was that implementation strategies based on remuneration or training in evidence-based healthcare would produce a higher proportion of children receiving sealed second permanent molars than standard care. The four study arms were: fee per sealant treatment, education in evidence-based practice, fee plus education, and control. A cost-effectiveness analysis was conducted. Analysis was based on 133 dentists and 2833 children. After adjustment for baseline differences, the primary outcome was 9.8% higher when a fee was offered. The education intervention had no statistically significant effect. 'Fee only' was the most cost-effective intervention. The study contributes to the incentives in health care provision debate, and led to the introduction of a direct fee for this treatment.

The role of evidence-based medicine in neurosurgery

Evidence-based medicine (EBM) has become one of the pillars of modern medicine. There are many myths and misconceptions about EBM that retard its application into neurosurgical practice. We aim to dispel some of these. Neurosurgeons should cultivate sound EBM practice and strive to improve the available evidence base for neurosurgery. Although randomised controlled trials are not suitable to investigate many neurosurgical problems, this does not preclude practising EBM that requires consideration of the strongest available evidence at the time of clinical decision making. Although individualised analysis of primary sources of evidence gives the clearest analysis, the diversity and complexity of modern medicine means that it is difficult for clinicians to stay abreast of all EBM through this mechanism alone. The development of evidence-based practice guidelines by neurosurgeons is a practical alternative. We recommend that neurosurgical organisations and societies take up this challenge and develop EBM education programs, encouraging the practise of EBM by neurosurgeons and neurosurgical trainees.

Educational outreach visits: effects on professional practice and health care outcomes

BACKGROUND

Educational outreach visits (EOVs) have been identified as an intervention that may improve the practice of healthcare professionals. This type of face-to-face visit has been referred to as university-based educational detailing, academic detailing, and educational visiting.

OBJECTIVES

To assess the effects of EOVs on health professional practice or patient outcomes.

SEARCH STRATEGY

For this update, we searched the Cochrane EPOC register to March 2007. In the original review, we searched multiple bibliographic databases including MEDLINE and CINAHL.

SELECTION CRITERIA

Randomised trials of EOVs that reported an objective measure of professional performance or healthcare outcomes. An EOV was defined as a personal visit by a trained person to healthcare professionals in their own settings.

DATA COLLECTION AND ANALYSIS

Two reviewers independently extracted data and assessed study quality. We used bubble plots and box plots to visually inspect the data. We conducted both quantitative and qualitative analyses. We used meta-regression to examine potential sources of heterogeneity determined a priori. We hypothesised eight factors to explain variation across effect estimates. In our primary visual and statistical analyses, we included only studies with dichotomous outcomes, with baseline data and with low or moderate risk of bias, in which the intervention included an EOV and was compared to no intervention.

MAIN RESULTS

We included 69 studies involving more than 15,000 health professionals. Twenty-eight studies (34 comparisons) contributed to the calculation of the median and interquartile range for the main comparison. The median adjusted risk difference (RD) in compliance with desired practice was 5.6% (interquartile range 3.0% to 9.0%). The adjusted RDs were highly consistent for prescribing (median 4.8%, interquartile range 3.0% to 6.5% for 17 comparisons), but varied for other types of professional performance (median 6.0%, interquartile range 3.6% to 16.0% for 17 comparisons). Meta-regression was limited by the large number of potential explanatory factors (eight) with only 31 comparisons, and did not provide any compelling explanations for the observed variation in adjusted RDs. There were 18 comparisons with continuous outcomes, with a median adjusted relative improvement of 21% (interquartile range 11% to 41%). There were eight trials (12 comparisons) in which the intervention included an EOV and was compared to another type of intervention, usually audit and feedback. Interventions that included EOVs appeared to be slightly superior to audit and feedback. Only six studies evaluated different types of visits in head-to-head comparisons. When individual visits were compared to group visits (three trials), the results were mixed.

AUTHORS' CONCLUSIONS

EOVs alone or when combined with other interventions have effects on prescribing that are relatively consistent and small, but potentially important. Their effects on other types of professional performance vary from small to modest improvements, and it is not possible from this review to explain that variation.

Value for money of changing healthcare services? Economic evaluation of quality improvement

There are many instances of perceived or real inefficiencies in health service delivery. Both healthcare providers and policy makers need to know the impact and cost of applying strategies to change the behaviour of individuals or organisations. Quality improvement or implementation research is concerned with evaluating the methods of behavioural change. Addressing inefficiencies in healthcare services raises a series of issues, beginning with how inefficiency itself should be defined. The basic concepts of cost analysis and economic evaluations are explained and a model for working through the economic issues of quality improvement is discussed. This model combines the costs and benefits of corrected inefficiency with the costs and degree of behavioural change achieved by a quality improvement method in the policy maker's locality. It shows why it may not always be cost effective for policy makers to address suboptimal behaviour. Both the interpretation of quality improvement research findings and their local application need careful consideration. The limited availability of applicable quality improvement research may make it difficult to provide robust advice on the value for money of many behavioural quality improvement strategies.

Pilot study on the feasibility and acceptability of academic detailing in general practice

OBJECTIVE

To investigate the feasibility and acceptability of academic detailing in general practice in the North-East-Flanders region of Belgium.

METHODS

All local quality groups in the study region were randomly allocated to either (1) two academic detailing visits to the individual members or (2) two academic detailing visits during the meetings of the local quality group. During these visits, the results of a systematic review of the literature on non-steroidal anti-inflammatory agents (NSAIDs) were presented.

RESULTS

Of 14 local quality groups, 12 allocated to the individual intervention agreed to participate. Of the 184 physicians invited to receive an academic detailer, 142 had two visits on NSAIDs. One hundred and five physicians gave their opinion on the visits by means of a questionnaire. The great majority of the responders (90%) wished to receive an academic detailer on other topics in the future, with a frequency of two visits per year. Of 13 local quality groups, 12 allocated to the group intervention, with a total number of 192 physicians who agreed to participate. Ten local quality groups with 166 members received the information on NSAIDs. The actual attendance rate per intervention session was approximately two out of three physicians. All 166 physicians of the participating local quality groups were offered an evaluation form, and 79 responded. Of the responders who received the full group intervention, 88% wished to have more academic detailing visits on other topics in their local quality group. A comparison between the evaluation forms of the individual and the group intervention revealed no major differences concerning the acceptability of the intervention.

CONCLUSION

The pilot study showed that academic detailing is feasible in the North-East-Flanders region of Belgium. Both the individual visits and the visits to the local quality groups were rated positively, and a majority of the general practitioners who returned the evaluation questionnaire wished to receive such visits in the future. The structure of the local quality groups implies limitations to the practical organisation of a visit, but requires less time investment than individual visits.

Using effectiveness studies for prescribing research, part 2

Trials that consider the effects of interventions on prescribing behaviour amongst clinicians often have complex design implications resulting in data that has inherent hierarchical structure. It follows that both experimental design and analysis plans must account for this structure and thus results should be considered in terms of clinician behaviour rather than individual patient response. We describe this change in perspective and the necessity for using statistical techniques that allow incorporation of potential confounding effects. We also discuss the appropriateness of some specific outcomes in relation to these trials.

Using effectiveness studies for prescribing research, part 1

The process of evaluating pharmaceuticals has become highly conceptualized in contrast to the lack of formal rules for assessing effects of interventions on practice. We argue that clinical audit is a key factor prior to instigating an intervention and that randomized controlled evaluations are preferable. We discuss the need for small-scale experiments prior to full trials to validate the underlying concept of an intervention with the recognition that different approaches may be necessary. This includes open rather than blind assessments and greater emphasis on qualitative issues during development of interventions followed by quantitative appraisal of their impact.

Disseminating and implementing the results of back pain research in primary care

STUDY DESIGN

Description of a workshop entitled "Implementation and Dissemination: Getting Research into Practice," that was held at the Fourth International Forum on Low Back Pain Research in Primary Care, in Israel in March 2000.

SUMMARY OF BACKGROUND DATA

A gap exists between research endeavors and the dissemination and implementation of new research findings.

OBJECTIVES

To describe the outcomes of a workshop on implementation and dissemination of research findings.

METHODS

The Fourth International Forum on Low Back Pain Research in Primary Care aimed to encourage open discussion and consensus building among leading experts in the field, and to develop a research agenda. The workshop on implementation and dissemination focused on issues surrounding the gap between research results and actual practice. These issues were introduced by several presentations. The broad conclusions of the subsequent debate are summarized in this paper as a series of responses to key questions: 1) who should do the implementation?, 2) what should researchers do to help implementation?, 3) what are the key outcomes?, and 4) what are important ingredients for successful implementation?

RESULTS

There was consensus about the importance of implementation of research findings, about the ineffectiveness of merely publishing or disseminating research findings, and about the need for prospective randomized trials evaluating the cost-effectiveness of different implementation strategies. The majority view is that the health provider professions and the professional bodies are the central organizations to implement guidelines, rather than the researchers themselves. Success in getting guidelines or research results into practice is dependent on involving local health service groups, experts, and opinion leaders (both local and national). Patient-centered outcomes and cost-effectiveness of guideline implementation were considered important. It was acknowledged that there are many potentially effective ingredients for successful implementation, but a clear indication of the contents of an effective implementation strategy is still lacking.

CONCLUSIONS

The plenary and workshops focused on closing the gap between research results and actual practice. As long as we do not fully understand how best to influence and change physician behavior, the choice of implementation strategies should be based on the present knowledge of potentially effective interventions and should include considerations of available resources for, and potential barriers to, implementation.

Sleeping with the enemy? A randomized controlled trial of a collaborative health authority/industry intervention to influence prescribing practice

AIMS

To evaluate the effectiveness of a health authority/pharmaceutical company collaborative intervention to influence the choice of proton pump inhibitors

METHODS

Randomized controlled trial, with general practices forming the unit of allocation and analysis.

RESULTS

Constructive working relationships were achieved with five of six pharmaceutical companies involved. One hundred and two out of 140 practitioners in intervention group practices received at least one visit from an industry representative. There were no reports of representatives operating outside their agreed remit. Prescribing in both the intervention and control group moved towards that recommended by the guidelines but there was no difference between the groups in either the proportion of prescriptions in line with the guidelines or the overall cost.

CONCLUSIONS

Health authorities can achieve professional working relationships with the pharmaceutical industry although no changes in practice attributable to the intervention are achieved. Further work is required to develop effective means to influence prescribing in line with independent guidelines especially in the context of the development of Primary Care Groups.