Effect of audit and feedback, and reminder messages on primary-care radiology referrals: a randomised trial

To what extent can behaviour change techniques be identified within an adaptable implementation package for primary care? A prospective directed content analysis

BACKGROUND

Interpreting evaluations of complex interventions can be difficult without sufficient description of key intervention content. We aimed to develop an implementation package for primary care which could be delivered using typically available resources and could be adapted to target determinants of behaviour for each of four quality indicators: diabetes control, blood pressure control, anticoagulation for atrial fibrillation and risky prescribing. We describe the development and prospective verification of behaviour change techniques (BCTs) embedded within the adaptable implementation packages.

METHODS

We used an over-lapping multi-staged process. We identified evidence-based, candidate delivery mechanisms-mainly audit and feedback, educational outreach and computerised prompts and reminders. We drew upon interviews with primary care professionals using the Theoretical Domains Framework to explore likely determinants of adherence to quality indicators. We linked determinants to candidate BCTs. With input from stakeholder panels, we prioritised likely determinants and intervention content prior to piloting the implementation packages. Our content analysis assessed the extent to which embedded BCTs could be identified within the packages and compared them across the delivery mechanisms and four quality indicators.

RESULTS

Each implementation package included at least 27 out of 30 potentially applicable BCTs representing 15 of 16 BCT categories. Whilst 23 BCTs were shared across all four implementation packages (e.g. BCTs relating to feedback and comparing behaviour), some BCTs were unique to certain delivery mechanisms (e.g. 'graded tasks' and 'problem solving' for educational outreach). BCTs addressing the determinants 'environmental context' and 'social and professional roles' (e.g. 'restructuring the social and 'physical environment' and 'adding objects to the environment') were indicator specific. We found it challenging to operationalise BCTs targeting 'environmental context', 'social influences' and 'social and professional roles' within our chosen delivery mechanisms.

CONCLUSION

We have demonstrated a transparent process for selecting, operationalising and verifying the BCT content in implementation packages adapted to target four quality indicators in primary care. There was considerable overlap in BCTs identified across the four indicators suggesting core BCTs can be embedded and verified within delivery mechanisms commonly available to primary care. Whilst feedback reports can include a wide range of BCTs, computerised prompts can deliver BCTs at the time of decision making, and educational outreach can allow for flexibility and individual tailoring in delivery.

Overtesting and undertesting in primary care: a systematic review and meta-analysis

BACKGROUND

Health systems are currently subject to unprecedented financial strains. Inappropriate test use wastes finite health resources (overuse) and delays diagnoses and treatment (underuse). As most patient care is provided in primary care, it represents an ideal setting to mitigate waste.

OBJECTIVE

To identify overuse and underuse of diagnostic tests in primary care.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES AND ELIGIBILITY CRITERIA

We searched MEDLINE and Embase from January 1999 to October 2017 for studies that measured the inappropriateness of any diagnostic test (measured against a national or international guideline) ordered for adult patients in primary care.

RESULTS

We included 357 171 patients from 63 studies in 15 countries. We extracted 103 measures of inappropriateness (41 underuse and 62 overuse) from included studies for 47 different diagnostic tests.The overall rate of inappropriate diagnostic test ordering varied substantially (0.2%-100%)%).17 tests were underused >50% of the time. Of these, echocardiography (n=4 measures) was consistently underused (between 54% and 89%, n=4). There was large variation in the rate of inappropriate underuse of pulmonary function tests (38%-78%, n=8).Eleven tests were inappropriately overused >50% of the time. Echocardiography was consistently overused (77%-92%), whereas inappropriate overuse of urinary cultures, upper endoscopy and colonoscopy varied widely, from 36% to 77% (n=3), 10%-54% (n=10) and 8%-52% (n=2), respectively.

CONCLUSIONS

There is marked variation in the appropriate use of diagnostic tests in primary care. Specifically, the use of echocardiography (both underuse and overuse) is consistently poor. There is substantial variation in the rate of inappropriate underuse of pulmonary function tests and the overuse of upper endoscopy, urinary cultures and colonoscopy.

PROSPERO REGISTRATION NUMBER

CRD42016048832.

Towards Quality, Comprehensiveness and Excellence. The Accreditation Project of the Organisation of European Cancer Institutes (OECI)

There are important gaps in the health status of citizens across Europe, as measured by life expectancy, mortality or morbidity data (Report for the European Commission on the health status of the European Union, 2003). Among the main determinants of the major causes of mortality and morbidity, stated in this report, stands recurrently access to quality healthcare. There is a fundamental need to define quality indicators and set minimal levels of performance quality criteria for healthcare. There is a need to integrate research into healthcare and to provide patients with equity of access to such high quality care. Oncology is a speciality particularly suited to experimenting a first application of accreditation at European level. The Organisation of European Cancer Institutes is a growing network of cancer Centres in Europe. The focus of the OECI is to work with professionals and organisations with regard to prevention, care, research, development, patient's role and education. In order to fulfil its mission, the OECI initiated in 2002 an accreditation project with three objectives: • to develop a comprehensive accreditation system for oncology care, taking into account prevention, care, research, education and networking. • to set an updated database of cancer centres in Europe, with exhaustive information on their resources and activities (in care, research, education and management) • to develop a global labelling tool dedicated to comprehensive cancer centres in Europe, designating the various types of cancer structures, and the comprehensive cancer centres of reference and Excellence.

An accreditation tool has been established, defining standards and criteria for prevention, care, research, education and follow-up activities. A quantitative database of cancer centres is integrated in the tool, with a questionnaire, that provides an overall view of the oncological landscape in OECI cancer centres in Europe. Data on infrastructures, resources and activities have been collected. This OECI accreditation tool will be launched in autumn 2008 for all cancer centres in Europe. It serves as a basis for the development of the labelling tool for cancer structures in Europe, with a focus on Comprehensiveness and Excellence labels. Quality assessment and improvement is a critical need in Europe and is addressed by the OECI for cancer care in Europe. Accreditation is a well accepted process and is feasible. Standards and criteria as well as an accreditation tool have been developed. The OECI questionnaire gives an accurate vision of cancer institutions throughout Europe, helping assessing the needs and providing standards. The accreditation project is a long-term complete and voluntary process with external and internal added value, an active process of sharing information and experience that should help the whole cancer community reach comprehensiveness and excellence.

Reducing Inappropriate Lumbar Spine MRI for Low Back Pain: Radiology Support, Communication and Alignment Network

PURPOSE

The aim of this study is to evaluate the impact of educational sessions on reducing lumbar spine MRI inappropriateness for uncomplicated low back pain and to present our institutional experience on the use of ACR's Radiology Support, Communication and Alignment Network (R-SCAN) program toward achieving appropriateness.

METHODS

The R-SCAN web portal was accessed to register a project. Using order entry data, the number of lumbar spine MRI orders placed per month at three family medicine clinics was assessed over a 10-month period. After educational presentations were given at those three clinics highlighting the American College of Physicians and Choosing Wisely campaign imaging guidelines, the number of MRI orders placed was reassessed over an additional 10 months. For a subset of these exams, the ACR Appropriateness Criteria rating of the lumbar spine MRIs were compared between the pre- and posteducation periods. A P value < .05 was considered statistically significant.

RESULTS

The average number of monthly MRIs ordered from all three clinics combined was 6.3 during the posteducation period, which was significantly less than during the pre-education period of 10.0 (P = .009). The combined average ACR Appropriateness Criteria rating made at all three clinics was 5.8 after educational sessions, which was significantly higher than the rating of 4.7 before educational sessions (P = .014).

CONCLUSION

Clinician education, facilitated by R-SCAN, resulted in a reduced number of MRI lumbar spine studies performed for uncomplicated low back pain and improved appropriateness of those studies as measured by the ACR Appropriateness Criteria rating.

Developing implementation science to improve the translation of research to address low back pain: A critical review

The evidence base regarding treatment for back pain does not align with clinical practice. Currently there is relatively little evidence to guide health decision-makers on how to improve the use, uptake or adoption of evidence-based recommended practice for low back pain. Improving the design, conduct and reporting of strategies to improve the implementation of back pain care will help address this important evidence-practice gap. In this paper, we.

Justification and active guideline implementation for spine radiography referrals in primary care

Background Spinal disorders are a major public health problem. Appropriate diagnostic imaging is an essential part in the management of back complaints. Nevertheless, inappropriate imaging increases population collective dose and health costs without improving outcome. Purpose To determine the effects of active implementation of referral guidelines on the number and justification of spine radiography in primary care in one city. Material and Methods Specified guidelines for spine radiography were distributed to referring practitioners altogether three times during the study period. Educational lectures were provided before the guidelines were taken into use. The guidelines were also made available via the intranet. The number of spine radiography referrals during similar 6-month periods in the year preceding the interventions and the following 2 years was analyzed. Justification of 448 spine radiographs was assessed similarly. Results After interventions, the total number of spine radiography examinations decreased by 48% (P < 0.001) and that of cervical spine radiography by 46% ( P < 0.001), thoracic spine by 53% ( P < 0.001), and lumbar spine by 47% ( P < 0.001). The results persisted after 1-year follow-up. Before interventions, 24% of the cervical, 46% of the thoracic, and 32% of the lumbar spine radiography referrals were justified. After interventions, only justification of lumbar spine radiography improved significantly, 64% being justified ( P = 0.005). Conclusion Spine radiography in primary care can be reduced significantly by active referral guideline implementation. The proportion of inappropriate radiography was unexpectedly high. Thus, further education and studies concerning the appropriate use of spinal radiography seems to be needed.

General practitioner views on the determinants of test ordering: a theory-based qualitative approach to the development of an intervention to improve immunoglobulin requests in primary care

BACKGROUND

Research suggests that variation in laboratory requesting patterns may indicate unnecessary test use. Requesting patterns for serum immunoglobulins vary significantly between general practitioners (GPs). This study aims to explore GP's views on testing to identify the determinants of behaviour and recommend feasible intervention strategies for improving immunoglobulin test use in primary care.

METHODS

Qualitative semi-structured interviews were conducted with GPs requesting laboratory tests at Cork University Hospital or University Hospital Kerry in the South of Ireland. GPs were identified using a Health Service Executive laboratory list of GPs in the Cork-Kerry region. A random sample of GPs (stratified by GP requesting patterns) was generated from this list. GPs were purposively sampled based on the criteria of location (urban/rural); length of time qualified; and practice size (single-handed/group). Interviews were carried out between December 2014 and February 2015. Interviews were transcribed verbatim using NVivo 10 software and analysed using the framework analysis method. Emerging themes were mapped to the theoretical domains framework (TDF), which outlines 12 domains that can enable or inhibit behaviour change. The behaviour change wheel and behaviour change technique (BCT) taxonomy were then used to identify potential intervention strategies.

RESULTS

Sixteen GPs were interviewed (ten males and six females). Findings suggest that intervention strategies should specifically target the key barriers to effective test ordering, while considering the context of primary care practice. Seven domains from the TDF were perceived to influence immunoglobulin test ordering behaviours and were identified as 'mechanisms for change' (knowledge, environmental context and resources, social/professional role and identity, beliefs about capabilities, beliefs about consequences, memory, attention and decision-making processes and behavioural regulation). Using these TDF domains, seven BCTs emerged as feasible 'intervention content' for targeting GPs' ordering behaviour. These included instructions on how to effectively request the test (how to perform behaviour), information on GPs' use of the test (feedback on behaviour), information about patient consequences resulting from not doing the test (information about health consequences), laboratory/consultant-based advice/education (credible source), altering the test ordering form (restructuring the physical environment), providing guidelines (prompts/cues) and adding interpretive comments to the results (adding objects to the environment). These BCTs aligned to four intervention functions: education, persuasion, environmental restructuring and enablement.

CONCLUSIONS

This study has effectively applied behaviour change theory to identify feasible strategies for improving immunoglobulin test use in primary care using the TDF, 'behaviour change wheel' and BCT taxonomy. The identified BCTs will form the basis of a theory-based intervention to improve the use of immunoglobulin tests among GPs. Future research will involve the development and evaluation of this intervention.

Interventions Aimed at Reducing Use of Low-Value Health Services: A Systematic Review

The effectiveness of different types of interventions to reduce low-value care has been insufficiently summarized to allow for translation to practice. This article systematically reviews the literature on the effectiveness of interventions to reduce low-value care and the quality of those studies. We found that multicomponent interventions addressing both patient and clinician roles in overuse have the greatest potential to reduce low-value care. Clinical decision support and performance feedback are promising strategies with a solid evidence base, and provider education yields changes by itself and when paired with other strategies. Further research is needed on the effectiveness of pay-for-performance, insurer restrictions, and risk-sharing contracts to reduce use of low-value care. While the literature reveals important evidence on strategies used to reduce low-value care, meaningful gaps persist. More experimentation, paired with rigorous evaluation and publication, is needed.

Implementation interventions to improve the management of non-specific low back pain: a systematic review

BACKGROUND

Recommendations in clinical practice guidelines for non-specific low back pain (NSLBP) are not necessarily translated into practice. Multiple studies have investigated different interventions to implement best evidence into clinical practice yet no synthesis of these studies has been carried out to date. The aim of this study was to systematically review available studies to determine whether implementation interventions in this field have been effective and to identify which strategies have been most successful in changing healthcare practitioner behaviours and improving patient outcomes.

METHODS

A systematic review was undertaken, searching electronic databases until end of December 2012 plus hand searching, writing to key authors and using prior knowledge of the field to identify papers. Included studies evaluated an implementation intervention to improve the management of NSLBP in clinical practice, measured key outcomes regarding change in practitioner behaviour and/or patient outcomes and subjected their data to statistical analysis. The Cochrane Effective Practice and Organisation of Care (EPOC) recommendations about systematic review conduct were followed. Study inclusion, data extraction and study risk of bias assessments were conducted independently by two review authors.

RESULTS

Of 7654 potentially eligible citations, 17 papers reporting on 14 studies were included. Risk of bias of included studies was highly variable with 7 of 17 papers rated at high risk. Single intervention or one-off implementation efforts were consistently ineffective in changing clinical practice. Increasing the frequency and duration of implementation interventions led to greater success with those continuously ongoing over time the most successful in improving clinical practice in line with best evidence recommendations.

CONCLUSIONS

Single intervention or one-off implementation interventions may seem attractive but are largely unsuccessful in effecting meaningful change in clinical practice for NSLBP. Increasing frequency and duration of implementation interventions seems to lead to greater success and the most successful implementation interventions used consistently sustained strategies.

Efficient treatment allocation in 2 × 2 cluster randomized trials, when costs and variances are heterogeneous

Typically, clusters and individuals in cluster randomized trials are allocated across treatment conditions in a balanced fashion. This is optimal under homogeneous costs and outcome variances. However, both the costs and the variances may be heterogeneous. Then, an unbalanced allocation is more efficient but impractical as the outcome variance is unknown in the design stage of a study. A practical alternative to the balanced design could be a design optimal for known and possibly heterogeneous costs and homogeneous variances. However, when costs and variances are heterogeneous, both designs suffer from loss of efficiency, compared with the optimal design. Focusing on cluster randomized trials with a 2 × 2 design, the relative efficiency of the balanced design and of the design optimal for heterogeneous costs and homogeneous variances is evaluated, relative to the optimal design. We consider two heterogeneous scenarios (two treatment arms with small, and two with large, costs or variances, or one small, two intermediate, and one large costs or variances) at each design level (cluster, individual, and both). Within these scenarios, we compute the relative efficiency of the two designs as a function of the extents of heterogeneity of the costs and variances, and the congruence (the cheapest treatment has the smallest variance) and incongruence (the cheapest treatment has the largest variance) between costs and variances. We find that the design optimal for heterogeneous costs and homogeneous variances is generally more efficient than the balanced design and we illustrate this theory on a trial that examines methods to reduce radiological referrals from general practices. Copyright © 2016 John Wiley & Sons, Ltd.

Professional interventions for general practitioners on the management of musculoskeletal conditions

BACKGROUND

Musculoskeletal conditions require particular management skills. Identification of interventions which are effective in equipping general practitioners (GPs) with such necessary skills could translate to improved health outcomes for patients and reduced healthcare and societal costs.

OBJECTIVES

To determine the effectiveness of professional interventions for GPs that aim to improve the management of musculoskeletal conditions in primary care. 

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), 2010, Issue 2; MEDLINE, Ovid (1950 - October 2013); EMBASE, Ovid (1980 - Ocotber 2013); CINAHL, EbscoHost (1980 - November 2013), and the EPOC Specialised Register. We conducted cited reference searches using ISI Web of Knowledge and Google Scholar; and handsearched selected issues of Arthritis and Rheumatism and Primary Care-Clinics in Office Practice. The latest search was conducted in November 2013.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies of professional interventions for GPs, taking place in a community setting, aiming to improve the management (including diagnosis and treatment) of musculoskeletal conditions and reporting any objective measure of GP behaviour, patient or economic outcomes. We considered professional interventions of any length, duration, intensity and complexity compared with active or inactive controls.

DATA COLLECTION AND ANALYSIS

Two review authors independently abstracted all data. We calculated the risk difference (RD) and risk ratio (RR) of compliance with desired practice for dichotomous outcomes, and the mean difference (MD) and standardised mean difference (SMD) for continuous outcomes. We investigated whether the direction of the targeted behavioural change affects the effectiveness of interventions.

MAIN RESULTS

Thirty studies met our inclusion criteria.From 11 studies on osteoporosis, meta-analysis of five studies (high-certainty evidence) showed that a combination of a GP alerting system on a patient's increased risk of osteoporosis and a patient-directed intervention (including patient education and a reminder to see their GP) improves GP behaviour with regard to diagnostic bone mineral density (BMD) testing and osteoporosis medication prescribing (RR 4.44; (95% confidence interval (CI) 3.54 to 5.55; 3 studies; 3,386 participants)) for BMD and RR 1.71 (95% CI 1.50 to 1.94; 5 studies; 4,223 participants) for osteoporosis medication. Meta-analysis of two studies showed that GP alerting on its own also probably improves osteoporosis guideline-consistent GP behaviour (RR 4.75 (95% CI 3.62 to 6.24; 3,047 participants)) for BMD and RR 1.52 (95% CI 1.26 to 1.84; 3.047 participants) for osteoporosis medication) and that adding the patient-directed component probably does not lead to a greater effect (RR 0.94 (95% CI 0.81 to 1.09; 2,995 participants)) for BMD and RR 0.93 (95% CI 0.79 to 1.10; 2,995 participants) for osteoporosis medication.Of the 10 studies on low back pain, seven showed that guideline dissemination and educational opportunities for GPs may lead to little or no improvement with regard to guideline-consistent GP behaviour. Two studies showed that the combination of guidelines and GP feedback on the total number of investigations requested may have an effect on GP behaviour and result in a slight reduction in the number of tests, while one of these studies showed that the combination of guidelines and GP reminders attached to radiology reports may result in a small but sustained reduction in the number of investigation requests.Of the four studies on osteoarthritis, one study showed that using educationally influential physicians may result in improvement in guideline-consistent GP behaviour. Another study showed slight improvements in patient outcomes (pain control) after training GPs on pain management.Of three studies on shoulder pain, one study reported that there may be little or no improvement in patient outcomes (functional capacity) after GP education on shoulder pain and injection training.Of two studies on other musculoskeletal conditions, one study on pain management showed that there may be worse patient outcomes (pain control) after GP training on the use of validated assessment scales.The 12 remaining studies across all musculoskeletal conditions showed little or no improvement in GP behaviour and patient outcomes.The direction of the targeted behaviour (i.e. increasing or decreasing a behaviour) does not seem to affect the effectiveness of an intervention. The majority of the studies did not investigate the potential adverse effects of the interventions and only three studies included a cost-effectiveness analysis.Overall, there were important methodological limitations in the body of evidence, with just a third of the studies reporting adequate allocation concealment and blinded outcome assessments. While our confidence in the pooled effect estimate of interventions for improving diagnostic testing and medication prescribing in osteoporosis is high, our confidence in the reported effect estimates in the remaining studies is low.

AUTHORS' CONCLUSIONS

There is good-quality evidence that a GP alerting system with or without patient-directed education on osteoporosis improves guideline-consistent GP behaviour, resulting in better diagnosis and treatment rates.Interventions such as GP reminder messages and GP feedback on performance combined with guideline dissemination may lead to small improvements in guideline-consistent GP behaviour with regard to low back pain, while GP education on osteoarthritis pain and the use of educationally influential physicians may lead to slight improvement in patient outcomes and guideline-consistent behaviour respectively. However, further studies are needed to ascertain the effectiveness of such interventions in improving GP behaviour and patient outcomes.

Using theory to improve low back pain care in Australian Aboriginal primary care: a mixed method single cohort pilot study

Background

Low back pain (LBP) care is frequently discordant with research evidence. This pilot study evaluated changes in LBP care following a systematic, theory informed intervention in a rural Australian Aboriginal Health Service. We aimed to improve three aspects of care; reduce inappropriate LBP radiological imaging referrals, increase psychosocial oriented patient assessment and, increase the provision of LBP self-management information to patients.

Methods

Three interventions to improve care were developed using a four-step systematic implementation approach. A mixed methods pre/post cohort design evaluated changes in the three behaviours using a clinical audit of LBP care in a six month period prior to the intervention and then following implementation. In-depth interviews elicited the perspectives of involved General Practitioners (GPs). Qualitative analysis was guided by the theoretical domains framework.

Results

The proportion of patients who received guideline inconsistent imaging referrals (GICI) improved from 4.1 GICI per 10 patients to 0.4 (95 % CI for decrease in rate: 1.6 to 5.6) amongst GPs involved in the intervention. Amongst non-participating GPs (locum/part-time GPs who commenced post-interventions) the rate of GICI increased from 1.5 to 4.4 GICI per 10 patients (95 % CI for increase in rate: .5 to 5.3). There was a modest increase in the number of patients who received LBP self-management information from participating GPs and no substantial changes to psychosocial oriented patient assessments by any participants; however GPs qualitatively reported that their behaviours had changed. Knowledge and beliefs about consequences were important behavioural domains related to changes. Environmental and resource factors including protocols for locum staff and clinical tools embedded in patient management software were future strategies identified.

Conclusions

A systematic intervention model resulted in partial improvements in LBP care. Determinants of practice change amongst GPs were increased knowledge of clinical guidelines, education delivered by someone considered a trusted source of information, and awareness of the negative consequences of inappropriate practices, especially radiological imaging on patient outcomes. Inconsistent and non-evidence based practices amongst locum GPs was an issue that emerged and will be a significant future challenge. The systematic approach utilised is applicable to other services interested in improving LBP care.

Imaging Guidelines for Enhancing Justifications for Radiologic Studies

Justification in the field of radiology refers to the appropriate use of radiologic imaging modalities, and may be achieved by establishing clinical imaging guidelines (CIGs). Recently, CIGs have been shown to be useful in selecting the proper medical imaging modality, resulting in the reduction of inappropriate radiologic examinations, thereby enhancing justifications. However, the development of CIGs is both time-consuming and difficult as the methodology of evidence-based medicine should be adhered to. Thus, although the radiologic societies in developed countries such as the United Kingdom and USA are already developing and implementing CIGs in their clinical practices, CIGs are not yet readily available in many other countries owing to differences in medical circumstances and resources. In this review, we assess the role and limitations of CIGs by examining the current status of CIGs in developed countries, and also describe the specific efforts made to establish CIGs in Korea.

How to Make Feedback More Effective? Qualitative Findings from Pilot Testing of an Audit and Feedback Report for Endoscopists

Background. Audit and feedback (A/F) reports are one of the few knowledge translation activities that can effect change in physician behavior. In this study, we pilot-tested an endoscopist A/F report to elicit opinions about the proposed report's usability, acceptability and usefulness, and implications for knowledge translation. Methods. Semi-structured qualitative interviews were conducted with eleven endoscopists in Ontario, Canada. We tested an A/F report template comprising 9 validated, accepted colonoscopy quality indicators populated with simulated data. Interview transcripts were coded using techniques such as constant comparison and themes were identified inductively over several team meetings. Results. Four interrelated themes were identified: (1) overall perceptions of the A/F report; (2) accountability and consequences for poor performance; (3) motivation to change/improve skills; and (4) training for performance enhancement and available resources. The A/F report was well received; however, participants cited some possible threats to the report's effectiveness including the perceived threat of loss of privileges or licensing and the potential for the data to be dismissed. Conclusions. Participants agreed that A/F has the potential to improve colonoscopy performance. However, in order to be effective in changing physician behavior, A/F must be thoughtfully implemented with attention to the potential concerns of its recipients.

The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review

Background

Laboratory testing is an integral part of day-to-day primary care practice, with approximately 30 % of patient encounters resulting in a request. However, research suggests that a large proportion of requests does not benefit patient care and is avoidable. The aim of this systematic review was to comprehensively search the literature for studies evaluating the effectiveness of interventions to improve primary care physician use of laboratory tests.

Methods

A search of PubMed, Cochrane Library, Embase and Scopus (from inception to 09/02/14) was conducted. The following study designs were considered: systematic reviews, randomised controlled trials (RCTs), controlled clinical trials (CCTs), controlled before and after studies (CBAs) and interrupted time series analysis (ITSs). Studies were quality appraised using a modified version of the Effective Practice and Organisation of Care (EPOC) checklist. The population of interest was primary care physicians. Interventions were considered if they aimed to improve laboratory testing in primary care. The outcome of interest was a volume of laboratory tests.

Results

In total, 6,166 titles and abstracts were reviewed, followed by 87 full texts. Of these, 11 papers were eligible for inclusion in the systematic review. This included four RCTs, six CBAs and one ITS study. The types of interventions examined included education, feedback, guidelines, education with feedback, feedback with guidelines and changing order forms. The quality of included studies varied with seven studies deemed to have a low risk of bias, three with unclear risk of bias and one with high risk of bias. All but one study found significant reductions in the volume of tests following the intervention, with effect sizes ranging from 1.2 to 60 %. Due to heterogeneity, meta-analysis was not performed.

Conclusions

Interventions such as educational strategies, feedback and changing test order forms may improve the efficient use of laboratory tests in primary care; however, the level of evidence is quite low and the quality is poor. The reproducibility of findings from different laboratories is also difficult to ascertain from the literature. Some standardisation of both interventions and outcome measures is required to enable formal meta-analysis.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0356-4) contains supplementary material, which is available to authorized users.

How to study improvement interventions: a brief overview of possible study types

Improvement (defined broadly as purposive efforts to secure positive change) has become an increasingly important activity and field of inquiry within healthcare. This article offers an overview of possible methods for the study of improvement interventions. The choice of available designs is wide, but debates continue about how far improvement efforts can be simultaneously practical (aimed at producing change) and scientific (aimed at producing new knowledge), and whether the distinction between the practical and the scientific is a real and useful one. Quality improvement projects tend to be applied and, in some senses, self-evaluating. They are not necessarily directed at generating new knowledge, but reports of such projects if well conducted and cautious in their inferences may be of considerable value. They can be distinguished heuristically from research studies, which are motivated by and set out explicitly to test a hypothesis, or otherwise generate new knowledge, and from formal evaluations of improvement projects. We discuss variants of trial designs, quasi-experimental designs, systematic reviews, programme evaluations, process evaluations, qualitative studies, and economic evaluations. We note that designs that are better suited to the evaluation of clearly defined and static interventions may be adopted without giving sufficient attention to the challenges associated with the dynamic nature of improvement interventions and their interactions with contextual factors. Reconciling pragmatism and research rigour is highly desirable in the study of improvement. Trade-offs need to be made wisely, taking into account the objectives involved and inferences to be made.

What is the evidence on interventions to manage referral from primary to specialist non-emergency care? A systematic review and logic model synthesis

Background

Demand management describes any method used to monitor, direct or regulate patient referrals. Several strategies have been developed to manage the referral of patients to secondary care, with interventions targeting primary care, specialist services, or infrastructure.

Objective

This research aimed to conduct an inclusive systematic review and logic model synthesis in order to better understand factors impacting on the effectiveness of interventions targeting referral between primary and secondary medical health care.

Design

The approach combined systematic review with logic modelling synthesis techniques to develop an evidence-based framework of factors influencing the pathway between interventions and system-wide changes.

Setting

Primary health care.

Main outcome measures

Referral from primary to secondary care.

Review methods

Systematic searches were undertaken to identify recent, relevant studies. Quality of individual studies was appraised, with consideration of overall strength of evidence. A narrative synthesis and logic model summary of the data was completed.

Results

From a database of 8327 unique papers, 290 were included in the review. The intervention studies were grouped into four categories of education interventions (n = 50); process change interventions (n = 49); system change interventions (n = 38); and patient-focused interventions (n = 3). Effectiveness was assessed variously in these papers; however, there was a gap regarding the mechanisms whereby these interventions lead to demand management impacts. The findings suggest that, although individual-level interventions may be popular, the stronger evidence relates only to peer-review and feedback interventions. Process change interventions appeared to be more effective when the change resulted in the specialist being provided with more or better quality information about the patient. System changes including the community provision of specialist services by general practitioners, outreach provision by specialists and the return of inappropriate referrals appeared to have evidence of effect. The pathway whereby interventions might lead to service-wide impact was complex, with multiple factors potentially acting as barriers or facilitators to the change process. Factors related, first, to the doctor (including knowledge, attitudes and beliefs, and previous experiences of a service), second, to the patient (including condition and social factors) and, third, to the influence of the doctor–patient relationship. We also identified a number of potentially influential factors at a local level, such as perceived waiting times and the availability of a specialist. These elements are key factors in the pathway between an intervention and intended demand management outcomes influencing both applicability and effectiveness.

Conclusions

The findings highlight the complexity of the referral process and multiple elements that will impact on intervention outcomes and applicability to a local area. Any interventions seeking to change referral practice need to address factors relating to the individual practitioner, the patient and also the situation in which the referral is taking place. These conclusions apply especially to referral management in a UK context where this whole range of factors/issues lies well within the remit of the NHS. This work highlights that intermediate outcomes are important in the referral pathway. It is recommended that researchers include measure of these intermediate outcomes in their evaluation of intervention effectiveness in order to determine where blocks to or facilitators of system-wide impact may be occurring.

Study registration

The study is registered as PROSPERO CRD42013004037.

Funding

The National Institute for Health Research Health Services and Delivery Research programme.

The effect of heterogeneous variance on efficiency and power of cluster randomized trials with a balanced 2 × 2 factorial design

Sample size calculation for cluster randomized trials (CRTs) with a [Formula: see text] factorial design is complicated due to the combination of nesting (of individuals within clusters) with crossing (of two treatments). Typically, clusters and individuals are allocated across treatment conditions in a balanced fashion, which is optimal under homogeneity of variance. However, the variance is likely to be heterogeneous if there is a treatment effect. An unbalanced allocation is then more efficient, but impractical because the optimal allocation depends on the unknown variances. Focusing on CRTs with a [Formula: see text] design, this paper addresses two questions: How much efficiency is lost by having a balanced design when the outcome variance is heterogeneous? How large must the sample size be for a balanced allocation to have sufficient power under heterogeneity of variance? We consider different scenarios of heterogeneous variance. Within each scenario, we determine the relative efficiency of a balanced design, as a function of the level (cluster, individual, both) and amount of heterogeneity of the variance. We then provide a simple correction of the sample size for the loss of power due to heterogeneity of variance when a balanced allocation is used. The theory is illustrated with an example of a published 2 x2 CRT.

How to study improvement interventions: a brief overview of possible study types

Improvement (defined broadly as purposive efforts to secure positive change) has become an increasingly important activity and field of inquiry within healthcare. This article offers an overview of possible methods for the study of improvement interventions. The choice of available designs is wide, but debates continue about how far improvement efforts can be simultaneously practical (aimed at producing change) and scientific (aimed at producing new knowledge), and whether the distinction between the practical and the scientific is a real and useful one. Quality improvement projects tend to be applied and, in some senses, self-evaluating. They are not necessarily directed at generating new knowledge, but reports of such projects if well conducted and cautious in their inferences may be of considerable value. They can be distinguished heuristically from research studies, which are motivated by and set out explicitly to test a hypothesis, or otherwise generate new knowledge, and from formal evaluations of improvement projects. We discuss variants of trial designs, quasi-experimental designs, systematic reviews, programme evaluations, process evaluations, qualitative studies, and economic evaluations. We note that designs that are better suited to the evaluation of clearly defined and static interventions may be adopted without giving sufficient attention to the challenges associated with the dynamic nature of improvement interventions and their interactions with contextual factors. Reconciling pragmatism and research rigour is highly desirable in the study of improvement. Trade-offs need to be made wisely, taking into account the objectives involved and inferences to be made.

Effectiveness of interventions designed to reduce the use of imaging for low-back pain: a systematic review

BACKGROUND

Rates of imaging for low-back pain are high and are associated with increased health care costs and radiation exposure as well as potentially poorer patient outcomes. We conducted a systematic review to investigate the effectiveness of interventions aimed at reducing the use of imaging for low-back pain.

METHODS

We searched MEDLINE, Embase, CINAHL and the Cochrane Central Register of Controlled Trials from the earliest records to June 23, 2014. We included randomized controlled trials, controlled clinical trials and interrupted time series studies that assessed interventions designed to reduce the use of imaging in any clinical setting, including primary, emergency and specialist care. Two independent reviewers extracted data and assessed risk of bias. We used raw data on imaging rates to calculate summary statistics. Study heterogeneity prevented meta-analysis.

RESULTS

A total of 8500 records were identified through the literature search. Of the 54 potentially eligible studies reviewed in full, 7 were included in our review. Clinical decision support involving a modified referral form in a hospital setting reduced imaging by 36.8% (95% confidence interval [CI] 33.2% to 40.5%). Targeted reminders to primary care physicians of appropriate indications for imaging reduced referrals for imaging by 22.5% (95% CI 8.4% to 36.8%). Interventions that used practitioner audits and feedback, practitioner education or guideline dissemination did not significantly reduce imaging rates. Lack of power within some of the included studies resulted in lack of statistical significance despite potentially clinically important effects.

INTERPRETATION

Clinical decision support in a hospital setting and targeted reminders to primary care doctors were effective interventions in reducing the use of imaging for low-back pain. These are potentially low-cost interventions that would substantially decrease medical expenditures associated with the management of low-back pain.

Referral interventions from primary to specialist care: a systematic review of international evidence

BACKGROUND

Demand management defines any method used to monitor, direct, or regulate patient referrals. Strategies have been developed to manage the referral of patients to secondary care, with interventions that target primary care, specialist services, or infrastructure.

AIM

To review the international evidence on interventions to manage referral from primary to specialist care.

DESIGN AND SETTING

Systematic review.

METHOD

Iterative, systematic searches of published and unpublished sources public health, health management, management, and grey literature databases from health care and other industries were undertaken to identify recent, relevant studies. A narrative synthesis of the data was completed to structure the evidence into groups of similar interventions.

RESULTS

The searches generated 8327 unique results, of which 140 studies were included. Interventions were grouped into four intervention categories: GP education (n = 50); process change (n = 49); system change (n = 38); and patient-focused (n = 3). It is clear that there is no 'magic bullet' to managing demand for secondary care services: although some groups of interventions may have greater potential for development, given the existing evidence that they can be effective in specific contexts.

CONCLUSIONS

To tackle demand management of primary care services, the focus cannot be on primary care alone; a whole-systems approach is needed because the introduction of interventions in primary care is often just the starting point of the referral process. In addition, more research is needed to develop and evaluate interventions that acknowledge the role of the patient in the referral decision.

A web-based clinical decision support tool for primary health care management of back pain: development and mixed methods evaluation

BACKGROUND

Many patients with back pain do not receive health care in accordance with best practice recommendations. Implementation trials to address this issue have had limited success. Despite the known effectiveness of clinical decision support systems (CDSS), none of these are available for back pain management.

OBJECTIVE

The objective of our study was to develop a Web-based CDSS to support Australian general practitioners (GPs) to diagnose and manage back pain according to guidelines.

METHODS

Asking a panel of international experts to review recommendations for sixteen clinical vignettes validated the tool. It was then launched nationally as part of National Pain Week and promoted to GPs via a media release and clinic based visits. Following this, a mixed methods evaluation was conducted to determine tool feasibility, acceptability, and utility. The 12 month usage data were analyzed, and in-depth, semistructured interviews with 20 GPs were conducted to identify barriers and enablers to uptake.

RESULTS

The tool had acceptable face validity when reviewed by experts. Over a 12 month period there were 7125 website visits with 4503 (63.20%) unique users. Assuming most unique users are GPs, around one quarter of the country's GPs may have used the tool at least once. Although usage was high, GP interviews highlighted the sometimes complex nature of management where the tool may not influence care. Conversely, several "touch-points", whereby the tool may exert its influence, were identified, most notably patient engagement.

CONCLUSIONS

A novel CDSS tool has the potential to assist with evidence-based management of back pain. A clinical trial is required to determine its impact on practitioner and patient outcomes.

General practitioners' knowledge of whiplash guidelines improved with online education

OBJECTIVE

The primary objective of this study was to evaluate the effect of an online education program used to implement the Australian (New South Wales) whiplash guidelines with general practitioners (GP). The secondary aim was to identify factors associated with learning.

METHODS

An online educational and evaluation activity was developed to reflect the key messages for GP from the Australian whiplash guidelines. The educational activity was hosted on the Royal Australian College of General Practitioners' website (www.gplearning.com.au) for a period of 3 years. Participants were recruited through advertisement and media releases. Participants completed a baseline evaluation of their knowledge, participated in the interactive educational activity and completed a post-knowledge questionnaire. The primary outcome was change in professional knowledge, predictors of learning were computed using linear regression.

RESULTS

Two hundred and fifteen GP participated. Knowledge significantly improved between baseline and post-knowledge questionnaire scores (P < 0.00001). A total of 57.2% of participants improved their knowledge by more than 20%, indicating a large effect. Low baseline knowledge predicted learning, accounting for 71% of the variance.

CONCLUSIONS

Online education of GP significantly improved their knowledge in relation to guidelines for whiplash. Those with low baseline knowledge improved their knowledge the most, suggesting that implementation strategies should be targeted at this group.

Variability in research ethics review of cluster randomized trials: a scenario-based survey in three countries

Background

Cluster randomized trials (CRTs) present unique ethical challenges. In the absence of a uniform standard for their ethical design and conduct, problems such as variability in procedures and requirements by different research ethics committees will persist. We aimed to assess the need for ethics guidelines for CRTs among research ethics chairs internationally, investigate variability in procedures for research ethics review of CRTs within and among countries, and elicit research ethics chairs’ perspectives on specific ethical issues in CRTs, including the identification of research subjects. The proper identification of research subjects is a necessary requirement in the research ethics review process, to help ensure, on the one hand, that subjects are protected from harm and exploitation, and on the other, that reviews of CRTs are completed efficiently.

Methods

A web-based survey with closed- and open-ended questions was administered to research ethics chairs in Canada, the United States, and the United Kingdom. The survey presented three scenarios of CRTs involving cluster-level, professional-level, and individual-level interventions. For each scenario, a series of questions was posed with respect to the type of review required (full, expedited, or no review) and the identification of research subjects at cluster and individual levels.

Results

A total of 189 (35%) of 542 chairs responded. Overall, 144 (84%, 95% CI 79 to 90%) agreed or strongly agreed that there is a need for ethics guidelines for CRTs and 158 (92%, 95% CI 88 to 96%) agreed or strongly agreed that research ethics committees could be better informed about distinct ethical issues surrounding CRTs. There was considerable variability among research ethics chairs with respect to the type of review required, as well as the identification of research subjects. The cluster-cluster and professional-cluster scenarios produced the most disagreement.

Conclusions

Research ethics committees identified a clear need for ethics guidelines for CRTs and education about distinct ethical issues in CRTs. There is disagreement among committees, even within the same countries, with respect to key questions in the ethics review of CRTs. This disagreement reflects variability of opinion and practices pointing toward possible gaps in knowledge, and supports the need for explicit guidelines for the ethical conduct and review of CRTs.

Imaging referral guidelines in Europe: now and in the future-EC Referral Guidelines Workshop Proceedings

As an integral part of the European Commission (EC) Imaging Referral Guidelines Project a 1.5-day workshop was held in Vienna on 20–21 September, 2012. At this workshop, models and good practices regarding the appropriateness and use of imaging referral guidelines (Guidelines) in Europe and worldwide were presented, together with the results of a survey of Guidelines in Europe. The latter included ideas, innovations and wishes for future Community action.

Recommendations for future Community action:

Stronger measures should be taken by the EC and the European competent authorities for making Guidelines available and used in all EU member states.

Evidence-based Guidelines with separate guidance for children should be issued or endorsed by a trusted European organisation.

Educational initiatives and electronic requesting in connection with clinical decision support (CDS) systems should be used to improve the implementation of Guidelines.

Monitoring of Guidelines implementation and use should be by clinical audit, particularly external audit, but also by local/internal audit.

Economic evaluation of active implementation versus guideline dissemination for evidence-based care of acute low-back pain in a general practice setting

INTRODUCTION

The development and publication of clinical practice guidelines for acute low-back pain has resulted in evidence-based recommendations that have the potential to improve the quality and safety of care for acute low-back pain. Development and dissemination of guidelines may not, however, be sufficient to produce improvements in clinical practice; further investment in active implementation of guideline recommendations may be required. Further research is required to quantify the trade-off between the additional upfront cost of active implementation of guideline recommendations for low-back pain and any resulting improvements in clinical practice.

METHODS

Cost-effectiveness analysis alongside the IMPLEMENT trial from a health sector perspective to compare active implementation of guideline recommendations via the IMPLEMENT intervention (plus standard dissemination) against standard dissemination alone.

RESULTS

The base-case analysis suggests that delivery of the IMPLEMENT intervention dominates standard dissemination (less costly and more effective), yielding savings of $135 per x-ray referral avoided (-$462.93/3.43). However, confidence intervals around point estimates for the primary outcome suggest that--irrespective of willingness to pay (WTP)--we cannot be at least 95% confident that the IMPLEMENT intervention differs in value from standard dissemination.

CONCLUSIONS

Our findings demonstrate that moving beyond development and dissemination to active implementation entails a significant additional upfront investment that may not be offset by health gains and/or reductions in health service utilization of sufficient magnitude to render active implementation cost-effective.

A Conceptual Framework for Understanding and Reducing Overuse by Primary Care Providers

Primary care providers frequently recommend, administer, or prescribe health care services that are unlikely to benefit their patients. Yet little is known about how to reduce provider overuse behavior. In the absence of a theoretically grounded causal framework, it is difficult to predict the contexts under which different types of interventions to reduce provider overuse will succeed and under which they will fail. In this article, we present a framework based on the theory of planned behavior that is designed to guide overuse research and intervention development. We describe categories of primary care provider beliefs that lead to the formation of intentions to assess the appropriateness of services, and propose factors that may affect whether the presence of assessment intentions results in an appropriate recommendation. Interventions that have been commonly used to address provider overuse behavior are reviewed within the context of the framework.

Developing an active implementation model for a chronic disease management program

Background

Introduction and diffusion of new disease management programs in healthcare is usually slow, but active theory-driven implementation seems to outperform other implementation strategies. However, we have only scarce evidence on the feasibility and real effect of such strategies in complex primary care settings where municipalities, general practitioners and hospitals should work together. The Central Denmark Region recently implemented a disease management program for chronic obstructive pulmonary disease (COPD) which presented an opportunity to test an active implementation model against the usual implementation model. The aim of the present paper is to describe the development of an active implementation model using the Medical Research Council’s model for complex interventions and the Chronic Care Model.

Methods

We used the Medical Research Council’s five-stage model for developing complex interventions to design an implementation model for a disease management program for COPD. First, literature on implementing change in general practice was scrutinised and empirical knowledge was assessed for suitability. In phase I, the intervention was developed; and in phases II and III, it was tested in a block- and cluster-randomised study. In phase IV, we evaluated the feasibility for others to use our active implementation model.

Results

The Chronic Care Model was identified as a model for designing efficient implementation elements. These elements were combined into a multifaceted intervention, and a timeline for the trial in a randomised study was decided upon in accordance with the five stages in the Medical Research Council’s model; this was captured in a PaTPlot, which allowed us to focus on the structure and the timing of the intervention. The implementation strategies identified as efficient were use of the Breakthrough Series, academic detailing, provision of patient material and meetings between providers. The active implementation model was tested in a randomised trial (results reported elsewhere).

Conclusion

The combination of the theoretical model for complex interventions and the Chronic Care Model and the chosen specific implementation strategies proved feasible for a practice-based active implementation model for a chronic-disease-management-program for COPD. Using the Medical Research Council’s model added transparency to the design phase which further facilitated the process of implementing the program.

Trial registration: http://www.clinicaltrials.gov/(NCT01228708).

Evaluation of a theory-informed implementation intervention for the management of acute low back pain in general medical practice: the IMPLEMENT cluster randomised trial

INTRODUCTION

This cluster randomised trial evaluated an intervention to decrease x-ray referrals and increase giving advice to stay active for people with acute low back pain (LBP) in general practice.

METHODS

General practices were randomised to either access to a guideline for acute LBP (control) or facilitated interactive workshops (intervention). We measured behavioural predictors (e.g. knowledge, attitudes and intentions) and fear avoidance beliefs. We were unable to recruit sufficient patients to measure our original primary outcomes so we introduced other outcomes measured at the general practitioner (GP) level: behavioural simulation (clinical decision about vignettes) and rates of x-ray and CT-scan (medical administrative data). All those not involved in the delivery of the intervention were blinded to allocation.

RESULTS

47 practices (53 GPs) were randomised to the control and 45 practices (59 GPs) to the intervention. The number of GPs available for analysis at 12 months varied by outcome due to missing confounder information; a minimum of 38 GPs were available from the intervention group, and a minimum of 40 GPs from the control group. For the behavioural constructs, although effect estimates were small, the intervention group GPs had greater intention of practising consistent with the guideline for the clinical behaviour of x-ray referral. For behavioural simulation, intervention group GPs were more likely to adhere to guideline recommendations about x-ray (OR 1.76, 95%CI 1.01, 3.05) and more likely to give advice to stay active (OR 4.49, 95%CI 1.90 to 10.60). Imaging referral was not statistically significantly different between groups and the potential importance of effects was unclear; rate ratio 0.87 (95%CI 0.68, 1.10) for x-ray or CT-scan.

CONCLUSIONS

The intervention led to small changes in GP intention to practice in a manner that is consistent with an evidence-based guideline, but it did not result in statistically significant changes in actual behaviour.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN012606000098538.

An educational intervention reduces the rate of inappropriate echocardiograms on an inpatient medical service

OBJECTIVES

This study sought to prospectively study the impact of an appropriate use criteria (AUC)-based educational intervention on transthoracic echocardiography (TTE) ordering among house staff on the inpatient general internal medicine service at an academic medical center.

BACKGROUND

AUC for TTE were developed in response to concerns about inappropriate use of TTE. To date, educational interventions based on the AUC to reduce inappropriate use of TTE have not been prospectively studied.

METHODS

A prospective, time series analysis of an educational intervention was conducted and then compared with TTE ordering on the same medical service during a control period. The intervention consisted of: 1) a lecture to house staff on the 2011 AUC for TTE; 2) a pocket card that applied the AUC to common clinical scenarios; and 3) biweekly e-mail feedback regarding ordering behavior. TTE ordering was tracked over the intervention period on a daily basis and feedback reports were e-mailed at 2-week intervals. The primary outcome was the proportion of inappropriate and appropriate TTE ordered during the intervention period.

RESULTS

Of all TTEs ordered in the control and study periods, 99% and 98%, respectively, were classifiable using the 2011 AUC. During the study period, there was a 26% reduction in the number of TTE ordered per day compared with the number ordered during the control period (2.9 vs. 3.9 TTE, p < 0.001). During the study period, the proportion of inappropriate TTE was significantly lower (5% vs. 13%, p < 0.001) and the proportion of appropriate TTE was significantly higher (93% vs. 84%, p < 0.001).

CONCLUSIONS

A simple educational intervention produced a significant reduction in the proportion of inappropriate TTE and increased the proportion of appropriate TTE ordered on an inpatient academic medical service. This study provides a practical approach for using the AUC to reduce the number of inappropriate TTE. Further study in other practice environments is warranted.

Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting the doctor to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system and delivered on paper to healthcare professionals on processes of care (related to healthcare professionals' practice) and outcomes of care (related to patients' health condition).

SEARCH METHODS

For this update the EPOC Trials Search Co-ordinator searched the following databases between June 11-19, 2012: The Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Library (Economics, Methods, and Health Technology Assessment sections), Issue 6, 2012; MEDLINE, OVID (1946- ), Daily Update, and In-process; EMBASE, Ovid (1947- ); CINAHL, EbscoHost (1980- ); EPOC Specialised Register, Reference Manager, and INSPEC, Engineering Village. The authors reviewed reference lists of related reviews and studies. 

SELECTION CRITERIA

We included individual or cluster-randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs) that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals on processes and/or outcomes of care.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. We contacted authors to obtain important missing information for studies that were published within the last 10 years. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median absolute improvement and interquartile range (IQR) in process adherence across included studies using the primary outcome or median outcome as representative outcome.

MAIN RESULTS

In the 32 included studies, computer-generated reminders delivered on paper to healthcare professionals achieved moderate improvement in professional practices, with a median improvement of processes of care of 7.0% (IQR: 3.9% to 16.4%). Implementing reminders alone improved care by 11.2% (IQR 6.5% to 19.6%) compared with usual care, while implementing reminders in addition to another intervention improved care by 4.0% only (IQR 3.0% to 6.0%) compared with the other intervention. The quality of evidence for these comparisons was rated as moderate according to the GRADE approach. Two reminder features were associated with larger effect sizes: providing space on the reminder for provider to enter a response (median 13.7% versus 4.3% for no response, P value = 0.01) and providing an explanation of the content or advice on the reminder (median 12.0% versus 4.2% for no explanation, P value = 0.02). Median improvement in processes of care also differed according to the behaviour the reminder targeted: for instance, reminders to vaccinate improved processes of care by 13.1% (IQR 12.2% to 20.7%) compared with other targeted behaviours. In the only study that had sufficient power to detect a clinically significant effect on outcomes of care, reminders were not associated with significant improvements.

AUTHORS' CONCLUSIONS

There is moderate quality evidence that computer-generated reminders delivered on paper to healthcare professionals achieve moderate improvement in process of care. Two characteristics emerged as significant predictors of improvement: providing space on the reminder for a response from the clinician and providing an explanation of the reminder's content or advice. The heterogeneity of the reminder interventions included in this review also suggests that reminders can improve care in various settings under various conditions.

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

Justification of diagnostic medical exposures: some practical issues. Report of an International Atomic Energy Agency Consultation

OBJECTIVES

The Radiation Protection of Patients Unit of the International Atomic Energy Agency (IAEA) is concerned about the effectiveness of justification of diagnostic medical exposures. Recent published work and the report of an initial IAEA consultation in the area gave grounds for such concerns. There is a significant level of inappropriate usage, and, in some cases, a poor level of awareness of dose and risk among some key groups involved. This article aims to address this.

METHODS

The IAEA convened a second group of experts in November 2008 to review practical and achievable actions that might lead to more effective justification.

RESULTS

This report summarises the matters that this group considered and the outcome of their deliberations. There is a need for improved communication, both within professions and between professionals on one hand, and between professionals and the patients/public on the other. Coupled with this, the issue of consent to imaging procedures was revisited. The need for good evidence-based referral guidelines or criteria of acceptability was emphasised, as was the need for their global adaptation and dissemination.

CONCLUSION

Clinical audit was regarded as a key tool in ensuring that justification becomes an effective, transparent and accountable part of normal radiological practice. In summary, justification would be facilitated by the "3 As": awareness, appropriateness and audit.

Improved outcomes in a quality improvement collaborative for pediatric inflammatory bowel disease

OBJECTIVES

Unintended variation in the care of patients with Crohn disease (CD) and ulcerative colitis (UC) may prevent achievement of optimal outcomes. We sought to improve chronic care delivery and outcomes for children with inflammatory bowel disease by using network-based quality improvement methods.

METHODS

By using a modified Breakthrough Series collaborative structure, 6 ImproveCareNow Network care centers tested changes in chronic illness care and collected data monthly. We used an interrupted time series design to evaluate the impact of these changes.

RESULTS

Data were available for 843 children with CD and 345 with UC. Changes in care delivery were associated with an increase in the proportion of visits with complete disease classification, measurement of thiopurine methyltransferase (TPMT) before initiation of thiopurines, and patients receiving an initial thiopurine dose appropriate to their TPMT status. These were significant in both populations for all process variables (P < .01) except for measurement of TPMT in CD patients (P = .12). There were significant increases in the proportion of CD (55%-68%) and UC (61%-72%) patients with inactive disease. There was also a significant increase in the proportion of CD patients not taking prednisone (86%-90%). Participating centers varied in the success of achieving these changes.

CONCLUSIONS

Improvements in the outcomes of patients with CD and UC were associated with improvements in the process of chronic illness care. Variation in the success of implementing changes suggests the importance of overcoming organizational factors related to quality improvement success.

A cluster randomised trial of educational messages to improve the primary care of diabetes

Background

Regular laboratory test monitoring of patient parameters offers a route for improving the quality of chronic disease care. We evaluated the effects of brief educational messages attached to laboratory test reports on diabetes care.

Methods

A programme of cluster randomised controlled trials was set in primary care practices in one primary care trust in England. Participants were the primary care practices' constituent healthcare professionals and patients with diabetes. Interventions comprised brief educational messages added to paper and electronic primary care practice laboratory test reports and introduced over two phases. Phase one messages, attached to Haemoglobin A1c (HbA1c) reports, targeted glycaemic and cholesterol control. Phase two messages, attached to albumin:creatinine ratio (ACR) reports, targeted blood pressure (BP) control, and foot inspection. Main outcome measures comprised practice mean HbA1c and cholesterol levels, diastolic and systolic BP, and proportions of patients having undergone foot inspections.

Results

Initially, 35 out of 37 eligible practices participated. Outcome data were available for a total of 8,690 patients with diabetes from 32 practices. The BP message produced a statistically significant reduction in diastolic BP (-0.62 mmHg; 95% confidence interval -0.82 to -0.42 mmHg) but not systolic BP (-0.06 mmHg, -0.42 to 0.30 mmHg) and increased the odds of achieving target BP control (odds ratio 1.05; 1.00, 1.10). The foot inspection message increased the likelihood of a recorded foot inspection (incidence rate ratio 1.26; 1.18 to 1.36). The glycaemic control message had no effect on mean HbA1c (increase 0.01%; -0.03 to 0.04) despite increasing the odds of a change in likelihood of HbA1c tests being ordered (OR 1.06; 1.01, 1.11). The cholesterol message had no effect (decrease 0.01 mmol/l, -0.04 to 0.05).

Conclusions

Three out of four interventions improved intermediate outcomes or process of diabetes care. The diastolic BP reduction approximates to relative reductions in mortality of 3% to 5% in stroke and 3% to 4% in ischaemic heart disease over 10 years. The lack of effect for other outcomes may, in part, be explained by difficulties in bringing about further improvements beyond certain thresholds of clinical performance.

Trial Registration

Current Controlled Trials, ISRCTN2186314.

Justification: how to get referring physicians involved

Barriers to involvement of clinicians in the process of justification include an already overloaded knowledge base, lack of time, inconsistent guidance and disproportionate patient expectations. Strategies to improve referring physicians' input include education, use of imaging referral guidelines, clinical audit and regulation. This article discusses and reviews evidence for approaches to encourage greater participation in justification by clinicians. Approaches are best summarised by 'Awareness, appropriateness and audit'.

Evaluation of a radiographic technique: one dimension of critical thinking

Background:

Previous articles in this series (July 2010 and April 2011) have looked at examples of how undergraduate students can demonstrate their ability to interpret data and generate new ideas as part of developing their critical thinking skills. As a final example, the evaluation component of critical thinking is explored that requires students to recognize arguments, separate fact from opinion and verify the value of evidence. In this way they can fully engage with evidence-based practice.

Contents:

The evaluation component of critical thinking encourages students to ask the right questions when considering research data and dig deeper into the motives, expertise and assumptions underlying the evidence presented. The worked example is for an evaluation of the effectiveness of X-ray imaging of the lumbar spine in patients presenting with persistent nonspecific low back pain (LBP). The structure of the evaluation includes clinical indications, diagnostic yield, effectiveness of current practice and comparison with other diagnostic imaging options.

Conclusions:

Since critical thinking is not a single entity, understanding the key components that contribute to the whole is important if undergraduate students are to be encouraged and supported in developing their critical thinking skills. The example of an evaluation of a radiographic technique illustrates how students are expected to go about demonstrating their understanding of the intentions and motivations behind judgements, protocols and guidelines that are aimed at improving the delivery of health care.

Applying psychological theories to evidence-based clinical practice: identifying factors predictive of lumbar spine x-ray for low back pain in UK primary care practice

Background

Psychological models predict behaviour in a wide range of settings. The aim of this study was to explore the usefulness of a range of psychological models to predict the health professional behaviour 'referral for lumbar spine x-ray in patients presenting with low back pain' by UK primary care physicians.

Methods

Psychological measures were collected by postal questionnaire survey from a random sample of primary care physicians in Scotland and north England. The outcome measures were clinical behaviour (referral rates for lumbar spine x-rays), behavioural simulation (lumbar spine x-ray referral decisions based upon scenarios), and behavioural intention (general intention to refer for lumbar spine x-rays in patients with low back pain). Explanatory variables were the constructs within the Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Weinstein's Stage Model termed the Precaution Adoption Process (PAP), and knowledge. For each of the outcome measures, a generalised linear model was used to examine the predictive value of each theory individually. Linear regression was used for the intention and simulation outcomes, and negative binomial regression was used for the behaviour outcome. Following this 'theory level' analysis, a 'cross-theoretical construct' analysis was conducted to investigate the combined predictive value of all individual constructs across theories.

Results

Constructs from TPB, SCT, CS-SRM, and OLT predicted behaviour; however, the theoretical models did not fit the data well. When predicting behavioural simulation, the proportion of variance explained by individual theories was TPB 11.6%, SCT 12.1%, OLT 8.1%, and II 1.5% of the variance, and in the cross-theory analysis constructs from TPB, CS-SRM and II explained 16.5% of the variance in simulated behaviours. When predicting intention, the proportion of variance explained by individual theories was TPB 25.0%, SCT 21.5%, CS-SRM 11.3%, OLT 26.3%, PAP 2.6%, and knowledge 2.3%, and in the cross-theory analysis constructs from TPB, SCT, CS-SRM, and OLT explained 33.5% variance in intention. Together these results suggest that physicians' beliefs about consequences and beliefs about capabilities are likely determinants of lumbar spine x-ray referrals.

Conclusions

The study provides evidence that taking a theory-based approach enables the creation of a replicable methodology for identifying factors that predict clinical behaviour. However, a number of conceptual and methodological challenges remain.

Ethical issues posed by cluster randomized trials in health research

The cluster randomized trial (CRT) is used increasingly in knowledge translation research, quality improvement research, community based intervention studies, public health research, and research in developing countries. However, cluster trials raise difficult ethical issues that challenge researchers, research ethics committees, regulators, and sponsors as they seek to fulfill responsibly their respective roles. Our project will provide a systematic analysis of the ethics of cluster trials. Here we have outlined a series of six areas of inquiry that must be addressed if the cluster trial is to be set on a firm ethical foundation:

1. Who is a research subject?

2. From whom, how, and when must informed consent be obtained?

3. Does clinical equipoise apply to CRTs?

4. How do we determine if the benefits outweigh the risks of CRTs?

5. How ought vulnerable groups be protected in CRTs?

6. Who are gatekeepers and what are their responsibilities?

Subsequent papers in this series will address each of these areas, clarifying the ethical issues at stake and, where possible, arguing for a preferred solution. Our hope is that these papers will serve as the basis for the creation of international ethical guidelines for the design and conduct of cluster randomized trials.