Effect of enhanced feedback and brief educational reminder messages on laboratory test requesting in primary care: a cluster randomised trial

What works for and what hinders deimplementation of low-value care in emergency medicine practice? A scoping review

OBJECTIVES

Low-value care can harm patients and healthcare systems. Despite a decade of global endeavours, low value care has persisted. Identification of barriers and enablers is essential for effective deimplementation of low-value care. This scoping review is an evidence summary of barriers, enablers and features of effective interventions for deimplementation of low-value care in emergency medicine practice worldwide.

DESIGN

A mixed-methods scoping review was conducted using the Arksey and O'Malley framework.

DATA SOURCES

Medline, CINAHL, Embase, EMCare, Scopus and grey literature were searched from inception to 5 December 2022.

ELIGIBILITY CRITERIA

Primary studies which employed qualitative, quantitative or mixed-methods approaches to explore deimplementation of low-value care in an EM setting and reported barriers, enablers or interventions were included. Reviews, protocols, perspectives, comments, opinions, editorials, letters to editors, news articles, books, chapters, policies, guidelines and animal studies were excluded. No language limits were applied.

DATA EXTRACTION AND SYNTHESIS

Study selection, data collection and quality assessment were performed by two independent reviewers. Barriers, enablers and interventions were mapped to the domains of the Theoretical Domains Framework. The Mixed Methods Appraisal Tool was used for quality assessment.

RESULTS

The search yielded 167 studies. A majority were quantitative studies (90%, 150/167) that evaluated interventions (86%, 143/167). Limited provider abilities, diagnostic uncertainty, lack of provider insight, time constraints, fear of litigation, and patient expectations were the key barriers. Enablers included leadership commitment, provider engagement, provider training, performance feedback to providers and shared decision-making with patients. Interventions included one or more of the following facets: education, stakeholder engagement, audit and feedback, clinical decision support, nudge, clinical champions and training. Multifaceted interventions were more likely to be effective than single-faceted interventions. Effectiveness of multifaceted interventions was influenced by fidelity of the intervention facets. Use of behavioural change theories such as the Theoretical Domains Framework in the published studies appeared to enhance the effectiveness of interventions to deimplement low-value care.

CONCLUSION

High-fidelity, multifaceted interventions that incorporated education, stakeholder engagement, audit/feedback and clinical decision support, were administered daily and lasted longer than 1 year were most effective in achieving deimplementation of low-value care in emergency departments. This review contributes the best available evidence to date, but further rigorous, theory-informed, qualitative and mixed-methods studies are needed to supplement the growing body of evidence to effectively deimplement low-value care in emergency medicine practice.

Randomised trial of general practitioner online education for prescribing and test ordering

INTRODUCTION

Potentially inappropriate medicine prescriptions and low-value diagnostic testing pose risks to patient safety and increases in health system costs. The aim of the Clinical and Healthcare Improvement through My Health Record usage and Education in General Practice study was to evaluate a scalable online quality improvement intervention, integrating online education regarding a national shared electronic health record and rational prescribing, pathology and imaging ordering by Australian general practitioners (GPs).

METHODS

The study was a parallel three-arm randomised trial comprising a prescribing education arm, a pathology education arm and an imaging education arm. Currently practising GPs in Australia were eligible to participate and randomised on a 1:1:1 basis to the study arms after consenting. The response to the intervention in reducing potentially unnecessary medicine prescriptions and tests in each arm was assessed using the other two arms as controls. The primary outcome was the cost per 100 consultations of predefined medication prescriptions, pathology and radiology test ordering 6 months following the intervention, compared with 6 months prior. Outcomes were assessed on intention-to-treat and post hoc per-protocol bases using multilevel regression models, with the analysts blinded to allocation.

RESULTS

In total, 106 GPs were enrolled and randomised (prescribing n=35, pathology n=36, imaging n=35). Data were available for 97 GPs at the end of trial (prescribing n=33, pathology n=32, imaging n=32) with 44 fully completing the intervention. In intention-to-treat analysis, there were no significant differences in the rates of change in costs across the three arms. Per protocol, there was a statistically significant difference in the rate of change in pathology costs (p=0.03). In the pathology arm, the rate of increase in pathology costs was significantly lower by $A187 (95% CI -$A340, -$A33) than the prescribing arm, and non-significantly $A9 (95% CI -$A128, $A110) lower than the imaging arm.

DISCUSSION

This study provides some evidence for reductions in costs for low-value pathology test ordering in those that completed the relevant online education. The study experienced slow uptake and low completion of the education intervention during the COVID-19 pandemic. Changes were not significant for the primary endpoint, which included all participants. Improving completion rates and combining real-time feedback on prescribing or test ordering may increase the overall effectiveness of the intervention. Given the purely online delivery of the education, there is scope for upscaling the intervention, which may provide cost-effectiveness benefits.

TRIAL REGISTRATION NUMBER

ACTRN12620000010998.

Evaluating an audit and feedback intervention for reducing overuse of pathology test requesting by Australian general practitioners: protocol for a factorial cluster randomised controlled trial

INTRODUCTION

Consistent evidence shows pathology services are overused worldwide and that about one-third of testing is unnecessary. Audit and feedback (AF) is effective for improving care but few trials evaluating AF to reduce pathology test requesting in primary care have been conducted. The aim of this trial is to estimate the effectiveness of AF for reducing requests for commonly overused pathology test combinations by high-requesting Australian general practitioners (GPs) compared with no intervention control. A secondary aim is to evaluate which forms of AF are most effective.

METHODS AND ANALYSIS

This is a factorial cluster randomised trial conducted in Australian general practice. It uses routinely collected Medicare Benefits Schedule data to identify the study population, apply eligibility criteria, generate the interventions and analyse outcomes. On 12 May 2022, all eligible GPs were simultaneously randomised to either no intervention control or to one of eight intervention groups. GPs allocated to an intervention group received individualised AF on their rate of requesting of pathology test combinations compared with their GP peers. Three separate elements of the AF intervention will be evaluated when outcome data become available on 11 August 2023: (1) invitation to participate in continuing professional development-accredited education on appropriate pathology requesting, (2) provision of cost information on pathology test combinations and (3) format of feedback. The primary outcome is the overall rate of requesting of any of the displayed combinations of pathology tests of GPs over 6 months following intervention delivery. With 3371 clusters, assuming no interaction and similar effects for each intervention, we anticipate over 95% power to detect a difference of 4.4 requests in the mean rate of pathology test combination requests between the control and intervention groups.

ETHICS AND DISSEMINATION

Ethics approval was received from the Bond University Human Research Ethics Committee (#JH03507; approved 30 November 2021). The results of this study will be published in a peer-reviewed journal and presented at conferences. Reporting will adhere to Consolidated Standards of Reporting Trials.

TRIAL REGISTRATION NUMBER

ACTRN12622000566730.

Disruption vs. evolution in laboratory medicine. Current challenges and possible strategies, making laboratories and the laboratory specialist profession fit for the future

Since beginning of medical diagnostics, laboratory specialists have done an amazing job, continuously improving quality, spectrum and speed of laboratory tests, currently contributing to the majority of medical decision making. These improvements are mostly of an incremental evolutionary fashion, meaning improvements of current processes. Sometimes these evolutionary innovations are of a radical fashion, such as the invention of automated analyzers replacing manual testing or the implementation of mass spectrometry, leading to one big performance leap instead of several small ones. In few cases innovations may be of disruptive nature. In laboratory medicine this would be applicable to digitalization of medicine or the decoding of the human genetic material. Currently, laboratory medicine is again facing disruptive innovations or technologies, which need to be adapted to as soon as possible. One of the major disruptive technologies is the increasing availability and medical use of artificial intelligence. It is necessary to rethink the position of the laboratory specialist within healthcare settings and the added value he or she can provide to patient care. The future of the laboratory specialist profession is bright, as it the only medical profession comprising such vast experience in patient diagnostics. However, laboratory specialists need to develop strategies to provide this expertise, by adopting to the quickly evolving technologies and demands. This opinion paper summarizes some of the disruptive technologies as well as strategies to secure and/or improve the quality of diagnostic patient care and the laboratory specialist profession.

Clinical Decision Support for Laboratory Testing

BACKGROUND

As technology enables new and increasingly complex laboratory tests, test utilization presents a growing challenge for healthcare systems. Clinical decision support (CDS) refers to digital tools that present providers with clinically relevant information and recommendations, which have been shown to improve test utilization. Nevertheless, individual CDS applications often fail, and implementation remains challenging.

CONTENT

We review common classes of CDS tools grounded in examples from the literature as well as our own institutional experience. In addition, we present a practical framework and specific recommendations for effective CDS implementation.

SUMMARY

CDS encompasses a rich set of tools that have the potential to drive significant improvements in laboratory testing, especially with respect to test utilization. Deploying CDS effectively requires thoughtful design and careful maintenance, and structured processes focused on quality improvement and change management play an important role in achieving these goals.

Development and Evaluation of an Audit and Feedback Process for Prevention of Acute Kidney Injury During Coronary Angiography and Intervention

Background

Contrast-associated acute kidney injury (CA-AKI) is a potentially preventable complication of coronary angiography and intervention. Relatively little research has been done to determine how knowledge on CA-AKI prevention can be translated into clinical practice.

Methods

We developed, implemented, and surveyed end-users about the usability, acceptability, and utility of an audit and feedback process for CA-AKI prevention in Alberta, Canada. The audit and feedback reported on amount of radiocontrast dye used, hemodynamic optimization of intravenous fluids, and CA-AKI incidence for each cardiologist practicing coronary angiography or percutaneous coronary intervention, compared with peers at their site and across the province. Reports were developed through an iterative process involving interventional cardiologists throughout the design process and usability testing.

Results

Cardiologists participating in usability testing indicated a preference for the visual displays of data and summarizing indicators on the front page, and endorsed the value of peer-to-peer comparisons of performance measures. Of 31 eligible cardiologists from across Alberta, 17 responded to a survey evaluating the audit and feedback process. Fifteen respondents (88.2%) agreed that the data presented in the audit and feedback report were understandable; 17 respondents (100%) agreed or strongly agreed that the presentation of the report helped them better understand their performance compared with that of their peers; and 14 (82.4%) agreed that the audit and feedback process helped them identify ways to reduce the risk of AKI for their patients.

Conclusions

Conducting an audit and providing feedback was an understandable and acceptable intervention to help cardiologists identify ways to improve prevention of CA-AKI during coronary angiography or intervention.

Overutilization in laboratory medicine: tackling the problem with quality improvement science

Overutilization of tests and treatments is a widespread problem in contemporary heath care, and laboratory medicine is no exception. It is estimated that 10-70% of laboratory tests may be unnecessary, with estimates in the literature varying depending on the situation and the laboratory test. Inappropriate use of laboratory tests can lead to further unnecessary testing, adverse events, inaccurate diagnoses, and inappropriate treatments. Altogether, this increases the risk of harm to a patient, which can be physical, psychological, or financial in nature. Overutilization in healthcare is driven by complex factors including care delivery models, litigious practice environments, and medical and patient culture. Quality improvement (QI) methods can help to tackle overutilization. In this review, we outline the global healthcare problem of laboratory overutilization, particularly in the developed world, and describe how an understanding of and application of quality improvement principles can help to address this challenge.

The impact of interventions applied in primary care to optimize the use of laboratory tests: a systematic review

Laboratory tests are important tools in primary care, but their use is sometimes inappropriate. The aim of this review is to give an overview of interventions applied in primary care to optimize the use of laboratory tests. A search for studies was made in the MEDLINE and EMBASE databases. We also extracted studies from two previous reviews published in 2015. Studies were included if they described application of an intervention aiming to optimize the use of laboratory tests. We also evaluated the overall risk of bias of the studies. We included 24 studies. The interventions were categorized as: education, feedback reports and computerized physician order entry (CPOE) strategies. Most of the studies were classified as medium or high risk of bias while only three studies were evaluated as low risk of bias. The majority of the studies aimed at reducing the number of tests, while four studies investigated interventions aiming to increase the use of specific tests. Despite the studies being heterogeneous, we made results comparable by transforming the results into weighted relative changes in number of tests when necessary. Education changed the number of tests consistently, and these results were supported by the low risk of bias of the papers. Feedback reports have mainly been applied in combination with education, while when used alone the effect was minimal. The use of CPOE strategies seem to produce a marked change in the number of test requests, however the studies were of medium or high risk of bias.

Strategies to reduce the use of low-value medical tests in primary care: a systematic review

BACKGROUND

It is recognised that medical tests are overused in primary care; however, it is unclear how best to reduce their use.

AIM

To identify which strategies are effective in reducing the use of low-value medical tests in primary care settings.

DESIGN AND SETTING

Systematic review.

METHOD

The databases MEDLINE, EMBASE, and Rx for Change were searched (January 1990 to November 2019) for randomised controlled trials (RCTs) that evaluated strategies to reduce the use of low-value medical tests in primary care settings. Two reviewers selected eligible RCTs, extracted data, and assessed their risk of bias.

RESULTS

Of the 16 RCTs included in the review, 11 reported a statistically significant reduction in the use of low-value medical tests. The median of the differences between the relative reductions in the intervention and control arms was 17% (interquartile range 12% to 24%). Strategies using reminders or audit/feedback showed larger reduction than those without these components (22% versus 14%, and 22% versus 13%, respectively) and patient-targeted strategies showed larger reductions than those not targeted at patients (51% versus 17%). Very few studies investigated the sustainability of the effect, adverse events, cost-effectiveness, or patient-reported outcomes related to reducing the use of low-value tests.

CONCLUSION

This review indicates that it is possible to reduce the use of low-value medical tests in primary care, especially by using multiple components including reminders, audit/feedback, and patient-targeted interventions. To implement these strategies widely in primary care settings, more research is needed not only to investigate their effectiveness, but also to examine adverse events, cost-effectiveness, and patient-reported outcomes.

Social norms interventions to change clinical behaviour in health workers: a systematic review and meta-analysis

Background

A social norms intervention seeks to change the clinical behaviour of a target health worker by exposing them to the values, beliefs, attitudes or behaviours of a reference group or person. These low-cost interventions can be used to encourage health workers to follow recommended professional practice.

Objective

To summarise evidence on whether or not social norms interventions are effective in encouraging health worker behaviour change, and to identify the most effective social norms interventions.

Design

A systematic review and meta-analysis of randomised controlled trials.

Data sources

The following databases were searched on 24 July 2018: Ovid MEDLINE (1946 to week 2 July 2018), EMBASE (1974 to 3 July 2018), Cumulative Index to Nursing and Allied Health Literature (1937 to July 2018), British Nursing Index (2008 to July 2018), ISI Web of Science (1900 to present), PsycINFO (1806 to week 3 July 2018) and Cochrane trials (up to July 2018).

Participants

Health workers took part in the study.

Interventions

Behaviour change interventions based on social norms.

Outcome measures

Health worker clinical behaviour, for example prescribing (primary outcome), and patient health outcomes, for example blood test results (secondary), converted into a standardised mean difference.

Methods

Titles and abstracts were reviewed against the inclusion criteria to exclude any that were clearly ineligible. Two reviewers independently screened the remaining full texts to identify relevant papers. Two reviewers extracted data independently, coded for behaviour change techniques and assessed quality using the Cochrane risk-of-bias tool. We performed a meta-analysis and presented forest plots, stratified by behaviour change technique. Sources of variation were explored using metaregression and network meta-analysis.

Results

A total of 4428 abstracts were screened, 477 full texts were screened and findings were based on 106 studies. Most studies were in primary care or hospitals, targeting prescribing, ordering of tests and communication with patients. The interventions included social comparison (in which information is given on how peers behave) and credible source (which refers to communication from a well-respected person in support of the behaviour). Combined data suggested that interventions that included social norms components were associated with an improvement in health worker behaviour of 0.08 standardised mean differences (95% confidence interval 0.07 to 0.10 standardised mean differences) (n = 100 comparisons), and an improvement in patient outcomes of 0.17 standardised mean differences (95% confidence interval 0.14 to 0.20) (n = 14), on average. Heterogeneity was high, with an overall I 2 of 85.4% (primary) and 91.5% (secondary). Network meta-analysis suggested that three types of social norms intervention were most effective, on average, compared with control: credible source (0.30 standardised mean differences, 95% confidence interval 0.13 to 0.47); social comparison combined with social reward (0.39 standardised mean differences, 95% confidence interval 0.15 to 0.64); and social comparison combined with prompts and cues (0.33 standardised mean differences, 95% confidence interval 0.22 to 0.44).

Limitations

The large number of studies prevented us from requesting additional information from authors. The trials varied in design, context and setting, and we combined different types of outcome to provide an overall summary of evidence, resulting in a very heterogeneous review.

Conclusions

Social norms interventions are an effective method of changing clinical behaviour in a variety of health service contexts. Although the overall result was modest and very variable, there is the potential for social norms interventions to be scaled up to target the behaviour of a large population of health workers and resulting patient outcomes.

Future work

Development of optimised credible source and social comparison behaviour change interventions, including qualitative research on acceptability and feasibility.

Study registration

This study is registered as PROSPERO CRD42016045718.

Funding

This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 8, No. 41. See the NIHR Journals Library website for further project information.

Manually-generated reminders delivered on paper: effects on professional practice and patient outcomes

BACKGROUND

Health professionals sometimes do not use the best evidence to treat their patients, in part due to unconscious acts of omission and information overload. Reminders help clinicians overcome these problems by prompting them to recall information that they already know, or by presenting information in a different and more accessible format. Manually-generated reminders delivered on paper are defined as information given to the health professional with each patient or encounter, provided on paper, in which no computer is involved in the production or delivery of the reminder. Manually-generated reminders delivered on paper are relatively cheap interventions, and are especially relevant in settings where electronic clinical records are not widely available and affordable. This review is one of three Cochrane Reviews focused on the effectiveness of reminders in health care.

OBJECTIVES

1. To determine the effectiveness of manually-generated reminders delivered on paper in changing professional practice and improving patient outcomes. 2. To explore whether a number of potential effect modifiers influence the effectiveness of manually-generated reminders delivered on paper.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, CINAHL and two trials registers on 5 December 2018. We searched grey literature, screened individual journals, conference proceedings and relevant systematic reviews, and reviewed reference lists and cited references of included studies.

SELECTION CRITERIA

We included randomised and non-randomised trials assessing the impact of manually-generated reminders delivered on paper as a single intervention (compared with usual care) or added to one or more co-interventions as a multicomponent intervention (compared with the co-intervention(s) without the reminder component) on professional practice or patients' outcomes. We also included randomised and non-randomised trials comparing manually-generated reminders with other quality improvement (QI) interventions.

DATA COLLECTION AND ANALYSIS

Two review authors screened studies for eligibility and abstracted data independently. We extracted the primary outcome as defined by the authors or calculated the median effect size across all reported outcomes in each study. We then calculated the median percentage improvement and interquartile range across the included studies that reported improvement related outcomes, and assessed the certainty of the evidence using the GRADE approach.

MAIN RESULTS

We identified 63 studies (41 cluster-randomised trials, 18 individual randomised trials, and four non-randomised trials) that met all inclusion criteria. Fifty-seven studies reported usable data (64 comparisons). The studies were mainly located in North America (42 studies) and the UK (eight studies). Fifty-four studies took place in outpatient/ambulatory settings. The clinical areas most commonly targeted were cardiovascular disease management (11 studies), cancer screening (10 studies) and preventive care (10 studies), and most studies had physicians as their target population (57 studies). General management of a clinical condition (17 studies), test-ordering (14 studies) and prescription (10 studies) were the behaviours more commonly targeted by the intervention. Forty-eight studies reported changes in professional practice measured as dichotomous process adherence outcomes (e.g. compliance with guidelines recommendations), 16 reported those changes measured as continuous process-of-care outcomes (e.g. number of days with catheters), eight reported dichotomous patient outcomes (e.g. mortality rates) and five reported continuous patient outcomes (e.g. mean systolic blood pressure). Manually-generated reminders delivered on paper probably improve professional practice measured as dichotomous process adherence outcomes) compared with usual care (median improvement 8.45% (IQR 2.54% to 20.58%); 39 comparisons, 40,346 participants; moderate certainty of evidence) and may make little or no difference to continuous process-of-care outcomes (8 comparisons, 3263 participants; low certainty of evidence). Adding manually-generated paper reminders to one or more QI co-interventions may slightly improve professional practice measured as dichotomous process adherence outcomes (median improvement 4.24% (IQR -1.09% to 5.50%); 12 comparisons, 25,359 participants; low certainty of evidence) and probably slightly improve professional practice measured as continuous outcomes (median improvement 0.28 (IQR 0.04 to 0.51); 2 comparisons, 12,372 participants; moderate certainty of evidence). Compared with other QI interventions, manually-generated reminders may slightly decrease professional practice measured as process adherence outcomes (median decrease 7.9% (IQR -0.7% to 11%); 14 comparisons, 21,274 participants; low certainty of evidence). We are uncertain whether manually-generated reminders delivered on paper, compared with usual care or with other QI intervention, lead to better or worse patient outcomes (dichotomous or continuous), as the certainty of the evidence is very low (10 studies, 13 comparisons). Reminders added to other QI interventions may make little or no difference to patient outcomes (dichotomous or continuous) compared with the QI alone (2 studies, 2 comparisons). Regarding resource use, studies reported additional costs per additional point of effectiveness gained, but because of the different currencies and years used the relevance of those figures is uncertain. None of the included studies reported outcomes related to harms or adverse effects.

AUTHORS' CONCLUSIONS

Manually-generated reminders delivered on paper as a single intervention probably lead to small to moderate increases in outcomes related to adherence to clinical recommendations, and they could be used as a single QI intervention. It is uncertain whether reminders should be added to other QI intervention already in place in the health system, although the effects may be positive. If other QI interventions, such as patient or computerised reminders, are available, they should be preferred over manually-generated reminders, but under close evaluation in order to decrease uncertainty about their potential effect.

Lack of effect of a poster-based intervention to reduce the number of blood culture samples collected

OBJECTIVE

To reduce the number of blood culture samples collected.

PATIENTS AND METHOD

We performed a cluster randomized controlled trial in adult acute care, and subacute care and rehabilitation wards in a university hospital in France. A poster associating an image of eyes looking at the reader with a summary of blood culture sampling guidelines was displayed in hospital wards in the intervention group. The incidence rate of blood cultures per 1000 days during pre- and post-intervention periods was calculated.

RESULTS

Thirty-one wards participated in the study. The median difference in blood cultures/1000 days between periods was -1.863 [-11.941; 1.007] in the intervention group and -5.824 [-14.763; -2.217] in the control group (P=0.27).

CONCLUSION

The intervention did not show the expected effect, possibly due to the choice of blood cultures as a target of good practice, but also to confounding factors such as the stringent policy of decreasing unnecessary costly testing.

Reducing unnecessary vitamin testing in general practice: barriers and facilitators according to general practitioners and patients

OBJECTIVE

There has been an increase in testing of vitamins in patients in general practice, often based on irrational indications or for non-specific symptoms, causing increasing healthcare expenditures and medicalisation of patients. So far, there is little evidence of effective strategies to reduce this overtesting in general practice. Therefore, the aim of this qualitative study was to explore the barriers and facilitators for reducing the number of (unnecessary) vitamin D and B12 laboratory tests ordered.

DESIGN AND SETTING

This qualitative study, based on a grounded theory design, used semistructured interviews among general practitioners (GPs) and patients from two primary care networks (147 GPs, 195 000 patients). These networks participated in the Reducing Vitamin Testing in Primary Care Practice (REVERT) study, a clustered randomized trial comparing two de-implementation strategies to reduce test ordering in primary care in the Netherlands.

PARTICIPANTS

Twenty-one GPs, with a maximum of 1 GP per practice who took part in the REVERT study, and 22 patients (who were invited by their GP during vitamin-related consultations) were recruited, from which 20 GPs and 19 patients agreed to participate in this study.

RESULTS

The most important factor hampering vitamin-test reduction programmes is the mismatch between patients and medical professionals regarding the presumed appropriate indications for testing for vitamin D and B12. In contrast, the most important facilitator for vitamin-test reduction may be updating GPs' knowledge about test indications and their awareness of their own testing behaviour.

CONCLUSION

To achieve a sustainable reduction in vitamin testing, guidelines with clear and uniform recommendations on evidence-based indications for vitamin testing, combined with regular (individual) feedback on test-ordering behaviour, are needed. Moreover, the general public needs access to clear and reliable information on vitamin testing. Further research is required to measure the effect of these strategies on the number of vitamin test requests.

TRIAL REGISTRATION NUMBER

WAG/mb/16/039555.

Going beyond audit and feedback: towards behaviour-based interventions to change physician laboratory test ordering behaviour

Studies indicate there are a variety of contributing factors affecting physician test ordering behaviour. Identifying these behaviours allows development of behaviour-based interventions. Methods Through a pilot study, the list of contributing factors in laboratory tests ordering, and the most ordered tests, were identified, and given to 50 medical students, interns, residents and paediatricians in questionnaire form. The results showed routine tests and peer or supervisor pressure as the most influential factors affecting physician ordering behaviour. An audit and feedback mechanism was selected as an appropriate intervention to improve physician ordering behaviour. The intervention was carried out at two intervals over a three-month period. Findings There was a large reduction in the number of laboratory tests ordered; from 908 before intervention to 389 and 361 after first and second intervention, respectively. There was a significant relationship between audit and feedback and the meaningful reduction of 7 out of 15 laboratory tests including complete blood count (p = 0.002), erythrocyte sedimentation rate (p = 0.01), C-reactive protein (p = 0.01), venous blood gas (p = 0.016), urine analysis (p = 0.005), blood culture (p = 0.045) and stool examination (p = 0.001). Conclusion The audit and feedback intervention, even in short duration, affects physician ordering behaviour. It should be designed in terms of behaviour-based intervention and diagnosis of the contributing factors in physicians' behaviour. Further studies are required to substantiate the effectiveness of such behaviour-based intervention strategies in changing physician behaviour.

Optimising laboratory monitoring of chronic conditions in primary care: a quality improvement framework

Monitoring of chronic conditions accounts for a significant proportion of blood testing in UK primary care; not all of this is based on evidence or guidelines. National benchmarking shows significant variation in testing rates for common blood tests. This project set out to standardise the blood tests used for monitoring of chronic conditions in primary care across North Devon, and to measure and reduce the harms of unwarranted testing. Chronic disease test groups were developed in line with current guidelines and implemented using one-click electronic test ordering systems. The main difference from previous general practitioner practice algorithms was removing the requirement for full blood count and liver function test monitoring for many conditions. Baseline harms of testing were measured and included significant costs, workload and patient anxiety. By defining the scale of the problem, we were able to leverage change across several cycles of quality improvement, using a pathology optimisation forum for peer-led improvement, and developing a framework focusing on what matters to patients. Overall primary care testing rates in North Devon fell by 14% for full blood count testing and 22% for liver function tests, but without a reduction in the number of tests showing possible significant pathology. We estimate that this has reduced testing costs by £200 000 across a population of around 180 000 people and has reduced downstream referral costs by a similar amount. Introduction of simple chronic disease test groups into primary care electronic ordering systems, when used alongside engagement with clinicians, leads to both quality improvement and reduction in system costs.

Impact of nonintrusive clinical decision support systems on laboratory test utilization in a large academic centre

BACKGROUND

The near-universal prevalence of electronic health records (EHRs) has made the utilization of clinical decision support systems (CDSS) an integral strategy for improving the value of laboratory ordering. Few studies have examined the effectiveness of nonintrusive CDSS on inpatient laboratory utilization in large academic centres.

METHODS

Red blood cell folate, hepatitis C virus viral loads and genotypes, and type and screens were selected for study. We incorporated the appropriate indications for these labs into text that accompanied the laboratory orders in our hospital's EHR. Providers could proceed with the order without additional clicks. An interrupted time-series analysis was performed, and the primary outcome was the rate of tests ordered on all inpatient medicine floors.

RESULTS

The rate of folate tests ordered per monthly admissions showed no significant level change at the time of the intervention with only a slight decrease in rate of 0.0109 (P = .07). There was a 43% decrease in the rate of hepatitis C virus tests per monthly admissions immediately after the intervention with a decrease of 0.0135 tests per monthly admissions (P = .02). The rate of type and screens orders per patient days each month had a significant downward trend by 0.114 before the intervention (P = .04) but no significant level change at the time of the intervention or significant change in rate after the intervention.

DISCUSSION

Our study suggests that nonintrusive CDSS should be evaluated for individual laboratory tests to ensure only effective alerts continue to be used so as to avoid increasing EHR fatigue.

An Audit of Repeat Testing at an Academic Medical Center: Consistency of Order Patterns With Recommendations and Potential Cost Savings

OBJECTIVES

To evaluate the prevalence of potentially unnecessary repeat testing (PURT) and the associated economic burden for an inpatient population at a large academic medical facility.

METHODS

We evaluated all inpatient test orders during 2016 for PURT by comparing the intertest times to published recommendations. Potential cost savings were estimated using the Centers for Medicare & Medicaid Services maximum allowable reimbursement rate. We evaluated result positivity as a determinant of PURT through logistic regression.

RESULTS

Of the evaluated 4,242 repeated target tests, 1,849 (44%) were identified as PURT, representing an estimated cost-savings opportunity of $37,376. Collectively, the association of result positivity and PURT was statistically significant (relative risk, 1.2; 95% confidence interval, 1.1-1.3; P < .001).

CONCLUSIONS

PURT contributes to unnecessary health care costs. We found that a small percentage of providers account for the majority of PURT, and PURT is positively associated with result positivity.

Evaluation of thyroid test utilization through analysis of population-level data

BACKGROUND

Inappropriate laboratory test utilization can result in unnecessary patient testing and increased healthcare costs. While several thyroid function tests are available, thyroid-stimulating hormone (TSH) is recommended as the first-line test for investigating and monitoring thyroid dysfunction. We evaluate thyroid test utilization in Northern Alberta in terms of testing patterns, frequencies, and reflex cutpoints.

METHODS

This retrospective study analyzed thyroid test requests from January to December 2014. Each request was designated as appropriate or potentially inappropriate as per clinical practice guidelines and Choosing Wisely recommendations, and the frequencies of each testing pattern were calculated. Sub-analysis was performed to categorize testing patterns based on physician specialty. The number of test requests per patient was determined to assess the appropriateness of testing frequency. Receiver operating characteristic (ROC) curves were generated to define optimal TSH cutpoints for automatic reflex to FT4 testing.

RESULTS

Of 752,217 test requests, approximately 10% were potentially inappropriate in terms of testing patterns. Free thyroxine (FT4) and free triiodothyronine (FT3) requested with TSH accounted for 59% of all potentially inappropriate test requests, and 49% of requests from endocrinologists (ENDO) were potentially inappropriate, occurring most frequently among those with less experience. Excessive testing frequencies were observed in 869 patients, accounting for 9382 test requests. Adjustment of our TSH reflex cutpoint would significantly increase specificity for identifying a low FT4 without compromising sensitivity.

CONCLUSIONS

This study suggests that questionable testing patterns, excessive testing frequencies, and suboptimal reflexive testing cutpoints contribute to inappropriate thyroid test utilization.

Advancing the literature on designing audit and feedback interventions: identifying theory-informed hypotheses

BACKGROUND

Audit and feedback (A&F) is a common strategy for helping health providers to implement evidence into practice. Despite being extensively studied, health care A&F interventions remain variably effective, with overall effect sizes that have not improved since 2003. Contributing to this stagnation is the fact that most health care A&F interventions have largely been designed without being informed by theoretical understanding from the behavioral and social sciences. To determine if the trend can be improved, the objective of this study was to develop a list of testable, theory-informed hypotheses about how to design more effective A&F interventions.

METHODS

Using purposive sampling, semi-structured 60-90-min telephone interviews were conducted with experts in theories related to A&F from a range of fields (e.g., cognitive, health and organizational psychology, medical decision-making, economics). Guided by detailed descriptions of A&F interventions from the health care literature, interviewees described how they would approach the problem of designing improved A&F interventions. Specific, theory-informed hypotheses about the conditions for effective design and delivery of A&F interventions were elicited from the interviews. The resulting hypotheses were assigned by three coders working independently into themes, and categories of themes, in an iterative process.

RESULTS

We conducted 28 interviews and identified 313 theory-informed hypotheses, which were placed into 30 themes. The 30 themes included hypotheses related to the following five categories: A&F recipient (seven themes), content of the A&F (ten themes), process of delivery of the A&F (six themes), behavior that was the focus of the A&F (three themes), and other (four themes).

CONCLUSIONS

We have identified a set of testable, theory-informed hypotheses from a broad range of behavioral and social science that suggest conditions for more effective A&F interventions. This work demonstrates the breadth of perspectives about A&F from non-healthcare-specific disciplines in a way that yields testable hypotheses for healthcare A&F interventions. These results will serve as the foundation for further work seeking to set research priorities among the A&F research community.

Reducing liver function tests for statin monitoring: an observational comparison of two clinical commissioning groups

BACKGROUND

Current liver function testing for statin monitoring is largely unnecessary and costly. Statins do not cause liver disease. Both reduction in test frequency and use of a single alanine transaminase (ALT) rather than a full seven analyte liver function test (LFT) array would reduce cost and may benefit patients.

AIM

To assess LFT testing in relation to statin use and evaluate an intervention to reduce full-array LFTs ordered by GPs for statin monitoring.

DESIGN AND SETTING

Two-year cross-sectional time series in two east London clinical commissioning groups (CCGs) with 650 000 patients. One CCG received the intervention; the other did not.

METHOD

The intervention comprised local guidance on LFTs for statin monitoring and access to a single ALT rather than full LFT array.

RESULTS

Of the total population, 17.6% were on statins, accounting for 43.2% of total LFTs. In the population without liver disease, liver function tests were 3.6 times higher for those on statins compared with those who were not. Following intervention there was a significant reduction in the full LFT array per 1000 people on statins, from 70.3 (95% confidence interval [CI] = 66.3 to 74.6) in the pre-intervention year, to 58.1 (95% CI = 55.5 to 60.7) in the post-intervention year (P<0.001). In the final month, March 2016, the rate was 53.2, a 24.3% reduction on the pre-intervention rate.

CONCLUSION

This simple and generalisable intervention, enabling ordering of a single ALT combined with information recommending prudent rather than periodic testing, reduced full LFT testing by 24.3% in people on statins. This is likely to have patient benefit at reduced cost.

General practitioner views on the determinants of test ordering: a theory-based qualitative approach to the development of an intervention to improve immunoglobulin requests in primary care

BACKGROUND

Research suggests that variation in laboratory requesting patterns may indicate unnecessary test use. Requesting patterns for serum immunoglobulins vary significantly between general practitioners (GPs). This study aims to explore GP's views on testing to identify the determinants of behaviour and recommend feasible intervention strategies for improving immunoglobulin test use in primary care.

METHODS

Qualitative semi-structured interviews were conducted with GPs requesting laboratory tests at Cork University Hospital or University Hospital Kerry in the South of Ireland. GPs were identified using a Health Service Executive laboratory list of GPs in the Cork-Kerry region. A random sample of GPs (stratified by GP requesting patterns) was generated from this list. GPs were purposively sampled based on the criteria of location (urban/rural); length of time qualified; and practice size (single-handed/group). Interviews were carried out between December 2014 and February 2015. Interviews were transcribed verbatim using NVivo 10 software and analysed using the framework analysis method. Emerging themes were mapped to the theoretical domains framework (TDF), which outlines 12 domains that can enable or inhibit behaviour change. The behaviour change wheel and behaviour change technique (BCT) taxonomy were then used to identify potential intervention strategies.

RESULTS

Sixteen GPs were interviewed (ten males and six females). Findings suggest that intervention strategies should specifically target the key barriers to effective test ordering, while considering the context of primary care practice. Seven domains from the TDF were perceived to influence immunoglobulin test ordering behaviours and were identified as 'mechanisms for change' (knowledge, environmental context and resources, social/professional role and identity, beliefs about capabilities, beliefs about consequences, memory, attention and decision-making processes and behavioural regulation). Using these TDF domains, seven BCTs emerged as feasible 'intervention content' for targeting GPs' ordering behaviour. These included instructions on how to effectively request the test (how to perform behaviour), information on GPs' use of the test (feedback on behaviour), information about patient consequences resulting from not doing the test (information about health consequences), laboratory/consultant-based advice/education (credible source), altering the test ordering form (restructuring the physical environment), providing guidelines (prompts/cues) and adding interpretive comments to the results (adding objects to the environment). These BCTs aligned to four intervention functions: education, persuasion, environmental restructuring and enablement.

CONCLUSIONS

This study has effectively applied behaviour change theory to identify feasible strategies for improving immunoglobulin test use in primary care using the TDF, 'behaviour change wheel' and BCT taxonomy. The identified BCTs will form the basis of a theory-based intervention to improve the use of immunoglobulin tests among GPs. Future research will involve the development and evaluation of this intervention.

Interventions Aimed at Reducing Use of Low-Value Health Services: A Systematic Review

The effectiveness of different types of interventions to reduce low-value care has been insufficiently summarized to allow for translation to practice. This article systematically reviews the literature on the effectiveness of interventions to reduce low-value care and the quality of those studies. We found that multicomponent interventions addressing both patient and clinician roles in overuse have the greatest potential to reduce low-value care. Clinical decision support and performance feedback are promising strategies with a solid evidence base, and provider education yields changes by itself and when paired with other strategies. Further research is needed on the effectiveness of pay-for-performance, insurer restrictions, and risk-sharing contracts to reduce use of low-value care. While the literature reveals important evidence on strategies used to reduce low-value care, meaningful gaps persist. More experimentation, paired with rigorous evaluation and publication, is needed.

Effectiveness of interventions to reduce ordering of thyroid function tests: a systematic review

OBJECTIVES

To evaluate the effectiveness of behaviour changing interventions targeting ordering of thyroid function tests.

DESIGN

Systematic review.

DATA SOURCES

MEDLINE, EMBASE and the Cochrane Database up to May 2015.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES

We included studies evaluating the effectiveness of behaviour change interventions aiming to reduce ordering of thyroid function tests. Randomised controlled trials (RCTs), non-randomised controlled studies and before and after studies were included. There were no language restrictions.

STUDY APPRAISAL AND SYNTHESIS METHODS

2 reviewers independently screened all records identified by the electronic searches and reviewed the full text of any deemed potentially relevant. Study details were extracted from the included papers and their methodological quality assessed independently using a validated tool. Disagreements were resolved through discussion and arbitration by a third reviewer. Meta-analysis was not used.

RESULTS

27 studies (28 papers) were included. They evaluated a range of interventions including guidelines/protocols, changes to funding policy, education, decision aids, reminders and audit/feedback; often intervention types were combined. The most common outcome measured was the rate of test ordering, but the effect on appropriateness, test ordering patterns and cost were also measured. 4 studies were RCTs. The majority of the studies were of poor or moderate methodological quality. The interventions were variable and poorly reported. Only 4 studies reported unsuccessful interventions but there was no clear pattern to link effect and intervention type or other characteristics.

CONCLUSIONS

The results suggest that behaviour change interventions are effective particularly in reducing the volume of thyroid function tests. However, due to the poor methodological quality and reporting of the studies, the likely presence of publication bias and the questionable relevance of some interventions to current day practice, we are unable to draw strong conclusions or recommend the implementation of specific intervention types. Further research is thus justified.

TRIAL REGISTRATION NUMBER

CRD42014006192.

Interventions to Educate Family Physicians to Change Test Ordering: Systematic Review of Randomized Controlled Trials

The purpose is to systematically review randomised controlled trials (RCTs) to change family physicians’ laboratory test-ordering. We searched 15 electronic databases (no language/date limitations). We identified 29 RCTs (4,111 physicians, 175,563 patients). Six studies specifically focused on reducing unnecessary tests, 23 on increasing screening tests. Using Cochrane methodology 48.5% of studies were low risk-of-bias for randomisation, 7% concealment of randomisation, 17% blinding of participants/personnel, 21% blinding outcome assessors, 27.5% attrition, 93% selective reporting. Only six studies were low risk for both randomisation and attrition. Twelve studies performed a power computation, three an intention-to-treat analysis and 13 statistically controlled clustering. Unweighted averages were computed to compare intervention/control groups for tests assessed by >5 studies. The results were that fourteen studies assessed lipids (average 10% more tests than control), 14 diabetes (average 8% > control), 5 cervical smears, 2 INR, one each thyroid, fecal occult-blood, cotinine, throat-swabs, testing after prescribing, and urine-cultures. Six studies aimed to decrease test groups (average decrease 18%), and two to increase test groups. Intervention strategies: one study used education (no change): two feedback (one 5% increase, one 27% desired decrease); eight education + feedback (average increase in desired direction >control 4.9%), ten system change (average increase 14.9%), one system change + feedback (increases 5-44%), three education + system change (average increase 6%), three education + system change + feedback (average 7.7% increase), one delayed testing. The conclusions are that only six RCTs were assessed at low risk of bias from both randomisation and attrition. Nevertheless, despite methodological shortcomings studies that found large changes (e.g. >20%) probably obtained real change.

The effectiveness of interventions to improve laboratory requesting patterns among primary care physicians: a systematic review

Background

Laboratory testing is an integral part of day-to-day primary care practice, with approximately 30 % of patient encounters resulting in a request. However, research suggests that a large proportion of requests does not benefit patient care and is avoidable. The aim of this systematic review was to comprehensively search the literature for studies evaluating the effectiveness of interventions to improve primary care physician use of laboratory tests.

Methods

A search of PubMed, Cochrane Library, Embase and Scopus (from inception to 09/02/14) was conducted. The following study designs were considered: systematic reviews, randomised controlled trials (RCTs), controlled clinical trials (CCTs), controlled before and after studies (CBAs) and interrupted time series analysis (ITSs). Studies were quality appraised using a modified version of the Effective Practice and Organisation of Care (EPOC) checklist. The population of interest was primary care physicians. Interventions were considered if they aimed to improve laboratory testing in primary care. The outcome of interest was a volume of laboratory tests.

Results

In total, 6,166 titles and abstracts were reviewed, followed by 87 full texts. Of these, 11 papers were eligible for inclusion in the systematic review. This included four RCTs, six CBAs and one ITS study. The types of interventions examined included education, feedback, guidelines, education with feedback, feedback with guidelines and changing order forms. The quality of included studies varied with seven studies deemed to have a low risk of bias, three with unclear risk of bias and one with high risk of bias. All but one study found significant reductions in the volume of tests following the intervention, with effect sizes ranging from 1.2 to 60 %. Due to heterogeneity, meta-analysis was not performed.

Conclusions

Interventions such as educational strategies, feedback and changing test order forms may improve the efficient use of laboratory tests in primary care; however, the level of evidence is quite low and the quality is poor. The reproducibility of findings from different laboratories is also difficult to ascertain from the literature. Some standardisation of both interventions and outcome measures is required to enable formal meta-analysis.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0356-4) contains supplementary material, which is available to authorized users.

Canadian family physician knowledge and attitudes toward laboratory utilization management

OBJECTIVES

Mitigation of unnecessary and redundant laboratory testing is an important quality assurance priority for laboratories and represents an opportunity for cost savings in the health care system. Family physicians represent the largest utilizers of laboratory testing by a large margin. Engagement of family physicians is therefore key to any laboratory utilization management initiatives. Despite this, family physicians have been largely excluded from the planning and implementation of such initiatives. Our purposes were to (1) assess the importance of lab management issues to family physicians, and (2) attempt to define the types of initiatives most acceptable to family physicians.

DESIGN AND METHODS

We invited all Alberta family practice residents and practicing physicians to participate in a self-administered online electronic survey. Survey questions addressed the perceived importance of lab misutilization, prevalence of various types of misutilization, acceptability of specific approaches to quality control, and responsibility of various parties to address this issue.

RESULTS

Of 162 respondents, 95% considered lab misutilization to be either important or very important. Many physicians placed the responsibility for addressing lab misutilization issues on multiple parties, including patients, but most commonly the ordering physician (97%). Acceptability for common strategies for quality improvement in lab misutilization showed a wide range (35%-98%).

CONCLUSIONS

These responses could serve as a framework for laboratories to begin discussions on this important topic with primary care groups.

Peer-to-peer physician feedback improves adherence to blood transfusion guidelines in the surgical intensive care unit

BACKGROUND

Translation of evidence to practice regarding adherence to published guidelines for transfusion of red blood cells (RBCs) in critically ill patients is sometimes suboptimal. We sought to use a multimodal intervention founded on peer-to-peer feedback and monthly audit to increase adherence to restrictive RBC transfusion guidelines.

METHODS

We conducted a prospective interventional study with a preintervention and postintervention comparison in our tertiary care center. For the 6-month preintervention period (January 1, 2013, to June 31, 2013) and the 6-month postintervention period (October 1, 2013, to March 31, 2014), all RBCs transfused in the surgical intensive care unit (SICU) were evaluated for pretransfusion hemoglobin (Hgb) trigger (TRIG). During the intervention, if stable low-risk patients were transfused outside of restrictive guidelines, the clinicians received e-mail notification and education from a surgeon colleague within 72 hours of transfusion. The mean TRIG, percentage of transfusions with TRIG greater than 8.0 g/dL, and rate of overtransfusion (posttransfusion Hgb > 10) were compared before and after intervention.

RESULTS

For stable, low-risk patients, mean TRIG decreased from 7.6 g/dL to 7.1 g/dL (p < 0.001) and percentage of transfusions with TRIG greater than 8.0 g/dL decreased from 25% to 2% (p < 0.001) The overtransfusion rate decreased from 11%to 3% (p = 0.001). Total 6-month transfusions decreased from 284 U to 181 U, a 36% decrease. There were no significant differences in median SICU or hospital lengths of stay. Although SICU discharge Hgb and hospital discharge Hgb were significantly lower in the intervention period (8.4 vs. 8.6 [p = 0.037] and 8.6 vs. 9.0 [p = 0.003]), 30-day readmission and mortality rates were similar.

CONCLUSION

A blood management program based on peer e-mail feedback was effective in improving adherence to guideline recommendations for transfusion of RBCs in stable, low-risk SICU patients.

LEVEL OF EVIDENCE

Therapeutic/care management study, level IV.

Improving anticoagulation in atrial fibrillation: observational study in three primary care trusts

BACKGROUND

Atrial fibrillation (AF) is a cause of stroke, and undertreatment with anticoagulants is a persistent issue despite their effectiveness.

AIM

To increase the proportion of people with AF treated appropriately using anticoagulants, and reduce inappropriate antiplatelet therapy.

DESIGN OF STUDY

Cross-sectional analysis.

SETTING

Electronic patient health records on 4604 patients with AF obtained from general practices in three inner London primary care trusts between April 2011 and 2013.

METHOD

The Anticoagulant Programme East London (APEL) sought to achieve its aims through an intervention with three components: altering professional beliefs using new clinical guidance and related education; facilitating change using computer software to support clinical decisions and patient review optimising anticoagulation; motivating change through evaluative feedback showing individual practice performance relative to peers.

RESULTS

From April 2011 to April 2013, the proportion of people with CHA2DS2-VASc ≥1 on anticoagulants increased from 52.6% to 59.8% (trend difference P<0.001). The proportion of people with CHA2DS2-VASc ≥1 on aspirin declined from 37.7% to 30.3% (trend difference P<0.001). Comparing the 2 years before the intervention with the 2 years after, numbers of new people on the AF register almost doubled from 108 to 204.

CONCLUSIONS

The APEL programme supports improvement in clinical managing AF by a combined programme of education around agreed guidance, computer aids to facilitate decision-making and patient review and feedback of locally identifiable results. If replicated nationally over 3 years, such a programme could result in approximately 1600 fewer strokes every year.

Temporal growth and geographic variation in the use of laboratory tests by NHS general practices: using routine data to identify research priorities

BACKGROUND

Laboratory tests are extensively used for diagnosis and monitoring in UK primary care. Test usage by GPs, and associated costs, have grown substantially in recent years.

AIM

This study aimed to quantify temporal growth and geographic variation in utilisation of laboratory tests.

DESIGN AND SETTING

Retrospective cohort study using data from general practices in the UK.

METHOD

Data from the General Practice Research Database, including patient demographics, clinical details, and laboratory test results, were used to estimate rates of change in utilisation between 2005 and 2009, and identify tests with greatest inter-regional variation, by fitting random-effects Poisson regression models. The study also investigated indications for test requests, using diagnoses and symptoms recorded in the 2 weeks before each test.

RESULTS

Around 660 000 tests were recorded in 230 000 person-years of follow-up. Test use increased by 24.2%, from 23 872 to 29 644 tests per 10 000 person-years, between 2005 and 2009. Tests with the largest increases were faecal occult blood (121%) and C-reactive protein (86%). There was substantial geographic variation in test utilisation; GPs in some regions requested tests such as plasma viscosity and cardiac enzymes at a rate more than three times the national average.

CONCLUSION

Increases in the use of laboratory tests have substantial resource implications. Rapid increases in particular tests may be supported by evidence-based guidelines, but these are often vague about who should be tested, how often, and for how long. Substantial regional variation in test use may reflect uncertainty about diagnostic accuracy and appropriate indications for the laboratory test. There is a need for further research on the diagnostic accuracy, therapeutic impact, and effect on patient health outcomes of the most rapidly increasing and geographically variable tests.

The role of informatics and decision support in utilization management

Information systems provide a critical link between clinical laboratories and the clinicians and patients they serve. Strategic deployment of informatics resources can enable a wide array of utilization initiatives and can substantially improve the appropriateness of test selection and results interpretation. In this article, we review information systems including computerized provider order entry (CPOE) systems, laboratory information systems (LISs), electronic health records (EHRs), laboratory middleware, knowledge management systems and systems for data extraction and analysis, and describe the role that each can play in utilization management. We also discuss specific utilization strategies that laboratories can employ within these systems, citing examples both from our own institution and from the literature. Finally, we review how emerging applications of decision support technologies may help to further refine test utilization, "personalize" laboratory diagnosis, and enhance the diagnostic value of laboratory testing.

An educational intervention reduces the rate of inappropriate echocardiograms on an inpatient medical service

OBJECTIVES

This study sought to prospectively study the impact of an appropriate use criteria (AUC)-based educational intervention on transthoracic echocardiography (TTE) ordering among house staff on the inpatient general internal medicine service at an academic medical center.

BACKGROUND

AUC for TTE were developed in response to concerns about inappropriate use of TTE. To date, educational interventions based on the AUC to reduce inappropriate use of TTE have not been prospectively studied.

METHODS

A prospective, time series analysis of an educational intervention was conducted and then compared with TTE ordering on the same medical service during a control period. The intervention consisted of: 1) a lecture to house staff on the 2011 AUC for TTE; 2) a pocket card that applied the AUC to common clinical scenarios; and 3) biweekly e-mail feedback regarding ordering behavior. TTE ordering was tracked over the intervention period on a daily basis and feedback reports were e-mailed at 2-week intervals. The primary outcome was the proportion of inappropriate and appropriate TTE ordered during the intervention period.

RESULTS

Of all TTEs ordered in the control and study periods, 99% and 98%, respectively, were classifiable using the 2011 AUC. During the study period, there was a 26% reduction in the number of TTE ordered per day compared with the number ordered during the control period (2.9 vs. 3.9 TTE, p < 0.001). During the study period, the proportion of inappropriate TTE was significantly lower (5% vs. 13%, p < 0.001) and the proportion of appropriate TTE was significantly higher (93% vs. 84%, p < 0.001).

CONCLUSIONS

A simple educational intervention produced a significant reduction in the proportion of inappropriate TTE and increased the proportion of appropriate TTE ordered on an inpatient academic medical service. This study provides a practical approach for using the AUC to reduce the number of inappropriate TTE. Further study in other practice environments is warranted.

Managing laboratory test ordering through test frequency filtering

Modern computer systems allow limits to be set on the periods allowed for repetitive testing. We investigated a computerised system for managing potentially overtly frequent laboratory testing, calculating the financial savings obtained.

In consultation with hospital physicians, tests were selected for which ‘spare periods’ (periods during which tests are barred) might be set to control repetitive testing. The tests were selected and spare periods determined based on known analyte variations in health and disease, variety of tissues or cells giving rise to analytes, clinical conditions and rate of change determining analyte levels, frequency with which doctors need information about the analytes and the logistical needs of the clinic.

The operation and acceptance of the system was explored with 23 analytes. Frequency filtering was subsequently introduced for 44 tests, each with their own spare periods. The proportion of tests barred was 0.56%, the most frequent of these being for total cholesterol, uric acid and HDL-cholesterol. The financial savings were 0.33% of the costs of all testing, with HbA

Managing laboratory testing through computerised limits to prevent overtly frequent testing is feasible. The savings were relatively low, but sustaining the system takes little effort, giving little reason not to apply it. The findings will serve as a basis for improving the system and may guide others in introducing similar systems.

Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting the doctor to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system and delivered on paper to healthcare professionals on processes of care (related to healthcare professionals' practice) and outcomes of care (related to patients' health condition).

SEARCH METHODS

For this update the EPOC Trials Search Co-ordinator searched the following databases between June 11-19, 2012: The Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Library (Economics, Methods, and Health Technology Assessment sections), Issue 6, 2012; MEDLINE, OVID (1946- ), Daily Update, and In-process; EMBASE, Ovid (1947- ); CINAHL, EbscoHost (1980- ); EPOC Specialised Register, Reference Manager, and INSPEC, Engineering Village. The authors reviewed reference lists of related reviews and studies. 

SELECTION CRITERIA

We included individual or cluster-randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs) that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals on processes and/or outcomes of care.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. We contacted authors to obtain important missing information for studies that were published within the last 10 years. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median absolute improvement and interquartile range (IQR) in process adherence across included studies using the primary outcome or median outcome as representative outcome.

MAIN RESULTS

In the 32 included studies, computer-generated reminders delivered on paper to healthcare professionals achieved moderate improvement in professional practices, with a median improvement of processes of care of 7.0% (IQR: 3.9% to 16.4%). Implementing reminders alone improved care by 11.2% (IQR 6.5% to 19.6%) compared with usual care, while implementing reminders in addition to another intervention improved care by 4.0% only (IQR 3.0% to 6.0%) compared with the other intervention. The quality of evidence for these comparisons was rated as moderate according to the GRADE approach. Two reminder features were associated with larger effect sizes: providing space on the reminder for provider to enter a response (median 13.7% versus 4.3% for no response, P value = 0.01) and providing an explanation of the content or advice on the reminder (median 12.0% versus 4.2% for no explanation, P value = 0.02). Median improvement in processes of care also differed according to the behaviour the reminder targeted: for instance, reminders to vaccinate improved processes of care by 13.1% (IQR 12.2% to 20.7%) compared with other targeted behaviours. In the only study that had sufficient power to detect a clinically significant effect on outcomes of care, reminders were not associated with significant improvements.

AUTHORS' CONCLUSIONS

There is moderate quality evidence that computer-generated reminders delivered on paper to healthcare professionals achieve moderate improvement in process of care. Two characteristics emerged as significant predictors of improvement: providing space on the reminder for a response from the clinician and providing an explanation of the reminder's content or advice. The heterogeneity of the reminder interventions included in this review also suggests that reminders can improve care in various settings under various conditions.

Managing demand for laboratory tests: a laboratory toolkit

Healthcare budgets worldwide are facing increasing pressure to reduce costs and improve efficiency, while maintaining quality. Laboratory testing has not escaped this pressure, particularly since pathology investigations cost the National Health Service £2.5 billion per year. Indeed, the Carter Review, a UK Department of Health-commissioned review of pathology services in England, estimated that 20% of this could be saved by improving pathology services, despite an average annual increase of 8%-10% in workload. One area of increasing importance is managing the demands for pathology tests and reducing inappropriate requesting. The Carter Review estimated that 25% of pathology tests were unnecessary, representing a huge potential waste. Certainly, the large variability in levels of requesting between general practitioners suggests that inappropriate requesting is widespread. Unlocking the key to this variation and implementing measures to reduce inappropriate requesting would have major implications for patients and healthcare resources alike. This article reviews the approaches to demand management. Specifically, it aims to (a) define demand management and inappropriate requesting, (b) assess the drivers for demand management, (c) examine the various approaches used, illustrating the potential of electronic requesting and (d) provide a wider context. It will cover issues, such as educational approaches, information technology opportunities and challenges, vetting, duplicate request identification and management, the role of key performance indicators, profile composition and assessment of downstream impact of inappropriate requesting. Currently, many laboratories are exploring demand management using a plethora of disparate approaches. Hence, this review seeks to provide a 'toolkit' with the view to allowing laboratories to develop a standardised demand management strategy.

Impact of a computerized system for evidence-based diabetes care on completeness of records: a before-after study

Background

Physicians practicing in ambulatory care are adopting electronic health record (EHR) systems. Governments promote this adoption with financial incentives, some hinged on improvements in care. These systems can improve care but most demonstrations of successful systems come from a few highly computerized academic environments. Those findings may not be generalizable to typical ambulatory settings, where evidence of success is largely anecdotal, with little or no use of rigorous methods. The purpose of our pilot study was to evaluate the impact of a diabetes specific chronic disease management system (CDMS) on recording of information pertinent to guideline-concordant diabetes care and to plan for larger, more conclusive studies.

Methods

Using a before–after study design we analyzed the medical record of approximately 10 patients from each of 3 diabetes specialists (total = 31) who were seen both before and after the implementation of a CDMS. We used a checklist of key clinical data to compare the completeness of information recorded in the CDMS record to both the clinical note sent to the primary care physician based on that same encounter and the clinical note sent to the primary care physician based on the visit that occurred prior to the implementation of the CDMS, accounting for provider effects with Generalized Estimating Equations.

Results

The CDMS record outperformed by a substantial margin dictated notes created for the same encounter. Only 10.1% (95% CI, 7.7% to 12.3%) of the clinically important data were missing from the CDMS chart compared to 25.8% (95% CI, 20.5% to 31.1%) from the clinical note prepared at the time (p < 0.001) and 26.3% (95% CI, 19.5% to 33.0%) from the clinical note prepared before the CDMS was implemented (p < 0.001). There was no significant difference between dictated notes created for the CDMS-assisted encounter and those created for usual care encounters (absolute mean difference, 0.8%; 95% CI, −8.5% to 6.8%).

Conclusions

The CDMS chart captured information important for the management of diabetes more often than dictated notes created with or without its use but we were unable to detect a difference in completeness between notes dictated in CDMS-associated and usual-care encounters. Our sample of patients and providers was small, and completeness of records may not reflect quality of care.

Demand management and test request rationalization

Demand for laboratory testing is increasing disproportionately to medical activity, and the tests involved are becoming increasingly complex. When this phenomenon is seen in parallel with declining teaching of laboratory medicine in the medical curriculum, a need emerges to manage demand to avoid unnecessary expenditure and improve the use of laboratory services: 'the right test in the right patient at the right time.' Various methods have been tried to manage demand, with success depending on the medical context, type of health service and preintervention situation. Because many factors contribute to demand, and the different settings in which these exist, it is not realistic to meta-analyse the studies and we are limited to trying to identify trends in results in particular situations. The studies suggest that education combined with facilitating interventions, such as feedback, prompts and changes to laboratory request forms are the most successful. From the perspective of a whole health service, it is important that results are not exaggerated by assessing benefits in terms of total rather than marginal cost. It would be desirable, although difficult, to include the impact on downstream clinical activity caused or avoided by the interventions. Advances in information and web technology may make the elusive goal of achieving substantial demand control more achievable.

Audit and feedback: effects on professional practice and healthcare outcomes

BACKGROUND

Audit and feedback is widely used as a strategy to improve professional practice either on its own or as a component of multifaceted quality improvement interventions. This is based on the belief that healthcare professionals are prompted to modify their practice when given performance feedback showing that their clinical practice is inconsistent with a desirable target. Despite its prevalence as a quality improvement strategy, there remains uncertainty regarding both the effectiveness of audit and feedback in improving healthcare practice and the characteristics of audit and feedback that lead to greater impact.

OBJECTIVES

To assess the effects of audit and feedback on the practice of healthcare professionals and patient outcomes and to examine factors that may explain variation in the effectiveness of audit and feedback.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) 2010, Issue 4, part of The Cochrane Library. www.thecochranelibrary.com, including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register (searched 10 December 2010); MEDLINE, Ovid (1950 to November Week 3 2010) (searched 09 December 2010); EMBASE, Ovid (1980 to 2010 Week 48) (searched 09 December 2010); CINAHL, Ebsco (1981 to present) (searched 10 December 2010); Science Citation Index and Social Sciences Citation Index, ISI Web of Science (1975 to present) (searched 12-15 September 2011).

SELECTION CRITERIA

Randomised trials of audit and feedback (defined as a summary of clinical performance over a specified period of time) that reported objectively measured health professional practice or patient outcomes. In the case of multifaceted interventions, only trials in which audit and feedback was considered the core, essential aspect of at least one intervention arm were included.

DATA COLLECTION AND ANALYSIS

All data were abstracted by two independent review authors. For the primary outcome(s) in each study, we calculated the median absolute risk difference (RD) (adjusted for baseline performance) of compliance with desired practice compliance for dichotomous outcomes and the median percent change relative to the control group for continuous outcomes. Across studies the median effect size was weighted by number of health professionals involved in each study. We investigated the following factors as possible explanations for the variation in the effectiveness of interventions across comparisons: format of feedback, source of feedback, frequency of feedback, instructions for improvement, direction of change required, baseline performance, profession of recipient, and risk of bias within the trial itself. We also conducted exploratory analyses to assess the role of context and the targeted clinical behaviour. Quantitative (meta-regression), visual, and qualitative analyses were undertaken to examine variation in effect size related to these factors.

MAIN RESULTS

We included and analysed 140 studies for this review. In the main analyses, a total of 108 comparisons from 70 studies compared any intervention in which audit and feedback was a core, essential component to usual care and evaluated effects on professional practice. After excluding studies at high risk of bias, there were 82 comparisons from 49 studies featuring dichotomous outcomes, and the weighted median adjusted RD was a 4.3% (interquartile range (IQR) 0.5% to 16%) absolute increase in healthcare professionals' compliance with desired practice. Across 26 comparisons from 21 studies with continuous outcomes, the weighted median adjusted percent change relative to control was 1.3% (IQR = 1.3% to 28.9%). For patient outcomes, the weighted median RD was -0.4% (IQR -1.3% to 1.6%) for 12 comparisons from six studies reporting dichotomous outcomes and the weighted median percentage change was 17% (IQR 1.5% to 17%) for eight comparisons from five studies reporting continuous outcomes. Multivariable meta-regression indicated that feedback may be more effective when baseline performance is low, the source is a supervisor or colleague, it is provided more than once, it is delivered in both verbal and written formats, and when it includes both explicit targets and an action plan. In addition, the effect size varied based on the clinical behaviour targeted by the intervention.

AUTHORS' CONCLUSIONS

Audit and feedback generally leads to small but potentially important improvements in professional practice. The effectiveness of audit and feedback seems to depend on baseline performance and how the feedback is provided. Future studies of audit and feedback should directly compare different ways of providing feedback.

A cluster randomized trial of an enhanced eGFR prompt in chronic kidney disease

BACKGROUND AND OBJECTIVES

Despite reporting estimated GFR (eGFR), use of evidence-based interventions in CKD remains suboptimal. This study sought to determine the effect of an enhanced eGFR laboratory prompt containing specific management recommendations, compared with standard eGFR reporting in CKD.

DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS

A cluster randomized trial of a standard or enhanced eGFR laboratory prompt was performed in 93 primary care practices in Alberta, Canada. Although all adult patients with CKD (eGFR <60 ml/min per 1.73 m(2)) were included, medication data were only available for elderly patients (aged ≥66 years). The primary outcome, the proportion of patients with diabetes or proteinuria receiving an angiotensin converting enzyme inhibitor (ACEi) or angiotensin receptor blocker (ARB), was assessed in elderly CKD patients.

RESULTS

There were 5444 elderly CKD patients with diabetes or proteinuria who were eligible for primary outcome assessment, irrespective of baseline ACEi/ARB use. ACEi/ARB use in the subsequent year was 77.1% and 76.9% in the standard and enhanced prompt groups, respectively. In the subgroup of elderly patients with an eGFR <30 ml/min per 1.73 m(2), ACEi/ARB use was higher in the enhanced prompt group. Among 22,092 CKD patients, there was no difference in the likelihood of a composite clinical outcome (death, ESRD, doubling of serum creatinine, or hospitalization for myocardial infarction, heart failure, or stroke) over a median of 2.1 years.

CONCLUSIONS

In elderly patients with CKD and an indication for ACEi/ARB, an enhanced laboratory prompt did not increase use of these medications.

A cluster randomised trial of educational messages to improve the primary care of diabetes

Background

Regular laboratory test monitoring of patient parameters offers a route for improving the quality of chronic disease care. We evaluated the effects of brief educational messages attached to laboratory test reports on diabetes care.

Methods

A programme of cluster randomised controlled trials was set in primary care practices in one primary care trust in England. Participants were the primary care practices' constituent healthcare professionals and patients with diabetes. Interventions comprised brief educational messages added to paper and electronic primary care practice laboratory test reports and introduced over two phases. Phase one messages, attached to Haemoglobin A1c (HbA1c) reports, targeted glycaemic and cholesterol control. Phase two messages, attached to albumin:creatinine ratio (ACR) reports, targeted blood pressure (BP) control, and foot inspection. Main outcome measures comprised practice mean HbA1c and cholesterol levels, diastolic and systolic BP, and proportions of patients having undergone foot inspections.

Results

Initially, 35 out of 37 eligible practices participated. Outcome data were available for a total of 8,690 patients with diabetes from 32 practices. The BP message produced a statistically significant reduction in diastolic BP (-0.62 mmHg; 95% confidence interval -0.82 to -0.42 mmHg) but not systolic BP (-0.06 mmHg, -0.42 to 0.30 mmHg) and increased the odds of achieving target BP control (odds ratio 1.05; 1.00, 1.10). The foot inspection message increased the likelihood of a recorded foot inspection (incidence rate ratio 1.26; 1.18 to 1.36). The glycaemic control message had no effect on mean HbA1c (increase 0.01%; -0.03 to 0.04) despite increasing the odds of a change in likelihood of HbA1c tests being ordered (OR 1.06; 1.01, 1.11). The cholesterol message had no effect (decrease 0.01 mmol/l, -0.04 to 0.05).

Conclusions

Three out of four interventions improved intermediate outcomes or process of diabetes care. The diastolic BP reduction approximates to relative reductions in mortality of 3% to 5% in stroke and 3% to 4% in ischaemic heart disease over 10 years. The lack of effect for other outcomes may, in part, be explained by difficulties in bringing about further improvements beyond certain thresholds of clinical performance.

Trial Registration

Current Controlled Trials, ISRCTN2186314.