Automated Software System to Promote Anticoagulation and Reduce Stroke Risk: Cluster-Randomized Controlled Trial

Computerized clinical decision support to improve stroke prevention therapy in primary care management of atrial fibrillation: a cluster randomized trial

BACKGROUND

Despite guidelines supporting antithrombotic therapy use in atrial fibrillation (AF), under-prescribing persists. We assessed whether computerized clinical decision support (CDS) would enable guideline-based antithrombotic therapy for AF patients in primary care.

METHODS

This cluster randomized trial of CDS versus usual care (UC) recruited participants from primary care practices across Nova Scotia, following them for 12 months. The CDS tool calculated bleeding and stroke risk scores and provided recommendations for using oral anticoagulants (OAC) per Canadian guidelines.

RESULTS

From June 14, 2014 to December 15, 2016, 203 primary care providers (99 UC, 104 CDS) with access to high-speed Internet were recruited, enrolling 1,145 eligible patients (543 UC, 590 CDS) assigned to the same treatment arm as their provider. Patient mean age was 72.3 years; most were male (350, 64.5% UC, 351, 59.5% CDS) and from a rural area (298, 54.9% UC, 315, 53.4% CDS). At baseline, a higher than anticipated proportion of patients were receiving guideline-based OAC therapy (373, 68.7% UC, 442, 74.9% CDS; relative risk [RR] 0.97 (95% confidence interval [CI], 0.87-1.07; P = .511)). At 12 months, prescription data were available for 538 usual care and 570 CDS patients, and significantly more CDS patients were managed according to guidelines (415, 77.1% UC, 479, 84.0% CDS; RR 1.08 (95% CI, 1.01-1.15; P = .024)).

CONCLUSION

Notwithstanding high baseline rates, primary care provider access to the CDS over 12 months further optimized the prescribing of OAC therapy per national guidelines to AF patients potentially eligible to receive it. This suggests that CDS can be effective in improving clinical process of care.

TRIAL REGISTRATION

Clinical Trials NCT01927367. https://clinicaltrials.gov/ct2/show/NCT01927367?term=NCT01927367&draw=2&rank=1.

Electronic health record-based behaviour change interventions aimed at general practitioners in the UK: a mixed methods systematic review using behaviour change theory

OBJECTIVES

Electronic health record (EHR) systems are used extensively in healthcare; their design can influence clinicians' behaviour. We conducted a systematic review of EHR-based interventions aimed at changing the clinical practice of general practitioners in the UK, assessed their effectiveness and applied behaviour change theory to identify lessons for other settings.

DESIGN

Mixed methods systematic review.

DATA SOURCES

MEDLINE, EMBASE, CENTRAL and APA PsycINFO were searched up to March 2023.

ELIGIBILITY CRITERIA

Quantitative and qualitative findings from randomised controlled trials (RCTs) controlled before-and-after studies and interrupted time series of EHR-based interventions in UK general practice were included.

DATA EXTRACTION AND SYNTHESIS

Quantitative synthesis was based on Cochrane's Synthesis without Meta-analysis. Interventions were categorised using the Behaviour Change Wheel and MINDSPACE frameworks and effectiveness determined by vote-counting using direction of effect. Inductive thematic synthesis was used for qualitative studies.

RESULTS

Database searching identified 3824 unique articles; 10 were included (from 2002 to 2021), comprising eight RCTs and two associated qualitative studies. Four of seven quantitative studies showed a positive effect on clinician behaviour and three on patient-level outcomes. Behaviour change techniques that may trigger emotions and required less cognitive engagement appeared to have positive effects. Qualitative findings indicated that interventions reassured clinicians of their decisions but were sometimes ignored.

CONCLUSION

Despite widespread use, there is little high quality, up-to-date experimental evidence evaluating the effectiveness of EHR-based interventions in UK general practice. The evidence suggested EHR-based interventions may be effective at changing behaviour. Persistent, simple action-oriented prompts appeared more effective than complex interventions requiring greater cognitive engagement. However, studies lacked detail in intervention design and theory behind design choices. Future research should seek to optimise EHR-based behaviour change intervention design and delineate limitations, providing theory-based justification for interventions. This will be of increasing importance with the growing use of EHRs to influence clinicians' decisions.

PROSPERO REGISTRATION NUMBER

CRD42022341009.

Role of a National Health Service Electronic Prescriptions Database in the Detection of Prescribing and Dispensing Issues and Adherence Evaluation of Direct Oral Anticoagulants

BACKGROUND

Anticoagulation therapy plays a crucial role in the management of atrial fibrillation (AF) by significantly reducing the risk of stroke. Direct oral anticoagulants (DOAC) became preferred over warfarin due to their superior safety and efficacy profile. Assessing adherence to anticoagulation therapy is necessary in clinical practice for optimising patient outcomes and treatment efficacy, thus emphasising its significance.

METHODS

A retrospective study utilised the Latvian National Health Service reimbursement prescriptions database, covering prescriptions for AF and flutter from January 2012 to December 2022. The proportion of days covered method was selected for adherence assessment, categorising it into three groups: (1) below 80%, (2) between 80% and 90%, and (3) above 90%.

RESULTS

A total of 1,646,648 prescriptions were analysed. Dabigatran prescriptions started declining after 2020, coinciding with a decrease in warfarin prescriptions since 2018. The total adherence levels to DOAC therapy were 69.4%. Only 44.2% of users achieved an adherence level exceeding 80%. The rate of paper prescriptions decreased from 98.5% in 2017 to 1.3% in 2022. Additionally, the utilisation of international non-proprietary names reached 79.7% in 2022. Specifically, 16.7% of patients selected a single pharmacy, whereas 27.7% visited one or two pharmacies. Meanwhile, other patients obtained medicines from multiple pharmacies.

CONCLUSIONS

The total adherence level to DOAC therapy is evaluated as low and there was no significant difference in age, gender, or "switcher" status among adherence groups. Physicians' prescribing habits have changed over a decade.

An interrupted time series study of electronic health record clinical decision support for providers caring for patients with atrial fibrillation at increased stroke risk

PURPOSE

To measure the effect of clinical decision support (CDS) on anticoagulation rates in patients with atrial fibrillation (AFib) or atrial flutter (AFlut) at high stroke risk and receiving care in outpatient settings, and to assess provider response to CDS.

METHODS

This observational, quasi-experimental, interrupted time series study utilized electronic health record data at a large integrated delivery network in Texas from April to November 2020. CDS consisted of an electronic Best Practice Advisory (BPA)/alert (Epic Systems Corporation, Verona, WI) with links to 2 AFib order sets displayed to providers in outpatient settings caring for non-anticoagulated patients with AFib and elevated CHA2DS2VASc scores. Weekly outpatient anticoagulation rates were assessed in patients with high stroke risk before and after implementation of CDS. Alert actions and acknowledgment reasons were evaluated descriptively.

RESULTS

Mean (SD) weekly counts of eligible patients were 8,917 (566) before and 8,881 (811) after implementation. Weekly anticoagulation rates increased during the pre-BPA study period (β1 = 0.07%; SE, 0.02%; P = 0.0062); however, there were no significant changes in the level (β2 = 0.60%; SE, 0.42%; P = 0.1651) or trend (β3 = -0.01%; SE, 0.05%; P = 0.8256) of anticoagulation rates associated with CDS implementation. In encounters with the BPA/alert displayed (n = 17,654), acknowledgment reasons were provided in 4,473 (25.3%) of the encounters, with prescribers most commonly citing bleeding risk (n = 1,327, 7.5%) and fall risk (n = 855, 4.8%).

CONCLUSION

There was a significant trend of increasing anticoagulation rates during the pre-BPA period, with no significant change in trend during the post-BPA period relative to the pre-BPA period.

Potentiality of algorithms and artificial intelligence adoption to improve medication management in primary care: a systematic review

OBJECTIVES

The aim of this study is to investigate the effect of artificial intelligence (AI) and/or algorithms on drug management in primary care settings comparing AI and/or algorithms with standard clinical practice. Second, we evaluated what is the most frequently reported type of medication error and the most used AI machine type.

METHODS

A systematic review of literature was conducted querying PubMed, Cochrane and ISI Web of Science until November 2021. The search strategy and the study selection were conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses and the Population, Intervention, Comparator, Outcome framework. Specifically, the Population chosen was general population of all ages (ie, including paediatric patients) in primary care settings (ie, home setting, ambulatory and nursery homes); the Intervention considered was the analysis AI and/or algorithms (ie, intelligent programs or software) application in primary care for reducing medications errors, the Comparator was the general practice and, lastly, the Outcome was the reduction of preventable medication errors (eg, overprescribing, inappropriate medication, drug interaction, risk of injury, dosing errors or in an increase in adherence to therapy). The methodological quality of included studies was appraised adopting the Quality Assessment of Controlled Intervention Studies of the National Institute of Health for randomised controlled trials.

RESULTS

Studies reported in different ways the effective reduction of medication error. Ten out of 14 included studies, corresponding to 71% of articles, reported a reduction of medication errors, supporting the hypothesis that AI is an important tool for patient safety.

CONCLUSION

This study highlights how a proper application of AI in primary care is possible, since it provides an important tool to support the physician with drug management in non-hospital environments.

Chronic disease IMPACT (chronic disease early detection and improved management in primary care project): An Australian stepped wedge cluster randomised trial

Background

Interrelated chronic vascular diseases (chronic kidney disease (CKD), type 2 diabetes (T2D) and cardiovascular disease (CVD)) are common with high morbidity and mortality. This study aimed to assess if an electronic-technology-based quality improvement intervention in primary care could improve detection and management of people with and at risk of these diseases.

Methods

Stepped-wedge trial with practices randomised to commence intervention in one of five 16-week periods. Intervention included (1) electronic-technology tool extracting data from general practice electronic medical records and generating graphs and lists for audit; (2) education regarding chronic disease and the electronic-technology tool; (3) assistance with quality improvement audit plan development, benchmarking, monitoring and support. De-identified data analysis using R 3.5.1 conducted using Bayesian generalised linear mixed model with practice and time-specific random intercepts.

Results

At baseline, eight included practices had 37,946 active patients (attending practice ≥3 times within 2 years) aged ≥18 years. Intervention was associated with increased OR (95% CI) for: kidney health checks (estimated glomerular filtration rate, urine albumin:creatinine ratio (uACR) and blood pressure) in those at risk 1.34 (1.26-1.42); coded diagnosis of CKD 1.18 (1.09-1.27); T2D diagnostic testing (fasting glucose or HbA1c) in those at risk 1.15 (1.08-1.23); uACR in patients with T2D 1.78 (1.56-2.05). Documented eye checks within recommended frequency in patients with T2D decreased 0.85 (0.77-0.96). There were no significant changes in other assessed variables.

Conclusions

This electronic-technology-based intervention in primary care has potential to help translate guidelines into practice but requires further refining to achieve widespread improvements across the interrelated chronic vascular diseases.

Improving guideline-based anticoagulation in atrial fibrillation: A systematic literature review of prospective trials

BACKGROUND

Guidelines for anticoagulation in patients with atrial fibrillation (AF) aim to decrease the risk of ischemic stroke. However, there is a gap in actual practice between patients who have an indication for anticoagulation and those who are actually prescribed anticoagulation.

OBJECTIVE

We sought to evaluate the efficacy of prior population-based interventions aimed at decreasing this AF anticoagulation gap.

METHODS

This study was prospectively registered in the International Prospective Register of Systematic Reviews database (CRD42021287875). A systematic literature review was conducted to obtain all prospective individually randomized and cluster randomized trials by searching 4 electronic databases: PubMed, Google Scholar, Web of Science, and Medline.

RESULTS

After a review of 1474 studies, 20 trials were included in this systematic literature review. Forty-five percent were effective in decreasing the AF anticoagulation gap. Trial interventions that improved anticoagulation prescribing included 6 trials of electronic risk assessment or decision support, 1 trial of provider education, 2 trials of new protocol or pathway, and 2 trials of patient education. Six of 15 ambulatory trials, 2 of 4 inpatient trials, and 1 trial that spanned inpatient and outpatient settings improved anticoagulation prescribing rates. Interventions focused on patient education, provider education, and electronic risk assessment or decision support increased absolute appropriate anticoagulation prescribing by 8.3%, 4.9%, and 2.0%, respectively.

CONCLUSION

Interventions aimed at improving anticoagulation prescribing patterns in AF can be effective, although there is heterogeneity in outcomes across intervention type. The most effective interventions appeared to target patient education, provider education, and electronic risk assessment or decision support.

Design, effectiveness, and economic outcomes of contemporary chronic disease clinical decision support systems: a systematic review and meta-analysis

Objectives

Electronic health record-based clinical decision support (CDS) has the potential to improve health outcomes. This systematic review investigates the design, effectiveness, and economic outcomes of CDS targeting several common chronic diseases.

Material and Methods

We conducted a search in PubMed (Medline), EBSCOHOST (CINAHL, APA PsychInfo, EconLit), and Web of Science. We limited the search to studies from 2011 to 2021. Studies were included if the CDS was electronic health record-based and targeted one or more of the following chronic diseases: cardiovascular disease, diabetes, chronic kidney disease, hypertension, and hypercholesterolemia. Studies with effectiveness or economic outcomes were considered for inclusion, and a meta-analysis was conducted.

Results

The review included 76 studies with effectiveness outcomes and 9 with economic outcomes. Of the effectiveness studies, 63% described a positive outcome that favored the CDS intervention group. However, meta-analysis demonstrated that effect sizes were heterogenous and small, with limited clinical and statistical significance. Of the economic studies, most full economic evaluations (n = 5) used a modeled analysis approach. Cost-effectiveness of CDS varied widely between studies, with an estimated incremental cost-effectiveness ratio ranging between USD$2192 to USD$151 955 per QALY.

Conclusion

We summarize contemporary chronic disease CDS designs and evaluation results. The effectiveness and cost-effectiveness results for CDS interventions are highly heterogeneous, likely due to differences in implementation context and evaluation methodology. Improved quality of reporting, particularly from modeled economic evaluations, would assist decision makers to better interpret and utilize results from these primary research studies.

Registration

PROSPERO (CRD42020203716)

Electronic health record-embedded decision support to reduce stroke risk in patients with atrial fibrillation - Study protocol

BACKGROUND

Atrial fibrillation (AF) is the most common significant cardiac rhythm disorder and is a powerful common risk factor for stroke. Randomized trials have demonstrated that anticoagulation can reduce the risk of stroke in patients with AF. Yet, there continues to be widespread underutilization of this therapy. To address this practice gap locally and improve efforts to reduce the risk of stroke for patients with AF in our health system, we have designed a study to implement and evaluate the effectiveness of an Atrial Fibrillation Decision Support Tool (AFDST) embedded within our electronic health record.

METHODS

Our intervention is provider-facing and focused on decision support. The clinical setting is ambulatory patients being seen by primary care physicians. Patients include those with both incident and prevalent AF. This randomized, prospective trial will enroll 800 patients in our University of Cincinnati Health System who are currently receiving less than optimal anticoagulation therapy as determined by the AFDST. Patients will be randomized to one of two arms - 1) usual care, in which the AFDST is available for use; 2) addition of a best practice advisory (BPA) to the AFDST notifying the clinician that their patient stands to gain a significant benefit from a change in their current thromboprophylactic therapy.

RESULTS

The primary outcome is effectiveness of the BPA measured by change to "appropriate thromboprophylaxis" based on the AFDST recommendation at 3 months post randomization. Secondary endpoints include Reach and Adoption, from the RE-AIM framework for implementation studies. Sample size is based upon an improvement from inappropriate to appropriate anticoagulation therapy estimated at 4% in the usual care arm and ≥10% in the experimental arm.

CONCLUSION

Our goal is to examine whether addition of a BPA to an AFDST focused on primary care physicians in an ambulatory care setting will improve "appropriate thromboprophylaxis" compared with usual care. Results will be examined at 3 months post randomization and at the end of the study to evaluate durability of changes. We expect to complete patient enrollment by the end of June 2022.

TRIAL REGISTRATION

Clinicaltrials.gov NCT04099485.

Moving Towards Equity With Digital Health Innovations for Stroke Care

Digital health has long been championed as a means to expanding access to health care. Now that the COVID-19 pandemic accelerated many health systems' integration of digital tools for care, digital health may provide a path towards more accessible stroke prevention and treatment, particularly for historically disadvantaged patient populations. Stroke management is composed of multiple time points where digital health innovations have the potential to augment health access and treatment: from primary prevention, to the time-sensitive detection of ischemic stroke, administration of thrombolytic agents and consideration for endovascular interventions, to appropriate post-acute care, rehabilitation, and lifelong secondary stroke prevention-stroke care relies on a multidisciplinary and standardized approach. However, as we discuss pointedly in this Focused Update, underrepresented individuals face multilevel digital health disparities that potentially diminish the benefits of these digital advances. As such, these multilevel needs must be discussed and accounted for as health systems seek to integrate innovative and equitable digital health solutions towards stroke care.

Improving appropriate use of anticoagulants in hospitalised patients: a pharmacist-led Check of Medication Appropriateness intervention

AIM

Inappropriate anticoagulant use increases the risk of bleeding and thrombotic events. We implemented clinical decision rules to promote judicious medication use, as part of the 'Check of Medication Appropriateness' (CMA). The CMA concerns a pharmacist-led review service, targeting potentially inappropriate prescriptions (PIPs). In this analysis, we aimed to evaluate the impact of the CMA on anticoagulant prescribing.

METHODS

The number of anticoagulant-related PIPs was evaluated before and after implementation of the intervention in a quasi-experimental interrupted time series analysis. The pre-implementation cohort received usual care. The anticoagulant-focused CMA, comprising 13 clinical rules pertaining to anticoagulation therapies, was implemented in the post-implementation cohort. Segmented regression analysis was used to assess the impact of the intervention on the number of residual PIPs. A residual PIP was defined as a PIP which persisted up to 48h after the CMA intervention. Total number of recommendations and acceptance rate were documented for the 2-year post-implementation period.

RESULTS

Pre-implementation, we observed 501 PIPs in 466 inpatients on 36 days, with a median proportion of 78.5% (range: 46.2%-100%) residual PIPs per day. Post-implementation, 538 PIPs were detected in 485 patients over the same number of days. The CMA intervention reduced the median proportion to 18.2% (range: 0-100%) per day. The effect coincided with an immediate relative reduction of 70% (95%CI 0.19-0.46) in anticoagulant-related residual PIPs. Post-implementation, 2778 recommendations were provided and 75.1% were accepted.

CONCLUSION

Our CMA approach significantly reduced anticoagulant-related PIPs. Implementing a pharmacist-led intervention, based on clinical rules, may support safer prescribing of anticoagulants.

The effect of electronic audits and feedback in primary care and factors that contribute to their effectiveness: a systematic review

PURPOSE

The aim of this systematic review was (i) to assess whether electronic audit and feedback (A&F) is effective in primary care and (ii) to evaluate important features concerning content and delivery of the feedback in primary care, including the use of benchmarks, the frequency of feedback, the cognitive load of feedback and the evidence-based aspects of the feedback.

DATA SOURCES

The MEDLINE, Embase, CINAHL and CENTRAL databases were searched for articles published since 2010 by replicating the search strategy used in the last Cochrane review on A&F.

STUDY SELECTION

Two independent reviewers assessed the records for their eligibility, performed the data extraction and evaluated the risk of bias. Our search resulted in 8744 records, including the 140 randomized controlled trials (RCTs) from the last Cochrane Review. The full texts of 431 articles were assessed to determine their eligibility. Finally, 29 articles were included.

DATA EXTRACTION

Two independent reviewers extracted standard data, data on the effectiveness and outcomes of the interventions, data on the kind of electronic feedback (static versus interactive) and data on the aforementioned feedback features.

RESULTS OF DATA SYNTHESIS

Twenty-two studies (76%) showed that electronic A&F was effective. All interventions targeting medication safety, preventive medicine, cholesterol management and depression showed an effect. Approximately 70% of the included studies used benchmarks and high-quality evidence in the content of the feedback. In almost half of the studies, the cognitive load of feedback was not reported. Due to high heterogeneity in the results, no meta-analysis was performed.

CONCLUSION

This systematic review included 29 articles examining electronic A&F interventions in primary care, and 76% of the interventions were effective. Our findings suggest electronic A&F is effective in primary care for different conditions such as medication safety and preventive medicine. Some of the benefits of electronic A&F include its scalability and the potential to be cost effective. The use of benchmarks as comparators and feedback based on high-quality evidence are widely used and important features of electronic feedback in primary care. However, other important features such as the cognitive load of feedback and the frequency of feedback provision are poorly described in the design of many electronic A&F intervention, indicating that a better description or implementation of these features is needed. Developing a framework or methodology for automated A&F interventions in primary care could be useful for future research.

Strategies for improving guideline adherence of anticoagulants for patients with atrial fibrillation in primary healthcare: A systematic review

BACKGROUND

Clinical guidelines on atrial fibrillation management help optimize the use of oral anticoagulants. However, guideline non-adherence is common, particularly in the primary care setting. The primary aim of this systematic review was to identify effective strategies for improving adherence to guideline-directed thromboprophylaxis to patients with atrial fibrillation in the primary care setting.

METHODS

A search was conducted on 6 electronic databases (Medline, Embase, ScienceDirect, Scopus, the Cumulative Indexing of Nursing and Allied Health Literature, and Web of Science) supplemented by a Google advanced search. Studies aimed at improving oral thromboprophylaxis guideline adherence in patients with atrial fibrillation, in the primary care setting, were included in the study.

RESULTS

A total of 33 studies were included in this review. Nine studies employed electronic decision support (EDS), of which 4 reported modest improvements in guideline adherence. Five of 6 studies that utilized local guidelines as quality improvement measures reported improvement in guideline adherence. All 5 studies that employed coordinated care and the use of specialist support and 4 of the 5 studies that involved pharmacist-led interventions reported improvements in guideline adherence. Interventions based mainly on feedback from audits were less effective.

CONCLUSIONS

Multifaceted interventions, especially those incorporating coordinated care and specialist support, pharmacists, or local adaptations to and implementation of national and/or international guidelines appear to be more consistently effective in improving guideline adherence in the primary care setting than interventions based mainly on EDS and feedback from audits.

SUPPORT-AF III: supporting use of AC through provider prompting about oral anticoagulation therapy for AF

Only half of atrial fibrillation (AF) patients with elevated stroke risk receive anticoagulation (AC). Electronic health record (EHR) alerts have the potential to close the gap. We designed an outpatient EHR alert (linked to an order set for ordering AC, labs, and specialty referrals) that fired when cardiology and primary care providers (PCPs) saw AF patients not on AC. We assigned all untreated patients seen by cardiology providers and PCPs in the 8 months before and after the alert launch to pre- and post-launch intervention cohorts, respectively. Untreated AF patients seeing other types of providers became controls. We then compared the difference in AC starts between intervention and control patients post-launch to the same difference prelaunch (adjusting for covariates). We measured alert responsiveness as how often patients had at least one encounter with a provider, who interacted with the alert. The adjusted percentage of AC starts for the prelaunch cohort was 20% for intervention patients and 17% for controls (difference = 3%); post-launch, the percentage was 13% for both post-launch intervention and controls (difference = 0%). The difference in difference was - 3% (p value 0.63). For half of patients, at least one provider was responsive to our alert. Reasons for no AC commonly included relative contraindications (e.g. fall, gastrointestinal bleed). Our alert did not increase AC starts but responsiveness to it was high. Increasing AC starts will likely require education surrounding relative contraindications.

Computerised clinical decision support systems and absolute improvements in care: meta-analysis of controlled clinical trials

OBJECTIVE

To report the improvements achieved with clinical decision support systems and examine the heterogeneity from pooling effects across diverse clinical settings and intervention targets.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

Medline up to August 2019.

ELIGIBILITY CRITERIA FOR SELECTING STUDIES AND METHODS

Randomised or quasi-randomised controlled trials reporting absolute improvements in the percentage of patients receiving care recommended by clinical decision support systems. Multilevel meta-analysis accounted for within study clustering. Meta-regression was used to assess the degree to which the features of clinical decision support systems and study characteristics reduced heterogeneity in effect sizes. Where reported, clinical endpoints were also captured.

RESULTS

In 108 studies (94 randomised, 14 quasi-randomised), reporting 122 trials that provided analysable data from 1 203 053 patients and 10 790 providers, clinical decision support systems increased the proportion of patients receiving desired care by 5.8% (95% confidence interval 4.0% to 7.6%). This pooled effect exhibited substantial heterogeneity (I²=76%), with the top quartile of reported improvements ranging from 10% to 62%. In 30 trials reporting clinical endpoints, clinical decision support systems increased the proportion of patients achieving guideline based targets (eg, blood pressure or lipid control) by a median of 0.3% (interquartile range -0.7% to 1.9%). Two study characteristics (low baseline adherence and paediatric settings) were associated with significantly larger effects. Inclusion of these covariates in the multivariable meta-regression, however, did not reduce heterogeneity.

CONCLUSIONS

Most interventions with clinical decision support systems appear to achieve small to moderate improvements in targeted processes of care, a finding confirmed by the small changes in clinical endpoints found in studies that reported them. A minority of studies achieved substantial increases in the delivery of recommended care, but predictors of these more meaningful improvements remain undefined.

Supporting anticoagulant treatment decision making to optimise stroke prevention in complex patients with atrial fibrillation: a cluster randomised trial

Background

Anticoagulation for preventing stroke in atrial fibrillation is under-utilised despite evidence supporting its use, resulting in avoidable death and disability. We aimed to evaluate an intervention to improve the uptake of anticoagulation.

Methods

We carried out a national, cluster randomised controlled trial in the Australian primary health care setting. General practitioners received an educational session, delivered via telephone by a medical peer and provided information about their patients selected either because they were not receiving anticoagulation or for whom anticoagulation was considered challenging. General practitioners were randomised to receive feedback from a medical specialist about the cases (expert decisional support) either before or after completing a post-test audit. The primary outcome was the proportion of patients reported as receiving oral anticoagulation. A secondary outcome assessed antithrombotic treatment as appropriate against guideline recommendations.

Results

One hundred and seventy-nine general practitioners participated in the trial, contributing information about 590 cases. At post-test, 152 general practitioners (84.9%) completed data collection on 497 cases (84.2%). A 4.6% (Adjusted Relative Risk = 1.11, 95% CI = 0.86–1.43) difference in the post-test utilization of anticoagulation between groups was not statistically significant (p = 0.42). Sixty-one percent of patients in both groups received appropriate antithrombotic management according to evidence-based guidelines at post-test (Adjusted Relative Risk = 1.0; 95% CI = 0.85 to 1.19) (p = 0.97).

Conclusions

Specialist feed-back in addition to an educational session did not increase the uptake of anticoagulation in patients with AF.

Trial registration

ANZCTRN12611000076976 Retrospectively registered.

Integrated Management Program Advancing Community Treatment of Atrial Fibrillation (IMPACT-AF): A cluster randomized trial of a computerized clinical decision support tool

BACKGROUND

Clinical decision support (CDS) tools designed to digest, filter, organize, and present health data are becoming essential in providing clinical and cost-effective care. Many are not rigorously evaluated for benefit before implementation. We assessed whether computerized CDS for primary care providers would improve atrial fibrillation (AF) management and outcomes as compared to usual care.

METHODS

Overall, 203 primary care providers were recruited, randomized, and then cluster stratified by location (urban, rural) to usual care (n = 99) or CDS (n = 104). Providers recruited 1,145 adult patients with AF to participate. The intervention was access to an evidenced-based, point-of-care computerized CDS designed to support guideline-based AF management. The primary efficacy outcome was a composite of unplanned cardiovascular hospitalizations and AF-related emergency department visits; the primary safety outcome was major bleeding, both over 1 year. Patients were the units of intention-to-treat analysis.

RESULTS

No significant effects on the primary efficacy (130 control, 118 CDS, hazard ratio: 0.98 [95% CI 0.71-1.37], P = .926) or safety (n = 7 usual care, n = 8 CDS, 1.3% total, P = .939) outcomes were observed at 12-months.

CONCLUSIONS

IMPACT-AF rigorously assessed a CDS tool in a highly representative sample of primary care providers and their patients; however, no impact on outcomes was observed. Considering the proliferating use of CDS applications, this study highlights the need for efficacy assessments prior to adoption and clinical implementation.

SUPPORT-AF II: Supporting Use of Anticoagulants Through Provider Profiling of Oral Anticoagulant Therapy for Atrial Fibrillation

Background:

Previous provider-directed electronic messaging interventions have not by themselves improved anticoagulation use in patients with atrial fibrillation. Direct engagement with providers using academic detailing coupled with electronic messaging may overcome the limitations of the prior interventions.

Methods and Results:

We randomized outpatient providers affiliated with our health system in a 2.5:1 ratio to our electronic profiling/messaging combined with academic detailing intervention. In the intervention, we emailed providers monthly reports of their anticoagulation percentage relative to peers for atrial fibrillation patients with elevated stroke risk (CHA 2 DS 2 -VASc ≥2). We also sent electronic medical record-based messages shortly before an appointment with an anticoagulation-eligible but untreated atrial fibrillation patient. Providers had the option to send responses with explanations for prescribing decisions. We also offered to meet with intervention providers using an academic detailing approach developed based on knowledge gaps discussed in provider focus groups. To assess feasibility, we tracked provider review of our messages. To assess effectiveness, we measured the change in anticoagulation for patients of intervention providers relative to controls. We identified 85 intervention and 34 control providers taking care of 3591 and 1908 patients, respectively; 33 intervention providers participated in academic detailing. More than 80% of intervention providers read our emails, and 98% of the time a provider reviewed our in-basket messages. Replies to messages identified patient refusal as the most common reason for patients not being on anticoagulation (11.2%). For the group of patients not on anticoagulation at baseline assigned to an intervention versus control provider, the adjusted percent increase in the use of anticoagulation over 6 months was 5.2% versus 7.4%, respectively ( P =0.21).

Conclusions:

Our electronic messaging and academic detailing intervention was feasible but did not increase anticoagulation use. Patient-directed interventions or provider interventions targeting patients declining anticoagulation may be necessary to raise the rate of anticoagulation.

Clinical Trial Registration

URL: http://www.clinicaltrials.gov . Unique identifier: NCT03583008.

An adaptable implementation package targeting evidence-based indicators in primary care: A pragmatic cluster-randomised evaluation

BACKGROUND

In primary care, multiple priorities and system pressures make closing the gap between evidence and practice challenging. Most implementation studies focus on single conditions, limiting generalisability. We compared an adaptable implementation package against an implementation control and assessed effects on adherence to four different evidence-based quality indicators.

METHODS AND FINDINGS

We undertook two parallel, pragmatic cluster-randomised trials using balanced incomplete block designs in general practices in West Yorkshire, England. We used 'opt-out' recruitment, and we randomly assigned practices that did not opt out to an implementation package targeting either diabetes control or risky prescribing (Trial 1); or blood pressure (BP) control or anticoagulation in atrial fibrillation (AF) (Trial 2). Within trials, each arm acted as the implementation control comparison for the other targeted indicator. For example, practices assigned to the diabetes control package acted as the comparison for practices assigned to the risky prescribing package. The implementation package embedded behaviour change techniques within audit and feedback, educational outreach, and computerised support, with content tailored to each indicator. Respective patient-level primary endpoints at 11 months comprised the following: achievement of all recommended levels of haemoglobin A1c (HbA1c), BP, and cholesterol; risky prescribing levels; achievement of recommended BP; and anticoagulation prescribing. Between February and March 2015, we recruited 144 general practices collectively serving over 1 million patients. We stratified computer-generated randomisation by area, list size, and pre-intervention outcome achievement. In April 2015, we randomised 80 practices to Trial 1 (40 per arm) and 64 to Trial 2 (32 per arm). Practices and trial personnel were not blind to allocation. Two practices were lost to follow-up but provided some outcome data. We analysed the intention-to-treat (ITT) population, adjusted for potential confounders at patient level (sex, age) and practice level (list size, locality, pre-intervention achievement against primary outcomes, total quality scores, and levels of patient co-morbidity), and analysed cost-effectiveness. The implementation package reduced risky prescribing (odds ratio [OR] 0.82; 97.5% confidence interval [CI] 0.67-0.99, p = 0.017) with an incremental cost-effectiveness ratio of £1,359 per quality-adjusted life year (QALY), but there was insufficient evidence of effect on other primary endpoints (diabetes control OR 1.03, 97.5% CI 0.89-1.18, p = 0.693; BP control OR 1.05, 97.5% CI 0.96-1.16, p = 0.215; anticoagulation prescribing OR 0.90, 97.5% CI 0.75-1.09, p = 0.214). No statistically significant effects were observed in any secondary outcome except for reduced co-prescription of aspirin and clopidogrel without gastro-protection in patients aged 65 and over (adjusted OR 0.62; 97.5% CI 0.39-0.99; p = 0.021). Main study limitations concern our inability to make any inferences about the relative effects of individual intervention components, given the multifaceted nature of the implementation package, and that the composite endpoint for diabetes control may have been too challenging to achieve.

CONCLUSIONS

In this study, we observed that a multifaceted implementation package was clinically and cost-effective for targeting prescribing behaviours within the control of clinicians but not for more complex behaviours that also required patient engagement.

TRIAL REGISTRATION

The study is registered with the ISRCTN registry (ISRCTN91989345).

Do computerized clinical decision support systems improve the prescribing of oral anticoagulants? A systematic review

BACKGROUND

Serious adverse drug reactions have been associated with the underuse or the misuse of oral anticoagulant therapy. We systematically reviewed the impact of computerized clinical decision support systems (CDSS) on the prescribing of oral anticoagulants and we described CDSS features associated with success or failure.

METHODS

We searched Medline, Embase, CENTRAL, CINHAL, and PsycINFO for studies that compared CDSS for the initiation or monitoring of oral anticoagulants with routine care. Two reviewers performed study selection, data collection, and risk-of-bias assessment. Disagreements were resolved with a third reviewer. Potentially important CDSS features, identified from previous literature, were evaluated.

RESULTS

Sixteen studies were included in our qualitative synthesis. Most trials were performed in primary care (n = 7) or hospitals (n = 6) and included atrial fibrillation (AF) patients (n = 9). Recommendations mainly focused on anticoagulation underuse (n = 11) and warfarin-drug interactions (n = 5). Most CDSS were integrated in electronic records or prescribing and provided support automatically at the time and location of decision-making. Significant improvements in practitioner performance were found in 9 out of 16 studies, while clinical outcomes were poorly reported. CDSS features seemed slightly more common in studies that demonstrated improvement.

CONCLUSIONS

CDSS might positively impact the use of oral anticoagulants in AF patients at high risk of stroke. The scope of CDSS should now evolve to assist prescribers in selecting the most appropriate and tailored medication. Efforts should nevertheless be made to improve the relevance of notifications and to address implementation outcomes.

GP incentives to design hypertension and atrial fibrillation local quality-improvement schemes: a controlled before-after study in UK primary care

BACKGROUND

Financial incentives in the UK such as the Quality and Outcomes Framework (QOF) reward GP surgeries for achievement of nationally defined targets. These have shown mixed results, with weak evidence for some measures, but also possible unintended negative effects.

AIM

To look at the effects of a local intervention for atrial fibrillation (AF) and hypertension, with surgeries rewarded financially for work, including appointing designated practice leads, attendance at peer review workshops, and producing their own protocols.

DESIGN AND SETTING

A controlled before-after study comparing surgery performance measures in UK primary care.

METHOD

This study used published QOF data to analyse changes from baseline in mean scores per surgery relating to AF and hypertension prevalence and management at T1 (12 months) and T2 (24 months) for the intervention group, which consisted of all 58 surgeries in East Lancashire Clinical Commissioning Group (CCG), compared to the control group, which consisted of all other surgeries in north-west England.

RESULTS

There was a small acceleration between T0 (baseline) and T2 in recorded prevalence of hypertension in the intervention group compared to the controls, difference 0.29% (95% confidence interval [CI] = 0.05 to 0.53), P = 0.017, but AF prevalence did not increase more in the intervention group. Improvement in quality of management of AF was significantly better in the intervention group, difference 3.24% (95% CI = 1.37 to 5.12), P = 0.001.

CONCLUSION

This intervention improved diagnosis rates of hypertension but not AF, though it did improve quality of AF management. It indicates that funded time to develop quality-improvement measures targeted at a local population and involving peer support can engage staff and have the potential to improve quality.

Electronic Decision support for Improvement of Contemporary Therapy for Stroke Prevention

BACKGROUND

Despite ample clinical trial data demonstrating that oral anticoagulation (OAC) treatment is highly effective in reducing stroke for patients with atrial fibrillation (AF), OAC treatment remains underutilized in current clinical practice. Targeting hospitalist and emergency department providers with electronic decision support represents a potential quality improvement opportunity in the use of OAC medication in AF patients.

METHODS

We conducted a 3-center study in which 2 sites utilized an electronic alert (EA) embedded in the electronic health record and 1 site provided usual care. The EA calculated the CHA₂DS₂-VASc score for clinicians. Patients were tracked following discharge from either the emergency department or hospital. We hypothesized that the EA would increase the rate of OAC use by 15% compared to usual care, with a study sample size of 360 patients. Study exclusions included severe heart valve disease, advanced renal disease, and severe dementia. The primary endpoint was OAC use at the time of hospital discharge or 30 days after hospital discharge (whichever was the last observation recorded).

RESULTS

Among 309 patients included for analysis (mean age 70.2 years), the median CHA₂DS₂-VASc score was 3.5. The frequency of OAC use at follow-up at the usual care hospital was 55.9% (95% confidence interval 47.4-67.9). At the 2 EA sites, the rate of OAC use at the last observation point was 43.9% (P = .06). Aspirin use at follow-up was similar at the usual care site and the EA sites (53.8% versus 46.3%). The rate of OAC use in patients greater than 75 years was 60.0% in the usual care site and 48.4% (P = .09) at the EA sites.

CONCLUSIONS

The EA in our study was not sufficient to ameliorate therapeutic inertia in the use of OAC for stroke prevention in AF.

Barriers to a software reminder system for risk assessment of stroke in atrial fibrillation: a process evaluation of a cluster randomised trial in general practice

BACKGROUND

Oral anticoagulants reduce the risk of stroke in patients with atrial fibrillation (AF), but are underused. AURAS-AF (AUtomated Risk Assessment for Stroke in AF) is a software tool designed to identify eligible patients and promote discussions within consultations about initiating anticoagulants.

AIM

To investigate the implementation of the software in UK general practice.

DESIGN AND SETTING

Process evaluation involving 23 practices randomly allocated to use AURAS-AF during a cluster randomised trial.

METHOD

An initial invitation to discuss anticoagulation was followed by screen reminders appearing during consultations until a decision had been made. The reminders required responses, giving reasons for cases where an anticoagulant was not initiated. Qualitative interviews with clinicians and patients explored acceptability and usability.

RESULTS

In a sample of 476 patients eligible for the invitation letter, only 159 (33.4%) were considered suitable for invitation by their GPs. Reasons given were frequently based on frailty, and risk of falls or haemorrhage. Of those invited, 35 (22%) started an anticoagulant (7.4% of those originally identified). A total of 1695 main-screen reminders occurred in 940 patients. In 883 instances, the decision was taken not to initiate and a range of reasons offered. Interviews with 15 patients and seven clinicians indicated that the intervention was acceptable, though the issue of disruptive screen reminders was raised.

CONCLUSION

Automated risk assessment for stroke in atrial fibrillation and prompting during consultations are feasible and generally acceptable, but did not overcome concerns about frailty and risk of haemorrhage as barriers to anticoagulant uptake.

Effectiveness of CHA2DS2-VASc based decision support on stroke prevention in atrial fibrillation: A cluster randomised trial in general practice

BACKGROUND

Guidelines on atrial fibrillation (AF) recommend the CHA₂DS₂-VASc rule for anticoagulant decision-making, but underuse exists. We studied the impact of an automated decision support on stroke prevention in patients with AF in a cluster randomised trial in general practice.

METHODS

Intervention practices were provided with a CHA₂DS₂-VASc based anticoagulant treatment recommendation. Reference practices provided care as usual. The primary outcome was incidence of ischaemic stroke, transient ischaemic attack (TIA) and/or thromboembolism (TE). Secondary outcomes were bleeding and the proportion of patients on guideline recommended anticoagulant treatment.

RESULTS

In total, 1129 AF patients were included in the 19 intervention practices and 1226 AF patients in the 19 reference practices. The median age was 77 (interquartile range (IQR) 68-75) years, the median CHA₂DS₂-VASc score was 3.0 (IQR 2.0-5.0). Underuse of anticoagulants in patients with CHA₂DS₂-VASc score ≥ 2 was 6.6%. After a median follow-up of 2.7 years (IQR 2.3-3.0), the incidence rate per 100 person-years of ischaemic stroke/TIA/TE was 1.96 in the intervention group and 1.42 in the reference group (hazard ratio (HR) 1.3, 95% C.I. 0.8-2.1). No difference was observed in the rate of bleeding (0.79 versus 0.82), or in the underuse (7.2% versus 8.2%) or overuse (8.0% versus 7.9%) of anticoagulation.

CONCLUSIONS

In this study in patients with AF in general practice, underuse of anticoagulants was relatively low. Providing practitioners with CHA₂DS₂-VASc based decision support did not result in a reduction in stroke incidence, affect bleeding risk or anticoagulant over- or underuse.

SUPPORT-AF: Piloting a Multi-Faceted, Electronic Medical Record-Based Intervention to Improve Prescription of Anticoagulation

Background Only 50% of eligible atrial fibrillation ( AF ) patients receive anticoagulation ( AC ). Feasibility and effectiveness of electronic medical record (EMR)-based interventions to profile and raise provider AC percentage is poorly understood. The SUPPORT-AF (Supporting Use of AC Through Provider Profiling of Oral AC Therapy for AF) study aims to improve rates of adherence to AC guidelines by developing and delivering supportive tools based on the EMR to providers treating patients with AF. Methods and Results We emailed cardiologists and community-based primary care providers affiliated with our institution reports of their AC percentage relative to peers. We also sent an electronic medical record-based message to these providers the day before an appointment with an atrial fibrillation patient who was eligible but not receiving AC . The electronic medical record message asked the provider to discuss AC with the patient if he or she deemed it appropriate. To assess feasibility, we tracked provider review of our correspondence. We also tracked the change in AC for intervention providers relative to alternate primary care providers not receiving our intervention. We identified 3786, 1054, and 566 patients cared for by 49 cardiology providers, 90 community-based primary care providers, and 88 control providers, respectively. At baseline, the percentage of AC was 71.3%, 63.5%, and 58.3% for these 3 respective groups. Intervention providers reviewed our e-mails and electronic medical record messages 45% and 96% of the time, respectively. For providers responding, patient refusal was the most common reason for patients not being on AC (21%) followed by high bleeding risk (19%). At follow-up 10 weeks later, change in AC was no different for either cardiology or community-based primary care providers relative to controls (0.2% lower and 0.01% higher, respectively). Conclusions Our intervention profiling AC was feasible, but not sufficient to increase AC in our population.

Evaluating the implementation of a quality improvement process in General Practice using a realist evaluation framework

RATIONALE, AIMS, AND OBJECTIVES

Underuse of anticoagulants in atrial fibrillation is known to increase the risk of stroke and is an international problem. The National Institute for Health Care and Excellence guidance CG180 seeks to reduce atrial fibrillation related strokes through prescriptions of Non-vitamin K antagonist Oral Anticoagulants. A quality improvement programme was established by the West of England Academic Health Science Network (West of England AHSN) to implement this guidance into General Practice. A realist evaluation identified whether the quality improvement programme worked, determining how and in what circumstances.

METHODS

Six General Practices in 1 region, became the case study sites. Quality improvement team, doctor, and pharmacist meetings within each of the General Practices were recorded at 3 stages: initial planning, review, and final. Additionally, 15 interviews conducted with the practice leads explored experiences of the quality improvement process. Observation and interview data were analysed and compared against the initial programme theory.

RESULTS

The quality improvement resources available were used variably, with the training being valued by all. The initial programme theories were refined. In particular, local workload pressures and individual General Practitioner experiences and pre-conceived ideas were acknowledged. Where key motivators were in place, such as prior experience, the programme achieved optimal outcomes and secured a lasting quality improvement legacy.

CONCLUSION

The employment of a quality improvement programme can deliver practice change and improvement legacy outcomes when particular mechanisms are employed and in contexts where there is a commitment to improve service.

Image digitization of discontinuous and degraded electrocardiogram paper records using an entropy-based bit plane slicing algorithm

BACKGROUND

Electrocardiograms (ECGs) are routinely recorded and stored in a variety of paper or scanned image format. Current ECG recording machines record ECG on graph paper, also it provides digitized ECG signal along with automated cardiovascular diagnosis (CVD). However, such recording machines cannot analyse preserved paper ECG records as it requires input in terms of digitized signal. Therefore, it is important to extract ECG signal from these preserved paper ECG records using digitization method. There are different paper degradations that adversely affect digitization process. The purpose of this work is to perform an image enhancement and digitization of the degraded ECG images to extract continuous ECG signal.

METHODS

In this paper, we propose entropy-based bit plane slicing (EBPS) algorithm in which pre-processing is done using dominant color detection and local bit plane slicing. Maximum entropy based adaptive bit plane selection is applied to the pre-processed image. Discontinuous ECG correction (DECGC) is then done to produce continuous ECG signal.

RESULTS

The algorithm is tested on 836 different degraded paper ECG records obtained from various diagnostic centers. After analysis with 101 known ground truth ECG signals the accuracy, sensitivity, specificity and overall F-measure of ECG is 99.42%, 99.69%, 99.81% and 99.26% respectively. The RMS error and correlation between the extracted digitized signal and ground truth for 101 cases is 0.040 and 99.89% respectively.

CONCLUSIONS

The EBPS method is able to remove all types of degradation in paper ECG records to generate a uniform digitized signal. Instead of manual measurement and prediction from archived paper ECG records, automated prediction (using already existing cardiovascular diagnosis software) is possible with the help of extracted digitized signal obtained using proposed digitization method, which will also help retrospective cardiovascular analysis.

A clinical decision support tool for improving adherence to guidelines on anticoagulant therapy in patients with atrial fibrillation at risk of stroke: A cluster-randomized trial in a Swedish primary care setting (the CDS-AF study)

BACKGROUND

Atrial fibrillation (AF) is associated with substantial morbidity, in particular stroke. Despite good evidence for the reduction of stroke risk with anticoagulant therapy, there remains significant undertreatment. The main aim of the current study was to investigate whether a clinical decision support tool (CDS) for stroke prevention integrated in the electronic health record could improve adherence to guidelines for stroke prevention in patients with AF.

METHODS AND FINDINGS

We conducted a cluster-randomized trial where all 43 primary care clinics in the county of Östergötland, Sweden (population 444,347), were randomized to be part of the CDS intervention or to serve as controls. The CDS produced an alert for physicians responsible for patients with AF and at increased risk for thromboembolism (according to the CHA2DS2-VASc algorithm) without anticoagulant therapy. The primary endpoint was adherence to guidelines after 1 year. After randomization, there were 22 and 21 primary care clinics in the CDS and control groups, respectively. There were no significant differences in baseline adherence to guidelines regarding anticoagulant therapy between the 2 groups (CDS group 70.3% [5,186/7,370; 95% CI 62.9%-77.7%], control group 70.0% [4,187/6,009; 95% CI 60.4%-79.6%], p = 0.83). After 12 months, analysis with linear regression with adjustment for primary care clinic size and adherence to guidelines at baseline revealed a significant increase in guideline adherence in the CDS (73.0%, 95% CI 64.6%-81.4%) versus the control group (71.2%, 95% CI 60.8%-81.6%, p = 0.013, with a treatment effect estimate of 0.016 [95% CI 0.003-0.028]; number of patients with AF included in the final analysis 8,292 and 6,508 in the CDS and control group, respectively). Over the study period, there was no difference in the incidence of stroke, transient ischemic attack, or systemic thromboembolism in the CDS group versus the control group (49 [95% CI 43-55] per 1,000 patients with AF in the CDS group compared to 47 [95% CI 39-55] per 1,000 patients with AF in the control group, p = 0.64). Regarding safety, the CDS group had a lower incidence of significant bleeding, with events in 12 (95% CI 9-15) per 1,000 patients with AF compared to 16 (95% CI 12-20) per 1,000 patients with AF in the control group (p = 0.04). Limitations of the study design include that the analysis was carried out in a catchment area with a high baseline adherence rate, and issues regarding reproducibility to other regions.

CONCLUSIONS

The present study demonstrates that a CDS can increase guideline adherence for anticoagulant therapy in patients with AF. Even though the observed difference was small, this is the first randomized study to our knowledge indicating beneficial effects with a CDS in patients with AF.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02635685.

Challenges for learning health systems in the NHS. Case study: electronic health records in cardiology

Electronic health records (EHRs) are at the centre of advances in health informatics, but also many other innovations in healthcare. However, there are still obstacles to implementation and realisation of the full potential of EHRs as there are with learning health systems (LHS). Cardiovascular disease, in the UK and globally, carries greater morbidity and mortality than any other disease. Therefore, planning and delivery of health services represent major costs to individuals and populations. Both the scale of disease burden and the growing role of technology in cardiology practice make analysis of experiences with EHRs in cardiology a useful lens through which to view achievements and gaps to date. In this article regarding LHS, EHRs in cardiology are used as a case study of LHS in the NHS.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

BACKGROUND

The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

OBJECTIVES

To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

SEARCH STRATEGY

We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

SELECTION CRITERIA

Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

MAIN RESULTS

Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

AUTHORS' CONCLUSIONS

Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.