A computerized intervention to decrease the use of calcium channel blockers in hypertension

Nudge strategies to improve healthcare providers' implementation of evidence-based guidelines, policies and practices: a systematic review of trials included within Cochrane systematic reviews

BACKGROUND

Nudge interventions are those that seek to modify the social and physical environment to enhance capacity for subconscious behaviours that align with the intrinsic values of an individual, without actively restricting options. This study sought to describe the application and effects of nudge strategies on clinician implementation of health-related guidelines, policies and practices within studies included in relevant Cochrane systematic reviews.

METHODS

As there is varied terminology used to describe nudge, this study examined studies within relevant systematic reviews. A two-stage screening process was undertaken where, firstly, all systematic reviews published in the Cochrane Library between 2016 and 2018 were screened to identify reviews that included quantitative studies to improve implementation of guidelines among healthcare providers. Secondly, individual studies within relevant systematic reviews were included if they were (i) randomised controlled trials (RCTs), (ii) included a nudge strategy in at least one intervention arm, and (iii) explicitly aimed to improve clinician implementation behaviour. We categorised nudge strategies into priming, salience and affect, default, incentives, commitment and ego, and norms and messenger based on the Mindspace framework.

SYNTHESIS

The number and percentage of trials using each nudge strategy was calculated. Due to substantial heterogeneity, we did not undertake a meta-analysis. Instead, we calculated within-study point estimates and 95% confidence intervals, and used a vote-counting approach to explore effects.

RESULTS

Seven reviews including 42 trials reporting on 57 outcomes were included. The most common nudge strategy was priming (69%), then norms and messenger (40%). Of the 57 outcomes, 86% had an effect on clinician behaviour in the hypothesised direction, and 53% of those were statistically significant. For continuous outcomes, the median effect size was 0.39 (0.22, 0.45), while for dichotomous outcomes the median Odds Ratio was 1.62 (1.13, 2.76).

CONCLUSIONS

This review of 42 RCTs included in Cochrane systematic reviews found that the impact of nudge strategies on clinician behaviour was at least comparable to other interventions targeting implementation of evidence-based guidelines. While uncertainty remains, the review provides justification for ongoing investigation of the evaluation and application of nudge interventions to support provider behaviour change.

TRIAL REGISTRATION

This review was not prospectively registered.

Emergency department 72-hour revisits among children with chronic diseases: a Saudi Arabian study

BACKGROUND

Emergency Department (ED) revisits have often been used as an indicator of medical care quality. This study aimed to quantify the frequency of ED revisits within 72 h of discharge and identify its factors among children with chronic diseases.

METHODS

We designed a retrospective cohort study of children with at least one chronic disease who were also under 18 years of age and had attended and were discharged from the ED at King Abdullah Specialist Children's Hospital (KASCH-RD), Riyadh, Saudi Arabia between April 19, 2015 and July 29, 2017. The outcome measure was the frequency of ED revisits during a period of 72 h after discharge.

RESULTS

The study included 11,057 ED discharges of children with at least one chronic disease. Their revisit rate was 1211 (11%), with 83 (6.9%) having had a second ED revisit within 72 h of ED discharge. According to ICD-10 codes, the most common causes of ED revisits were respiratory, digestive, genitourinary, symptoms, and external causes. Factors of frequent ED revisits within 72 h were young age, institutional health insurance coverage, year of new health information system (2015), external causes, and genitourinary.

CONCLUSION

The rate of 72-h ED revisits after discharge of children with chronic diseases treated at KASCH-RD was relatively high, and was associated with young age, institutional health insurance coverage, year of a new health information system implementation, and external causes of ED visit. These study findings amplify the need for intervention to reduce the rate of early ED revisits among children with chronic diseases.

Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and healthcare outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting them to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time. This is an update of a previously published review.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system (computer-generated) and delivered on paper to healthcare professionals on quality of care (outcomes related to healthcare professionals' practice) and patient outcomes (outcomes related to patients' health condition).

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, six other databases and two trials registers up to 21 September 2016 together with reference checking, citation searching and contact with study authors to identify additional studies.

SELECTION CRITERIA

We included individual- or cluster-randomized and non-randomized trials that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals, alone (single-component intervention) or in addition to one or more co-interventions (multi-component intervention), compared with usual care or the co-intervention(s) without the reminder component.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median improvement and interquartile range (IQR) across included studies using the primary outcome or median outcome as representative outcome. We assessed the certainty of the evidence according to the GRADE approach.

MAIN RESULTS

We identified 35 studies (30 randomized trials and five non-randomized trials) and analyzed 34 studies (40 comparisons). Twenty-nine studies took place in the USA and six studies took place in Canada, France, Israel, and Kenya. All studies except two took place in outpatient care. Reminders were aimed at enhancing compliance with preventive guidelines (e.g. cancer screening tests, vaccination) in half the studies and at enhancing compliance with disease management guidelines for acute or chronic conditions (e.g. annual follow-ups, laboratory tests, medication adjustment, counseling) in the other half.Computer-generated reminders delivered on paper to healthcare professionals, alone or in addition to co-intervention(s), probably improves quality of care slightly compared with usual care or the co-intervention(s) without the reminder component (median improvement 6.8% (IQR: 3.8% to 17.5%); 34 studies (40 comparisons); moderate-certainty evidence).Computer-generated reminders delivered on paper to healthcare professionals alone (single-component intervention) probably improves quality of care compared with usual care (median improvement 11.0% (IQR 5.4% to 20.0%); 27 studies (27 comparisons); moderate-certainty evidence). Adding computer-generated reminders delivered on paper to healthcare professionals to one or more co-interventions (multi-component intervention) probably improves quality of care slightly compared with the co-intervention(s) without the reminder component (median improvement 4.0% (IQR 3.0% to 6.0%); 11 studies (13 comparisons); moderate-certainty evidence).We are uncertain whether reminders, alone or in addition to co-intervention(s), improve patient outcomes as the certainty of the evidence is very low (n = 6 studies (seven comparisons)). None of the included studies reported outcomes related to harms or adverse effects of the intervention.

AUTHORS' CONCLUSIONS

There is moderate-certainty evidence that computer-generated reminders delivered on paper to healthcare professionals probably slightly improves quality of care, in terms of compliance with preventive guidelines and compliance with disease management guidelines. It is uncertain whether reminders improve patient outcomes because the certainty of the evidence is very low. The heterogeneity of the reminder interventions included in this review also suggests that reminders can probably improve quality of care in various settings under various conditions.

A Collaborative Initiative to Improve the Care of Elderly Medicare Patients With Hypertension

Qualidigm, the Connecticut Quality Improvement Organization (QIO), collaborated with 17 primary care physicians (PCPs) in private practice to improve the care of elderly patients with hypertension. Patients were identified from Medicare billing data and care was assessed from medical records. Improvement interventions included feedback of baseline performance data and provision of a variety of practice enhancing materials. Care was assessed for 590 patients in 1997 (16-47 patients/PCP) and 547 patients in 1999 (7-51 patients/PCP). Patient characteristics were similar in both periods. Use of recommended therapies and blood pressure control, ie, percent < 140/90 mm Hg, was low and did not improve significantly between the 2 periods (aggregate 39% in 1997 versus 42% in 1999; P = .24). Care of elderly patients with hypertension was not improved with a multifaceted QIO intervention. Additional study is required to determine incentives, barriers, and facilitating factors for quality improvement in the private practice primary care setting.

Internet-based interventions for the secondary prevention of coronary heart disease

BACKGROUND

The Internet could provide a means of delivering secondary prevention programmes to people with coronary heart disease (CHD).

OBJECTIVES

To determine the effectiveness of Internet-based interventions targeting lifestyle changes and medicines management for the secondary prevention of CHD.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, in December 2014. We also searched six other databases in October 2014, and three trials registers in January 2015 together with reference checking and handsearching to identify additional studies.

SELECTION CRITERIA

Randomised controlled trials (RCTs) evaluating Internet-delivered secondary prevention interventions aimed at people with CHD.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed risk of bias and extracted data according to the Cochrane Handbook for Systematic Reviews of Interventions. We assessed evidence quality using the GRADE approach and presented this in a 'Summary of findings' table.

MAIN RESULTS

Eighteen trials met our inclusion criteria. Eleven studies are complete (1392 participants), and seven are ongoing. Of the completed studies, seven interventions are broad, targeting the lifestyle management of CHD, and four focused on physical activity promotion. The comparison group in trials was usual care (n = 6), minimal intervention (n = 3), or traditional cardiac rehabilitation (n = 2).We found no effects of Internet-based interventions for all-cause mortality (odds ratio (OR) 0.27, 95% confidence interval (CI) 0.04 to 1.63; participants = 895; studies = 6; low-quality evidence). There was only one case of cardiovascular mortality in a control group (participants = 895; studies = 6). No incidences of non-fatal re-infarction were reported across any of the studies. We found no effects for revascularisation (OR 0.69, 95% CI 0.37 to 1.27; participants = 895; studies = 6; low-quality evidence).We found no effects for total cholesterol (mean difference (MD) 0.00, 95% CI -0.27 to 0.28; participants = 439; studies = 4; low-quality evidence), high-density lipoprotein (HDL) cholesterol (MD 0.01, 95% CI -0.06 to 0.07; participants = 437; studies = 4; low-quality evidence), or triglycerides (MD 0.01, 95% CI -0.17 to 0.19; participants = 439; studies = 4; low-quality evidence). We did not pool the data for low-density lipoprotein (LDL) cholesterol due to considerable heterogeneity. Two out of six trials measuring LDL cholesterol detected favourable intervention effects, and four trials reported no effects. Seven studies measured systolic and diastolic blood pressure; we did not pool the data due to substantial heterogeneity. For systolic blood pressure, two studies showed a reduction with the intervention, but the remaining studies showed no effect. For diastolic blood pressure, two studies showed a reduction with the intervention, one study showed an increase with the intervention, and the remaining four studies showed no effect.Five trials measured health-related quality of life (HRQOL). We could draw no conclusions from one study due to incomplete reporting; one trial reported no effect; two studies reported a short- and medium-term effect respectively; and one study reported both short- and medium-term effects.Five trials assessed dietary outcomes: two reported favourable effects, and three reported no effects. Eight studies assessed physical activity: five of these trials reported no physical activity effects, and three reported effectiveness. Trials are yet to measure the impact of these interventions on compliance with medication.Two studies measured healthcare utilisation: one reported no effects, and the other reported increased usage of healthcare services compared to a control group in the intervention group at nine months' follow-up. Two trials collected cost data: both reported that Internet-delivered interventions are likely to be cost-effective.In terms of the risk of bias, the majority of studies reported appropriate randomisation and appropriate concealment of randomisation processes. A lack of blinding resulted in a risk of performance bias in seven studies, and a risk of detection bias in five trials. Two trials were at risk of attrition bias, and five were at risk for reporting bias.

AUTHORS' CONCLUSIONS

In general, evidence was of low quality due to lack of blinding, loss to follow-up, and uncertainty around the effect size. Few studies measured clinical events, and of those that did, a very small number of events were reported, and therefore no firm conclusions can be made. Similarly, there was no clear evidence of effect for cardiovascular risk factors, although again the number of studies reporting these was small. There was some evidence for beneficial effects on HRQOL, dietary outcomes, and physical activity, although firm conclusions cannot yet be made. The effects on healthcare utilisation and cost-effectiveness are also inconclusive, and trials are yet to measure the impact of Internet interventions on compliance with medication. The comparison groups differed across trials, and there were insufficient studies with usable data for subgroup analyses. We intend to study the intensity of comparison groups in future updates of this review when more evidence is available. The completion of the ongoing trials will add to the evidence base.

Clinical Decision Support Systems and Prevention: A Community Guide Cardiovascular Disease Systematic Review

CONTEXT

Clinical decision support systems (CDSSs) can help clinicians assess cardiovascular disease (CVD) risk and manage CVD risk factors by providing tailored assessments and treatment recommendations based on individual patient data. The goal of this systematic review was to examine the effectiveness of CDSSs in improving screening for CVD risk factors, practices for CVD-related preventive care services such as clinical tests and prescribed treatments, and management of CVD risk factors.

EVIDENCE ACQUISITION

An existing systematic review (search period, January 1975-January 2011) of CDSSs for any condition was initially identified. Studies of CDSSs that focused on CVD prevention in that review were combined with studies identified through an updated search (January 2011-October 2012). Data analysis was conducted in 2013.

EVIDENCE SYNTHESIS

A total of 45 studies qualified for inclusion in the review. Improvements were seen for recommended screening and other preventive care services completed by clinicians, recommended clinical tests completed by clinicians, and recommended treatments prescribed by clinicians (median increases of 3.8, 4.0, and 2.0 percentage points, respectively). Results were inconsistent for changes in CVD risk factors such as systolic and diastolic blood pressure, total and low-density lipoprotein cholesterol, and hemoglobin A1C levels.

CONCLUSIONS

CDSSs are effective in improving clinician practices related to screening and other preventive care services, clinical tests, and treatments. However, more evidence is needed from implementation of CDSSs within the broad context of comprehensive service delivery aimed at reducing CVD risk and CVD-related morbidity and mortality.

Interventions to improve adherence to cardiovascular disease guidelines: a systematic review

BACKGROUND

Successful management of cardiovascular disease (CVD) is impaired by poor adherence to clinical practice guidelines. The objective of our review was to synthesize evidence about the effectiveness of interventions that target healthcare providers to improve adherence to CVD guidelines and patient outcomes.

METHODS

We searched PubMed, EMBASE, Cochrane Library, PsycINFO, Web of Science and CINAHL databases from inception to June 2014, using search terms related to adherence and clinical practice guidelines. Studies were limited to randomized controlled trials testing an intervention to improve adherence to guidelines that measured both a patient and adherence outcome. Descriptive summary tables were created from data extractions. Meta-analyses were conducted on clinically homogeneous comparisons, and sensitivity analyses and subgroup analyses were carried out where possible. GRADE summary of findings tables were created for each comparison and outcome.

RESULTS AND DISCUSSION

We included 38 RCTs in our review. Interventions included guideline dissemination, education, audit and feedback, and academic detailing. Meta-analyses were conducted for several outcomes by intervention type. Many comparisons favoured the intervention, though only the adherence outcome for the education intervention showed statistically significant improvement compared to usual care (standardized mean difference = 0.58 [95 % confidence interval 0.35 to 0.8]).

CONCLUSIONS

Many interventions show promise to improve practitioner adherence to CVD guidelines. The quality of evidence and number of trials limited our ability to draw conclusions.

Making pharmacogenomic-based prescribing alerts more effective: A scenario-based pilot study with physicians

To facilitate personalized drug dosing (PDD), this pilot study explored the communication effectiveness and clinical impact of using a prototype clinical decision support (CDS) system embedded in an electronic health record (EHR) to deliver pharmacogenomic (PGx) information to physicians. We employed a conceptual framework and measurement model to access the impact of physician characteristics (previous experience, awareness, relative advantage, perceived usefulness), technology characteristics (methods of implementation-semi-active/active, actionability-low/high) and a task characteristic (drug prescribed) on communication effectiveness (usefulness, confidence in prescribing decision), and clinical impact (uptake, prescribing intent, change in drug dosing). Physicians performed prescribing tasks using five simulated clinical case scenarios, presented in random order within the prototype PGx-CDS system. Twenty-two physicians completed the study. The proportion of physicians that saw a relative advantage to using PGx-CDS was 83% at the start and 94% at the conclusion of our study. Physicians used semi-active alerts 74-88% of the time. There was no association between previous experience with, awareness of, and belief in a relative advantage of using PGx-CDS and improved uptake. The proportion of physicians reporting confidence in their prescribing decisions decreased significantly after using the prototype PGx-CDS system (p=0.02). Despite decreases in confidence, physicians perceived a relative advantage to using PGx-CDS, viewed semi-active alerts on most occasions, and more frequently changed doses toward doses supported by published evidence. Specifically, sixty-five percent of physicians reduced their dosing, significantly for capecitabine (p=0.002) and mercaptopurine/thioguanine (p=0.03). These findings suggest a need to improve our prototype such that PGx CDS content is more useful and delivered in a way that improves physician's confidence in their prescribing decisions. The greatest increases in communication effectiveness and clinical impact of PGx-CDS are likely to be realized through continued focus on content, content delivery, and tailoring to physician characteristics.

Meta-regression analyses to explain statistical heterogeneity in a systematic review of strategies for guideline implementation in primary health care

This study is an in-depth-analysis to explain statistical heterogeneity in a systematic review of implementation strategies to improve guideline adherence of primary care physicians in the treatment of patients with cardiovascular diseases. The systematic review included randomized controlled trials from a systematic search in MEDLINE, EMBASE, CENTRAL, conference proceedings and registers of ongoing studies. Implementation strategies were shown to be effective with substantial heterogeneity of treatment effects across all investigated strategies. Primary aim of this study was to explain different effects of eligible trials and to identify methodological and clinical effect modifiers. Random effects meta-regression models were used to simultaneously assess the influence of multimodal implementation strategies and effect modifiers on physician adherence. Effect modifiers included the staff responsible for implementation, level of prevention and definition pf the primary outcome, unit of randomization, duration of follow-up and risk of bias. Six clinical and methodological factors were investigated as potential effect modifiers of the efficacy of different implementation strategies on guideline adherence in primary care practices on the basis of information from 75 eligible trials. Five effect modifiers were able to explain a substantial amount of statistical heterogeneity. Physician adherence was improved by 62% (95% confidence interval (95% CI) 29 to 104%) or 29% (95% CI 5 to 60%) in trials where other non-medical professionals or nurses were included in the implementation process. Improvement of physician adherence was more successful in primary and secondary prevention of cardiovascular diseases by around 30% (30%; 95% CI -2 to 71% and 31%; 95% CI 9 to 57%, respectively) compared to tertiary prevention. This study aimed to identify effect modifiers of implementation strategies on physician adherence. Especially the cooperation of different health professionals in primary care practices might increase efficacy and guideline implementation seems to be more difficult in tertiary prevention of cardiovascular diseases.

Strategies for guideline implementation in primary care focusing on patients with cardiovascular disease: a systematic review

BACKGROUND

Guidelines should reduce inappropriate practice and improve the efficiency of treatment. Not only methodological quality but also acceptance and successful implementation in daily practice are crucial for the benefit on patients. Focusing on cardiovascular diseases (CVD), it is still unclear which implementation strategy can improve physician adherence to the recommendations of guidelines in primary care.

METHODS

We conducted a systematic review on randomized controlled trials about guideline implementation strategies on CVD. Medline, Embase, CENTRAL, conference proceedings and registers of ongoing studies were searched.

RESULTS

Eighty-four trials met our predefined inclusion criteria, of them 54 trials compared unimodal strategies and 30 multimodal strategies to usual care. Concerning unimodal strategies, 15 trials investigated provider reminder systems, 3 audit and feedback, 15 provider education, 4 patient education, 5 promotion of self-management and 14 organizational change. The strongest benefit of a unimodal implementation strategy was found due to organizational change (odds ratio 1.96; 95% CI 1.4 to 2.75), followed by patient education, provider education and provider reminder systems. Trials on the efficacy of audit and feedback and patient self-management showed differing results or small advantages in terms of physician adherence. Multimodal interventions showed almost similar effect measures and ranking of strategies.

CONCLUSION

The use of implementation strategies for the distribution of guidelines on CVD can be convincingly effective on physician adherence, regardless whether based on a unimodal or multimodal design. Three distinct strategies should be well considered in such an attempt: organizational changes in the primary care team, patient education and provider education.

A Conceptual Framework for Understanding and Reducing Overuse by Primary Care Providers

Primary care providers frequently recommend, administer, or prescribe health care services that are unlikely to benefit their patients. Yet little is known about how to reduce provider overuse behavior. In the absence of a theoretically grounded causal framework, it is difficult to predict the contexts under which different types of interventions to reduce provider overuse will succeed and under which they will fail. In this article, we present a framework based on the theory of planned behavior that is designed to guide overuse research and intervention development. We describe categories of primary care provider beliefs that lead to the formation of intentions to assess the appropriateness of services, and propose factors that may affect whether the presence of assessment intentions results in an appropriate recommendation. Interventions that have been commonly used to address provider overuse behavior are reviewed within the context of the framework.

Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting the doctor to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system and delivered on paper to healthcare professionals on processes of care (related to healthcare professionals' practice) and outcomes of care (related to patients' health condition).

SEARCH METHODS

For this update the EPOC Trials Search Co-ordinator searched the following databases between June 11-19, 2012: The Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Library (Economics, Methods, and Health Technology Assessment sections), Issue 6, 2012; MEDLINE, OVID (1946- ), Daily Update, and In-process; EMBASE, Ovid (1947- ); CINAHL, EbscoHost (1980- ); EPOC Specialised Register, Reference Manager, and INSPEC, Engineering Village. The authors reviewed reference lists of related reviews and studies. 

SELECTION CRITERIA

We included individual or cluster-randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs) that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals on processes and/or outcomes of care.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. We contacted authors to obtain important missing information for studies that were published within the last 10 years. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median absolute improvement and interquartile range (IQR) in process adherence across included studies using the primary outcome or median outcome as representative outcome.

MAIN RESULTS

In the 32 included studies, computer-generated reminders delivered on paper to healthcare professionals achieved moderate improvement in professional practices, with a median improvement of processes of care of 7.0% (IQR: 3.9% to 16.4%). Implementing reminders alone improved care by 11.2% (IQR 6.5% to 19.6%) compared with usual care, while implementing reminders in addition to another intervention improved care by 4.0% only (IQR 3.0% to 6.0%) compared with the other intervention. The quality of evidence for these comparisons was rated as moderate according to the GRADE approach. Two reminder features were associated with larger effect sizes: providing space on the reminder for provider to enter a response (median 13.7% versus 4.3% for no response, P value = 0.01) and providing an explanation of the content or advice on the reminder (median 12.0% versus 4.2% for no explanation, P value = 0.02). Median improvement in processes of care also differed according to the behaviour the reminder targeted: for instance, reminders to vaccinate improved processes of care by 13.1% (IQR 12.2% to 20.7%) compared with other targeted behaviours. In the only study that had sufficient power to detect a clinically significant effect on outcomes of care, reminders were not associated with significant improvements.

AUTHORS' CONCLUSIONS

There is moderate quality evidence that computer-generated reminders delivered on paper to healthcare professionals achieve moderate improvement in process of care. Two characteristics emerged as significant predictors of improvement: providing space on the reminder for a response from the clinician and providing an explanation of the reminder's content or advice. The heterogeneity of the reminder interventions included in this review also suggests that reminders can improve care in various settings under various conditions.

Changing clinical practice through patient specific reminders available at the time of the clinical encounter: systematic review and meta-analysis

OBJECTIVE

To synthesise current evidence for the influence on clinical behaviour of patient-specific electronically generated reminders available at the time of the clinical encounter.

DATA SOURCES

PubMed, Cochrane library of systematic reviews; Science Citation Index Expanded; Social Sciences Citation Index; ASSIA; EMBASE; CINAHL; DARE; HMIC were searched for relevant articles.

STUDY ELIGIBILITY CRITERIA, PARTICIPANTS AND INTERVENTIONS

We included controlled trials of reminder interventions if the intervention was: directed at clinician behaviour; available during the clinical encounter; computer generated (including computer generated paper-based reminders); and generated by patient-specific (rather than condition specific or drug specific) data.

STUDY APPRAISAL AND SYNTHESIS METHODS

Systematic review and meta-analysis of controlled trials published since 1970. A random effects model was used to derive a pooled odds ratio for adherence to recommended care or achievement of target outcome. Subgroups were examined based on area of care and study design. Odds ratios were derived for each sub-group. We examined the designs, settings and other features of reminders looking for factors associated with a consistent effect.

RESULTS

Altogether, 42 papers met the inclusion criteria. The studies were of variable quality and some were affected by unit of analysis errors due to a failure to account for clustering. An overall odds ratio of 1.79 [95% confidence interval 1.56, 2.05] in favour of reminders was derived. Heterogeneity was high and factors predicting effect size were difficult to identify.

LIMITATIONS

Methodological diversity added to statistical heterogeneity as an obstacle to meta-analysis. The quality of included studies was variable and in some reports procedural details were lacking.

CONCLUSIONS AND IMPLICATIONS OF KEY FINDINGS

The analysis suggests a moderate effect of electronically generated, individually tailored reminders on clinician behaviour during the clinical encounter. Future research should concentrate on identifying the features of reminder interventions most likely to result in the target behaviour.

Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review

Background

The use of computerized clinical decision support systems (CCDSSs) may improve chronic disease management, which requires recurrent visits to multiple health professionals, ongoing disease and treatment monitoring, and patient behavior modification. The objective of this review was to determine if CCDSSs improve the processes of chronic care (such as diagnosis, treatment, and monitoring of disease) and associated patient outcomes (such as effects on biomarkers and clinical exacerbations).

Methods

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for potentially eligible articles published up to January 2010. We included randomized controlled trials that compared the use of CCDSSs to usual practice or non-CCDSS controls. Trials were eligible if at least one component of the CCDSS was designed to support chronic disease management. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of relevant outcomes.

Results

Of 55 included trials, 87% (n = 48) measured system impact on the process of care and 52% (n = 25) of those demonstrated statistically significant improvements. Sixty-five percent (36/55) of trials measured impact on, typically, non-major (surrogate) patient outcomes, and 31% (n = 11) of those demonstrated benefits. Factors of interest to decision makers, such as cost, user satisfaction, system interface and feature sets, unique design and deployment characteristics, and effects on user workflow were rarely investigated or reported.

Conclusions

A small majority (just over half) of CCDSSs improved care processes in chronic disease management and some improved patient health. Policy makers, healthcare administrators, and practitioners should be aware that the evidence of CCDSS effectiveness is limited, especially with respect to the small number and size of studies measuring patient outcomes.

Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review

Background

Computerized clinical decision support systems (CCDSSs) for drug therapy management are designed to promote safe and effective medication use. Evidence documenting the effectiveness of CCDSSs for improving drug therapy is necessary for informed adoption decisions. The objective of this review was to systematically review randomized controlled trials assessing the effects of CCDSSs for drug therapy management on process of care and patient outcomes. We also sought to identify system and study characteristics that predicted benefit.

Methods

We conducted a decision-maker-researcher partnership systematic review. We updated our earlier reviews (1998, 2005) by searching MEDLINE, EMBASE, EBM Reviews, Inspec, and other databases, and consulting reference lists through January 2010. Authors of 82% of included studies confirmed or supplemented extracted data. We included only randomized controlled trials that evaluated the effect on process of care or patient outcomes of a CCDSS for drug therapy management compared to care provided without a CCDSS. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive.

Results

Sixty-five studies met our inclusion criteria, including 41 new studies since our previous review. Methodological quality was generally high and unchanged with time. CCDSSs improved process of care performance in 37 of the 59 studies assessing this type of outcome (64%, 57% of all studies). Twenty-nine trials assessed patient outcomes, of which six trials (21%, 9% of all trials) reported improvements.

Conclusions

CCDSSs inconsistently improved process of care measures and seldomly improved patient outcomes. Lack of clear patient benefit and lack of data on harms and costs preclude a recommendation to adopt CCDSSs for drug therapy management.

Benefits and drawbacks of electronic health record systems

The Health Information Technology for Economic and Clinical Health (HITECH) Act of 2009 that was signed into law as part of the "stimulus package" represents the largest US initiative to date that is designed to encourage widespread use of electronic health records (EHRs). In light of the changes anticipated from this policy initiative, the purpose of this paper is to review and summarize the literature on the benefits and drawbacks of EHR systems. Much of the literature has focused on key EHR functionalities, including clinical decision support systems, computerized order entry systems, and health information exchange. Our paper describes the potential benefits of EHRs that include clinical outcomes (eg, improved quality, reduced medical errors), organizational outcomes (eg, financial and operational benefits), and societal outcomes (eg, improved ability to conduct research, improved population health, reduced costs). Despite these benefits, studies in the literature highlight drawbacks associated with EHRs, which include the high upfront acquisition costs, ongoing maintenance costs, and disruptions to workflows that contribute to temporary losses in productivity that are the result of learning a new system. Moreover, EHRs are associated with potential perceived privacy concerns among patients, which are further addressed legislatively in the HITECH Act. Overall, experts and policymakers believe that significant benefits to patients and society can be realized when EHRs are widely adopted and used in a "meaningful" way.

Impact of EHR-based clinical decision support on adherence to guidelines for patients on NSAIDs: a randomized controlled trial

PURPOSE

Electronic health records (EHRs) with clinical decision support hold promise for improving quality of care, but their impact on management of chronic conditions has been mixed. This study examined the impact of EHR-based clinical decision support on adherence to guidelines for reducing gastrointestinal complications in primary care patients on nonsteroidal anti-inflammatory drugs (NSAIDs).

METHODS

This randomized controlled trial was conducted in a national network of primary care offices using an EHR and focused on patients taking traditional NSAIDs who had factors associated with a high risk for gastrointestinal complications (a history of peptic ulcer disease; concomitant use of anticoagulants, anti-platelet medications [including aspirin], or corticosteroids; or an age of 75 years or older). The offices were randomized to receive EHR-based guidelines and alerts for high-risk patients on NSAIDs, or usual care. The primary outcome was the proportion of patients who received guideline-concordant care during the 1-year study period (June 2007-June 2008), defined as having their traditional NSAID discontinued (including a switch to a lower-risk medication), having a gastroprotective medication coprescribed, or both.

RESULTS

Participants included 27 offices with 119 clinicians and 5,234 high-risk patients. Intervention patients were more likely than usual care patients to receive guideline-concordant care (25.4% vs 22.4%, adjusted odds ratio = 1.19; 95% confidence interval, 1.01-1.42). For individual high-risk groups, patients on low-dose aspirin were more likely to receive guideline-concordant care with the intervention vs usual care (25.0% vs 20.8%, adjusted odds ratio = 1.30; 95% confidence interval, 1.04-1.62), but there was no significant difference for patients in other high-risk groups.

CONCLUSIONS

This study showed only a small impact of EHR-based clinical decision support for high-risk patients on NSAIDs in primary care offices. These results add to the growing literature about the complexity of EHR-based clinical decision support for improving quality of care.

The effectiveness of computerized clinical guidelines in the process of care: a systematic review

BACKGROUND

Clinical practice guidelines have been developed aiming to improve the quality of care. The implementation of the computerized clinical guidelines (CCG) has been supported by the development of computerized clinical decision support systems.This systematic review assesses the impact of CCG on the process of care compared with non-computerized clinical guidelines.

METHODS

Specific features of CCG were studied through an extensive search of scientific literature, querying electronic databases: Pubmed/Medline, Embase and Cochrane Controlled Trials Register. A multivariable logistic regression was carried out to evaluate the association of CCG's features with positive effect on the process of care.

RESULTS

Forty-five articles were selected. The logistic model showed that Automatic provision of recommendation in electronic version as part of clinician workflow (Odds Ratio [OR]= 17.5; 95% confidence interval [CI]: 1.6-193.7) and Publication Year (OR = 6.7; 95%CI: 1.3-34.3) were statistically significant predictors.

CONCLUSIONS

From the research that has been carried out, we can conclude that after implementation of CCG significant improvements in process of care are shown. Our findings also suggest clinicians, managers and other health care decision makers which features of CCG might improve the structure of computerized system.

Hypertension guideline adherence among nursing home patients

BACKGROUND

Adherence to hypertension guidelines in the outpatient setting is low.

OBJECTIVE

To evaluate adherence to JNC VII guidelines in nursing home patients.

DESIGN

Data were obtained from the 2004 National Nursing Home Survey (NNHS), a nationally representative sample of US nursing homes. Patients with hypertension were identified using ICD-9 codes. Adherence to JNC VII guidelines was defined as the use of a thiazide diuretic in patients without a compelling indication for a different class of antihypertensive medication, such as diabetes, chronic kidney disease, coronary artery disease, congestive heart failure, or a history of stroke.

PARTICIPANTS

There were 13,507 patients in the 2004 NNHS survey, of whom 7,129 had hypertension.

MAIN RESULTS

Of these 7,129 hypertensive patients, only 12.6% were on a thiazide. Out of the 7,129 hypertensive patients, 3,113 did not have diabetes, chronic kidney disease, coronary artery disease, congestive heart failure, or a history of stroke. Of these 3,113 patients, only 13.9% were on a thiazide. After excluding patients with a potential contraindication to a diuretic, such as hospice care or incontinence, only 18% were prescribed a thiazide. Of the 3,113 patients, 1,148 were on a single class of antihypertensive and more were prescribed a beta blocker, ACE inhibitor, calcium channel blocker, loop diuretic, and ARB than a thiazide diuretic.

CONCLUSIONS

Adherence to hypertension guidelines among nursing home patients is low. The appropriate use of thiazide diuretics could reduce costs and improve blood pressure control and patient outcomes.

Features predicting the success of computerized decision support for prescribing: a systematic review of randomized controlled trials

Background

Computerized decision support systems (CDSS) are believed to have the potential to improve the quality of health care delivery, although results from high quality studies have been mixed. We conducted a systematic review to evaluate whether certain features of prescribing decision support systems (RxCDSS) predict successful implementation, change in provider behaviour, and change in patient outcomes.

Methods

A literature search of Medline, EMBASE, CINAHL and INSPEC databases (earliest entry to June 2008) was conducted to identify randomized controlled trials involving RxCDSS. Each citation was independently assessed by two reviewers for outcomes and 28 predefined system features. Statistical analysis of associations between system features and success of outcomes was planned.

Results

Of 4534 citations returned by the search, 41 met the inclusion criteria. Of these, 37 reported successful system implementations, 25 reported success at changing health care provider behaviour, and 5 noted improvements in patient outcomes. A mean of 17 features per study were mentioned. The statistical analysis could not be completed due primarily to the small number of studies and lack of diversity of outcomes. Descriptive analysis did not confirm any feature to be more prevalent in successful trials relative to unsuccessful ones for implementation, provider behaviour or patient outcomes.

Conclusion

While RxCDSSs have the potential to change health care provider behaviour, very few high quality studies show improvement in patient outcomes. Furthermore, the features of the RxCDSS associated with success (or failure) are poorly described, thus making it difficult for system design and implementation to improve.

Using health information technology to improve hypertension management

High-quality medical care requires implementing evidence-based best practices, with continued monitoring to improve performance. Implementation science is beginning to identify approaches to developing, implementing, and evaluating quality improvement strategies across health care systems that lead to good outcomes for patients. Health information technology has much to contribute to quality improvement for hypertension, particularly as part of multidimensional strategies for improved care. Clinical reminders closely aligned with organizational commitment to quality improvement may be one component of a successful strategy for improving blood pressure control. The ATHENA-Hypertension (Assessment and Treatment of Hypertension: Evidence-based Automation) system is an example of more complex clinical decision support. It is feasible to implement and deploy innovative health information technologies for clinical decision support with features such as clinical data visualizations and evidence to support specific recommendations. Further study is needed to determine the optimal contexts for such systems and their impact on patient outcomes.

Impact of a generalizable reminder system on colorectal cancer screening in diverse primary care practices: a report from the prompting and reminding at encounters for prevention project

BACKGROUND

Computerized reminder systems (CRS) show promise for increasing preventive services such as colorectal cancer (CRC) screening. However, prior research has not evaluated a generalizable CRS across diverse, community primary care practices. We evaluated whether a generalizable CRS, ClinfoTracker, could improve screening rates for CRC in diverse primary care practices.

METHODS

The study was a prospective trial to evaluate ClinfoTracker using historical control data in 12 Great Lakes Research In Practice Network community-based, primary care practices distributed from Southeast to Upper Peninsula Michigan. Our outcome measures were pre- and post-study practice-level CRC screening rates among patients seen during the 9-month study period. Ability to maintain the CRS was measured by days of reminder printing. Field notes were used to examine each practice's cohesion and technology capabilities.

RESULTS

All but one practice increased their CRC screening rates, ranging from 3.3% to 16.8% improvement. t tests adjusted for within practice correlation showed improvement in screening rates across all 12 practices, from 41.7% to 50.9%, P = 0.002. Technology capabilities impacted printing days (74% for high technology vs. 45% for low technology practices, P = 0.01), and cohesion demonstrated an impact trend for screening (15.3% rate change for high cohesion vs. 7.9% for low cohesion practices).

CONCLUSIONS

Implementing a generalizable CRS in diverse primary care practices yielded significant improvements in CRC screening rates. Technology capabilities are important in maintaining the system, but practice cohesion may have a greater influence on screening rates. This work has important implications for practices implementing reminder systems.

Electronic result viewing and quality of care in small group practices

BACKGROUND

There is a paucity of data on the effectiveness of commercially available electronic systems for improving health care in office practices, where the majority of health care is delivered. In particular, the effect of electronic laboratory result viewing on quality of care, including preventive care, chronic disease management, and patient satisfaction, is unclear.

OBJECTIVE

To determine whether electronic laboratory result viewing is associated with higher ambulatory care quality.

METHODS

We conducted a cross-sectional study of primary care physicians (PCPs) in the Taconic IPA in New York, all of whom have the opportunity to use a free-standing electronic portal for laboratory result viewing. We analyzed 15 quality measures, reflecting preventive care, chronic disease management, and patient satisfaction, which were collected in 2005. Using generalized estimating equations, we determined associations between portal usage and quality, adjusting for adoption of electronic health records and 10 other physician characteristics, including case mix.

MAIN RESULTS

One-third of physicians (54/168, 32%) used the portal at least once over a 6-month period. Use of the portal was associated with higher quality overall (adjusted odds ratio [OR] 1.25; 95% confidence interval [CI] 1.003, 1.57). In stratified analyses, portal usage was associated with higher quality on those performance measures expected to be impacted by result viewing (adjusted OR 1.34; 95% CI 1.00, 1.81; p = 0.05), but not associated with quality for measures not expected to be impacted by result viewing (adjusted OR 1.03; 95% CI 0.72, 1.48; p = 0.85).

CONCLUSION

Electronic laboratory result viewing was independently associated with higher ambulatory care quality. Longitudinal studies are needed to confirm this association.

Prompting clinicians about preventive care measures: a systematic review of randomized controlled trials

Preventive care measures remain underutilized despite recommendations to increase their use. The objective of this review was to examine the characteristics, types, and effects of paper- and computer-based interventions for preventive care measures. The study provides an update to a previous systematic review. We included randomized controlled trials that implemented a physician reminder and measured the effects on the frequency of providing preventive care. Of the 1,535 articles identified, 28 met inclusion criteria and were combined with the 33 studies from the previous review. The studies involved 264 preventive care interventions, 4,638 clinicians and 144,605 patients. Implementation strategies included combined paper-based with computer generated reminders in 34 studies (56%), paper-based reminders in 19 studies (31%), and fully computerized reminders in 8 studies (13%). The average increase for the three strategies in delivering preventive care measures ranged between 12% and 14%. Cardiac care and smoking cessation reminders were most effective. Computer-generated prompts were the most commonly implemented reminders. Clinician reminders are a successful approach for increasing the rates of delivering preventive care; however, their effectiveness remains modest. Despite increased implementation of electronic health records, randomized controlled trials evaluating computerized reminder systems are infrequent.

Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: a systematic review

Previous reviews of electronic decision-support systems (EDSS) have often treated them as a single category, and factors that may modify their effectiveness of EDSS have not been examined. The objective was to summarise the evidence associating the use of computerised decision support and improved patient outcomes. PubMed/Medline and the Database of Abstracts were searched for randomised controlled trials (RCT) of EDSS from 1 January 1994 to 31 January 2006. Twenty-four RCT studies from 97 reviewed were selected, eight of them examined systems supporting decisions for patients who presented with an acute illness, and 16 studies enrolled patients with chronic conditions. Overall, 13 (54%) of the studies showed a positive result, and 11 (46%) were with no impact. Critiquing and consultative systems showed the impact in 71% and 47% of studies, respectively. All systems targeting decisions related to acute disease improved patient outcomes compared with 38% of systems focused on the management of chronic conditions (P = 0.005). Provision of EDSS improves prescribing practices and treatment outcomes of patients with acute illnesses; however, EDSS were less effective in primary care. Complex interventions as clinical EDSS may require new metrics of assessment to describe the impact on patient outcomes.

Improving prescribing of antihypertensive and cholesterol-lowering drugs: a method for identifying and addressing barriers to change

BACKGROUND

We describe a simple approach we used to identify barriers and tailor an intervention to improve pharmacological management of hypertension and hypercholesterolaemia. We also report the results of a post hoc exercise and survey we carried out to evaluate our approach for identifying barriers and tailoring interventions.

METHODS

We used structured reflection, searched for other relevant trials, surveyed general practitioners and talked with physicians during pilot testing of the intervention. The post hoc exercise was carried out as focus groups of international researchers in the field of quality improvement in health care. The post hoc survey was done by telephone interviews with physicians allocated to the experimental group of a randomised trial of our multifaceted intervention.

RESULTS

A wide range of barriers was identified and several interventions were suggested through structured reflection. The survey led to some adjustments. Studying other trials and pilot testing did not lead to changes in the design of the intervention. Neither the post hoc focus groups nor the post hoc survey revealed important barriers or interventions that we had not considered or included in our tailored intervention.

CONCLUSIONS

A simple approach to identifying barriers to change appears to have been adequate and efficient. However, we do not know for certain what we would have gained by using more comprehensive methods and we do not know whether the resulting intervention would have been more effective if we had used other methods. The effectiveness of our multifaceted intervention is under evaluation in a randomised controlled trial.

Antithrombotic and Thrombolytic Therapy: From Evidence to Application

This chapter about implementation strategies for practice guidelines is part of the 7th ACCP Conference on Antithrombotic and Thrombolytic Therapy: Evidence Based Guidelines. Grade 1 recommendations are strong and indicate that the benefits do, or do not, outweigh risks, burden, and costs. Grade 2 suggests that feasibility, acceptability and cost related to implementation strategies may lead to different choices depending on the practice setting (for a full understanding of the grading see Guyatt et al, CHEST 2004; 126:179S-187S). To encourage uptake of guidelines to reduce thrombosis, we recommend that appreciable resources be devoted to distribution of educational material (Grade 2B). We suggest that few resources be devoted to educational meetings (Grade 2B), to audit and feedback (Grade 2B), or to educational outreach visits (Grade 2B) to encourage uptake of the guidelines. We suggest that appreciable resources be devoted to computer reminders (Grade 2A) and to patient-mediated interventions (Grade 2B) to encourage uptake of the guidelines. This review suggests that there are few implementation strategies that are of unequivocal, consistent benefit, and that are clearly and consistently worth resource investment. Fully informed decisions will require additional research to identify effective guideline implementation strategies to optimize antithrombotic and thrombolytic therapy.

Impact of a physician-oriented intervention on follow-up in colorectal cancer screening

BACKGROUND

Complete diagnostic evaluation or CDE (i.e., colonoscopy or combined flexible sigmoidoscopy plus barium enema X-ray) is often not performed for persons with an abnormal screening fecal occult blood test (FOBT+) result.

METHOD

This study evaluated the impact of a reminder-feedback and educational outreach intervention on primary care practice CDE recommendation and performance rates. Four hundred seventy primary care physicians (PCPs) in 318 practices participated in the study. Patients were mailed an FOBT kit annually as part of a screening program. Practices were randomly assigned to a Control Group (N = 198) or an Intervention Group (N = 120). During an 18-month pre-randomization period and a 9-month post-randomization period, 2992 screening FOBT+ patients were identified. Intervention practices received the screening program and the intervention. Control practices received only the screening program. Study outcomes were baseline-adjusted CDE recommendation and performance rates.

RESULTS

At baseline, about two-thirds of FOBT+ patients received a CDE recommendation, and about half had a CDE performed. At endpoint, CDE recommendation and performance rates were both significantly higher for the Intervention as compared to the Control practices (OR = 2.28; 95% CI: 1.37, 3.78, and OR = 1.63; 95% CI: 1.06, 2.50, respectively).

CONCLUSIONS

The reminder-feedback plus educational outreach intervention significantly increased CDE recommendation and performance.

The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care

BACKGROUND

Adverse drug-related events are common in the elderly, and inappropriate prescribing is a preventable risk factor. Our objective was to determine whether inappropriate prescribing could be reduced when primary care physicians had computer-based access to information on all prescriptions dispensed and automated alerts for potential prescribing problems.

METHODS

We randomly assigned 107 primary care physicians with at least 100 patients aged 66 years and older (total 12 560) to a group receiving computerized decision-making support (CDS) or a control group. Physicians in the CDS group had access to information on current and past prescriptions through a dedicated computer link to the provincial seniors' drug-insurance program. When any of 159 clinically relevant prescribing problems were identified by the CDS software, the physician received an alert that identified the nature of the problem, possible consequences and alternative therapy. The rate of initiation and discontinuation of potentially inappropriate prescriptions was assessed over a 13-month period.

RESULTS

In the 2 months before the study, 31.8% of the patients in the CDS group and 33.3% of those in the control group had at least 1 potentially inappropriate prescription. During the study the number of new potentially inappropriate prescriptions per 1000 visits was significantly lower (18%) in the CDS group than in the control group (relative rate [RR] 0.82, 95% confidence interval [CI] 0.69-0.98), but differences between the groups in the rate of discontinuation of potentially inappropriate prescriptions were significant only for therapeutic duplication by the study physician and another physician (RR 1.66, 95% CI 0.99-2.79) and drug interactions caused by prescriptions written by the study physician (RR 2.15, 95% CI 0.98-4.70).

INTERPRETATION

Computer-based access to complete drug profiles and alerts about potential prescribing problems reduces the rate of initiation of potentially inappropriate prescriptions but has a more selective effect on the discontinuation of such prescriptions.

Improving guideline adherence: a randomized trial evaluating strategies to increase beta-blocker use in heart failure

BACKGROUND

The dissemination of clinical practice guidelines often has not been accompanied by desired improvements in guideline adherence. This study evaluated interventions for implementing a new practice guideline advocating the use of beta-blockers for heart failure patients.

METHODS AND RESULTS

This was a randomized controlled trial involving heart failure patients (n=169) with an ejection fraction < or =45% and no contraindications to beta-blockers. Patients' primary providers were randomized in a stratified design to 1 of 3 interventions: (1) control: provider education; (2) provider and patient notification: computerized provider reminders and patient letters advocating beta-blockers; and (3) nurse facilitator: supervised nurse to initiate and titrate beta-blockers. The primary outcome, the proportion of patients who were initiated or uptitrated and maintained on beta-blockers, analyzed by intention to treat, was achieved in 67% (36 of 54) of patients in the nurse facilitator group compared with 16% (10 of 64) in the provider/patient notification and 27% (14 of 51) in the control groups (P<0.001 for the comparisons between the nurse facilitator group and both other groups). The proportion of patients on target beta-blocker doses at the study end (median follow-up, 12 months) was also highest in the nurse facilitator group (43%) compared with the control (10%) and provider/patient notification groups (2%) (P<0.001). There were no differences in adverse events among groups.

CONCLUSIONS

The use of a nurse facilitator was a successful approach for implementing a beta-blocker guideline in heart failure patients. The use of provider education, clinical reminders, and patient education was of limited value in this setting.

Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials

OBJECTIVE

To systematically review randomised controlled trials (RCTs) of computer-generated medication reminders or feedback directed to healthcare providers or patients.

DATA SOURCES

Extensive computerised and manual literature searches identified 76 English-language reports of RCTs reported before 1 January 2002. Searches were conducted between June 1998 and April 2002.

STUDY SELECTION

26 papers making 29 comparisons (two papers reported on multiple interventions) of computer-supported medication management to a control group.

DATA EXTRACTION

The quality of the RCTs was systematically assessed and scored independently by two reviewers. Rates of compliance with (potential) reminders for the control and intervention groups were extracted.

DATA SYNTHESIS

Heterogeneity of studies prevented a meta-analysis. Where possible, rates were calculated using the intention-to-treat principle. The comparisons were grouped into five areas. Reminders to providers in outpatient settings: six of 12 comparisons demonstrated positive effects (relative rates [RRs: intervention rates/control rates], 1.0 to 42.0). Provider feedback in outpatient settings: five of seven comparisons showed improved clinician behaviour (RRs, 1.0 to 2.5). Combined reminders and feedback in outpatient settings: the single comparison found no improvement. Reminders to providers in inpatient settings: three of five comparisons showed improvements (RRs, 1.0 to 2.1). Patient-directed reminders: two of four comparisons showed improvements in patient compliance.

CONCLUSION

Reminders are more effective than feedback in modifying physician behaviour related to medication management. Patient-directed reminders can improve medication adherence.

Hypertension guidelines in elderly patients: is anybody listening?

PURPOSE

Previous guidelines for the management of uncomplicated hypertension in elderly patients have recommended diuretic agents and then beta-blockers. We examined trends in the initial treatment choice for elderly people with hypertension and the effects of a government-sponsored program to publish and disseminate a simplified version of the national guidelines for the treatment of hypertension to all physicians in Ontario, Canada.

SUBJECTS AND METHODS

Linked administrative databases containing information on the more than 1.2 million elderly residents in Ontario were used. Time series analysis was performed to determine prescribing trends from 1993 to 1998 for patients who began antihypertensive medication for the treatment of hypertension and to examine the effects of the simplified guidelines that were distributed in July of 1995.

RESULTS

Diuretic agents were the most commonly prescribed medications, with annual rates from 35% to 38% (P = 0.59) throughout the study. Beta-blocker prescribing rose from 12% to 16% (P <0.01), whereas angiotensin-converting enzyme (ACE) inhibitor prescribing rose from 27% to 32% (P <0.01). Prescriptions for calcium channel blockers dropped significantly, from 23% to 14% (P <0.01). However, the publication and dissemination of the Ontario hypertension guidelines had no statistically significant effects on the proportion of patients who began treatment with a diuretic agent (P = 0.55), beta-blocker, (P = 0.32), ACE inhibitor (P = 0.09), or calcium channel blocker (P = 0.07).

CONCLUSION

The dissemination of simplified practice guidelines for hypertension did not have notable effects on prescribing patterns in Ontario.

Can we alter physician behavior by educational methods? Lessons learned from studies of the management and follow-up of hypertension

INTRODUCTION

As expectations for effective continuing medical education (CME) grow, so, too, does the need to identify relationships among educational methods, physician performance, and patient outcomes associated with specific disease entities. Thus, we set out to review the literature on the effectiveness of physician educational interventions in the management and follow-up of hypertension.

METHOD

We searched PubMed and the Research and Development Resource Base in Continuing Medical Education for randomized controlled trials of physician educational interventions. We included only those studies that (a) used replicable educational interventions with > 50% physician involvement and that employed objective methods to measure physician behavior change or patient outcomes, (b) indicated a physician or patient dropout rate of < 30%, and (c) followed outcome measurement for > 30 days. Studies were designated "positive" if one or more of the primary outcome measures demonstrated a statistically significant change in physician performance or health care outcome.

RESULTS

We found 12 studies in which 7 different physician educational interventions were employed, alone or in combination, including reminders (computer or chart), formal CME, computerized decision support systems/risk stratification, printed educational materials, academic detailing, continuous quality improvement projects, and disease management aids in patient charts. Of the 12, 7 were positive and 4 were negative. One had mixed results.

DISCUSSION

Although physician educational interventions, especially reminders, improved the follow-up of hypertension, they were ineffective in changing blood pressure levels. However, they may have some utility in improving compliance with guideline recommendations.

Design and analysis of controlled trials in naturally clustered environments: implications for medical informatics

In medical informatics research, study questions frequently involve individuals who are grouped into clusters. For example, an intervention may be aimed at a clinician (who treats a cluster of patients) with the intention of improving the health of individual patients. Correlation among individuals within a cluster can lead to incorrect estimates of the sample size required to detect an effect and inappropriate estimates of the confidence intervals and the statistical significance of the intervention effects. Contamination, which is the spread of the effect of an intervention or control treatment to the opposite group, often occurs between individuals within clusters. It leads to an attenuation of the effect of the intervention and reduced power to detect a difference. If individuals are randomized in a clinical trial (individual-randomized trial), then correlation must be taken into account in the analysis, and the sample size may need to be increased to compensate for contamination. Randomizing clusters rather than individuals (cluster-randomized trials) can eliminate contamination and may be preferred for logistical reasons. Cluster-randomized trials are generally less efficient than individual-randomized trials, so the tradeoffs must be assessed. Correlation must be taken into account in the analysis and in the sample-size calculations for cluster-randomized trials.

Conceptual alignment of electronic health record data with guideline and workflow knowledge

Even though computerized practice guidelines and workflow management (WfM) are proven effective techniques to improving quality of care and reducing costs, they are not widely deployed today. One reason for this is the impedance mismatch between guideline systems and electronic health record (EHR) systems. This paper presents the Unified Service Action Model (USAM) that has been developed for the HL7 Reference Information Model (RIM) and that conceptually integrates guidelines and WfM in the EHR. We argue that the information items recorded in the EHR are logically similar to elements of guideline and WfM definitions. Therefore, the USAM suggests that guidelines and EHR reuse the same information structures. This reuse is possible through a technique borrowed from natural language grammar and modal logic. The conceptual alignment of guidelines, WfM and the EHR could facilitate the sharing and deployment of guidelines in routine health care.

Complete diagnostic evaluation in colorectal cancer screening: research design and baseline findings

BACKGROUND

While indicated by guidelines, complete diagnostic evaluation, or CDE (i.e., colonoscopy or combined flexible sigmoidoscopy plus barium enema X ray), is often not recommended and performed for persons with an abnormal screening fecal occult blood test (FOBT) result. We initiated a randomized trial to assess the impact of a physician-oriented intervention on CDE rates in primary care practices.

METHODS

In 1998, we identified 1,184 primary care physicians (PCPs) in 584 practices whose patients received FOBTs that are mailed annually by a managed care organization screening program. A total of 470 PCPs in 318 practices completed a baseline survey. Practices were randomly assigned either to a Control Group (N = 198) or to an Intervention Group (N = 120). Control Group practices received the screening program. Intervention Group practices received the screening program and the intervention (i.e., CDE reminder-feedback plus educational outreach). Practice CDE recommendation and performance rates are the primary outcomes to be measured in the study.

RESULTS

Baseline CDE recommendation and performance rates were low and were comparable in Control and Intervention Group practices (54 to 57% and 39 to 40%, respectively). PCPs in the practices tended to view FOBT screening and CDE favorably, but had concerns about screening efficacy, time involved in CDE, and patient discomfort and adherence. Control Group physicians were more likely than Intervention Group physicians to believe that a mail-out FOBT screening program helps in the practice of medicine.

CONCLUSIONS

We were able to enroll a high proportion of targeted primary care practices, measure practice characteristics and CDE rates at baseline, and develop and implement the intervention. Study outcome analyses will take into account baseline differences in practice characteristics.

Considering clustering: a methodological review of clinical decision support system studies

Computer-based clinical decision support systems (CDSSs) are often implemented at a cluster level, but standard statistical methods for sample estimation and analysis may not be appropriate for such studies. This review aims to determine whether the design and analysis methods of cluster-based studies were adequately addressed in reports of CDSS studies. We retrieved 61 reports of the CDSS controlled trials and identified 24 studies meeting our inclusion criteria. Of these, none included sample size calculations that allowed for clustering, while 14 (58%) took account of clustering in the analysis. Although there is increasing recognition of the methodological issues associated with cluster design in health care, many medical informaticians are still not aware of these issues. Investigators should publish estimates of the intracluster correlation coefficients and variance components in their reports to guide the planning of the future studies.

A design model for computer-based guideline implementation based on information management services

Clinical practice guidelines must be implemented effectively if they are to influence the behavior of clinicians. The authors describe a model for computer-based guideline implementation that identifies eight information management services needed to integrate guideline-based decision support with clinical workflow. Recommendation services determine appropriate activities in specific clinical circumstances. Documentation services involve data capture. Registration services integrate demographic and administrative data. Explanation services enhance the credibility of automated recommendations by providing supportive evidence and rating the quality of evidence. Calculation services measure time intervals, suggest medication dosages, and perform other computational tasks. Communication services employ standards for information transfer and provide data security. Effective presentation services facilitate understanding of complex data, clarify trends, and format written materials (including prescriptions) for patients. Aggregation services associate outcomes with specific guideline interventions. The authors provide examples of the eight services that make up the model from five evidence-based practice parameters developed by the American Academy of Pediatrics.

Computer-based guideline implementation systems: a systematic review of functionality and effectiveness

In this systematic review, the authors analyze the functionality provided by recent computer-based guideline implementation systems and characterize the effectiveness of the systems. Twenty-five studies published between 1992 and January 1998 were identified. Articles were included if the authors indicated an intent to implement guideline recommendations for clinicians and if the effectiveness of the system was evaluated. Provision of eight information management services and effects on guideline adherence, documentation, user satisfaction, and patient outcome were noted. All systems provided patient-specific recommendations. In 19, recommendations were available concurrently with care. Explanation services were described for nine systems. Nine systems allowed interactive documentation, and 17 produced paper-based output. Communication services were present most often in systems integrated with electronic medical records. Registration, calculation, and aggregation services were infrequently reported. There were 10 controlled trials (9 randomized) and 10 time-series correlational studies. Guideline adherence improved in 14 of 18 systems in which it was measured. Documentation improved in 4 of 4 studies.