A Knowledge-based Decision Support System for recommending safe recipes to individuals with dysphagia

BACKGROUND

Dysphagia is a disorder that can be associated to several pathological conditions, including neuromuscular diseases, with significant impact on quality of life. Dysphagia often leads to malnutrition, as a consequence of the dietary changes made by patients or their caregivers, who may deliberately decide to reduce or avoid specific food consistencies (because they are not perceived as safe), and the lack of knowledge in how to process foods are critics. Such dietary changes often result in unbalanced nutrients intake, which can have significant consequences for frail patients. This paper presents the development of a prototypical novel ontology-based Decision Support System (DSS) to support neuromuscular patients with dysphagia (following a per-oral nutrition) and their caregivers in preparing nutritionally balanced and safe meals.

METHOD

After reviewing scientific literature, we developed in collaboration with Ear-Nose-Throat (ENT) specialists, neurologists, and dieticians the DSS formalizes expert knowledge to suggest recipes that are considered safe according to patient's consistency limitations and dysphagia severity and also nutritionally well-balanced.

RESULTS

The prototype can be accessed via digital applications both by physicians to generate and verify the recommendations, and by the patients and their caregivers to follow the step-by-step procedures to autonomously prepare and process one or more recipe. The system is evaluated with 9 clinicians to assess the quality of the DSS's suggested recipes and its acceptance in clinical practice.

CONCLUSIONS

Preliminary results suggest a global positive outcome for the recipes inferred by the DSS and a good usability of the system.

Attitudes To and Uptake of Repertory Software in Homeopathy Clinical Practice-Results of an International Survey

BACKGROUND

 Despite the substantial size of the maturing complementary medicine (CM) industry, the technologies used by practitioners have received little research attention. In the clinical delivery of homeopathy services, repertory software can be employed to cross-reference client symptoms with numerous databases, making the process of seeking a clinical intervention quicker and more accurate. The purpose of the study is to learn about the quantitative patterns of usage, uptake and attitudes to repertory software amongst professional homeopaths.

METHODS

 An online cross-sectional survey of 15 questions was completed by practicing professional homeopaths between August 2016 and May 2017, using non-probability snowball sampling. Questions gathered demographic information, reflections and attitudes on the use of electronic repertories in clinical homeopathy practice.

RESULTS

 In total, 59% of respondents reported using software regularly in practice and 71% found that it adds clear value in their work. Sixty-eight percent of respondents learned about repertory software during homeopathy training, and 47% were introduced to software when they began clinical practice. Lack of sufficient training is a very important barrier to the use of repertory software, indicating that more robust and accessible software training is needed for practitioners. Many respondents agreed with a statement that repertory software represents good value for money and yet 46% agreed that it is cost prohibitive for most practitioners, signaling a challenge for software companies. Few respondents reported regularly using more than three of the most common repertory features.

CONCLUSION

 This preliminary study presents some potentially significant uptake, usage and attitude markers that stand to shed light on the practice of homeopathy and the place of emerging technologies such as repertory software. Ultimately, more research is needed to help identify and address the challenges, risks and tensions around integration of practice-enhancing technologies in CM educational and clinical settings to best serve the diverse and changing needs of practitioners.

Effect of computerised, knowledge-based, clinical decision support systems on patient-reported and clinical outcomes of patients with chronic disease managed in primary care settings: a systematic review

OBJECTIVES

Chronic diseases are the leading cause of disability globally. Most chronic disease management occurs in primary care with outcomes varying across primary care providers. Computerised clinical decision support systems (CDSS) have been shown to positively affect clinician behaviour by improving adherence to clinical guidelines. This study provides a summary of the available evidence on the effect of CDSS embedded in electronic health records on patient-reported and clinical outcomes of adult patients with chronic disease managed in primary care.

DESIGN AND ELIGIBILITY CRITERIA

Systematic review, including randomised controlled trials (RCTs), cluster RCTs, quasi-RCTs, interrupted time series and controlled before-and-after studies, assessing the effect of CDSS (vs usual care) on patient-reported or clinical outcomes of adult patients with selected common chronic diseases (asthma, chronic obstructive pulmonary disease, heart failure, myocardial ischaemia, hypertension, diabetes mellitus, hyperlipidaemia, arthritis and osteoporosis) managed in primary care.

DATA SOURCES

Medline, Embase, CENTRAL, Scopus, Health Management Information Consortium and trial register clinicaltrials.gov were searched from inception to 24 June 2020.

DATA EXTRACTION AND SYNTHESIS

Screening, data extraction and quality assessment were performed by two reviewers independently. The Cochrane risk of bias tool was used for quality appraisal.

RESULTS

From 5430 articles, 8 studies met the inclusion criteria. Studies were heterogeneous in population characteristics, intervention components and outcome measurements and focused on diabetes, asthma, hyperlipidaemia and hypertension. Most outcomes were clinical with one study reporting on patient-reported outcomes. Quality of the evidence was impacted by methodological biases of studies.

CONCLUSIONS

There is inconclusive evidence in support of CDSS. A firm inference on the intervention effect was not possible due to methodological biases and study heterogeneity. Further research is needed to provide evidence on the intervention effect and the interplay between healthcare setting features, CDSS characteristics and implementation processes.

PROSPERO REGISTRATION NUMBER

CRD42020218184.

Sources of Support for Studies That Inform Recommendations of the Community Preventive Services Task Force

OBJECTIVES

The Community Preventive Services Task Force (CPSTF) makes evidence-based recommendations about preventive services, programs, and policies in community settings to improve public health. CPSTF recommendations are based on systematic evidence reviews. This study examined the sponsors (ie, sources of financial, material, or intellectual support) for publications included in systematic reviews used by the CPSTF to make recommendations during a 9-year period.

METHODS

We examined systematic evidence reviews (effectiveness reviews and economic reviews) for CPSTF findings issued from January 1, 2010, through December 31, 2018. We assessed study publications used in these reviews for sources of support; we classified sources as government, nonprofit, industry, or no identified support. We also identified country of origin for each sponsor and the most frequently mentioned sponsors.

RESULTS

The CPSTF issued findings based on 144 systematic reviews (106 effectiveness reviews and 38 economic reviews). These reviews included 3846 publications: 3363 publications in effectiveness reviews and 483 publications in economic reviews. Government agencies supported 57.1% (n = 1919) of publications in effectiveness reviews and 59.2% (n = 286) in economic reviews. More than 1500 study sponsors from 36 countries provided support. The National Institutes of Health was the leading sponsor for effectiveness reviews (21.3%; 718 of 3363) and economic reviews (16.2%; 78 of 480), followed by the Centers for Disease Control and Prevention (7.0%; 234 of 3363 effectiveness reviews and 14.8%; 71 of 480 economic reviews).

CONCLUSIONS

The evidence base used by the CPSTF was supported by an array of sponsors, with government agencies providing the most support. Study findings highlight the need for sponsorship transparency and the role of government as a leading supporter of studies that underpin CPSTF recommendations for improving public health.

Cost and economic benefit of clinical decision support systems for cardiovascular disease prevention: a community guide systematic review

Objective

This review evaluates costs and benefits associated with acquiring, implementing, and operating clinical decision support systems (CDSSs) to prevent cardiovascular disease (CVD).

Materials and Methods

Methods developed for the Community Guide were used to review CDSS literature covering the period from January 1976 to October 2015. Twenty-one studies were identified for inclusion.

Results

It was difficult to draw a meaningful estimate for the cost of acquiring and operating CDSSs to prevent CVD from the available studies ( n  = 12) due to considerable heterogeneity. Several studies ( n  = 11) indicated that health care costs were averted by using CDSSs but many were partial assessments that did not consider all components of health care. Four cost-benefit studies reached conflicting conclusions about the net benefit of CDSSs based on incomplete assessments of costs and benefits. Three cost-utility studies indicated inconsistent conclusions regarding cost-effectiveness based on a conservative $50,000 threshold.

Discussion

Intervention costs were not negligible, but specific estimates were not derived because of the heterogeneity of implementation and reporting metrics. Expected economic benefits from averted health care cost could not be determined with confidence because many studies did not fully account for all components of health care.

Conclusion

We were unable to conclude whether CDSSs for CVD prevention is either cost-beneficial or cost-effective. Several evidence gaps are identified, most prominently a lack of information about major drivers of cost and benefit, a lack of standard metrics for the cost of CDSSs, and not allowing for useful life of a CDSS that generally extends beyond one accounting period.

Risk scoring for the primary prevention of cardiovascular disease

BACKGROUND

The current paradigm for cardiovascular disease (CVD) emphasises absolute risk assessment to guide treatment decisions in primary prevention. Although the derivation and validation of multivariable risk assessment tools, or CVD risk scores, have attracted considerable attention, their effect on clinical outcomes is uncertain.

OBJECTIVES

To assess the effects of evaluating and providing CVD risk scores in adults without prevalent CVD on cardiovascular outcomes, risk factor levels, preventive medication prescribing, and health behaviours.

SEARCH METHODS

We searched the Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library (2016, Issue 2), MEDLINE Ovid (1946 to March week 1 2016), Embase (embase.com) (1974 to 15 March 2016), and Conference Proceedings Citation Index-Science (CPCI-S) (1990 to 15 March 2016). We imposed no language restrictions. We searched clinical trial registers in March 2016 and handsearched reference lists of primary studies to identify additional reports.

SELECTION CRITERIA

We included randomised and quasi-randomised trials comparing the systematic provision of CVD risk scores by a clinician, healthcare professional, or healthcare system compared with usual care (i.e. no systematic provision of CVD risk scores) in adults without CVD.

DATA COLLECTION AND ANALYSIS

Three review authors independently selected studies, extracted data, and evaluated study quality. We used the Cochrane 'Risk of bias' tool to assess study limitations. The primary outcomes were: CVD events, change in CVD risk factor levels (total cholesterol, systolic blood pressure, and multivariable CVD risk), and adverse events. Secondary outcomes included: lipid-lowering and antihypertensive medication prescribing in higher-risk people. We calculated risk ratios (RR) for dichotomous data and mean differences (MD) or standardised mean differences (SMD) for continuous data using 95% confidence intervals. We used a fixed-effects model when heterogeneity (I²) was at least 50% and a random-effects model for substantial heterogeneity (I² > 50%). We evaluated the quality of evidence using the GRADE framework.

MAIN RESULTS

We identified 41 randomised controlled trials (RCTs) involving 194,035 participants from 6422 reports. We assessed studies as having high or unclear risk of bias across multiple domains. Low-quality evidence evidence suggests that providing CVD risk scores may have little or no effect on CVD events compared with usual care (5.4% versus 5.3%; RR 1.01, 95% confidence interval (CI) 0.95 to 1.08; I² = 25%; 3 trials, N = 99,070). Providing CVD risk scores may reduce CVD risk factor levels by a small amount compared with usual care. Providing CVD risk scores reduced total cholesterol (MD -0.10 mmol/L, 95% CI -0.20 to 0.00; I² = 94%; 12 trials, N = 20,437, low-quality evidence), systolic blood pressure (MD -2.77 mmHg, 95% CI -4.16 to -1.38; I² = 93%; 16 trials, N = 32,954, low-quality evidence), and multivariable CVD risk (SMD -0.21, 95% CI -0.39 to -0.02; I² = 94%; 9 trials, N = 9549, low-quality evidence). Providing CVD risk scores may reduce adverse events compared with usual care, but results were imprecise (1.9% versus 2.7%; RR 0.72, 95% CI 0.49 to 1.04; I² = 0%; 4 trials, N = 4630, low-quality evidence). Compared with usual care, providing CVD risk scores may increase new or intensified lipid-lowering medications (15.7% versus 10.7%; RR 1.47, 95% CI 1.15 to 1.87; I² = 40%; 11 trials, N = 14,175, low-quality evidence) and increase new or increased antihypertensive medications (17.2% versus 11.4%; RR 1.51, 95% CI 1.08 to 2.11; I² = 53%; 8 trials, N = 13,255, low-quality evidence).

AUTHORS' CONCLUSIONS

There is uncertainty whether current strategies for providing CVD risk scores affect CVD events. Providing CVD risk scores may slightly reduce CVD risk factor levels and may increase preventive medication prescribing in higher-risk people without evidence of harm. There were multiple study limitations in the identified studies and substantial heterogeneity in the interventions, outcomes, and analyses, so readers should interpret results with caution. New models for implementing and evaluating CVD risk scores in adequately powered studies are needed to define the role of applying CVD risk scores in primary CVD prevention.

Clinical Decision Support Systems and Prevention: A Community Guide Cardiovascular Disease Systematic Review

CONTEXT

Clinical decision support systems (CDSSs) can help clinicians assess cardiovascular disease (CVD) risk and manage CVD risk factors by providing tailored assessments and treatment recommendations based on individual patient data. The goal of this systematic review was to examine the effectiveness of CDSSs in improving screening for CVD risk factors, practices for CVD-related preventive care services such as clinical tests and prescribed treatments, and management of CVD risk factors.

EVIDENCE ACQUISITION

An existing systematic review (search period, January 1975-January 2011) of CDSSs for any condition was initially identified. Studies of CDSSs that focused on CVD prevention in that review were combined with studies identified through an updated search (January 2011-October 2012). Data analysis was conducted in 2013.

EVIDENCE SYNTHESIS

A total of 45 studies qualified for inclusion in the review. Improvements were seen for recommended screening and other preventive care services completed by clinicians, recommended clinical tests completed by clinicians, and recommended treatments prescribed by clinicians (median increases of 3.8, 4.0, and 2.0 percentage points, respectively). Results were inconsistent for changes in CVD risk factors such as systolic and diastolic blood pressure, total and low-density lipoprotein cholesterol, and hemoglobin A1C levels.

CONCLUSIONS

CDSSs are effective in improving clinician practices related to screening and other preventive care services, clinical tests, and treatments. However, more evidence is needed from implementation of CDSSs within the broad context of comprehensive service delivery aimed at reducing CVD risk and CVD-related morbidity and mortality.

Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis

We systematically reviewed randomized controlled trials (RCTs) assessing the effectiveness of computerized decision support systems (CDSSs) featuring rule- or algorithm-based software integrated with electronic health records (EHRs) and evidence-based knowledge. We searched MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Cochrane Database of Abstracts of Reviews of Effects. Information on system design, capabilities, acquisition, implementation context, and effects on mortality, morbidity, and economic outcomes were extracted. Twenty-eight RCTs were included. CDSS use did not affect mortality (16 trials, 37395 patients; 2282 deaths; risk ratio [RR] = 0.96; 95% confidence interval [CI] = 0.85, 1.08; I(2) = 41%). A statistically significant effect was evident in the prevention of morbidity, any disease (9 RCTs; 13868 patients; RR = 0.82; 95% CI = 0.68, 0.99; I(2) = 64%), but selective outcome reporting or publication bias cannot be excluded. We observed differences for costs and health service utilization, although these were often small in magnitude. Across clinical settings, new generation CDSSs integrated with EHRs do not affect mortality and might moderately improve morbidity outcomes.

Meta-regression analyses to explain statistical heterogeneity in a systematic review of strategies for guideline implementation in primary health care

This study is an in-depth-analysis to explain statistical heterogeneity in a systematic review of implementation strategies to improve guideline adherence of primary care physicians in the treatment of patients with cardiovascular diseases. The systematic review included randomized controlled trials from a systematic search in MEDLINE, EMBASE, CENTRAL, conference proceedings and registers of ongoing studies. Implementation strategies were shown to be effective with substantial heterogeneity of treatment effects across all investigated strategies. Primary aim of this study was to explain different effects of eligible trials and to identify methodological and clinical effect modifiers. Random effects meta-regression models were used to simultaneously assess the influence of multimodal implementation strategies and effect modifiers on physician adherence. Effect modifiers included the staff responsible for implementation, level of prevention and definition pf the primary outcome, unit of randomization, duration of follow-up and risk of bias. Six clinical and methodological factors were investigated as potential effect modifiers of the efficacy of different implementation strategies on guideline adherence in primary care practices on the basis of information from 75 eligible trials. Five effect modifiers were able to explain a substantial amount of statistical heterogeneity. Physician adherence was improved by 62% (95% confidence interval (95% CI) 29 to 104%) or 29% (95% CI 5 to 60%) in trials where other non-medical professionals or nurses were included in the implementation process. Improvement of physician adherence was more successful in primary and secondary prevention of cardiovascular diseases by around 30% (30%; 95% CI -2 to 71% and 31%; 95% CI 9 to 57%, respectively) compared to tertiary prevention. This study aimed to identify effect modifiers of implementation strategies on physician adherence. Especially the cooperation of different health professionals in primary care practices might increase efficacy and guideline implementation seems to be more difficult in tertiary prevention of cardiovascular diseases.

The economics of medicines optimization: policy developments, remaining challenges and research priorities

BACKGROUND

This review scopes the evidence on the effectiveness and cost-effectiveness of interventions to improve suboptimal use of medicines in order to determine the evidence gaps and help inform research priorities.

SOURCES OF DATA

Systematic searches of the National Health Service (NHS) Economic Evaluation Database, the Cochrane Database of Systematic Reviews and the Database of Abstracts of Reviews of Effects.

AREAS OF AGREEMENT

The majority of the studies evaluated interventions to improve adherence, inappropriate prescribing and prescribing errors.

AREAS OF CONTROVERSY

Interventions tend to be specific to a particular stage of the pathway and/or to a particular disease and have mostly been evaluated for their effect on intermediate or process outcomes.

GROWING POINTS

Medicines optimization offers an opportunity to improve health outcomes and efficiency of healthcare.

AREAS TIMELY FOR DEVELOPING RESEARCH

The available evidence is insufficient to assess the effectiveness and cost-effectiveness of interventions to address suboptimal medicine use in the UK NHS. Decision modelling, evidence synthesis and elicitation have the potential to address the evidence gaps and help prioritize research.

[Implementation of ontology-based clinical decision support system for management of interactions between antihypertensive drugs and diet]

PURPOSE

The influence of dietary composition on blood pressure is an important subject in healthcare. Interactions between antihypertensive drugs and diet (IBADD) is the most important factor in the management of hypertension. It is therefore essential to support healthcare providers' decision making role in active and continuous interaction control in hypertension management. The aim of this study was to implement an ontology-based clinical decision support system (CDSS) for IBADD management (IBADDM). We considered the concepts of antihypertensive drugs and foods, and focused on the interchangeability between the database and the CDSS when providing tailored information.

METHODS

An ontology-based CDSS for IBADDM was implemented in eight phases: (1) determining the domain and scope of ontology, (2) reviewing existing ontology, (3) extracting and defining the concepts, (4) assigning relationships between concepts, (5) creating a conceptual map with CmapTools, (6) selecting upper ontology, (7) formally representing the ontology with Protégé (ver.4.3), (8) implementing an ontology-based CDSS as a JAVA prototype application.

RESULTS

We extracted 5,926 concepts, 15 properties, and formally represented them using Protégé. An ontology-based CDSS for IBADDM was implemented and the evaluation score was 4.60 out of 5.

CONCLUSION

We endeavored to map functions of a CDSS and implement an ontology-based CDSS for IBADDM.

Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes

BACKGROUND

Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting the doctor to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time.

OBJECTIVES

To evaluate the effects of reminders automatically generated through a computerized system and delivered on paper to healthcare professionals on processes of care (related to healthcare professionals' practice) and outcomes of care (related to patients' health condition).

SEARCH METHODS

For this update the EPOC Trials Search Co-ordinator searched the following databases between June 11-19, 2012: The Cochrane Central Register of Controlled Trials (CENTRAL) and Cochrane Library (Economics, Methods, and Health Technology Assessment sections), Issue 6, 2012; MEDLINE, OVID (1946- ), Daily Update, and In-process; EMBASE, Ovid (1947- ); CINAHL, EbscoHost (1980- ); EPOC Specialised Register, Reference Manager, and INSPEC, Engineering Village. The authors reviewed reference lists of related reviews and studies. 

SELECTION CRITERIA

We included individual or cluster-randomized controlled trials (RCTs) and non-randomized controlled trials (NRCTs) that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals on processes and/or outcomes of care.

DATA COLLECTION AND ANALYSIS

Review authors working in pairs independently screened studies for eligibility and abstracted data. We contacted authors to obtain important missing information for studies that were published within the last 10 years. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median absolute improvement and interquartile range (IQR) in process adherence across included studies using the primary outcome or median outcome as representative outcome.

MAIN RESULTS

In the 32 included studies, computer-generated reminders delivered on paper to healthcare professionals achieved moderate improvement in professional practices, with a median improvement of processes of care of 7.0% (IQR: 3.9% to 16.4%). Implementing reminders alone improved care by 11.2% (IQR 6.5% to 19.6%) compared with usual care, while implementing reminders in addition to another intervention improved care by 4.0% only (IQR 3.0% to 6.0%) compared with the other intervention. The quality of evidence for these comparisons was rated as moderate according to the GRADE approach. Two reminder features were associated with larger effect sizes: providing space on the reminder for provider to enter a response (median 13.7% versus 4.3% for no response, P value = 0.01) and providing an explanation of the content or advice on the reminder (median 12.0% versus 4.2% for no explanation, P value = 0.02). Median improvement in processes of care also differed according to the behaviour the reminder targeted: for instance, reminders to vaccinate improved processes of care by 13.1% (IQR 12.2% to 20.7%) compared with other targeted behaviours. In the only study that had sufficient power to detect a clinically significant effect on outcomes of care, reminders were not associated with significant improvements.

AUTHORS' CONCLUSIONS

There is moderate quality evidence that computer-generated reminders delivered on paper to healthcare professionals achieve moderate improvement in process of care. Two characteristics emerged as significant predictors of improvement: providing space on the reminder for a response from the clinician and providing an explanation of the reminder's content or advice. The heterogeneity of the reminder interventions included in this review also suggests that reminders can improve care in various settings under various conditions.

The effectiveness of integrated health information technologies across the phases of medication management: a systematic review of randomized controlled trials

OBJECTIVE

The US Agency for Healthcare Research and Quality funded an evidence report to address seven questions on multiple aspects of the effectiveness of medication management information technology (MMIT) and its components (prescribing, order communication, dispensing, administering, and monitoring).

MATERIALS AND METHODS

Medline and 11 other databases without language or date limitations to mid-2010. Randomized controlled trials (RCTs) assessing integrated MMIT were selected by two independent reviewers. Reviewers assessed study quality and extracted data. Senior staff checked accuracy.

RESULTS

Most of the 87 RCTs focused on clinical decision support and computerized provider order entry systems, were performed in hospitals and clinics, included primarily physicians and sometimes nurses but not other health professionals, and studied process changes related to prescribing and monitoring medication. Processes of care improved for prescribing and monitoring mostly in hospital settings, but the few studies measuring clinical outcomes showed small or no improvements. Studies were performed most frequently in the USA (n=63), Europe (n=16), and Canada (n=6).

DISCUSSION

Many studies had limited description of systems, installations, institutions, and targets of the intervention. Problems with methods and analyses were also found. Few studies addressed order communication, dispensing, or administering, non-physician prescribers or pharmacists and their MMIT tools, or patients and caregivers. Other study methods are also needed to completely understand the effects of MMIT.

CONCLUSIONS

Almost half of MMIT interventions improved the process of care, but few studies measured clinical outcomes. This large body of literature, although instructive, is not uniformly distributed across settings, people, medication phases, or outcomes.

The economics of health information technology in medication management: a systematic review of economic evaluations

OBJECTIVE

To conduct a systematic review and synthesis of the evidence surrounding the cost-effectiveness of health information technology (HIT) in the medication process.

MATERIALS AND METHODS

Peer-reviewed electronic databases and gray literature were searched to identify studies on HIT used to assist in the medication management process. Articles including an economic component were reviewed for further screening. For this review, full cost-effectiveness analyses, cost-utility analyses and cost-benefit analyses, as well as cost analyses, were eligible for inclusion and synthesis.

RESULTS

The 31 studies included were heterogeneous with respect to the HIT evaluated, setting, and economic methods used. Thus the data could not be synthesized, and a narrative review was conducted. Most studies evaluated computer decision support systems in hospital settings in the USA, and only five of the studied performed full economic evaluations.

DISCUSSION

Most studies merely provided cost data; however, useful economic data involves far more input. A full economic evaluation includes a full enumeration of the costs, synthesized with the outcomes of the intervention.

CONCLUSION

The quality of the economic literature in this area is poor. A few studies found that HIT may offer cost advantages despite their increased acquisition costs. However, given the uncertainty that surrounds the costs and outcomes data, and limited study designs, it is difficult to reach any definitive conclusion as to whether the additional costs and benefits represent value for money. Sophisticated concurrent prospective economic evaluations need to be conducted to address whether HIT interventions in the medication management process are cost-effective.

Computerized clinical decision support systems for primary preventive care: a decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes

BACKGROUND

Computerized clinical decision support systems (CCDSSs) are claimed to improve processes and outcomes of primary preventive care (PPC), but their effects, safety, and acceptance must be confirmed. We updated our previous systematic reviews of CCDSSs and integrated a knowledge translation approach in the process. The objective was to review randomized controlled trials (RCTs) assessing the effects of CCDSSs for PPC on process of care, patient outcomes, harms, and costs.

METHODS

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews Database, Inspec, and other databases, as well as reference lists through January 2010. We contacted authors to confirm data or provide additional information. We included RCTs that assessed the effect of a CCDSS for PPC on process of care and patient outcomes compared to care provided without a CCDSS. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive.

RESULTS

We added 17 new RCTs to our 2005 review for a total of 41 studies. RCT quality improved over time. CCDSSs improved process of care in 25 of 40 (63%) RCTs. Cumulative scientifically strong evidence supports the effectiveness of CCDSSs for screening and management of dyslipidaemia in primary care. There is mixed evidence for effectiveness in screening for cancer and mental health conditions, multiple preventive care activities, vaccination, and other preventive care interventions. Fourteen (34%) trials assessed patient outcomes, and four (29%) reported improvements with the CCDSS. Most trials were not powered to evaluate patient-important outcomes. CCDSS costs and adverse events were reported in only six (15%) and two (5%) trials, respectively. Information on study duration was often missing, limiting our ability to assess sustainability of CCDSS effects.

CONCLUSIONS

Evidence supports the effectiveness of CCDSSs for screening and treatment of dyslipidaemia in primary care with less consistent evidence for CCDSSs used in screening for cancer and mental health-related conditions, vaccinations, and other preventive care. CCDSS effects on patient outcomes, safety, costs of care, and provider satisfaction remain poorly supported.

Can computerized clinical decision support systems improve practitioners' diagnostic test ordering behavior? A decision-maker-researcher partnership systematic review

Background

Underuse and overuse of diagnostic tests have important implications for health outcomes and costs. Decision support technology purports to optimize the use of diagnostic tests in clinical practice. The objective of this review was to assess whether computerized clinical decision support systems (CCDSSs) are effective at improving ordering of tests for diagnosis, monitoring of disease, or monitoring of treatment. The outcome of interest was effect on the diagnostic test-ordering behavior of practitioners.

Methods

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for eligible articles published up to January 2010. We included randomized controlled trials comparing the use of CCDSSs to usual practice or non-CCDSS controls in clinical care settings. Trials were eligible if at least one component of the CCDSS gave suggestions for ordering or performing a diagnostic procedure. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of test ordering outcomes.

Results

Thirty-five studies were identified, with significantly higher methodological quality in those published after the year 2000 (p = 0.002). Thirty-three trials reported evaluable data on diagnostic test ordering, and 55% (18/33) of CCDSSs improved testing behavior overall, including 83% (5/6) for diagnosis, 63% (5/8) for treatment monitoring, 35% (6/17) for disease monitoring, and 100% (3/3) for other purposes. Four of the systems explicitly attempted to reduce test ordering rates and all succeeded. Factors of particular interest to decision makers include costs, user satisfaction, and impact on workflow but were rarely investigated or reported.

Conclusions

Some CCDSSs can modify practitioner test-ordering behavior. To better inform development and implementation efforts, studies should describe in more detail potentially important factors such as system design, user interface, local context, implementation strategy, and evaluate impact on user satisfaction and workflow, costs, and unintended consequences.

Computerized clinical decision support systems for chronic disease management: a decision-maker-researcher partnership systematic review

Background

The use of computerized clinical decision support systems (CCDSSs) may improve chronic disease management, which requires recurrent visits to multiple health professionals, ongoing disease and treatment monitoring, and patient behavior modification. The objective of this review was to determine if CCDSSs improve the processes of chronic care (such as diagnosis, treatment, and monitoring of disease) and associated patient outcomes (such as effects on biomarkers and clinical exacerbations).

Methods

We conducted a decision-maker-researcher partnership systematic review. We searched MEDLINE, EMBASE, Ovid's EBM Reviews database, Inspec, and reference lists for potentially eligible articles published up to January 2010. We included randomized controlled trials that compared the use of CCDSSs to usual practice or non-CCDSS controls. Trials were eligible if at least one component of the CCDSS was designed to support chronic disease management. We considered studies 'positive' if they showed a statistically significant improvement in at least 50% of relevant outcomes.

Results

Of 55 included trials, 87% (n = 48) measured system impact on the process of care and 52% (n = 25) of those demonstrated statistically significant improvements. Sixty-five percent (36/55) of trials measured impact on, typically, non-major (surrogate) patient outcomes, and 31% (n = 11) of those demonstrated benefits. Factors of interest to decision makers, such as cost, user satisfaction, system interface and feature sets, unique design and deployment characteristics, and effects on user workflow were rarely investigated or reported.

Conclusions

A small majority (just over half) of CCDSSs improved care processes in chronic disease management and some improved patient health. Policy makers, healthcare administrators, and practitioners should be aware that the evidence of CCDSS effectiveness is limited, especially with respect to the small number and size of studies measuring patient outcomes.

Computerized clinical decision support systems for drug prescribing and management: a decision-maker-researcher partnership systematic review

Background

Computerized clinical decision support systems (CCDSSs) for drug therapy management are designed to promote safe and effective medication use. Evidence documenting the effectiveness of CCDSSs for improving drug therapy is necessary for informed adoption decisions. The objective of this review was to systematically review randomized controlled trials assessing the effects of CCDSSs for drug therapy management on process of care and patient outcomes. We also sought to identify system and study characteristics that predicted benefit.

Methods

We conducted a decision-maker-researcher partnership systematic review. We updated our earlier reviews (1998, 2005) by searching MEDLINE, EMBASE, EBM Reviews, Inspec, and other databases, and consulting reference lists through January 2010. Authors of 82% of included studies confirmed or supplemented extracted data. We included only randomized controlled trials that evaluated the effect on process of care or patient outcomes of a CCDSS for drug therapy management compared to care provided without a CCDSS. A study was considered to have a positive effect (i.e., CCDSS showed improvement) if at least 50% of the relevant study outcomes were statistically significantly positive.

Results

Sixty-five studies met our inclusion criteria, including 41 new studies since our previous review. Methodological quality was generally high and unchanged with time. CCDSSs improved process of care performance in 37 of the 59 studies assessing this type of outcome (64%, 57% of all studies). Twenty-nine trials assessed patient outcomes, of which six trials (21%, 9% of all trials) reported improvements.

Conclusions

CCDSSs inconsistently improved process of care measures and seldomly improved patient outcomes. Lack of clear patient benefit and lack of data on harms and costs preclude a recommendation to adopt CCDSSs for drug therapy management.

Do computerised clinical decision support systems for prescribing change practice? A systematic review of the literature (1990-2007)

BACKGROUND

Computerised clinical decision support systems (CDSSs) are used widely to improve quality of care and patient outcomes. This systematic review evaluated the impact of CDSSs in targeting specific aspects of prescribing, namely initiating, monitoring and stopping therapy. We also examined the influence of clinical setting (institutional vs ambulatory care), system- or user-initiation of CDSS, multi-faceted vs stand alone CDSS interventions and clinical target on practice changes in line with the intent of the CDSS.

METHODS

We searched Medline, Embase and PsychINFO for publications from 1990-2007 detailing CDSS prescribing interventions. Pairs of independent reviewers extracted the key features and prescribing outcomes of methodologically adequate studies (experiments and strong quasi-experiments).

RESULTS

56 studies met our inclusion criteria, 38 addressing initiating, 23 monitoring and three stopping therapy. At the time of initiating therapy, CDSSs appear to be somewhat more effective after, rather than before, drug selection has occurred (7/12 versus 12/26 studies reporting statistically significant improvements in favour of CDSSs on = 50% of prescribing outcomes reported). CDSSs also appeared to be effective for monitoring therapy, particularly using laboratory test reminders (4/7 studies reporting significant improvements in favour of CDSSs on the majority of prescribing outcomes). None of the studies addressing stopping therapy demonstrated impacts in favour of CDSSs over comparators. The most consistently effective approaches used system-initiated advice to fine-tune existing therapy by making recommendations to improve patient safety, adjust the dose, duration or form of prescribed drugs or increase the laboratory testing rates for patients on long-term therapy. CDSSs appeared to perform better in institutional compared to ambulatory settings and when decision support was initiated automatically by the system as opposed to user initiation. CDSSs implemented with other strategies such as education were no more successful in improving prescribing than stand alone interventions. Cardiovascular disease was the most studied clinical target but few studies demonstrated significant improvements on the majority of prescribing outcomes.

CONCLUSION

Our understanding of CDSS impacts on specific aspects of the prescribing process remains relatively limited. Future implementation should build on effective approaches including the use of system-initiated advice to address safety issues and improve the monitoring of therapy.