Clinical Decision Support and Implications for the Clinician Burnout Crisis

What can be done about workplace wellbeing in emergency departments? 'There's no petrol for this Ferrari'

Workplace wellbeing encompasses all aspects of working life. Peak health organisations recognise that poor workplace wellbeing is costly, both to individuals and to the organisation, and the value in promoting healthy workplaces. Workplace wellbeing improves when its barriers are acknowledged and addressed, and protective factors are promoted. The Emergency Department (ED) is a place of intense and challenging activity, exacerbated by high workloads and overcrowding. This impacts negatively on patient care, staff safety and wellbeing. We held focus groups across four EDs to discuss barriers and enablers to wellbeing and found four core themes: Workplace Satisfaction; Barriers to Wellbeing; Organisational Culture that Prioritises Staff Wellbeing; Self-care and Self Compassion. From this, and existing literature, we collaboratively developed a contextualised staff wellbeing framework titled: 'Staff Wellbeing Good Practice Framework: From Surviving to Thriving, How to Protect your Wellbeing in the Emergency Department' that emphasises their values of Competence, Connection and Control.

A randomized, embedded, pragmatic, Bayesian clinical trial examining clinical decision support for high flow nasal cannula management in children with bronchiolitis: design and statistical analysis plan

BACKGROUND

High flow nasal cannula (HFNC) has been increasingly adopted in the past 2 decades as a mode of respiratory support for children hospitalized with bronchiolitis. The growing use of HFNC despite a paucity of high-quality data regarding the therapy's efficacy has led to concerns about overutilization. We developed an electronic health record (EHR) embedded, quality improvement (QI) oriented clinical trial to determine whether standardized management of HFNC weaning guided by clinical decision support (CDS) results in a reduction in the duration of HFNC compared to usual care for children with bronchiolitis.

METHODS

The design and summary of the statistical analysis plan for the REspiratory SupporT for Efficient and cost-Effective Care (REST EEC; "rest easy") trial are presented. The investigators hypothesize that CDS-coupled, standardized HFNC weaning will reduce the duration of HFNC, the trial's primary endpoint, for children with bronchiolitis compared to usual care. Data supporting trial design and eventual analyses are collected from the EHR and other real world data sources using existing informatics infrastructure and QI data sources. The trial workflow, including randomization and deployment of the intervention, is embedded within the EHR of a large children's hospital using existing vendor features. Trial simulations indicate that by assuming a true hazard ratio effect size of 1.27, equivalent to a 6-h reduction in the median duration of HFNC, and enrolling a maximum of 350 children, there will be a > 0.75 probability of declaring superiority (interim analysis posterior probability of intervention effect > 0.99 or final analysis posterior probability of intervention effect > 0.9) and a > 0.85 probability of declaring superiority or the CDS intervention showing promise (final analysis posterior probability of intervention effect > 0.8). Iterative plan-do-study-act cycles are used to monitor the trial and provide targeted education to the workforce.

DISCUSSION

Through incorporation of the trial into usual care workflows, relying on QI tools and resources to support trial conduct, and relying on Bayesian inference to determine whether the intervention is superior to usual care, REST EEC is a learning health system intervention that blends health system operations with active evidence generation to optimize the use of HFNC and associated patient outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05909566. Registered on June 18, 2023.

Evaluation of an electronic prescription platform: Clinicians' feedback on three distinct services aiming to facilitate clinical decision and safer e-prescription

BACKGROUND

Health Care Professionals (HCPs) are the main end-users of digital clinical tools such as electronic prescription systems. For this reason, it is of high importance to include HCPs throughout the design, development and evaluation of a newly introduced system to ensure its usefulness, as well as confirm that it tends to their needs and can be integrated in their everyday clinical practice.

METHODS

In the context of the PrescIT project, an electronic prescription platform with three services was developed (i.e., Prescription Check, Prescription Suggestion, Therapeutic Prescription Monitoring). To allow an iterative process of discovery through user feedback, design and implementation, a two-phase evaluation was carried out, with the participation of HCPs from three hospitals in Northern Greece. The two-phase evaluation included presentations of the platform, followed by think-aloud sessions, individual platform testing and the collection of qualitative as well as quantitative feedback, through standard questionnaires (e.g., SUS, PSSUQ).

RESULTS

Twenty one HCPs (8 in the first, 18 in the second phase, and five present in both) participated in the two-phase evaluation. HCPs comprised clinicians varying in their specialty and one pharmacist. Clinicians' feedback during the first evaluation phase already deemed usability as "excellent" (with SUS scores ranging from 75 to 95/100, showing a mean value of 86.6 and SD of 9.2) but also provided additional user requirements, which further shaped and improved the services. In the second evaluation phase, clinicians explored the system's usability, and identified the services' strengths and weaknesses. Clinicians perceived the platform as useful, as it provides information on potential adverse drug reactions, drug-to-drug interactions and suggests medications that are compatible with patients' comorbidities and current medication.

CONCLUSIONS

The developed PrescIT platform aims to increase overall safety and effectiveness of healthcare services. Therefore, including clinicians in a two-phase evaluation confirmed that the introduced system is useful, tends to the users' needs, does not create fatigue and can be integrated in their everyday clinical practice to support clinical decision and e-prescribing.

Evaluating the Prevalence of Burnout Among Health Care Professionals Related to Electronic Health Record Use: Systematic Review and Meta-Analysis

BACKGROUND

Burnout among health care professionals is a significant concern, with detrimental effects on health care service quality and patient outcomes. The use of the electronic health record (EHR) system has been identified as a significant contributor to burnout among health care professionals.

OBJECTIVE

This systematic review and meta-analysis aims to assess the prevalence of burnout among health care professionals associated with the use of the EHR system, thereby providing evidence to improve health information systems and develop strategies to measure and mitigate burnout.

METHODS

We conducted a comprehensive search of the PubMed, Embase, and Web of Science databases for English-language peer-reviewed articles published between January 1, 2009, and December 31, 2022. Two independent reviewers applied inclusion and exclusion criteria, and study quality was assessed using the Joanna Briggs Institute checklist and the Newcastle-Ottawa Scale. Meta-analyses were performed using R (version 4.1.3; R Foundation for Statistical Computing), with EndNote X7 (Clarivate) for reference management.

RESULTS

The review included 32 cross-sectional studies and 5 case-control studies with a total of 66,556 participants, mainly physicians and registered nurses. The pooled prevalence of burnout among health care professionals in cross-sectional studies was 40.4% (95% CI 37.5%-43.2%). Case-control studies indicated a higher likelihood of burnout among health care professionals who spent more time on EHR-related tasks outside work (odds ratio 2.43, 95% CI 2.31-2.57).

CONCLUSIONS

The findings highlight the association between the increased use of the EHR system and burnout among health care professionals. Potential solutions include optimizing EHR systems, implementing automated dictation or note-taking, employing scribes to reduce documentation burden, and leveraging artificial intelligence to enhance EHR system efficiency and reduce the risk of burnout.

TRIAL REGISTRATION

PROSPERO International Prospective Register of Systematic Reviews CRD42021281173; https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021281173.

Application of a user experience design approach for an EHR-based clinical decision support system

Objective

We applied a user experience (UX) design approach to clinical decision support (CDS) tool development for the specific use case of pediatric asthma. Our objective was to understand physicians' workflows, decision-making processes, barriers (ie, pain points), and facilitators to increase usability of the tool.

Materials and methods

We used a mixed-methods approach with semi-structured interviews and surveys. The coded interviews were synthesized into physician-user journey maps (ie, visualization of a process to accomplish goals) and personas (ie, user types). Interviews were conducted via video. We developed physician journey maps and user personas informed by their goals, systems interactions, and experiences with pediatric asthma management.

Results

The physician end-user personas identified were: efficiency, relationship, and learning. Features of a potential asthma CDS tool sought varied by physician practice type and persona. It was important to the physician end-user that the asthma CDS tool demonstrate value by lowering workflow friction (ie, difficulty or obstacles), improving the environment surrounding physicians and patients, and using it as a teaching tool. Customizability versus standardization were important considerations for uptake.

Discussion

Different values and motivations of physicians influence their use and interaction with the EHR and CDS tools. These different perspectives can be captured by applying a UX design approach to the development process. For example, with the importance of customizability, one approach may be to build a core module with variations depending on end-user preference.

Conclusion

A UX approach can drive design to help understand physician-users and meet their needs; ultimately with the goal of increased uptake.

Development and Validation of Inpatient Hypoglycemia Models Centered Around the Insulin Ordering Process

BACKGROUND

The insulin ordering process is an opportunity to provide clinicians with hypoglycemia risk predictions, but few hypoglycemia models centered around the insulin ordering process exist.

METHODS

We used data on adult patients, admitted in 2019 to non-ICU floors of a large teaching hospital, who had orders for subcutaneous insulin. Our outcome was hypoglycemia, defined as a blood glucose (BG) <70 mg/dL within 24 hours after ordering insulin. We trained and evaluated models to predict hypoglycemia at the time of placing an insulin order, using logistic regression, random forest, and extreme gradient boosting (XGBoost). We compared performance using area under the receiver operating characteristic curve (AUCs) and precision-recall curves. We determined recall at our goal precision of 0.30.

RESULTS

Of 21 052 included insulin orders, 1839 (9%) were followed by a hypoglycemic event within 24 hours. Logistic regression, random forest, and XGBoost models had AUCs of 0.81, 0.80, and 0.79, and recall of 0.44, 0.49, and 0.32, respectively. The most significant predictor was the lowest BG value in the 24 hours preceding the order. Predictors related to the insulin order being placed at the time of the prediction were useful to the model but less important than the patient's history of BG values over time.

CONCLUSIONS

Hypoglycemia within the next 24 hours can be predicted at the time an insulin order is placed, providing an opportunity to integrate decision support into the medication ordering process to make insulin therapy safer.

Resident-Driven Clinical Decision Support Governance to Improve the Utility of Clinical Decision Support

OBJECTIVES

 This resident-driven quality improvement project aimed to better understand the known problem of a misaligned clinical decision support (CDS) strategy and improve CDS utilization.

METHODS

 An internal survey was sent to all internal medicine (IM) residents to identify the most bothersome CDS alerts. Survey results were supported by electronic health record (EHR) data of CDS firing rates and response rates which were collected for each of the three most bothersome CDS tools. Changes to firing criteria were created to increase utilization and to better align with the five rights of CDS. Findings and proposed changes were presented to our institution's CDS Governance Committee. Changes were approved and implemented. Postintervention firing rates were then collected for 1 week.

RESULTS

 Twenty nine residents participated in the CDS survey and identified sepsis alerts, lipid profile reminders, and telemetry renewals to be the most bothersome alerts. EHR data showed action rates for these CDS as low as 1%. We implemented changes to focus emergency department (ED)-based sepsis alerts to the right provider, better address the right information for lipid profile reminders, and select the right time in workflow for telemetry renewals to be most effective. With these changes we successfully eliminated ED-based sepsis CDS reminders for IM providers, saw a 97% reduction in firing rates for the lipid profile CDS, and noted a 55% reduction in firing rates for telemetry CDS.

CONCLUSION

 This project highlighted that alert improvements spearheaded by resident teams can be completed successfully using robust CDS governance strategies and can effectively optimize interruptive alerts.

Using Clinical Decision Support Systems to Decrease Intravenous Acetaminophen Use: Implementation and Lessons Learned

BACKGROUND

Clinical decision support systems (CDSS) can enhance medical decision-making by providing targeted information to providers. While they have the potential to improve quality of care and reduce costs, they are not universally effective and can lead to unintended harm.

OBJECTIVES

To describe the implementation of an unsuccessful interruptive CDSS that aimed to promote appropriate use of intravenous (IV) acetaminophen at an academic pediatric hospital, with an emphasis on lessons learned.

METHODS

Quality improvement methodology was used to study the effect of an interruptive CDSS, which set a mandatory expiry time of 24 hours for all IV acetaminophen orders. This CDSS was implemented on April 5, 2021. The primary outcome measure was number of IV acetaminophen administrations per 1,000 patient days, measured pre- and postimplementation. Process measures were the number of IV acetaminophen orders placed per 1,000 patient days. Balancing measures were collected via survey data and included provider and nursing acceptability and unintended consequences of the CDSS.

RESULTS

There was no special cause variation in hospital-wide IV acetaminophen administrations and orders after CDSS implementation, nor when the CDSS was removed. A total of 88 participants completed the survey. Nearly half (40/88) of respondents reported negative issues with the CDSS, with the majority stating that this affected patient care (39/40). Respondents cited delays in patient care and reduced efficiency as the most common negative effects.

CONCLUSION

This study underscores the significance of monitoring CDSS implementations and including end user acceptability as an outcome measure. Teams should be prepared to modify or remove CDSS that do not achieve their intended goal or are associated with low end user acceptability. CDSS holds promise for improving clinical practice, but careful implementation and ongoing evaluation are crucial for maximizing their benefits and minimizing potential harm.

Machine Learning and Artificial Intelligence Applications to Epilepsy: a Review for the Practicing Epileptologist

PURPOSE OF REVIEW

Machine Learning (ML) and Artificial Intelligence (AI) are data-driven techniques to translate raw data into applicable and interpretable insights that can assist in clinical decision making. Some of these tools have extremely promising initial results, earning both great excitement and creating hype. This non-technical article reviews recent developments in ML/AI in epilepsy to assist the current practicing epileptologist in understanding both the benefits and limitations of integrating ML/AI tools into their clinical practice.

RECENT FINDINGS

ML/AI tools have been developed to assist clinicians in almost every clinical decision including (1) predicting future epilepsy in people at risk, (2) detecting and monitoring for seizures, (3) differentiating epilepsy from mimics, (4) using data to improve neuroanatomic localization and lateralization, and (5) tracking and predicting response to medical and surgical treatments. We also discuss practical, ethical, and equity considerations in the development and application of ML/AI tools including chatbots based on Large Language Models (e.g., ChatGPT). ML/AI tools will change how clinical medicine is practiced, but, with rare exceptions, the transferability to other centers, effectiveness, and safety of these approaches have not yet been established rigorously. In the future, ML/AI will not replace epileptologists, but epileptologists with ML/AI will replace epileptologists without ML/AI.

Beyond the override: Using evidence of previous drug tolerance to suppress drug allergy alerts; a retrospective study of opioid alerts

OBJECTIVE

Despite the extensive literature exploring alert fatigue, most studies have focused on describing the phenomenon, but not on fixing it. The authors aimed to identify data useful to avert clinically irrelevant alerts to inform future research on clinical decision support (CDS) design.

METHODS

We conducted a retrospective observational study of opioid drug allergy alert (DAA) overrides for the calendar year of 2019 at a large academic medical center, to identify data elements useful to find irrelevant alerts to be averted.

RESULTS

Overall, 227,815 DAAs were fired in 2019, with an override rate of 91 % (n = 208196). Opioids represented nearly two-thirds of these overrides (n = 129063; 62 %) and were the drug class with the highest override rate (96 %). On average, 29 opioid DAAs were overridden per patient. While most opioid alerts (97.1 %) are fired for a possible match (the drug class of the allergen matches the drug class of the prescribed drug), they are overridden significantly less frequently for definite match (exact match between allergen and prescribed drug) (88 % vs. 95.9 %, p < 0.001). When comparing the triggering drug with previously administered drugs, override rates were equally high for both definite match (95.9 %), no match (95.5 %), and possible match (95.1 %). Likewise, when comparing to home medications, overrides were excessively high for possible match (96.3 %), no match (96 %), and definite match (94.4 %).

CONCLUSION

We estimate that 74.5% of opioid DAAs (46.4% of all DAAs) at our institution could be relatively safely averted, since they either have a definite match for previous inpatient administrations suggesting drug tolerance or are fired as possible match with low risk of cross-sensitivity. Future research should focus on identifying other relevant data elements ideally with automated methods and use of emerging standards to empower CDS systems to suppress false-positive alerts while avoiding safety hazards.

Development and Integration of Machine Learning Algorithm to Identify Peripheral Arterial Disease: Multistakeholder Qualitative Study

BACKGROUND

Machine learning (ML)-driven clinical decision support (CDS) continues to draw wide interest and investment as a means of improving care quality and value, despite mixed real-world implementation outcomes.

OBJECTIVE

This study aimed to explore the factors that influence the integration of a peripheral arterial disease (PAD) identification algorithm to implement timely guideline-based care.

METHODS

A total of 12 semistructured interviews were conducted with individuals from 3 stakeholder groups during the first 4 weeks of integration of an ML-driven CDS. The stakeholder groups included technical, administrative, and clinical members of the team interacting with the ML-driven CDS. The ML-driven CDS identified patients with a high probability of having PAD, and these patients were then reviewed by an interdisciplinary team that developed a recommended action plan and sent recommendations to the patient's primary care provider. Pseudonymized transcripts were coded, and thematic analysis was conducted by a multidisciplinary research team.

RESULTS

Three themes were identified: positive factors translating in silico performance to real-world efficacy, organizational factors and data structure factors affecting clinical impact, and potential challenges to advancing equity. Our study found that the factors that led to successful translation of in silico algorithm performance to real-world impact were largely nontechnical, given adequate efficacy in retrospective validation, including strong clinical leadership, trustworthy workflows, early consideration of end-user needs, and ensuring that the CDS addresses an actionable problem. Negative factors of integration included failure to incorporate the on-the-ground context, the lack of feedback loops, and data silos limiting the ML-driven CDS. The success criteria for each stakeholder group were also characterized to better understand how teams work together to integrate ML-driven CDS and to understand the varying needs across stakeholder groups.

CONCLUSIONS

Longitudinal and multidisciplinary stakeholder engagement in the development and integration of ML-driven CDS underpins its effective translation into real-world care. Although previous studies have focused on the technical elements of ML-driven CDS, our study demonstrates the importance of including administrative and operational leaders as well as an early consideration of clinicians' needs. Seeing how different stakeholder groups have this more holistic perspective also permits more effective detection of context-driven health care inequities, which are uncovered or exacerbated via ML-driven CDS integration through structural and organizational challenges. Many of the solutions to these inequities lie outside the scope of ML and require coordinated systematic solutions for mitigation to help reduce disparities in the care of patients with PAD.

The Impact of Clinical Decision Support on Health Disparities and the Digital Divide

OBJECTIVES

This literature review summarizes relevant studies from the last three years (2020-2022) related to clinical decision support (CDS) and CDS impact on health disparities and the digital divide. This survey identifies current trends and synthesizes evidence-based recommendations and considerations for future development and implementation of CDS tools.

METHODS

We conducted a search in PubMed for literature published between 2020 and 2022. Our search strategy was constructed as a combination of the MEDLINE®/PubMed® Health Disparities and Minority Health Search Strategy and relevant CDS MeSH terms and phrases. We then extracted relevant data from the studies, including priority population when applicable, domain of influence on the disparity being addressed, and the type of CDS being used. We also made note of when a study discussed the digital divide in some capacity and organized the comments into general themes through group discussion.

RESULTS

Our search yielded 520 studies, with 45 included at the conclusion of screening. The most frequent CDS type in this review was point-of-care alerts/reminders (33.3%). Health Care System was the most frequent domain of influence (71.1%), and Blacks/African Americans were the most frequently included priority population (42.2%). Throughout the literature, we found four general themes related to the technology divide: inaccessibility of technology, access to care, trust of technology, and technology literacy.This survey revealed the diversity of CDS being used to address health disparities and several barriers which may make CDS less effective or potentially harmful to certain populations. Regular examinations of literature that feature CDS and address health disparities can help to reveal new strategies and patterns for improving healthcare.

Differences in Use of Clinical Decision Support Tools and Implementation of Aspirin, Blood Pressure Control, Cholesterol Management, and Smoking Cessation Quality Metrics in Small Practices by Race and Sex

Importance

Practice-level evidence is needed to clarify the value of population-based clinical decision support (CDS) tools in reducing racial and sex disparities in cardiovascular care.

Objective

To evaluate the association between CDS tools and racial and sex disparities in the aspirin use, blood pressure control, cholesterol management, and smoking cessation (ABCS) care quality metrics among smaller primary care practices.

Design, Setting, and Participants

This cross-sectional study used practice-level data from the Agency for Healthcare Research and Quality-funded EvidenceNOW initiative. The national initiative from May 1, 2015, to April 30, 2021, spanned 12 US states and focused on improving cardiovascular preventive care by providing quality improvement support to smaller primary care practices. A total of 576 primary care practices in EvidenceNOW submitted both survey data and electronic health record (EHR)-derived ABCS data stratified by race and sex.

Main Outcomes and Measures

Practice-level estimates of disparities between Black and White patients and between male and female patients were calculated as the difference in proportions of eligible patients within each practice meeting ABCS care quality metrics. The association between CDS tools (EHR prompts, standing orders, and clinical registries) and disparities was evaluated by multiply imputed multivariable models for each CDS tool, adjusted for practice rurality, ownership, and size.

Results

Across the 576 practices included in the analysis, 219 (38.0%) had patient panels that were more than half White and 327 (56.8%) had panels that were more than half women. The proportion of White compared with Black patients meeting metrics for blood pressure (difference, 5.16% [95% CI, 4.29%-6.02%]; P < .001) and cholesterol management (difference, 1.49% [95% CI, 0.04%-2.93%] P = .04) was higher; the proportion of men meeting metrics for aspirin use (difference, 4.36% [95% CI, 3.34%-5.38%]; P < .001) and cholesterol management (difference, 3.88% [95% CI, 3.14%-4.63%]; P < .001) was higher compared with women. Conversely, the proportion of women meeting practice blood pressure control (difference, -1.80% [95% CI, -2.32% to -1.28%]; P < .001) and smoking cessation counseling (difference, -1.67% [95% CI, -2.38% to -0.95%]; P < .001) metrics was higher compared with men. Use of CDS tools was not associated with differences in race or sex disparities except for the smoking metric. Practices using CDS tools showed a higher proportion of men meeting the smoking counseling metric than women (coefficient, 3.82 [95% CI, 0.95-6.68]; P = .009).

Conclusions and Relevance

The findings of this cross-sectional study suggest that practices using CDS tools had small disparities that were not statistically significant, but CDS tools were not associated with reductions in disparities. More research is needed on effective practice-level interventions to mitigate disparities.

The effectiveness of a noninterruptive alert to increase prescription of take-home naloxone in emergency departments

OBJECTIVE

Opioid-related overdose (OD) deaths continue to increase. Take-home naloxone (THN), after treatment for an OD in an emergency department (ED), is a recommended but under-utilized practice. To promote THN prescription, we developed a noninterruptive decision support intervention that combined a detailed OD documentation template with a reminder to use the template that is automatically inserted into a provider's note by decision rules. We studied the impact of the combined intervention on THN prescribing in a longitudinal observational study.

METHODS

ED encounters involving an OD were reviewed before and after implementation of the reminder embedded in the physicians' note to use an advanced OD documentation template for changes in: (1) use of the template and (2) prescription of THN. Chi square tests and interrupted time series analyses were used to assess the impact. Usability and satisfaction were measured using the System Usability Scale (SUS) and the Net Promoter Score.

RESULTS

In 736 OD cases defined by International Classification of Disease version 10 diagnosis codes (247 prereminder and 489 postreminder), the documentation template was used in 0.0% and 21.3%, respectively (P < .0001). The sensitivity and specificity of the reminder for OD cases were 95.9% and 99.8%, respectively. Use of the documentation template led to twice the rate of prescribing of THN (25.7% vs 50.0%, P < .001). Of 19 providers responding to the survey, 74% of SUS responses were in the good-to-excellent range and 53% of providers were Net Promoters.

CONCLUSIONS

A noninterruptive decision support intervention was associated with higher THN prescribing in a pre-post study across a multiinstitution health system.

Clinician interest in clinical decision support for PSA-based prostate cancer screening

OBJECTIVE

To evaluate the interest of primary care clinicians in utilizing CDS for PSA screening. Evidence suggests that electronic clinical decision support (CDS) may decrease low-value prostate-specific antigen (PSA) testing. However, physician attitudes towards CDS for PSA screening are largely unknown.

METHODS

A survey was sent to 201 primary care clinicians, including both physicians and Advanced Practice Providers (APP), within a large academic health system. Eligible clinicians cared for male patients aged 40 to 80 years and ordered ≥5 PSA tests in the past year. Respondents were stratified into 3 groups, appropriate screeners, low-value screeners, or rare-screeners, based on responses to survey questions assessing PSA screening practices. The degree of interest in electronic CDS was determined via a composite Likert score comprising relevant survey items.

RESULTS

Survey response rate was 29% (59/201) consisting of 85% MD/DO and 15% APP respondents. All clinicians surveyed were interested in CDS (P < 0.001) without significant difference between screener groups. Clinicians agreed most uniformly that CDS be evidence-based. Clinicians disagreed on whether CDS would decrease professional discretion over patient decisions.

CONCLUSIONS

Primary care clinicians are interested in CDS for PSA screening regardless of their current screening practices. Prioritizing CDS features that clinicians value, such as ensuring CDS recommendations are evidence-based, may increase the likelihood of successful implementation, whereas perceived threat to autonomy may be a hinderance to utilization.

Artificial intelligence-based clinical decision support in pediatrics

Machine learning models may be integrated into clinical decision support (CDS) systems to identify children at risk of specific diagnoses or clinical deterioration to provide evidence-based recommendations. This use of artificial intelligence models in clinical decision support (AI-CDS) may have several advantages over traditional "rule-based" CDS models in pediatric care through increased model accuracy, with fewer false alerts and missed patients. AI-CDS tools must be appropriately developed, provide insight into the rationale behind decisions, be seamlessly integrated into care pathways, be intuitive to use, answer clinically relevant questions, respect the content expertise of the healthcare provider, and be scientifically sound. While numerous machine learning models have been reported in pediatric care, their integration into AI-CDS remains incompletely realized to date. Important challenges in the application of AI models in pediatric care include the relatively lower rates of clinically significant outcomes compared to adults, and the lack of sufficiently large datasets available necessary for the development of machine learning models. In this review article, we summarize key concepts related to AI-CDS, its current application to pediatric care, and its potential benefits and risks. IMPACT: The performance of clinical decision support may be enhanced by the utilization of machine learning-based algorithms to improve the predictive performance of underlying models. Artificial intelligence-based clinical decision support (AI-CDS) uses models that are experientially improved through training and are particularly well suited toward high-dimensional data. The application of AI-CDS toward pediatric care remains limited currently but represents an important area of future research.

Multidisciplinary Approach to Improve Human Immunodeficiency Virus and Syphilis Testing Rates in Emergency Departments

BACKGROUND

Best practice guidelines recommend that patients at risk for sexually transmitted infections (STIs), such as gonorrhea (GC) and chlamydia, should also be tested for human immunodeficiency virus (HIV) and syphilis. This prospective quality assurance study aimed to increase HIV and syphilis testing rates in emergency departments (EDs) across the Cleveland Clinic Health System from January 1, 2020 through January 1, 2022.

METHODS

A multidisciplinary team of emergency medicine, infectious diseases, pharmacy, and microbiology personnel convened to identify barriers to HIV and syphilis testing during ED encounters at which GC/chlamydia were tested. The following interventions were implemented in response: rapid HIV testing with new a workflow for results follow-up, a standardized STI-screening order panel, and feedback to clinicians about ordering patterns.

RESULTS

There were 57 797 ED visits with GC/chlamydia testing completed during the study period. Human immunodeficiency virus testing was ordered at 5% of these encounters before the interventions were implemented and increased to 8%, 23%, and 36% after each successive intervention. Syphilis testing increased from 9% before the interventions to 12%, 28%, and 39% after each successive intervention. In multivariable analyses adjusted for age, gender, and location, the odds ratio for HIV and syphilis testing after all interventions was 11.72 (95% confidence interval [CI], 10.82-12.71; P ≤.001) and 6.79 (95% CI, 6.34-7.27; P ≤.001), respectively.

CONCLUSIONS

The multidisciplinary intervention resulted in improved testing rates for HIV and syphilis.

Barriers and enablers to implementing and using clinical decision support systems for chronic diseases: a qualitative systematic review and meta-aggregation

Background

Clinical decision support (CDS) is increasingly used to facilitate chronic disease care. Despite increased availability of electronic health records and the ongoing development of new CDS technologies, uptake of CDS into routine clinical settings is inconsistent. This qualitative systematic review seeks to synthesise healthcare provider experiences of CDS—exploring the barriers and enablers to implementing, using, evaluating, and sustaining chronic disease CDS systems.

Methods

A search was conducted in Medline, CINAHL, APA PsychInfo, EconLit, and Web of Science from 2011 to 2021. Primary research studies incorporating qualitative findings were included if they targeted healthcare providers and studied a relevant chronic disease CDS intervention. Relevant CDS interventions were electronic health record-based and addressed one or more of the following chronic diseases: cardiovascular disease, diabetes, chronic kidney disease, hypertension, and hypercholesterolaemia. Qualitative findings were synthesised using a meta-aggregative approach.

Results

Thirty-three primary research articles were included in this qualitative systematic review. Meta-aggregation of qualitative data revealed 177 findings and 29 categories, which were aggregated into 8 synthesised findings. The synthesised findings related to clinical context, user, external context, and technical factors affecting CDS uptake. Key barriers to uptake included CDS systems that were simplistic, had limited clinical applicability in multimorbidity, and integrated poorly into existing workflows. Enablers to successful CDS interventions included perceived usefulness in providing relevant clinical knowledge and structured chronic disease care; user confidence gained through training and post training follow-up; external contexts comprised of strong clinical champions, allocated personnel, and technical support; and CDS technical features that are both highly functional, and attractive.

Conclusion

This systematic review explored healthcare provider experiences, focussing on barriers and enablers to CDS use for chronic diseases. The results provide an evidence-base for designing, implementing, and sustaining future CDS systems. Based on the findings from this review, we highlight actionable steps for practice and future research.

Trial registration

PROSPERO CRD42020203716

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00326-x.

Causal deep learning reveals the comparative effectiveness of antihyperglycemic treatments in poorly controlled diabetes

Type-2 diabetes is associated with severe health outcomes, the effects of which are responsible for approximately 1/4^th of the total healthcare spending in the United States (US). Current treatment guidelines endorse a massive number of potential anti-hyperglycemic treatment options in various combinations. Strategies for optimizing treatment selection are lacking. Real-world data from a nationwide population of over one million high-risk diabetic patients (HbA1c ≥ 9%) in the US is analyzed to evaluate the comparative effectiveness for HbA1c reduction in this population of more than 80 different treatment strategies ranging from monotherapy up to combinations of five concomitant classes of drugs across each of 10 clinical cohorts defined by age, insulin dependence, and a number of other chronic conditions. A causal deep learning approach developed on such data allows for more personalized evaluation of treatment selection. An average confounder-adjusted reduction in HbA1c of 0.69% [-0.75, -0.65] is observed between patients receiving high vs low ranked treatments across cohorts for which the difference was significant. This method can be extended to explore treatment optimization for other chronic conditions.

Evaluating the Impact of a Point-of-Care Cardiometabolic Clinical Decision Support Tool on Clinical Efficiency Using Electronic Health Record Audit Log Data: Algorithm Development and Validation

Background

Electronic health record (EHR) systems are becoming increasingly complicated, leading to concerns about rising physician burnout, particularly for primary care physicians (PCPs). Managing the most common cardiometabolic chronic conditions by PCPs during a limited clinical time with a patient is challenging.

Objective

This study aimed to evaluate a Cardiometabolic Sutter Health Advanced Reengineered Encounter (CM-SHARE), a web-based application to visualize key EHR data, on the EHR use efficiency.

Methods

We developed algorithms to identify key clinic workflow measures (eg, total encounter time, total physician time in the examination room, and physician EHR time in the examination room) using audit data, and we validated and calibrated the measures with time-motion data. We used a pre-post parallel design to identify propensity score–matched CM-SHARE users (cases), nonusers (controls), and nested-matched patients. Cardiometabolic encounters from matched case and control patients were used for the workflow evaluation. Outcome measures were compared between the cases and controls. We applied this approach separately to both the CM-SHARE pilot and spread phases.

Results

Time-motion observation was conducted on 101 primary care encounters for 9 PCPs in 3 clinics. There was little difference (<0.8 minutes) between the audit data–derived workflow measures and the time-motion observation. Two key unobservable times from audit data, physician entry into and exiting the examination room, were imputed based on time-motion studies. CM-SHARE was launched with 6 pilot PCPs in April 2016. During the prestudy period (April 1, 2015, to April 1, 2016), 870 control patients with 2845 encounters were matched with 870 case patients and encounters, and 727 case patients with 852 encounters were matched with 727 control patients and 3754 encounters in the poststudy period (June 1, 2016, to June 30, 2017). Total encounter time was slightly shorter (mean −2.7, SD 1.4 minutes, 95% CI −4.7 to −0.9; mean –1.6, SD 1.1 minutes, 95% CI −3.2 to −0.1) for cases than controls for both periods. CM-SHARE saves physicians approximately 2 minutes EHR time in the examination room (mean −2.0, SD 1.3, 95% CI −3.4 to −0.9) compared with prestudy period and poststudy period controls (mean −1.9, SD 0.9, 95% CI −3.8 to −0.5). In the spread phase, 48 CM-SHARE spread PCPs were matched with 84 control PCPs and 1272 cases with 3412 control patients, having 1119 and 4240 encounters, respectively. A significant reduction in total encounter time for the CM-SHARE group was observed for short appointments (≤20 minutes; 5.3-minute reduction on average) only. Total physician EHR time was significantly reduced for both longer and shorter appointments (17%-33% reductions).

Conclusions

Combining EHR audit log files and clinical information, our approach offers an innovative and scalable method and new measures that can be used to evaluate clinical EHR efficiency of digital tools used in clinical settings.

Human-centered design of clinical decision support for management of hypertension with chronic kidney disease

Background

Primary care providers face challenges in recognizing and controlling hypertension in patients with chronic kidney disease (CKD). Clinical decision support (CDS) has the potential to aid clinicians in identifying patients who could benefit from medication changes. This study designed an alert to control hypertension in CKD patients using an iterative human-centered design process.

Methods

In this study, we present a human-centered design process employing multiple methods for gathering user requirements and feedback on design and usability. Initially, we conducted contextual inquiry sessions to gather user requirements for the CDS. This was followed by group design sessions and one-on-one formative think-aloud sessions to validate requirements, obtain feedback on the design and layout, uncover usability issues, and validate changes.

Results

This study included 20 participants. The contextual inquiry produced 10 user requirements which influenced the initial alert design. The group design sessions revealed issues related to several themes, including recommendations and clinical content that did not match providers' expectations and extraneous information on the alerts that did not provide value. Findings from the individual think-aloud sessions revealed that participants disagreed with some recommended clinical actions, requested additional information, and had concerns about the placement in their workflow. Following each step, iterative changes were made to the alert content and design.

Discussion

This study showed that participation from users throughout the design process can lead to a better understanding of user requirements and optimal design, even within the constraints of an EHR alerting system. While raising awareness of design needs, it also revealed concerns related to workflow, understandability, and relevance.

Conclusion

The human-centered design framework using multiple methods for CDS development informed the creation of an alert to assist in the treatment and recognition of hypertension in patients with CKD.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12911-022-01962-y.

Design, effectiveness, and economic outcomes of contemporary chronic disease clinical decision support systems: a systematic review and meta-analysis

Objectives

Electronic health record-based clinical decision support (CDS) has the potential to improve health outcomes. This systematic review investigates the design, effectiveness, and economic outcomes of CDS targeting several common chronic diseases.

Material and Methods

We conducted a search in PubMed (Medline), EBSCOHOST (CINAHL, APA PsychInfo, EconLit), and Web of Science. We limited the search to studies from 2011 to 2021. Studies were included if the CDS was electronic health record-based and targeted one or more of the following chronic diseases: cardiovascular disease, diabetes, chronic kidney disease, hypertension, and hypercholesterolemia. Studies with effectiveness or economic outcomes were considered for inclusion, and a meta-analysis was conducted.

Results

The review included 76 studies with effectiveness outcomes and 9 with economic outcomes. Of the effectiveness studies, 63% described a positive outcome that favored the CDS intervention group. However, meta-analysis demonstrated that effect sizes were heterogenous and small, with limited clinical and statistical significance. Of the economic studies, most full economic evaluations (n = 5) used a modeled analysis approach. Cost-effectiveness of CDS varied widely between studies, with an estimated incremental cost-effectiveness ratio ranging between USD$2192 to USD$151 955 per QALY.

Conclusion

We summarize contemporary chronic disease CDS designs and evaluation results. The effectiveness and cost-effectiveness results for CDS interventions are highly heterogeneous, likely due to differences in implementation context and evaluation methodology. Improved quality of reporting, particularly from modeled economic evaluations, would assist decision makers to better interpret and utilize results from these primary research studies.

Registration

PROSPERO (CRD42020203716)

Managing the Mental Health of Healthcare Professionals in Times of Crisis: The Aruban COVID-19 Experience

Hospital workers in Aruba have been facing an increased demand for healthcare in the unique setting of a Small Island Developing State (SIDS). This study assessed the impact of the first wave of the SARS-CoV-2 pandemic on the mental health of staff at the major hospital in Aruba, examining the differences between employee groups, with the goal of providing recommendations for targeted support and coping strategies in future crises in a small island setting. Patients and methods: In a mixed-method cohort design, Dr. Horacio E. Oduber Hospital staff were asked to complete a 25-item questionnaire about their concerns and worries, organization of work, and general wellbeing; 24% of the hospital staff filled in the questionnaire (mean age 41 ± 11 years, 79% female). Alongside the needs assessment questionnaire, six focus groups were established to explore staff feelings on specific measures taken by hospital management during the COVID-19 crisis. Results: Questionnaire analysis (n = 231) revealed employees’ concerns about infecting their relatives and their financial stability. In particular, nurses were significantly more concerned than other staff groups. In the wellbeing section of the questionnaire, items regarding future security scored poorest, alongside increased levels of tiredness and nervousness. Focus groups discussions revealed frustrations of the hospital staff with the foreign staff brought in to help during the crisis and a need for better leadership and communication practices from hospital management. Conclusions: Comprehensive and holistic approaches should be implemented by the hospital management to prevent occupational burnout and demoralized work ethics and further emotional exhaustion.

Implementation of an Electronic Health Record Integrated Clinical Pathway Improves Adherence to COVID-19 Hospital Care Guidelines

BACKGROUND

During the COVID-19 pandemic, frequently changing guidelines presented challenges to emergency department (ED) clinicians. The authors implemented an electronic health record (EHR)-integrated clinical pathway that could be accessed by clinicians within existing workflows when caring for patients under investigation (PUI) for COVID-19. The objective was to examine the association between clinical pathway utilization and adherence to institutional best practice treatment recommendations for COVID-19.

METHODS

The authors conducted an observational analysis of all ED patients seen in a health system inclusive of seven EDs between March 18, 2020, and April 20, 2021. They implemented the pathway as an interactive flow chart that allowed clinicians to place orders while viewing the most up-to-date institutional guidance. Primary outcomes were proportion of admitted PUIs receiving dexamethasone and aspirin in the ED, and secondary outcome was time to delivering treatment.

RESULTS

A total of 13 269 patients were admitted PUIs. The pathway was used by 40.6% of ED clinicians. When clinicians used the pathway, patients were more likely to be prescribed aspirin (OR, 7.15; 95% CI, 6.2-8.26) and dexamethasone (10.4; 8.85-12.2). For secondary outcomes, clinicians using the pathway had statistically significant ( P < 0.0001) improvement in timeliness of ordering medications and admission to the hospital. Aspirin, dexamethasone, and admission order time were improved by 103.89, 94.34, and 121.94 minutes, respectively.

CONCLUSIONS

The use of an EHR-integrated clinical pathway improved clinician adherence to changing COVID-19 treatment guidelines and timeliness to associated medication administration. As pathways continue to be implemented, their effects on improving patient outcomes and decreasing disparities in patient care should be further examined.

Barriers to and Facilitators for Acceptance of Comprehensive Clinical Decision Support System-Driven Care Maps for Patients With Thoracic Trauma: Interview Study Among Health Care Providers and Nurses

BACKGROUND

Comprehensive clinical decision support (CDS) care maps can improve the delivery of care and clinical outcomes. However, they are frequently plagued by usability problems and poor user acceptance.

OBJECTIVE

This study aims to characterize factors influencing successful design and use of comprehensive CDS care maps and identify themes associated with end-user acceptance of a thoracic trauma CDS care map earlier in the process than has traditionally been done. This was a planned adaptive redesign stage of a User Acceptance and System Adaptation Design development and implementation strategy for a CDS care map. This stage was based on a previously developed prototype CDS care map guided by the Unified Theory of Acceptance and Use of Technology.

METHODS

A total of 22 multidisciplinary end users (physicians, advanced practice providers, and nurses) were identified and recruited using snowball sampling. Qualitative interviews were conducted, audio-recorded, and transcribed verbatim. Generation of prespecified codes and the interview guide was informed by the Unified Theory of Acceptance and Use of Technology constructs and investigative team experience. Interviews were blinded and double-coded. Thematic analysis of interview scripts was conducted and yielded descriptive themes about factors influencing the construction and potential use of an acceptable CDS care map.

RESULTS

A total of eight dominant themes were identified: alert fatigue (theme 1), automation (theme 2), redundancy (theme 3), minimalistic design (theme 4), evidence based (theme 5), prevent errors (theme 6), comprehensive across the spectrum of disease (theme 7), and malleability (theme 8). Themes 1 to 4 addressed factors directly affecting end users, and themes 5 to 8 addressed factors affecting patient outcomes. More experienced providers prioritized a system that is easy to use. Nurses prioritized a system that incorporated evidence into decision support. Clinicians across specialties, roles, and ages agreed that the amount of extra work generated should be minimal and that the system should help them administer optimal care efficiently.

CONCLUSIONS

End user feedback reinforces attention toward factors that improve the acceptance and use of a CDS care map for patients with thoracic trauma. Common themes focused on system complexity, the ability of the system to fit different populations and settings, and optimal care provision. Identifying these factors early in the development and implementation process may facilitate user-centered design and improve adoption.

Pragmatic Considerations on Clinical Decision Support from the 2019 Literature

Objectives : To summarize significant research contributions published in 2019 in the field of computerized clinical decision support and select the best papers for the Decision Support section of the International Medical Informatics Association (IMIA) Yearbook.

Methods : Two bibliographic databases were searched for papers referring to clinical decision support systems (CDSSs) and computerized provider order entry (CPOE) systems. From search results, section editors established a list of candidate best papers, which were then peer-reviewed by external reviewers. The IMIA Yearbook editorial committee finally selected the best papers on the basis of all reviews including the section editors’ evaluation.

Results : A total of 1,378 articles were retrieved. Fifteen best paper candidates were selected, the reviews of which resulted in the selection of three best papers. One paper reports on a guideline modeling approach based on clinical decision trees, both clinically interpretable and suitable for implementation in CDSSs. In another paper, authors promote the use of extended Timed Transition Diagrams in CDSSs to formalize consistently recurrent medical processes for chronic diseases management. The third paper proposes a conceptual framework and a grid for assessing the performance of predictive tools based on the critical appraisal of published evidence.

Conclusions : As showed by the number and the variety of works related to decision support, research in the field is very active. This year’s selection highlighted pragmatic works that promote transparency and trust required by decision support tools.