Evaluating the alert appropriateness of clinical decision support systems in supporting clinical workflow

Impact of automated pop-up alerts on simultaneous prescriptions of antimicrobial agents and metal cations

BACKGROUND

Antimicrobial agents (AMAs) are essential for treating infections. A part of AMAs chelate with metal cations (MCs), reducing their blood concentrations. That drug-drug interaction could lead to a reduction of therapeutic efficacy and the emergence of drug-resistant bacteria. However, prescriptions ordering concomitant intake (co-intake) of AMAs and MCs are frequently seen in clinical settings. A method for preventing such prescriptions is urgently needed.

METHODS

We implemented pop-up alerts in the hospital's ordering and pharmacy dispensation support system to notify the prescriptions ordering co-intake of AMAs and MCs for physicians and pharmacists, respectively. To assess the effectiveness of the pop-up alerts, we investigated the number of prescriptions ordering co-intake of AMAs and MCs and the number of pharmacist inquiries to prevent co-intake of AMAs and MCs before and after the implementation of pop-up alerts.

RESULTS

Before the implementation of pop-up alerts, 84.5% of prescriptions containing AMA and MCs ordered co-intake of AMAs and MCs. Implementing pop-up alerts time-dependently reduced the proportion of prescriptions ordering co-intake of AMAs and MCs to 43.8% and 29.5% one year and two years later, respectively. The reduction of tetracycline-containing prescriptions was mainly significant. Before the implementation of pop-up alerts, the proportion of prescriptions in which pharmacists prevented co-intake of AMAs and MCs was 3.4%. Implementing pop-up alerts time-dependently increased proportions of such prescriptions to 20.9% and 28.2% one year and two years later.

CONCLUSION

Implementing pop-up alerts reduced prescriptions ordering co-intake of AMAs and MCs and accelerated pharmacists to prevent co-intake of AMAs and MCs. The implementation of dual pop-up alerts in the hospital's ordering and pharmacy dispensation support system could help prevent co-intake of AMAs and MCs.

Artificial Intelligence, the Digital Surgeon: Unravelling Its Emerging Footprint in Healthcare - The Narrative Review

Background

Artificial Intelligence (AI) holds transformative potential for the healthcare industry, offering innovative solutions for diagnosis, treatment planning, and improving patient outcomes. As AI continues to be integrated into healthcare systems, it promises advancements across various domains. This review explores the diverse applications of AI in healthcare, along with the challenges and limitations that need to be addressed. The aim is to provide a comprehensive overview of AI's impact on healthcare and to identify areas for further development and focus.

Main Applications

The review discusses the broad range of AI applications in healthcare. In medical imaging and diagnostics, AI enhances the accuracy and efficiency of diagnostic processes, aiding in early disease detection. AI-powered clinical decision support systems assist healthcare professionals in patient management and decision-making. Predictive analytics using AI enables the prediction of patient outcomes and identification of potential health risks. AI-driven robotic systems have revolutionized surgical procedures, improving precision and outcomes. Virtual assistants and chatbots enhance patient interaction and support, providing timely information and assistance. In the pharmaceutical industry, AI accelerates drug discovery and development by identifying potential drug candidates and predicting their efficacy. Additionally, AI improves administrative efficiency and operational workflows in healthcare, streamlining processes and reducing costs. AI-powered remote monitoring and telehealth solutions expand access to healthcare, particularly in underserved areas.

Challenges and Limitations

Despite the significant promise of AI in healthcare, several challenges persist. Ensuring the reliability and consistency of AI-driven outcomes is crucial. Privacy and security concerns must be navigated carefully, particularly in handling sensitive patient data. Ethical considerations, including bias and fairness in AI algorithms, need to be addressed to prevent unintended consequences. Overcoming these challenges is critical for the ethical and successful integration of AI in healthcare.

Conclusion

The integration of AI into healthcare is advancing rapidly, offering substantial benefits in improving patient care and operational efficiency. However, addressing the associated challenges is essential to fully realize the transformative potential of AI in healthcare. Future efforts should focus on enhancing the reliability, transparency, and ethical standards of AI technologies to ensure they contribute positively to global health outcomes.

Evaluating health information systems-related errors using the human, organization, process, technology-fit (HOPT-fit) framework

Complex socio-technical health information systems (HIS) issues can create new error risks. Therefore, we evaluated the management of HIS-related errors using the proposed human, organization, process, and technology-fit framework to identify the lessons learned. Qualitative case study methodology through observation, interview, and document analysis was conducted at a 1000-bed Japanese specialist teaching hospital. Effective management of HIS-related errors was attributable to many socio-technical factors including continuous improvement, safety culture, strong management and leadership, effective communication, preventive and corrective mechanisms, an incident reporting system, and closed feedback loops. Enablers of medication errors include system sophistication and process factors like workarounds, variance, clinical workload, slips and mistakes, and miscommunication. The case management effectiveness in handling the HIS-related errors can guide other clinical settings. The potential of HIS to minimize errors can be achieved through continual, systematic, and structured evaluation. The case study validated the applicability of the proposed evaluation framework that can be applied flexibly according to study contexts to inform HIS stakeholders in decision-making. The comprehensive and specific measures of the proposed framework and approach can be a useful guide for evaluating complex HIS-related errors. Leaner and fitter socio-technical components of HIS can yield safer system use.

Clinical decision support to enhance venous thromboembolism pharmacoprophylaxis prescribing for pediatric inpatients with COVID-19

OBJECTIVE

To design and evaluate a clinical decision support (CDS) module to improve guideline concordant venous thromboembolism (VTE) pharmacoprophylaxis prescribing for pediatric inpatients with COVID-19.

MATERIALS AND METHODS

The proportion of patients who met our institutional clinical practice guideline's (CPG) criteria for VTE prophylaxis was compared to those who triggered a CDS alert, indicating the patient needed VTE prophylaxis, and to those who were prescribed prophylaxis pre and post the launch of a new VTE CDS module to support VTE pharmacoprophylaxis prescribing. The sensitivity, specificity, positive predictive value (PPV), negative predictive value, F1-score and accuracy of the tool were calculated for the pre- and post-intervention periods using the CPG recommendation as the gold standard. Accuracy was defined as the sum of the true positives and true negatives over the sum of the true positives, false positives, true negatives, and false negatives. Logistic regression was used to identify variables associated with correct thromboprophylaxis prescribing.

RESULTS

A significant increase in the proportion of patients triggering a CDS alert occurred in the post-intervention period (44.3% vs. 6.9%, p < .001); however, no reciprocal increase in VTE prophylaxis prescribing was achieved (36.6% vs. 40.9%, p = .53). The updated CDS module had an improved sensitivity (55.0% vs. 13.3%), NPV (44.9% vs. 36.3%), F1-score (66.7% vs. 23.5%), and accuracy (62.5% vs. 42.0%), but an inferior specificity (78.6% vs. 100%) and PPV (84.6% vs. 100%).

DISCUSSION

The updated CDS model had an improved accuracy and overall performance in correctly identifying patients requiring VTE prophylaxis. Despite an increase in correct patient identification by the CDS module, the proportion of patients receiving appropriate pharmacologic prophylaxis did not change.

CONCLUSION

CDS tools to support correct VTE prophylaxis prescribing need ongoing refinement and validation to maximize clinical utility.

Natural Language Processing - A Surveillance Stepping Stone to Identify Child Abuse

OBJECTIVE

We aimed to refine a natural language processing (NLP) algorithm that identified injuries associated with child abuse and identify areas in which integration into a real-time clinical decision support (CDS) tool may improve clinical care.

METHODS

We applied an NLP algorithm in "silent mode" to all emergency department (ED) provider notes between July 2021 and December 2022 (n = 353) at 1 pediatric and 8 general EDs. We refined triggers for the NLP, assessed adherence to clinical guidelines, and evaluated disparities in degree of evaluation by examining associations between demographic variables and abuse evaluation or reporting to child protective services.

RESULTS

Seventy-three cases falsely triggered the NLP, often due to errors in interpreting linguistic context. We identified common false-positive scenarios and refined the algorithm to improve NLP specificity. Adherence to recommended evaluation standards for injuries defined by nationally accepted clinical guidelines was 63%. There were significant demographic differences in evaluation and reporting based on presenting ED type, insurance status, and race and ethnicity.

CONCLUSIONS

Analysis of an NLP algorithm in "silent mode" allowed for refinement of the algorithm and highlighted areas in which real-time CDS may help ED providers identify and pursue appropriate evaluation of injuries associated with child physical abuse.

Ability of machine-learning based clinical decision support system to reduce alert fatigue, wrong-drug errors, and alert users about look alike, sound alike medication

BACKGROUND AND OBJECTIVE

The overall benefits of using clinical decision support systems (CDSSs) can be restrained if physicians inadvertently ignore clinically useful alerts due to "alert fatigue" caused by an excessive number of clinically irrelevant warnings. Moreover, inappropriate drug errors, look-alike/sound-alike (LASA) drug errors, and problem list documentation are common, costly, and potentially harmful. This study sought to evaluate the overall performance of a machine learning-based CDSS (MedGuard) for triggering clinically relevant alerts, acceptance rate, and to intercept inappropriate drug errors as well as LASA drug errors.

METHODS

We conducted a retrospective study that evaluated MedGuard alerts, the alert acceptance rate, and the rate of LASA alerts between July 1, 2019, and June 31, 2021, from outpatient settings at an academic hospital. An expert pharmacist checked the suitability of the alerts, rate of acceptance, wrong-drug errors, and confusing drug pairs.

RESULTS

Over the two-year study period, 1,206,895 prescriptions were ordered and a total of 28,536 alerts were triggered (alert rate: 2.36 %). Of the 28,536 alerts presented to physicians, 13,947 (48.88 %) were accepted. A total of 8,014 prescriptions were changed/modified (28.08 %, 8,014/28,534) with the most common reasons being adding and/or deleting diseases (52.04 %, 4,171/8,014), adding and/or deleting drugs (21.89 %, 1,755/8,014) and others (35.48 %, 2,844/ 8,014). However, the rate of drug error interception was 1.64 % (470 intercepted errors out of 28,536 alerts), which equates to 16.4 intercepted errors per 1000 alerted orders.

CONCLUSION

This study shows that machine learning based CDSS, MedGuard, has an ability to improve patients' safety by triggering clinically valid alerts. This system can also help improve problem list documentation and intercept inappropriate drug errors and LASA drug errors, which can improve medication safety. Moreover, high acceptance of alert rates can help reduce clinician burnout and adverse events.

The Role of Data Science in Closing the Implementation Gap

Data science has the potential to greatly enhance efforts to translate evidence into practice in critical care. The intensive care unit is a data-rich environment enabling insight into both patient-level care patterns and clinician-level treatment patterns. By applying artificial intelligence to these novel data sources, implementation strategies can be tailored to individual patients, individual clinicians, and individual situations, revealing when evidence-based practices are missed and facilitating context-sensitive clinical decision support. To achieve these goals, technology developers should work closely with clinicians to create unbiased applications that are integrated into the clinical workflow.

Organizational and behavioral attributes' roles in adopting cloud services: An empirical study in the healthcare industry

The need for cloud services has been raised globally to provide a platform for healthcare providers to efficiently manage their citizens' health records and thus provide treatment remotely. In Iraq, the healthcare records of public hospitals are increasing progressively with poor digital management. While recent works indicate cloud computing as a platform for all sectors globally, a lack of empirical evidence demands a comprehensive investigation to identify the significant factors that influence the utilization of cloud health computing. Here we provide a cost-effective, modular, and computationally efficient model of utilizing cloud computing based on the organization theory and the theory of reasoned action perspectives. A total of 105 key informant data were further analyzed. The partial least square structural equation modeling was used for data analysis to explore the effect of organizational structure variables on healthcare information technicians' behaviors to utilize cloud services. Empirical results revealed that Internet networks, software modularity, hardware modularity, and training availability significantly influence information technicians' behavioral control and confirmation. Furthermore, these factors positively impacted their utilization of cloud systems, while behavioral control had no significant effect. The importance-performance map analysis further confirms that these factors exhibit high importance in shaping user utilization. Our findings can provide a comprehensive and unified guide to policymakers in the healthcare industry by focusing on the significant factors in organizational and behavioral contexts to engage health information technicians in the development and implementation phases.

Using AI-generated suggestions from ChatGPT to optimize clinical decision support

OBJECTIVE

To determine if ChatGPT can generate useful suggestions for improving clinical decision support (CDS) logic and to assess noninferiority compared to human-generated suggestions.

METHODS

We supplied summaries of CDS logic to ChatGPT, an artificial intelligence (AI) tool for question answering that uses a large language model, and asked it to generate suggestions. We asked human clinician reviewers to review the AI-generated suggestions as well as human-generated suggestions for improving the same CDS alerts, and rate the suggestions for their usefulness, acceptance, relevance, understanding, workflow, bias, inversion, and redundancy.

RESULTS

Five clinicians analyzed 36 AI-generated suggestions and 29 human-generated suggestions for 7 alerts. Of the 20 suggestions that scored highest in the survey, 9 were generated by ChatGPT. The suggestions generated by AI were found to offer unique perspectives and were evaluated as highly understandable and relevant, with moderate usefulness, low acceptance, bias, inversion, redundancy.

CONCLUSION

AI-generated suggestions could be an important complementary part of optimizing CDS alerts, can identify potential improvements to alert logic and support their implementation, and may even be able to assist experts in formulating their own suggestions for CDS improvement. ChatGPT shows great potential for using large language models and reinforcement learning from human feedback to improve CDS alert logic and potentially other medical areas involving complex, clinical logic, a key step in the development of an advanced learning health system.

Targeting repetitive laboratory testing with electronic health records-embedded predictive decision support: A pre-implementation study

INTRODUCTION

Unnecessary laboratory testing contributes to patient morbidity and healthcare waste. Despite prior attempts at curbing such overutilization, there remains opportunity for improvement using novel data-driven approaches. This study presents the development and early evaluation of a clinical decision support tool that uses a predictive model to help providers reduce low-yield, repetitive laboratory testing in hospitalized patients.

METHODS

We developed an EHR-embedded SMART on FHIR application that utilizes a laboratory test result prediction model based on historical laboratory data. A combination of semi-structured physician interviews, usability testing, and quantitative analysis on retrospective laboratory data were used to inform the tool's development and evaluate its acceptability and potential clinical impact.

KEY RESULTS

Physicians identified culture and lack of awareness of repeat orders as key drivers for overuse of inpatient blood testing. Users expressed an openness to a lab prediction model and 13/15 physicians believed the tool would alter their ordering practices. The application received a median System Usability Scale score of 75, corresponding to the 75th percentile of software tools. On average, physicians desired a prediction certainty of 85% before discontinuing a routine recurring laboratory order and a higher certainty of 90% before being alerted. Simulation on historical lab data indicates that filtering based on accepted thresholds could have reduced ∼22% of repeat chemistry panels.

CONCLUSIONS

The use of a predictive algorithm as a means to calculate the utility of a diagnostic test is a promising paradigm for curbing laboratory test overutilization. An EHR-embedded clinical decision support tool employing such a model is a novel and acceptable intervention with the potential to reduce low-yield, repetitive laboratory testing.

Assessing the Value of ChatGPT for Clinical Decision Support Optimization

Objective

To determine if ChatGPT can generate useful suggestions for improving clinical decision support (CDS) logic and to assess noninferiority compared to human-generated suggestions.

Methods

We supplied summaries of CDS logic to ChatGPT, an artificial intelligence (AI) tool for question answering that uses a large language model, and asked it to generate suggestions. We asked human clinician reviewers to review the AI-generated suggestions as well as human-generated suggestions for improving the same CDS alerts, and rate the suggestions for their usefulness, acceptance, relevance, understanding, workflow, bias, inversion, and redundancy.

Results

Five clinicians analyzed 36 AI-generated suggestions and 29 human-generated suggestions for 7 alerts. Of the 20 suggestions that scored highest in the survey, 9 were generated by ChatGPT. The suggestions generated by AI were found to offer unique perspectives and were evaluated as highly understandable and relevant, with moderate usefulness, low acceptance, bias, inversion, redundancy.

Conclusion

AI-generated suggestions could be an important complementary part of optimizing CDS alerts, can identify potential improvements to alert logic and support their implementation, and may even be able to assist experts in formulating their own suggestions for CDS improvement. ChatGPT shows great potential for using large language models and reinforcement learning from human feedback to improve CDS alert logic and potentially other medical areas involving complex, clinical logic, a key step in the development of an advanced learning health system.

The Reasons for Physicians and Pharmacists' Acceptance of Clinical Support Systems in Saudi Arabia

This research aims to identify the technological and non-technological factors influencing user acceptance of the CDSS in a group of healthcare facilities in Saudi Arabia. The study proposes an integrated model that indicates the factors to be considered when designing and evaluating CDSS. This model is developed by integrating factors from the "Fit between Individuals, Task, and Technology" (FITT) framework into the three domains of the human, organization, and technology-fit (HOT-fit) model. The resulting FITT-HOT-fit integrated model was tested using a quantitative approach to evaluate the currently implemented CDSS as a part of Hospital Information System BESTCare 2.0 in the Saudi Ministry of National Guard Health Affairs. For data collection, a survey questionnaire was conducted at all Ministry of National Guard Health Affairs hospitals. Then, the collected survey data were analyzed using Structural Equation Modeling (SEM). This analysis included measurement instrument reliability, discriminant validity, convergent validity, and hypothesis testing. Moreover, a CDSS usage data sample was extracted from the data warehouse to be analyzed as an additional data source. The results of the hypotheses test show that usability, availability, and medical history accessibility are critical factors influencing user acceptance of CDSS. This study provides prudence about healthcare facilities and their higher management to adopt CDSS.

Real-Time User Feedback to Support Clinical Decision Support System Improvement

OBJECTIVES

To improve clinical decision support (CDS) by allowing users to provide real-time feedback when they interact with CDS tools and by creating processes for responding to and acting on this feedback.

METHODS

Two organizations implemented similar real-time feedback tools and processes in their electronic health record and gathered data over a 30-month period. At both sites, users could provide feedback by using Likert feedback links embedded in all end-user facing alerts, with results stored outside the electronic health record, and provide feedback as a comment when they overrode an alert. Both systems are monitored daily by clinical informatics teams.

RESULTS

The two sites received 2,639 Likert feedback comments and 623,270 override comments over a 30-month period. Through four case studies, we describe our use of end-user feedback to rapidly respond to build errors, as well as identifying inaccurate knowledge management, user-interface issues, and unique workflows.

CONCLUSION

Feedback on CDS tools can be solicited in multiple ways, and it contains valuable and actionable suggestions to improve CDS alerts. Additionally, end users appreciate knowing their feedback is being received and may also make other suggestions to improve the electronic health record. Incorporation of end-user feedback into CDS monitoring, evaluation, and remediation is a way to improve CDS.

Alerts in Clinical Decision Support Systems (CDSS): A Bibliometric Review and Content Analysis

A clinical decision support system (CDSS) informs or generates medical recommendations for healthcare practitioners. An alert is the most common way for a CDSS to interact with practitioners. Research about alerts in CDSS has proliferated over the past ten years. The research trend is ongoing with new emerging terms and focus. Bibliometric analysis is ideal for researchers to understand the research trend and future directions. Influential articles, institutes, countries, authors, and commonly used keywords were analyzed to grasp a comprehensive view on our topic, alerts in CDSS. Articles published between 2011 and 2021 were extracted from the Web of Science database. There were 728 articles included for bibliometric analysis, among which 24 papers were selected for content analysis. Our analysis shows that the research direction has shifted from patient safety to system utility, implying the importance of alert usability to be clinically impactful. Finally, we conclude with future research directions such as the optimization of alert mechanisms and comprehensiveness to enhance alert appropriateness and to reduce alert fatigue.

Modulators Influencing Medication Alert Acceptance: An Explorative Review

OBJECTIVES

Clinical decision support systems (CDSSs) use alerts to enhance medication safety and reduce medication error rates. A major challenge of medication alerts is their low acceptance rate, limiting their potential benefit. A structured overview about modulators influencing alert acceptance is lacking. Therefore, we aimed to review and compile qualitative and quantitative modulators of alert acceptance and organize them in a comprehensive model.

METHODS

In accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guideline, a literature search in PubMed was started in February 2018 and continued until October 2021. From all included articles, qualitative and quantitative parameters and their impact on alert acceptance were extracted. Related parameters were then grouped into factors, allocated to superordinate determinants, and subsequently further allocated into five categories that were already known to influence alert acceptance.

RESULTS

Out of 539 articles, 60 were included. A total of 391 single parameters were extracted (e.g., patients' comorbidity) and grouped into 75 factors (e.g., comorbidity), and 25 determinants (e.g., complexity) were consequently assigned to the predefined five categories, i.e., CDSS, care provider, patient, setting, and involved drug. More than half of all factors were qualitatively assessed (n = 21) or quantitatively inconclusive (n = 19). Furthermore, 33 quantitative factors clearly influenced alert acceptance (positive correlation: e.g., alert type, patients' comorbidity; negative correlation: e.g., number of alerts per care provider, moment of alert display in the workflow). Two factors (alert frequency, laboratory value) showed contradictory effects, meaning that acceptance was significantly influenced both positively and negatively by these factors, depending on the study. Interventional studies have been performed for only 12 factors while all other factors were evaluated descriptively.

CONCLUSION

This review compiles modulators of alert acceptance distinguished by being studied quantitatively or qualitatively and indicates their effect magnitude whenever possible. Additionally, it describes how further research should be designed to comprehensively quantify the effect of alert modulators.

Stratifying individuals into non-alcoholic fatty liver disease risk levels using time series machine learning models

Non-alcoholic fatty liver disease (NAFLD) affects 25% of the population worldwide, and its prevalence is anticipated to increase globally. While most NAFLD patients are asymptomatic, NAFLD may progress to fibrosis, cirrhosis, cardiovascular disease, and diabetes. Research reports, with daunting results, show the challenge that NAFLD's burden causes to global population health. The current process for identifying fibrosis risk levels is inefficient, expensive, does not cover all potential populations, and does not identify the risk in time. Instead of invasive liver biopsies, we implemented a non-invasive fibrosis assessment process calculated from clinical data (accessed via EMRs/EHRs). We stratified patients' risks for fibrosis from 2007 to 2017 by modeling the risk in 5579 individuals. The process involved time-series machine learning models (Hidden Markov Models and Group-Based Trajectory Models) profiled fibrosis risk by modeling patients' latent medical status resulted in three groups. The high-risk group had abnormal lab test values and a higher prevalence of chronic conditions. This study can help overcome the inefficient, traditional process of detecting fibrosis via biopsies (that are also medically unfeasible due to their invasive nature, the medical resources involved, and costs) at early stages. Thus longitudinal risk assessment may be used to make population-specific medical recommendations targeting early detection of high risk patients, to avoid the development of fibrosis disease and its complications as well as decrease healthcare costs.

The appropriateness of clinical decision support systems alerts in supporting clinical workflows: A systematic review

A CDSS generates a high number of inappropriate alerts that interrupt the clinical workflow. As a result, clinicians silence, disable, or ignore alerts, thereby undermining patient safety. Therefore, the effectiveness and appropriateness of CDSS alerts need to be evaluated. A systematic review was carried out to identify the factors that affect CDSS alert appropriateness in supporting clinical workflow. Seven electronic databases (PubMed, Scopus, ACM, Science Direct, IEEE, Ovid Medline, and Ebscohost) were searched for English language articles published between 1997 and 2018. Seventy six papers met the inclusion criteria, of which 26, 24, 15, and 11 papers are retrospective cohort, qualitative, quantitative, and mixed-method studies, respectively. The review highlights various factors influencing the appropriateness and efficiencies of CDSS alerts. These factors are categorized into technology, human, organization, and process aspects using a combination of approaches, including socio-technical framework, five rights of CDSS, and Lean. Most CDSS alerts were not properly designed based on human factor methods and principles, explaining high alert overrides in clinical practices. The identified factors and recommendations from the review may offer valuable insights into how CDSS alerts can be designed appropriately to support clinical workflow.

Evaluating the appropriateness of clinical decision support alerts: A case study

RATIONALE, AIMS, AND OBJECTIVES

Clinical decision support (CDS) generates excessive alerts that disrupt the workflow of clinicians. Therefore, inefficient clinical processes that contribute to the misfit between CDS alert and workflow must be evaluated. This study evaluates the appropriateness of CDS alerts in supporting clinical workflow from a socio-technical perspective.

METHOD

A qualitative case study evaluation was conducted at a 620-bed public teaching hospital in Malaysia using interview, observation, and document analysis to investigate the features and functions of alert appropriateness and workflow-related issues in cardiological and dermatological settings. The current state map for medication prescribing process was also modelled to identify problems pertinent to CDS alert appropriateness.

RESULTS

The main findings showed that CDS was not well designed to fit into a clinician's workflow due to influencing factors such as technology (usability, alert content, and alert timing), human (training, perception, knowledge, and skills), organizational (rules and regulations, privacy, and security), and processes (documenting patient information, overriding default option, waste, and delay) impeding the use of CDS with its alert function. We illustrated how alert affect workflow in clinical processes using a Lean tool known as value stream mapping. This study also proposes how CDS alerts should be integrated into clinical workflows to optimize their potential to enhance patient safety.

CONCLUSION

The design and implementation of CDS alerts should be aligned with and incorporate socio-technical factors. Process improvement methods such as Lean can be used to enhance the appropriateness of CDS alerts by identifying inefficient clinical processes that impede the fit of these alerts into clinical workflow.

Human Factors and Organizational Issues in Health Informatics: Innovations and Opportunities

OBJECTIVE

Human factors and ergonomics (HF/E) frameworks and methods are becoming embedded in the health informatics community. There is now broad recognition that health informatics tools must account for the diverse needs, characteristics, and abilities of end users, as well as their context of use. The objective of this review is to synthesize the current nature and scope of HF/E integration into the health informatics community.

METHODS

Because the focus of this synthesis is on understanding the current integration of the HF/E and health informatics research communities, we manually reviewed all manuscripts published in primary HF/E and health informatics journals during 2020.

RESULTS

HF/E-focused health informatics studies included in this synthesis focused heavily on EHR customizations, specifically clinical decision support customizations and customized data displays, and on mobile health innovations. While HF/E methods aimed to jointly improve end user safety, performance, and satisfaction, most HF/E-focused health informatics studies measured only end user satisfaction.

CONCLUSION

HF/E-focused health informatics researchers need to identify and communicate methodological standards specific to health informatics, to better synthesize findings across resource intensive HF/E-focused health informatics studies. Important gaps in the HF/E design and evaluation process should be addressed in future work, including support for technology development platforms and training programs so that health informatics designers are as diverse as end users.

[Prescription of phosphorus, calcium and magnesium: choice of the millimole unit to establish the equivalence of doses between oral and injectable forms]

OBJECTIVES

Information available on the packaging of drugs indicated for patients electrolytes replenishment differs from one manufacturer to another. They relate, for example, the unit chosen to express elemental electrolyte concentration. These differences constitute a risk factor for medication errors. This article proposes a clinical decision support tool which defines dose equivalences between the oral and injectable formulation galenic forms for medications providing phosphorus, calcium and magnesium and a calculated replenishment ratio.

METHODS

The amounts of elemental electrolyte were determined from the information contained on the packaging and the summaries of product characteristics. Only the specialties of our hospital drug formulary were studied. For each element, the replenishment ratio was determined from published data.

RESULTS

Equivalence tables were created for the phosphorus, calcium and magnesium between oral and injectable formulation. A clinical decision support tool was developed from these data.

CONCLUSION

The use of this tool is a first way to reduce the risk of medication errors. It remains to determine the conditions for its dissemination and evaluation. This issue raises the questions of the exclusive use of the millimole unit on packaging and for prescription, and that of the integration of this type of tool into prescription software and decision support systems.

Electronic clinical decision support for children with minor head trauma and intracranial injuries: a sociotechnical analysis

BACKGROUND

Current management of children with minor head trauma (MHT) and intracranial injuries is not evidence-based and may place some children at risk of harm. Evidence-based electronic clinical decision support (CDS) for management of these children may improve patient safety and decrease resource use. To guide these efforts, we evaluated the sociotechnical environment impacting the implementation of electronic CDS, including workflow and communication, institutional culture, and hardware and software infrastructure, among other factors.

METHODS

Between March and May, 2020 semi-structured qualitative focus group interviews were conducted to identify sociotechnical influences on CDS implementation. Physicians from neurosurgery, emergency medicine, critical care, and pediatric general surgery were included, along with information technology specialists. Participants were recruited from nine health centers in the United States. Focus group transcripts were coded and analyzed using thematic analysis. The final themes were then cross-referenced with previously defined sociotechnical dimensions.

RESULTS

We included 28 physicians and four information technology specialists in seven focus groups (median five participants per group). Five physicians were trainees and 10 had administrative leadership positions. Through inductive thematic analysis, we identified five primary themes: (1) clinical impact; (2) stakeholders and users; (3) tool content; (4) clinical practice integration; and (5) post-implementation evaluation measures. Participants generally supported using CDS to determine an appropriate level-of-care for these children. However, some had mixed feelings regarding how the tool could best be used by different specialties (e.g. use by neurosurgeons versus non-neurosurgeons). Feedback from the interviews helped refine the tool content and also highlighted potential technical and workflow barriers to address prior to implementation.

CONCLUSIONS

We identified key factors impacting the implementation of electronic CDS for children with MHT and intracranial injuries. These results have informed our implementation strategy and may also serve as a template for future efforts to implement health information technology in a multidisciplinary, emergency setting.