Role of Artificial Intelligence in Patient Safety Outcomes: Systematic Literature Review

Glucocorticoid therapy for sepsis in the AI era: a survey on current and future approaches

Sepsis, a life-threatening medical condition, manifests as new or worsening organ failures due to a dysregulated host response to infection. Many patients with sepsis have manifested a hyperinflammatory phenotype leading to the identification of inflammatory modulation by corticosteroids as a key treatment modality. However, the optimal use of corticosteroids in sepsis treatment remains a contentious subject, necessitating a deeper understanding of their physiological and pharmacological effects. Our study conducts a comprehensive review of randomized controlled trials (RCTs) focusing on traditional corticosteroid treatment in sepsis, alongside an analysis of evolving clinical guidelines. Additionally, we explore the emerging role of artificial intelligence (AI) in medicine, particularly in diagnosing, prognosticating, and treating sepsis. AI's advanced data processing capabilities reveal new avenues for enhancing corticosteroid therapeutic strategies in sepsis. The integration of AI in sepsis treatment has the potential to address existing gaps in knowledge, especially in the application of corticosteroids. Our findings suggest that combining corticosteroid therapy with AI-driven insights could lead to more personalized and effective sepsis treatments. This approach holds promise for improving clinical outcomes and presents a significant advancement in the management of this complex and often fatal condition.

Leverage machine learning to identify key measures in hospital operations management: a retrospective study to explore feasibility and performance of four common algorithms

BACKGROUND

Measures in operations management are pivotal for monitoring and assessing various aspects of hospital performance. Existing literature highlights the importance of regularly updating key management measures to reflect changing trends and organizational goals. Advancements in machine learning (ML) have presented promising opportunities for enhancing the process of updating operations management measures. However, their specific application and performance remain relatively unexplored. We aimed to investigate the feasibility and effectiveness of using common ML techniques to identify and update key measures in hospital operations management.

METHODS

Historical data on 43 measures on financial balance and quality of care under 4 categories were retrieved from the BI system of a regional health system in Central China. The dataset included 17 surgical and 15 non-surgical departments over 48 months. Four common ML techniques, linear models (LM), random forest (RF), partial least squares (PLS), and neural networks (NN), were used to identify the most important measures. Ordinary least square was employed to investigate the impact of the top 10 measures. A ground truth validation compared the ML-identified key measures against the humanly decided strategic measures from annual meeting minutes.

RESULTS

For financial balancing, inpatient treatment revenue was an important measure in 3/4 years, followed by equipment depreciation costs. The measures identified using the same technique differed between years, though RF and PLS yielded relatively consistent results. For quality of care, none of the ML-identified measures repeated over the years. Those consistently important over four years differed almost entirely among four techniques. On ground truth validation, the 2016-2019 ML-identified measures were among the humanly identified measures, with the exception of equipment depreciation from the 2019 dataset. All the ML-identified measures for quality of care failed to coincide with the humanly decided measures.

CONCLUSIONS

Using ML to identify key hospital operational measures is viable but performance of ML techniques vary considerably. RF performs best among the four techniques in identifying key measures in financial balance. None of the ML techniques seem effective for identifying quality of care measures. ML is suggested as a decision support tool to remind and inspire decision-makers in certain aspects of hospital operations management.

Transforming Otolaryngology-Head and Neck Surgery: The Pivotal Role of Artificial Intelligence in Clinical Workflows

Use of artificial intelligence (AI) is expanding exponentially as it pertains to workflow operations. Otolaryngology-Head and Neck Surgery (OHNS), as with all medical fields, is just now beginning to realize the exciting upsides of AI as it relates to patient care but otolaryngologists should also be critical when considering using AI solutions. This paper highlights how AI can optimize clinical workflows in the outpatient, inpatient, and surgical settings while also discussing some of the possible drawbacks with the burgeoning technology.

Machine learning methods in physical therapy: A scoping review of applications in clinical context

BACKGROUND

Machine learning (ML) efficiently processes large datasets, showing promise in enhancing clinical practice within physical therapy.

OBJECTIVE

The aim of this scoping review is to provide an overview of studies using ML approaches in clinical settings of physical therapy.

DATA SOURCES

A scoping review was performed in PubMed, EMBASE, PEDro, Cochrane, Web of Science, and Scopus.

SELECTION CRITERIA

We included studies utilizing ML methods. ML was defined as the utilization of computational systems to encode patterns and relationships, enabling predictions or classifications with minimal human interference.

DATA EXTRACTION AND DATA SYNTHESIS

Data were extracted regarding methods, data types, performance metrics, and model availability.

RESULTS

Forty-two studies were included. The majority were published after 2020 (n = 25). Fourteen studies (33.3%) were in the musculoskeletal physical therapy field, nine (21.4%) in neurological, and eight (19%) in sports physical therapy. We identified 44 different ML models, with random forest being the most used. Three studies reported on model availability. We identified several clinical applications for ML-based tools, including diagnosis (n = 14), prognosis (n = 7), treatment outcomes prediction (n = 7), clinical decision support (n = 5), movement analysis (n = 4), patient monitoring (n = 3), and personalized care plan (n = 2).

LIMITATION

Model performance metrics, costs, model interpretability, and explainability were not reported.

CONCLUSION

This scope review mapped the emerging landscape of machine learning applications in physical therapy. Despite the growing interest, the field still lacks high-quality studies on validation, model availability, and acceptability to advance from research to clinical practice.

Clinician voices on ethics of LLM integration in healthcare: a thematic analysis of ethical concerns and implications

OBJECTIVES

This study aimed to explain and categorize key ethical concerns about integrating large language models (LLMs) in healthcare, drawing particularly from the perspectives of clinicians in online discussions.

MATERIALS AND METHODS

We analyzed 3049 posts and comments extracted from a self-identified clinician subreddit using unsupervised machine learning via Latent Dirichlet Allocation and a structured qualitative analysis methodology.

RESULTS

Analysis uncovered 14 salient themes of ethical implications, which we further consolidated into 4 overarching domains reflecting ethical issues around various clinical applications of LLM in healthcare, LLM coding, algorithm, and data governance, LLM's role in health equity and the distribution of public health services, and the relationship between users (human) and LLM systems (machine).

DISCUSSION

Mapping themes to ethical frameworks in literature illustrated multifaceted issues covering transparent LLM decisions, fairness, privacy, access disparities, user experiences, and reliability.

CONCLUSION

This study emphasizes the need for ongoing ethical review from stakeholders to ensure responsible innovation and advocates for tailored governance to enhance LLM use in healthcare, aiming to improve clinical outcomes ethically and effectively.

Is artificial intelligence for medical professionals serving the patients? : Protocol for a systematic review on patient-relevant benefits and harms of algorithmic decision-making

BACKGROUND

Algorithmic decision-making (ADM) utilises algorithms to collect and process data and develop models to make or support decisions. Advances in artificial intelligence (AI) have led to the development of support systems that can be superior to medical professionals without AI support in certain tasks. However, whether patients can benefit from this remains unclear. The aim of this systematic review is to assess the current evidence on patient-relevant benefits and harms, such as improved survival rates and reduced treatment-related complications, when healthcare professionals use ADM systems (developed using or working with AI) compared to healthcare professionals without AI-related ADM (standard care)-regardless of the clinical issues.

METHODS

Following the PRISMA statement, MEDLINE and PubMed (via PubMed), Embase (via Elsevier) and IEEE Xplore will be searched using English free text terms in title/abstract, Medical Subject Headings (MeSH) terms and Embase Subject Headings (Emtree fields). Additional studies will be identified by contacting authors of included studies and through reference lists of included studies. Grey literature searches will be conducted in Google Scholar. Risk of bias will be assessed by using Cochrane's RoB 2 for randomised trials and ROBINS-I for non-randomised trials. Transparent reporting of the included studies will be assessed using the CONSORT-AI extension statement. Two researchers will screen, assess and extract from the studies independently, with a third in case of conflicts that cannot be resolved by discussion.

DISCUSSION

It is expected that there will be a substantial shortage of suitable studies that compare healthcare professionals with and without ADM systems concerning patient-relevant endpoints. This can be attributed to the prioritisation of technical quality criteria and, in some cases, clinical parameters over patient-relevant endpoints in the development of study designs. Furthermore, it is anticipated that a significant portion of the identified studies will exhibit relatively poor methodological quality and provide only limited generalisable results.

SYSTEMATIC REVIEW REGISTRATION

This study is registered within PROSPERO (CRD42023412156).

An Ethically Supported Framework for Determining Patient Notification and Informed Consent Practices When Using Artificial Intelligence in Health Care

Artificial intelligence (AI) is increasingly being used in health care. Without an ethically supportable, standard approach to knowing when patients should be informed about AI, hospital systems and clinicians run the risk of fostering mistrust among their patients and the public. Therefore, hospital leaders need guidance on when to tell patients about the use of AI in their care. In this article, we provide such guidance. To determine which AI technologies fall into each of the identified categories (no notification or no informed consent [IC], notification only, and formal IC), we propose that AI use-cases should be evaluated using the following criteria: (1) AI model autonomy, (2) departure from standards of practice, (3) whether the AI model is patient facing, (4) clinical risk introduced by the model, and (5) administrative burdens. We take each of these in turn, using a case example of AI in health care to illustrate our proposed framework. As AI becomes more commonplace in health care, our proposal may serve as a starting point for creating consensus on standards for notification and IC for the use of AI in patient care.

Legal implications of artificial intelligence in health care

The last few years have seen a boom in the popularity of artificial intelligence (AI) around the world, and the health care sector has not been immune from what has been perceived by some as a revolutionary technology. Although AI has been around for many years, including in the field of health care, the recent introduction of consumer-facing generative AI tools has put a spotlight on the technology that has drawn attention from governments, corporations, consumers and more. Health care systems, physician groups, health insurance companies, and others in the space have shown an eagerness to explore AI's potential to improve various aspects of health care, but new legal risks and challenges are unfolding every day. This contribution looks at the latest health care-related measures in the United States and international legal and regulatory landscapes, as well as data privacy implications and discrimination concerns coming out of AI-enabled solutions. It also discusses concerns that health care systems and physicians alike are monitoring, including the potential for medical errors resulting from AI, liability considerations, and malpractice insurance trends.

Artificial intelligence: revolutionizing robotic surgery: review

Robotic surgery, known for its minimally invasive techniques and computer-controlled robotic arms, has revolutionized modern medicine by providing improved dexterity, visualization, and tremor reduction compared to traditional methods. The integration of artificial intelligence (AI) into robotic surgery has further advanced surgical precision, efficiency, and accessibility. This paper examines the current landscape of AI-driven robotic surgical systems, detailing their benefits, limitations, and future prospects. Initially, AI applications in robotic surgery focused on automating tasks like suturing and tissue dissection to enhance consistency and reduce surgeon workload. Present AI-driven systems incorporate functionalities such as image recognition, motion control, and haptic feedback, allowing real-time analysis of surgical field images and optimizing instrument movements for surgeons. The advantages of AI integration include enhanced precision, reduced surgeon fatigue, and improved safety. However, challenges such as high development costs, reliance on data quality, and ethical concerns about autonomy and liability hinder widespread adoption. Regulatory hurdles and workflow integration also present obstacles. Future directions for AI integration in robotic surgery include enhancing autonomy, personalizing surgical approaches, and refining surgical training through AI-powered simulations and virtual reality. Overall, AI integration holds promise for advancing surgical care, with potential benefits including improved patient outcomes and increased access to specialized expertise. Addressing challenges and promoting responsible adoption are essential for realizing the full potential of AI-driven robotic surgery.

Transforming simulation in healthcare to enhance interprofessional collaboration leveraging big data analytics and artificial intelligence

Simulation in healthcare, empowered by big data analytics and artificial intelligence (AI), has the potential to drive transformative innovations towards enhanced interprofessional collaboration (IPC). This convergence of technologies revolutionizes medical education, offering healthcare professionals (HCPs) an immersive, iterative, and dynamic simulation platform for hands-on learning and deliberate practice. Big data analytics, integrated in modern simulators, creates realistic clinical scenarios which mimics real-world complexities. This optimization of skill acquisition and decision-making with personalized feedback leads to life-long learning. Beyond clinical training, simulation-based AI, virtual reality (VR), and augmented reality (AR) automated tools offer avenues for quality improvement, research and innovation, and team working. Additionally, the integration of VR and AR enhances simulation experience by providing realistic environments for practicing high-risk procedures and personalized learning. IPC, crucial for patient safety and quality care, finds a natural home in simulation-based education, fostering teamwork, communication, and shared decision-making among diverse HCP teams. A thoughtful integration of simulation-based medical education into curricula requires overcoming its barriers such as professional silos and stereo-typing. There is a need for a cautious implantation of technology in clinical training without overly ignoring the real patient-based medical education.

Evaluating EHR-Integrated Digital Technologies for Medication-Related Outcomes and Health Equity in Hospitalised Adults: A Scoping Review

The purpose of this scoping review is to identify and evaluate studies that examine the effectiveness and implementation strategies of Electronic Health Record (EHR)-integrated digital technologies aimed at improving medication-related outcomes and promoting health equity among hospitalised adults. Using the Consolidated Framework for Implementation Research (CFIR), the implementation methods and outcomes of the studies were evaluated, as was the assessment of methodological quality and risk of bias. Searches through Medline, Embase, Web of Science, and CINAHL Plus yielded 23 relevant studies from 1,232 abstracts, spanning 11 countries and from 2008 to 2022, with varied research designs. Integrated digital tools such as alert systems, clinical decision support systems, predictive analytics, risk assessment, and real-time screening and surveillance within EHRs demonstrated potential in reducing medication errors, adverse events, and inappropriate medication use, particularly in older patients. Challenges include alert fatigue, clinician acceptance, workflow integration, cost, data integrity, interoperability, and the potential for algorithmic bias, with a call for long-term and ongoing monitoring of patient safety and health equity outcomes. This review, guided by the CFIR framework, highlights the importance of designing health technology based on evidence and user-centred practices. Quality assessments identified eligibility and representativeness issues that affected the reliability and generalisability of the findings. This review also highlights a critical research gap on whether EHR-integrated digital tools can address or worsen health inequities among hospitalised patients. Recognising the growing role of Artificial Intelligence (AI) and Machine Learning (ML), this review calls for further research on its influence on medication management and health equity through integration of EHR and digital technology.

From Diagnosis to Precision Surgery: The Transformative Role of Artificial Intelligence in Urologic Imaging

The multidisciplinary nature of artificial intelligence (AI) has allowed for rapid growth of its application in medical imaging. Artificial intelligence algorithms can augment various imaging modalities, such as X-rays, CT, and MRI, to improve image quality and generate high-resolution three-dimensional images. AI reconstruction of three-dimensional models of patient anatomy from CT or MRI scans can better enable urologists to visualize structures and accurately plan surgical approaches. AI can also be optimized to create virtual reality simulations of surgical procedures based on patient-specific data, giving urologists more hands-on experience and preparation. Recent development of artificial intelligence modalities, such as TeraRecon and Ceevra, offer rapid and efficient medical imaging analyses aimed at enhancing the provision of urologic care, notably for intraoperative guidance during robot-assisted radical prostatectomy (RARP) and partial nephrectomy.

A Comprehensive Review of Artificial Intelligence in Prostate Cancer Care: State-of-the-Art Diagnostic Tools and Future Outlook

Prostate cancer remains a significant global health challenge, characterized by high incidence and substantial morbidity and mortality rates. Early detection is critical for improving patient outcomes, yet current diagnostic methods have limitations in accuracy and reliability. Artificial intelligence (AI) has emerged as a promising tool to address these challenges in prostate cancer care. AI technologies, including machine learning algorithms and advanced imaging techniques, offer potential solutions to enhance diagnostic accuracy, optimize treatment strategies, and personalize patient care. This review explores the current landscape of AI applications in prostate cancer diagnostics, highlighting state-of-the-art tools and their clinical implications. By synthesizing recent advancements and discussing future directions, the review underscores the transformative potential of AI in revolutionizing prostate cancer diagnosis and management. Ultimately, integrating AI into clinical practice can potentially improve outcomes and quality of life for patients affected by prostate cancer.

Transforming Hospital Quality Improvement Through Harnessing the Power of Artificial Intelligence

This policy analysis focuses on harnessing the power of artificial intelligence (AI) in hospital quality improvement to transform quality and patient safety. It examines the application of AI at the two following fundamental levels: (1) diagnostic and treatment and (2) clinical operations. AI applications in diagnostics directly impact patient care and safety. At the same time, AI indirectly influences patient safety at the clinical operations level by streamlining (1) operational efficiency, (2) risk assessment, (3) predictive analytics, (4) quality indicators reporting, and (5) staff training and education. The challenges and future perspectives of AI application in healthcare, encompassing technological, ethical, and other considerations, are also critically analyzed.

Biomedical Data Science, Artificial Intelligence, and Ethics: Navigating Challenges in the Face of Explosive Growth

Advances in biomedical data science and artificial intelligence (AI) are profoundly changing the landscape of healthcare. This article reviews the ethical issues that arise with the development of AI technologies, including threats to privacy, data security, consent, and justice, as they relate to donors of tissue and data. It also considers broader societal obligations, including the importance of assessing the unintended consequences of AI research in biomedicine. In addition, this article highlights the challenge of rapid AI development against the backdrop of disparate regulatory frameworks, calling for a global approach to address concerns around data misuse, unintended surveillance, and the equitable distribution of AI's benefits and burdens. Finally, a number of potential solutions to these ethical quandaries are offered. Namely, the merits of advocating for a collaborative, informed, and flexible regulatory approach that balances innovation with individual rights and public welfare, fostering a trustworthy AI-driven healthcare ecosystem, are discussed.

Revolutionizing Intracranial Hemorrhage Diagnosis: A Retrospective Analytical Study of Viz.ai ICH for Enhanced Diagnostic Accuracy

Introduction Artificial intelligence (AI) alerts the radiologist to the presence of intracranial hemorrhage (ICH) as fast as 1-2 minutes from scan completion, leading to faster diagnosis and treatment. We wanted to validate a new AI application called Viz.ai ICH to improve the diagnosis of suspected ICH. Methods We performed a retrospective analysis of 4,203 consecutive non-contrast brain computed tomography (CT) reports in a single institution between September 1, 2021, and January 31, 2022. The reports were made by neuroradiologists who reviewed each case for the presence of ICH. Reports and identified cases with positive findings for ICH were reviewed. Positive cases were categorized based on subtype, timing, and size/volume. Viz.ai ICH output was reviewed for positive cases. This AI model was validated by assessing its performance with Viz.ai ICH as the index test compared to the neuroradiologists' interpretation as the gold standard. Results According to neuroradiologists, 9.2% of non-contrast brain CT reports were positive for ICH. The sensitivity of Viz.ai ICH was 85%, specificity was 98%, positive predictive value was 81%, and negative predictive value was 99%. Subgroup analysis was performed based on intraparenchymal, subarachnoid, subdural, and intraventricular subtypes. Sensitivities were 94%, 79%, 83%, and 44%, respectively. Further stratification revealed sensitivity improves with higher acuity and volume/size across subtypes. Conclusion Our analysis indicates that AI can accurately detect ICH's presence, particularly for large-volume/large-size ICH. The paper introduces a novel AI model for detecting ICH. This advancement contributes to the field by revolutionizing ICH detection and improving patient outcomes.

[Artificial Intelligence in Head and Neck Surgery: Potentials, Challenges, and Ethical Considerations]

BACKGROUND

The growing prominence of Artificial Intelligence (AI) in medicine introduces both transformative possibilities and potential challenges. Our study focuses on the current status and perceptions of AI in Head and Neck Surgery (HNS), examining its utilization, benefits, ethical concerns, and protective measures.

OBJECTIVES

The study aims to illuminate the existing landscape of AI in HNS in Germany.

MATERIALS AND METHODS

Conducted through a questionnaire, key aspects include its current usage, potential applications (e.g., diagnosis, surgical planning), anticipated benefits (e.g., improved patient care ), and significant ethical concerns (e.g., miscalculations by AI, data privacy).

RESULTS

The survey reveals limited AI adoption in HNS, with substantial potential for improvement. Ethical considerations, especially miscalculations by AI and data privacy, emerge as central issues. The survey emphasizes the crucial role of physician control and the need for legal oversight to address concerns related to AI integration. While AI's presence in HNS is modest, the study identifies opportunities for enhancement. Ethical guidelines and practitioner-centric control are vital for discussions surrounding AI integration.

CONCLUSIONS

This research underscores the significance of ethical considerations and practitioner control in the context of AI in surgical practices. It highlights the demand for targeted training to empower practitioners in navigating the complexities of AI technologies in healthcare, ensuring responsible and patient-centric implementation.

Artificial Intelligence in Perioperative Care: Opportunities and Challenges

Artificial intelligence (AI) applications have great potential to enhance perioperative care. This paper explores promising areas for AI in anesthesiology; expertise, stakeholders, and infrastructure for development; and barriers and challenges to implementation.

Artificial intelligence in medical education - perception among medical students

BACKGROUND

As Artificial Intelligence (AI) becomes pervasive in healthcare, including applications like robotic surgery and image analysis, the World Medical Association emphasises integrating AI education into medical curricula. This study evaluates medical students' perceptions of 'AI in medicine', their preferences for AI training in education, and their grasp of AI's ethical implications in healthcare.

MATERIALS & METHODS

A cross-sectional study was conducted among 325 medical students in Kerala using a pre-validated, semi structured questionnaire. The survey collected demographic data, any past educational experience about AI, participants' self-evaluation of their knowledge and evaluated self-perceived understanding of applications of AI in medicine. Participants responded to twelve Likert-scale questions targeting perceptions and ethical aspects and their opinions on suggested topics on AI to be included in their curriculum.

RESULTS & DISCUSSION

AI was viewed as an assistive technology for reducing medical errors by 57.2% students and 54.2% believed AI could enhance medical decision accuracy. About 49% agreed that AI could potentially improve accessibility to healthcare. Concerns about AI replacing physicians were reported by 37.6% and 69.2% feared a reduction in the humanistic aspect of medicine. Students were worried about challenges to trust (52.9%), patient-physician relationships (54.5%) and breach of professional confidentiality (53.5%). Only 3.7% felttotally competent in informing patients about features and risks associated with AI applications. Strong demand for structured AI training was expressed, particularly on reducing medical errors (76.9%) and ethical issues (79.4%).

CONCLUSION

This study highlights medical students' demand for structured AI training in undergraduate curricula, emphasising its importance in addressing evolving healthcare needs and ethical considerations. Despite widespread ethical concerns, the majority perceive AI as an assistive technology in healthcare. These findings provide valuable insights for curriculum development and defining learning outcomes in AI education for medical students.

Evaluating the performance of Generative Pre-trained Transformer-4 (GPT-4) in standardizing radiology reports

OBJECTIVE

Radiology reporting is an essential component of clinical diagnosis and decision-making. With the advent of advanced artificial intelligence (AI) models like GPT-4 (Generative Pre-trained Transformer 4), there is growing interest in evaluating their potential for optimizing or generating radiology reports. This study aimed to compare the quality and content of radiologist-generated and GPT-4 AI-generated radiology reports.

METHODS

A comparative study design was employed in the study, where a total of 100 anonymized radiology reports were randomly selected and analyzed. Each report was processed by GPT-4, resulting in the generation of a corresponding AI-generated report. Quantitative and qualitative analysis techniques were utilized to assess similarities and differences between the two sets of reports.

RESULTS

The AI-generated reports showed comparable quality to radiologist-generated reports in most categories. Significant differences were observed in clarity (p = 0.027), ease of understanding (p = 0.023), and structure (p = 0.050), favoring the AI-generated reports. AI-generated reports were more concise, with 34.53 fewer words and 174.22 fewer characters on average, but had greater variability in sentence length. Content similarity was high, with an average Cosine Similarity of 0.85, Sequence Matcher Similarity of 0.52, BLEU Score of 0.5008, and BERTScore F1 of 0.8775.

CONCLUSION

The results of this proof-of-concept study suggest that GPT-4 can be a reliable tool for generating standardized radiology reports, offering potential benefits such as improved efficiency, better communication, and simplified data extraction and analysis. However, limitations and ethical implications must be addressed to ensure the safe and effective implementation of this technology in clinical practice.

CLINICAL RELEVANCE STATEMENT

The findings of this study suggest that GPT-4 (Generative Pre-trained Transformer 4), an advanced AI model, has the potential to significantly contribute to the standardization and optimization of radiology reporting, offering improved efficiency and communication in clinical practice.

KEY POINTS

• Large language model-generated radiology reports exhibited high content similarity and moderate structural resemblance to radiologist-generated reports. • Performance metrics highlighted the strong matching of word selection and order, as well as high semantic similarity between AI and radiologist-generated reports. • Large language model demonstrated potential for generating standardized radiology reports, improving efficiency and communication in clinical settings.

AI Quality Standards in Health Care: Rapid Umbrella Review

BACKGROUND

In recent years, there has been an upwelling of artificial intelligence (AI) studies in the health care literature. During this period, there has been an increasing number of proposed standards to evaluate the quality of health care AI studies.

OBJECTIVE

This rapid umbrella review examines the use of AI quality standards in a sample of health care AI systematic review articles published over a 36-month period.

METHODS

We used a modified version of the Joanna Briggs Institute umbrella review method. Our rapid approach was informed by the practical guide by Tricco and colleagues for conducting rapid reviews. Our search was focused on the MEDLINE database supplemented with Google Scholar. The inclusion criteria were English-language systematic reviews regardless of review type, with mention of AI and health in the abstract, published during a 36-month period. For the synthesis, we summarized the AI quality standards used and issues noted in these reviews drawing on a set of published health care AI standards, harmonized the terms used, and offered guidance to improve the quality of future health care AI studies.

RESULTS

We selected 33 review articles published between 2020 and 2022 in our synthesis. The reviews covered a wide range of objectives, topics, settings, designs, and results. Over 60 AI approaches across different domains were identified with varying levels of detail spanning different AI life cycle stages, making comparisons difficult. Health care AI quality standards were applied in only 39% (13/33) of the reviews and in 14% (25/178) of the original studies from the reviews examined, mostly to appraise their methodological or reporting quality. Only a handful mentioned the transparency, explainability, trustworthiness, ethics, and privacy aspects. A total of 23 AI quality standard-related issues were identified in the reviews. There was a recognized need to standardize the planning, conduct, and reporting of health care AI studies and address their broader societal, ethical, and regulatory implications.

CONCLUSIONS

Despite the growing number of AI standards to assess the quality of health care AI studies, they are seldom applied in practice. With increasing desire to adopt AI in different health topics, domains, and settings, practitioners and researchers must stay abreast of and adapt to the evolving landscape of health care AI quality standards and apply these standards to improve the quality of their AI studies.

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Unveiling the Influence of AI Predictive Analytics on Patient Outcomes: A Comprehensive Narrative Review

This comprehensive literature review explores the transformative impact of artificial intelligence (AI) predictive analytics on healthcare, particularly in improving patient outcomes regarding disease progression, treatment response, and recovery rates. AI, encompassing capabilities such as learning, problem-solving, and decision-making, is leveraged to predict disease progression, optimize treatment plans, and enhance recovery rates through the analysis of vast datasets, including electronic health records (EHRs), imaging, and genetic data. The utilization of machine learning (ML) and deep learning (DL) techniques in predictive analytics enables personalized medicine by facilitating the early detection of conditions, precision in drug discovery, and the tailoring of treatment to individual patient profiles. Ethical considerations, including data privacy, bias, and accountability, emerge as vital in the responsible implementation of AI in healthcare. The findings underscore the potential of AI predictive analytics in revolutionizing clinical decision-making and healthcare delivery, emphasizing the necessity of ethical guidelines and continuous model validation to ensure its safe and effective use in augmenting human judgment in medical practice.

Learning with an evolving medicine label: how artificial intelligence-based medication recommendation systems must adapt to changing medication labels

INTRODUCTION

Artificial intelligence or machine learning (AI/ML) based systems can help personalize prescribing decisions for individual patients. The recommendations of these clinical decision support systems must relate to the "label" of the medicines involved. The label of a medicine is an approved guide that indicates how to prescribe the drug in a safe and effective manner.

AREAS COVERED

The label for a medicine may evolve as new information on drug safety and effectiveness emerges, leading to the addition or removal of warnings, drug-drug interactions, or to permit new indications. However, the speed at which these updates are made to these AI/ML recommendation systems may be delayed and could influence the safety of prescribing decisions. This article explores the need to keep AI/ML tools 'in sync' with any label changes. Additionally, challenges relating to medicine availability and geographical suitability are discussed.

EXPERT OPINION

These considerations highlight the important role that pharmacoepidemiologists and drug safety professionals must play within the monitoring and use of these tools. Furthermore, these issues highlight the guiding role that regulators need to have in planning and oversight of these tools.

Predicting the Progression of Chronic Kidney Disease: A Systematic Review of Artificial Intelligence and Machine Learning Approaches

Chronic kidney disease (CKD) is a progressive condition characterized by gradual loss of kidney function, necessitating timely monitoring and interventions. This systematic review comprehensively evaluates the application of artificial intelligence (AI) and machine learning (ML) techniques for predicting CKD progression. A rigorous literature search identified 13 relevant studies employing diverse AI/ML algorithms, including logistic regression, support vector machines, random forests, neural networks, and deep learning approaches. These studies primarily aimed to predict CKD progression to end-stage renal disease (ESRD) or the need for renal replacement therapy, with some focusing on diabetic kidney disease progression, proteinuria, or estimated glomerular filtration rate (GFR) decline. The findings highlight the promising predictive performance of AI/ML models, with several achieving high accuracy, sensitivity, specificity, and area under the receiver operating characteristic curve scores. Key factors contributing to enhanced prediction included incorporating longitudinal data, baseline characteristics, and specific biomarkers such as estimated GFR, proteinuria, serum albumin, and hemoglobin levels. Integration of these predictive models with electronic health records and clinical decision support systems offers opportunities for timely risk identification, early interventions, and personalized management strategies. While challenges related to data quality, bias, and ethical considerations exist, the reviewed studies underscore the potential of AI/ML techniques to facilitate early detection, risk stratification, and targeted interventions for CKD patients. Ongoing research, external validation, and careful implementation are crucial to leveraging these advanced analytical approaches in clinical practice, ultimately improving outcomes and reducing the burden of CKD.

Artificial Intelligence and Healthcare: A Journey through History, Present Innovations, and Future Possibilities

Artificial intelligence (AI) has emerged as a powerful tool in healthcare significantly impacting practices from diagnostics to treatment delivery and patient management. This article examines the progress of AI in healthcare, starting from the field's inception in the 1960s to present-day innovative applications in areas such as precision medicine, robotic surgery, and drug development. In addition, the impact of the COVID-19 pandemic on the acceleration of the use of AI in technologies such as telemedicine and chatbots to enhance accessibility and improve medical education is also explored. Looking forward, the paper speculates on the promising future of AI in healthcare while critically addressing the ethical and societal considerations that accompany the integration of AI technologies. Furthermore, the potential to mitigate health disparities and the ethical implications surrounding data usage and patient privacy are discussed, emphasizing the need for evolving guidelines to govern AI's application in healthcare.

Development of a scoring system to quantify errors from semantic characteristics in incident reports

OBJECTIVES

Incident reporting systems are widely used to identify risks and enable organisational learning. Free-text descriptions contain important information about factors associated with incidents. This study aimed to develop error scores by extracting information about the presence of error factors in incidents using an original decision-making model that partly relies on natural language processing techniques.

METHODS

We retrospectively analysed free-text data from reports of incidents between January 2012 and December 2022 from Nagoya University Hospital, Japan. The sample data were randomly allocated to equal-sized training and validation datasets. We conducted morphological analysis on free text to segment terms from sentences in the training dataset. We calculated error scores for terms, individual reports and reports from staff groups according to report volume size and compared these with conventional classifications by patient safety experts. We also calculated accuracy, recall, precision and F-score values from the proposed 'report error score'.

RESULTS

Overall, 114 013 reports were included. We calculated 36 131 'term error scores' from the 57 006 reports in the training dataset. There was a significant difference in error scores between reports of incidents categorised by experts as arising from errors (p<0.001, d=0.73 (large)) and other incidents. The accuracy, recall, precision and F-score values were 0.8, 0.82, 0.85 and 0.84, respectively. Group error scores were positively associated with expert ratings (correlation coefficient, 0.66; 95% CI 0.54 to 0.75, p<0.001) for all departments.

CONCLUSION

Our error scoring system could provide insights to improve patient safety using aggregated incident report data.

A Systematic Review of the Application of Artificial Intelligence in Nursing Care: Where are We, and What's Next?

Background

Integrating Artificial Intelligence (AI) into healthcare has transformed the landscape of patient care and healthcare delivery. Despite this, there remains a notable gap in the existing literature synthesizing the comprehensive understanding of AI's utilization in nursing care.

Objective

This systematic review aims to synthesize the available evidence to comprehensively understand the application of AI in nursing care.

Methods

Studies published between January 2019 and December 2023, identified through CINAHL Plus with Full Text, Web of Science, PubMed, and Medline, were included in this review. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines guided the identification, screening, exclusion, and inclusion of articles. The convergent integrated analysis framework, as proposed by the Joanna Briggs Institute, was employed to synthesize data from the included studies for theme generation.

Results

A total of 337 records were identified from databases. Among them, 35 duplicates were removed, and 302 records underwent eligibility screening. After applying inclusion and exclusion criteria, eleven studies were deemed eligible and included in this review. Through data synthesis of these studies, six themes pertaining to the use of AI in nursing care were identified: 1) Risk Identification, 2) Health Assessment, 3) Patient Classification, 4) Research Development, 5) Improved Care Delivery and Medical Records, and 6) Developing a Nursing Care Plan.

Conclusion

This systematic review contributes valuable insights into the multifaceted applications of AI in nursing care. Through the synthesis of data from the included studies, six distinct themes emerged. These findings not only consolidate the current knowledge base but also underscore the diverse ways in which AI is shaping and improving nursing care practices.

Potential Applications of Artificial Intelligence (AI) in Managing Polypharmacy in Saudi Arabia: A Narrative Review

Prescribing medications is a fundamental practice in the management of illnesses that necessitates in-depth knowledge of clinical pharmacology. Polypharmacy, or the concurrent use of multiple medications by individuals with complex health conditions, poses significant challenges, including an increased risk of drug interactions and adverse reactions. The Saudi Vision 2030 prioritises enhancing healthcare quality and safety, including addressing polypharmacy. Artificial intelligence (AI) offers promising tools to optimise medication plans, predict adverse drug reactions and ensure drug safety. This review explores AI's potential to revolutionise polypharmacy management in Saudi Arabia, highlighting practical applications, challenges and the path forward for the integration of AI solutions into healthcare practices.

Risks and benefits associated with the primary functions of artificial intelligence powered autoinjectors

Objectives

This research aims to present and assess the Primary Functions of autoinjectors introduced in ISO 11608-1:2022. Investigate the risks in current autoinjector technology, identify and assess risks and benefits associated with Artificial Intelligence (AI) powered autoinjectors, and propose a framework for mitigating these risks. ISO 11608-1:2022 is a standard that specifies requirements and test methods for needle-based injection systems intended to deliver drugs, focusing on design and function to ensure patient safety and product effectiveness. 'KZH' is an FDA product code used to classify autoinjectors, for regulatory purposes, ensuring they meet defined safety and efficacy standards before being marketed.

Method

A comprehensive analysis of autoinjectors problems is conducted using data from the United States Food and Drug Administration (FDA) database. This database records medical device reporting events, including those related to autoinjectors, reported by various sources. The analysis focuses on events associated with the product code KZH, covering data from January 1, 2008, to September 30, 2023. This research employs statistical frequency analysis and incorporates pertinent the FDA, United Kingdom, European Commission regulations, and ISO standards.

Results

500 medical device reporting events are assessed for autoinjectors under the KZH code. Ultimately, 188 of these events are confirmed to be associated with autoinjectors, all 500 medical devices were seen to lack AI capabilities. An analysis of these events for traditional mechanical autoinjectors revealed a predominant occurrence of malfunctions (72%) and injuries (26%) among event types. Device problems, such as breakage, defects, jams, and others, accounted for 45% of incidents, while 10% are attributed to patient problems, particularly missed and underdoses.

Conclusion

Traditional autoinjectors are designed to assist patients in medication administration, underscoring the need for quality control, reliability, and design enhancements. AI autoinjectors, sharing this goal, bring additional cybersecurity and software risks, requiring a comprehensive risk management framework that includes standards, tools, training, and ongoing monitoring. The integration of AI promises to improve functionality, enable real-time monitoring, and facilitate remote clinical trials, timely interventions, and tailored medical treatments.

Quantification of vesicoureteral reflux using machine learning

INTRODUCTION

The radiographic grading of voiding cystourethrogram (VCUG) images is often used to determine the clinical course and appropriate treatment in patients with vesicoureteral reflux (VUR). However, image-based evaluation of VUR remains highly subjective, so we developed a supervised machine learning model to automatically and objectively grade VCUG data.

STUDY DESIGN

A total of 113 VCUG images were gathered from public sources to compile the dataset for this study. For each image, VUR severity was graded by four pediatric radiologists and three pediatric urologists (low severity scored 1-3; high severity 4-5). Ground truth for each image was assigned based on the grade diagnosed by a majority of the expert assessors. Nine features were extracted from each VCUG image, then six machine learning models were trained, validated, and tested using 'leave-one-out' cross-validation. All features were compared and contrasted, with the highest-ranked then being used to train the final models.

RESULTS

F1-score is a metric that is often used to indicate performance accuracy of machine learning models. When using the highest-ranked VCUG image features, F1-scores for the support vector machine (SVM) and multi-layer perceptron (MLP) classifiers were 90.27 % and 91.14 %, respectively, indicating a high level of accuracy. When using all features combined, F1 scores were 89.37 % for SVM and 90.27 % for MLP.

DISCUSSION

These findings indicate that a distorted pattern of renal calyces is an accurate predictor of high-grade VUR. Machine learning protocols can be enhanced in future to improve objective grading of VUR.

Critical review of self-diagnosis of mental health conditions using artificial intelligence

The advent of artificial intelligence (AI) has revolutionised various aspects of our lives, including mental health nursing. AI-driven tools and applications have provided a convenient and accessible means for individuals to assess their mental well-being within the confines of their homes. Nonetheless, the widespread trend of self-diagnosing mental health conditions through AI poses considerable risks. This review article examines the perils associated with relying on AI for self-diagnosis in mental health, highlighting the constraints and possible adverse outcomes that can arise from such practices. It delves into the ethical, psychological, and social implications, underscoring the vital role of mental health professionals, including psychologists, psychiatrists, and nursing specialists, in providing professional assistance and guidance. This article aims to highlight the importance of seeking professional assistance and guidance in addressing mental health concerns, especially in the era of AI-driven self-diagnosis.

The value of machine learning technology and artificial intelligence to enhance patient safety in spine surgery: a review

Machine learning algorithms have the potential to significantly improve patient safety in spine surgeries by providing healthcare professionals with valuable insights and predictive analytics. These algorithms can analyze preoperative data, such as patient demographics, medical history, and imaging studies, to identify potential risk factors and predict postoperative complications. By leveraging machine learning, surgeons can make more informed decisions, personalize treatment plans, and optimize surgical techniques to minimize risks and enhance patient outcomes. Moreover, by harnessing the power of machine learning, healthcare providers can make data-driven decisions, personalize treatment plans, and optimize surgical interventions, ultimately enhancing the quality of care in spine surgery. The findings highlight the potential of integrating artificial intelligence in healthcare settings to mitigate risks and enhance patient safety in surgical practices. The integration of machine learning holds immense potential for enhancing patient safety in spine surgeries. By leveraging advanced algorithms and predictive analytics, healthcare providers can optimize surgical decision-making, mitigate risks, and personalize treatment strategies to improve outcomes and ensure the highest standard of care for patients undergoing spine procedures. As technology continues to evolve, the future of spine surgery lies in harnessing the power of machine learning to transform patient safety and revolutionize surgical practices. The present review article was designed to discuss the available literature in the field of machine learning techniques to enhance patient safety in spine surgery.

Exploring approaches to contemporary clinical incident analysis methods within acute care settings: a scoping review protocol

OBJECTIVE

This review will explore the literature on contemporary incident analysis methods used in acute hospital settings, identifying types and characteristics of these methods and how they are used to minimize, prevent, or learn from errors and improve patient safety.

INTRODUCTION

Safety is a major focus in health care; however, despite best efforts, errors and incidents still occur, leading to harm or potential harm to patients, families, carers, staff, or the organization. Incident analysis methods aim to reduce risk of harm. Traditional methods have been criticized for failing to consider the complexity of health care and the dynamic nature of acute care settings. Alternative methodologies are being sought to achieve higher levels of patient safety and care quality care in hospitals. Learning from errors and communicating with those involved in incidents are key requirements in contemporary incident analysis.

INCLUSION CRITERIA

This review will consider empirical research published since 2013, reporting on the use of clinical incident analysis methods within acute care settings. The review will explore ways in which consumers or stakeholders (eg, clinicians or other hospital workers, patients, families, carers, visitors) have been included in these analysis methods and how data have been used to support changes in the service or organization.

METHODS

Following JBI methods and PRISMA-ScR reporting guidance, we will search PubMed, CINAHL (EBSCOhost), Embase, Scopus, the Cochrane Library, Web of Science, and ProQuest Dissertations and Theses. Studies will be reviewed independently, with results presented in tables, figures, and narrative summaries according to the concepts of interest.

Clinical data mining: challenges, opportunities, and recommendations for translational applications

Clinical data mining of predictive models offers significant advantages for re-evaluating and leveraging large amounts of complex clinical real-world data and experimental comparison data for tasks such as risk stratification, diagnosis, classification, and survival prediction. However, its translational application is still limited. One challenge is that the proposed clinical requirements and data mining are not synchronized. Additionally, the exotic predictions of data mining are difficult to apply directly in local medical institutions. Hence, it is necessary to incisively review the translational application of clinical data mining, providing an analytical workflow for developing and validating prediction models to ensure the scientific validity of analytic workflows in response to clinical questions. This review systematically revisits the purpose, process, and principles of clinical data mining and discusses the key causes contributing to the detachment from practice and the misuse of model verification in developing predictive models for research. Based on this, we propose a niche-targeting framework of four principles: Clinical Contextual, Subgroup-Oriented, Confounder- and False Positive-Controlled (CSCF), to provide guidance for clinical data mining prior to the model's development in clinical settings. Eventually, it is hoped that this review can help guide future research and develop personalized predictive models to achieve the goal of discovering subgroups with varied remedial benefits or risks and ensuring that precision medicine can deliver its full potential.

Navigating the Future: The Transformative Impact of Artificial Intelligence on Hospital Management- A Comprehensive Review

This comprehensive review explores the transformative impact of artificial intelligence (AI) on hospital management, delving into its applications, challenges, and future trends. Integrating AI in administrative functions, clinical operations, and patient engagement holds significant promise for enhancing efficiency, optimizing resource allocation, and revolutionizing patient care. However, this evolution is accompanied by ethical, legal, and operational considerations that necessitate careful navigation. The review underscores key findings, emphasizing the implications for the future of hospital management. It calls for a proactive approach, urging stakeholders to invest in education, prioritize ethical guidelines, foster collaboration, advocate for thoughtful regulation, and embrace a culture of innovation. The healthcare industry can successfully navigate this transformative era through collective action, ensuring that AI contributes to more effective, accessible, and patient-centered healthcare delivery.

Navigating the Future: A Comprehensive Review of Artificial Intelligence Applications in Gastrointestinal Cancer

This comprehensive review explores the transformative role of artificial intelligence (AI) in the realm of gastrointestinal cancer. Gastrointestinal cancers present unique challenges, necessitating precise diagnostic tools and personalized treatment strategies. Leveraging AI, particularly machine learning and deep learning algorithms, has demonstrated remarkable potential in revolutionizing early detection, treatment planning, prognosis, and drug development. The analysis of current research and technological advancements underscores the capacity of AI to unravel intricate patterns within extensive datasets, providing actionable insights that enhance diagnostic accuracy and treatment efficacy. The transformative impact of AI on the landscape of gastrointestinal cancer is emphasized, signaling a paradigm shift towards more precise and targeted cancer care. The conclusion emphasizes the need for sustained research efforts and collaborative initiatives among AI researchers, healthcare professionals, and policymakers. By fostering interdisciplinary collaboration, we can navigate the evolving field of gastrointestinal cancer care, embracing the potential of AI to improve patient outcomes and contribute to a more effective and personalized approach to cancer management.

From Machine Learning to Patient Outcomes: A Comprehensive Review of AI in Pancreatic Cancer

Pancreatic cancer is a highly aggressive and difficult-to-detect cancer with a poor prognosis. Late diagnosis is common due to a lack of early symptoms, specific markers, and the challenging location of the pancreas. Imaging technologies have improved diagnosis, but there is still room for improvement in standardizing guidelines. Biopsies and histopathological analysis are challenging due to tumor heterogeneity. Artificial Intelligence (AI) revolutionizes healthcare by improving diagnosis, treatment, and patient care. AI algorithms can analyze medical images with precision, aiding in early disease detection. AI also plays a role in personalized medicine by analyzing patient data to tailor treatment plans. It streamlines administrative tasks, such as medical coding and documentation, and provides patient assistance through AI chatbots. However, challenges include data privacy, security, and ethical considerations. This review article focuses on the potential of AI in transforming pancreatic cancer care, offering improved diagnostics, personalized treatments, and operational efficiency, leading to better patient outcomes.

When to err is inhuman: An examination of the influence of artificial intelligence-driven nursing care on patient safety

Artificial intelligence, as a nonhuman entity, is increasingly used to inform, direct, or supplant nursing care and clinical decision-making. The boundaries between human- and nonhuman-driven nursing care are blurred with the advent of sensors, wearables, camera devices, and humanoid robots at such an accelerated pace that the critical evaluation of its influence on patient safety has not been fully assessed. Since the pivotal release of To Err is Human, patient safety is being challenged by the dynamic healthcare environment like never before, with nursing at a critical juncture to steer the course of artificial intelligence integration in clinical decision-making. This paper presents an overview of artificial intelligence and its application in healthcare and highlights the implications which affect nursing as a profession, including perspectives on nursing education and training recommendations. The legal and policy challenges which emerge when artificial intelligence influences the risk of clinical errors and safety issues are discussed.

Artificial intelligence for predicting mortality in hospitalized COVID-19 patients

Background

The global demographic situation has been significantly impacted by the COVID-19 pandemic. The objective of this study was to develop a model that predicts the risk of COVID-associated mortality using clinical and laboratory data collected within 72 h of hospital admission.

Materials and methods

A total of 3024 subjects with PCR-confirmed COVID-19 were admitted to Almazov National Research Medical Center between May 2020 and August 2021. Among them, 6.25% (n = 189) of patients had a fatal outcome. Five machine learning models and the Boruta-SHAP feature selection method were utilized to assess the risk of mortality during COVID-19 hospitalization.

Results

All methods demonstrated high efficacy, with ROC AUC (Receiver Operating Characteristic Area Under the Curve) values exceeding 80%. The selected Boruta-SHAP features, when incorporated into the random forest model, achieved an ROC AUC of 93.1% in the validation.

Conclusion

Throughout the study, close collaboration with healthcare professionals ensured that the developed tool met their practical needs. The success of our model validates the potential of machine learning techniques as decision support systems in clinical practice.

Systematic reviews of machine learning in healthcare: a literature review

INTRODUCTION

The increasing availability of data and computing power has made machine learning (ML) a viable approach to faster, more efficient healthcare delivery.

METHODS

A systematic literature review (SLR) of published SLRs evaluating ML applications in healthcare settings published between1 January 2010 and 27 March 2023 was conducted.

RESULTS

In total 220 SLRs covering 10,462 ML algorithms were reviewed. The main application of AI in medicine related to the clinical prediction and disease prognosis in oncology and neurology with the use of imaging data. Accuracy, specificity, and sensitivity were provided in 56%, 28%, and 25% SLRs respectively. Internal and external validation was reported in 53% and less than 1% of the cases respectively. The most common modeling approach was neural networks (2,454 ML algorithms), followed by support vector machine and random forest/decision trees (1,578 and 1,522 ML algorithms, respectively).

EXPERT OPINION

The review indicated considerable reporting gaps in terms of the ML's performance, both internal and external validation. Greater accessibility to healthcare data for developers can ensure the faster adoption of ML algorithms into clinical practice.

Overcoming Low Adherence to Chronic Medications by Improving their Effectiveness using a Personalized Second-generation Digital System

INTRODUCTION

Low adherence to chronic treatment regimens is a significant barrier to improving clinical outcomes in patients with chronic diseases. Low adherence is a result of multiple factors.

METHODS

We review the relevant studies on the prevalence of low adherence and present some potential solutions.

RESULTS

This review presents studies on the current measures taken to overcome low adherence, indicating a need for better methods to deal with this problem. The use of first-generation digital systems to improve adherence is mainly based on reminding patients to take their medications, which is one of the reasons they fail to provide a solution for many patients. The establishment of a second-generation artificial intelligence system, which aims to improve the effectiveness of chronic drugs, is described.

CONCLUSION

Improving clinically meaningful outcome measures and disease parameters may increase adherence and improve patients' response to therapy.

Medical practitioner perspectives on AI in emergency triage

Introduction

A proposed Diagnostic AI System for Robot-Assisted Triage ("DAISY") is under development to support Emergency Department ("ED") triage following increasing reports of overcrowding and shortage of staff in ED care experienced within National Health Service, England ("NHS") but also globally. DAISY aims to reduce ED patient wait times and medical practitioner overload. The objective of this study was to explore NHS health practitioners' perspectives and attitudes towards the future use of AI-supported technologies in ED triage.

Methods

Between July and August 2022 a qualitative-exploratory research study was conducted to collect and capture the perceptions and attitudes of nine NHS healthcare practitioners to better understand the challenges and benefits of a DAISY deployment. The study was based on a thematic analysis of semi-structured interviews. The study involved qualitative data analysis of the interviewees' responses. Audio-recordings were transcribed verbatim, and notes included into data documents. The transcripts were coded line-by-line, and data were organised into themes and sub-themes. Both inductive and deductive approaches to thematic analysis were used to analyse such data.

Results

Based on a qualitative analysis of coded interviews with the practitioners, responses were categorised into broad main thematic-types, namely: trust; current practice; social, legal, ethical, and cultural concerns; and empathetic practice. Sub-themes were identified for each main theme. Further quantitative analyses explored the vocabulary and sentiments of the participants when talking generally about NHS ED practices compared to discussing DAISY. Limitations include a small sample size and the requirement that research participants imagine a prototype AI-supported system still under development. The expectation is that such a system would work alongside the practitioner. Findings can be generalisable to other healthcare AI-supported systems and to other domains.

Discussion

This study highlights the benefits and challenges for an AI-supported triage healthcare solution. The study shows that most NHS ED practitioners interviewed were positive about such adoption. Benefits cited were a reduction in patient wait times in the ED, assistance in the streamlining of the triage process, support in calling for appropriate diagnostics and for further patient examination, and identification of those very unwell and requiring more immediate and urgent attention. Words used to describe the system were that DAISY is a "good idea", "help", helpful, "easier", "value", and "accurate". Our study demonstrates that trust in the system is a significant driver of use and a potential barrier to adoption. Participants emphasised social, legal, ethical, and cultural considerations and barriers to DAISY adoption and the importance of empathy and non-verbal cues in patient interactions. Findings demonstrate how DAISY might support and augment human medical performance in ED care, and provide an understanding of attitudinal barriers and considerations for the development and implementation of future triage AI-supported systems.

Adopting and expanding ethical principles for generative artificial intelligence from military to healthcare

In 2020, the U.S. Department of Defense officially disclosed a set of ethical principles to guide the use of Artificial Intelligence (AI) technologies on future battlefields. Despite stark differences, there are core similarities between the military and medical service. Warriors on battlefields often face life-altering circumstances that require quick decision-making. Medical providers experience similar challenges in a rapidly changing healthcare environment, such as in the emergency department or during surgery treating a life-threatening condition. Generative AI, an emerging technology designed to efficiently generate valuable information, holds great promise. As computing power becomes more accessible and the abundance of health data, such as electronic health records, electrocardiograms, and medical images, increases, it is inevitable that healthcare will be revolutionized by this technology. Recently, generative AI has garnered a lot of attention in the medical research community, leading to debates about its application in the healthcare sector, mainly due to concerns about transparency and related issues. Meanwhile, questions around the potential exacerbation of health disparities due to modeling biases have raised notable ethical concerns regarding the use of this technology in healthcare. However, the ethical principles for generative AI in healthcare have been understudied. As a result, there are no clear solutions to address ethical concerns, and decision-makers often neglect to consider the significance of ethical principles before implementing generative AI in clinical practice. In an attempt to address these issues, we explore ethical principles from the military perspective and propose the "GREAT PLEA" ethical principles, namely Governability, Reliability, Equity, Accountability, Traceability, Privacy, Lawfulness, Empathy, and Eutonomy, for generative AI in healthcare. Furthermore, we introduce a framework for adopting and expanding these ethical principles in a practical way that has been useful in the military and can be applied to healthcare for generative AI, based on contrasting their ethical concerns and risks. Ultimately, we aim to proactively address the ethical dilemmas and challenges posed by the integration of generative AI into healthcare practice.

Machine learning models to detect and predict patient safety events using electronic health records: A systematic review

INTRODUCTION

Identifying patient safety events using electronic health records (EHRs) and automated machine learning-based detection methods can help improve the efficiency and quality of healthcare service provision.

OBJECTIVE

This study aimed to systematically review machine learning-based methods and techniques, as well as their results for patient safety event management using EHRs.

METHODS

We reviewed the studies that focused on machine learning techniques, including automatic prediction and detection of patient safety events and medical errors through EHR analysis to manage patient safety events. The data were collected by searching Scopus, PubMed (Medline), Web of Science, EMBASE, and IEEE Xplore databases.

RESULTS

After screening, 41 papers were reviewed. Support vector machine (SVM), random forest, conditional random field (CRF), and bidirectional long short-term memory with conditional random field (BiLSTM-CRF) algorithms were mostly applied to predict, identify, and classify patient safety events using EHRs; however, they had different performances. BiLSTM-CRF was employed in most of the studies to extract and identify concepts, e.g., adverse drug events (ADEs) and adverse drug reactions (ADRs), as well as relationships between drug and severity, drug and ADEs, drug and ADRs. Recurrent neural networks (RNN) and BiLSTM-CRF had the best results in detecting ADEs compared to other patient safety events. Linear classifiers and Naive Bayes (NB) had the highest performance for ADR detection. Logistic regression had the best results in detecting surgical site infections. According to the findings, the quality of articles has non-significantly improved in recent years, but they had low average scores.

CONCLUSIONS

Machine learning can be useful in automatic detection and prediction of patient safety events. However, most of these algorithms have not yet been externally validated or prospectively tested. Therefore, further studies are required to improve the performance of these automated systems.

A systematic scoping review protocol to summarise and appraise the use of artificial intelligence in the analysis of digital videos of invasive general surgical procedures

Background

Intraoperative video recordings are a valuable addition to operative written documentation. However, the review of these videos often requires surgical expertise and takes considerable time. While a large amount of work has been undertaken to understand the role of artificial intelligence (AI) in healthcare more generally, the application of these techniques to automate the analysis of surgical videos is currently unclear. In this systematic scoping review, we sought to give a contemporary overview of the use of AI research in the analysis of digital videos of invasive general surgical procedures. We will describe and summarise the study characteristics, purpose of the applications and stage of development, to ascertain how these techniques might be applied in future research and to identify gaps in current knowledge (e.g. uncertainties about the study methods).

Methods

Systematic searches will be conducted in OVID Medline and Embase, using terms related to 'artificial intelligence', 'surgery' and 'video' to identify all potentially relevant studies published since 1st January 2012. All primary studies where AI has been applied to the analysis of videos (recorded by conventional digital cameras or laparoscopic or robotic-assisted technology) of general surgical procedures will be included. Data extraction will include study characteristics, governance, details of video datasets and AI models, measures of accuracy, validation and any reported limitations.

Ethics and dissemination

No ethical approval is required as primary data will not be collected. The results will be disseminated at relevant conferences, on social media and published in a peer-reviewed journal.

Development and Validation of Deep-Learning-Based Sepsis and Septic Shock Early Prediction System (DeepSEPS) Using Real-World ICU Data

BACKGROUND

Successful sepsis treatment depends on early diagnosis. We aimed to develop and validate a system to predict sepsis and septic shock in real time using deep learning.

METHODS

Clinical data were retrospectively collected from electronic medical records (EMRs). Data from 2010 to 2019 were used as development data, and data from 2020 to 2021 were used as validation data. The collected EMRs consisted of eight vital signs, 13 laboratory data points, and three demographic information items. We validated the deep-learning-based sepsis and septic shock early prediction system (DeepSEPS) using the validation datasets and compared our system with other traditional early warning scoring systems, such as the national early warning score, sequential organ failure assessment (SOFA), and quick sequential organ failure assessment.

RESULTS

DeepSEPS achieved even higher area under receiver operating characteristic curve (AUROC) values (0.7888 and 0.8494 for sepsis and septic shock, respectively) than SOFA. The prediction performance of traditional scoring systems was enhanced because the early prediction time point was close to the onset time of sepsis; however, the DeepSEPS scoring system consistently outperformed all conventional scoring systems at all time points. Furthermore, at the time of onset of sepsis and septic shock, DeepSEPS showed the highest AUROC (0.9346).

CONCLUSIONS

The sepsis and septic shock early warning system developed in this study exhibited a performance that is worth considering when predicting sepsis and septic shock compared to other traditional early warning scoring systems. DeepSEPS showed better performance than existing sepsis prediction programs. This novel real-time system that simultaneously predicts sepsis and septic shock requires further validation.