1
|
Sahoo RK, Sahoo KC, Negi S, Baliarsingh SK, Panda B, Pati S. Health professionals' perspectives on the use of Artificial Intelligence in healthcare: A systematic review. PATIENT EDUCATION AND COUNSELING 2025; 134:108680. [PMID: 39893988 DOI: 10.1016/j.pec.2025.108680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Revised: 01/09/2025] [Accepted: 01/21/2025] [Indexed: 02/04/2025]
Abstract
INTRODUCTION Artificial Intelligence (AI) is fast emerging as a crucial tool for improving patient care and treatment outcomes; however, concerns persist among health professionals about potential compromises in quality care and loss of jobs. The availability of systematic evidence on health professionals' perspectives on AI in healthcare is limited. OBJECTIVE This systematic review aims to document the perceived advantages and disadvantages associated with AI applications in healthcare. METHOD We conducted a comprehensive search across databases - Embase, PubMed/Medline, IEEE, and Epistemonikos up to November 2023, using 'Artificial Intelligence' AND 'health professionals' as key domains. We searched for studies that describe the perceptions of healthcare professionals towards AI in healthcare. FINDINGS We identified 3931 records. After screening, 25 articles were selected, and 11 were included in the final review. The studies highlight the benefits of AI in healthcare, such as consultation summaries, data management, patient triaging, and referrals, but also raise concerns about job loss, over-reliance, legal implications, and data privacy concerns. CONCLUSION AI enhances care delivery efficiency, and concerns arise due to knowledge and experience gaps. Therefore, healthcare workforce education and skill development are crucial for AI adoption, implementation, and future research.
Collapse
Affiliation(s)
- Rakesh Kumar Sahoo
- KIIT School of Public Health, KIIT Deemed to be university, Bhubaneswar - 751024, India; ICMR-Regional Medical Research Centre, Bhubaneswar - 751023, India
| | - Krushna Chandra Sahoo
- Health Technology Assessment in India, Department of Health Research, Ministry of Health & Family Welfare, New Delhi - 11000, India; ICMR-Regional Medical Research Centre, Bhubaneswar - 751023, India
| | - Sapna Negi
- ICMR-Regional Medical Research Centre, Bhubaneswar - 751023, India
| | | | - Bhuputra Panda
- KIIT School of Public Health, KIIT Deemed to be university, Bhubaneswar - 751024, India.
| | - Sanghamitra Pati
- ICMR-Regional Medical Research Centre, Bhubaneswar - 751023, India.
| |
Collapse
|
2
|
Zaboski BA, Bednarek L. Precision Psychiatry for Obsessive-Compulsive Disorder: Clinical Applications of Deep Learning Architectures. J Clin Med 2025; 14:2442. [PMID: 40217892 DOI: 10.3390/jcm14072442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2025] [Revised: 03/20/2025] [Accepted: 04/01/2025] [Indexed: 04/14/2025] Open
Abstract
Obsessive-compulsive disorder (OCD) is a complex psychiatric condition characterized by significant heterogeneity in symptomatology and treatment response. Advances in neuroimaging, EEG, and other multimodal datasets have created opportunities to identify biomarkers and predict outcomes, yet traditional statistical methods often fall short in analyzing such high-dimensional data. Deep learning (DL) offers powerful tools for addressing these challenges by leveraging architectures capable of classification, prediction, and data generation. This brief review provides an overview of five key DL architectures-feedforward neural networks, convolutional neural networks, recurrent neural networks, generative adversarial networks, and transformers-and their applications in OCD research and clinical practice. We highlight how these models have been used to identify the neural predictors of treatment response, diagnose and classify OCD, and advance precision psychiatry. We conclude by discussing the clinical implementation of DL, summarizing its advances and promises in OCD, and underscoring key challenges for the field.
Collapse
Affiliation(s)
- Brian A Zaboski
- Yale School of Medicine, Department of Psychiatry, Yale University, New Haven, CT 06510, USA
| | - Lora Bednarek
- Department of Psychology, University of California, San Diego, CA 92093, USA
| |
Collapse
|
3
|
Scalise E, Costa D, Gallelli G, Ielapi N, Turchino D, Accarino G, Faga T, Michael A, Bracale UM, Andreucci M, Serra R. Biomarkers and Social Determinants in Atherosclerotic Arterial Diseases: A Scoping Review. Ann Vasc Surg 2025; 113:41-63. [PMID: 39863282 DOI: 10.1016/j.avsg.2024.12.076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2024] [Revised: 12/27/2024] [Accepted: 12/27/2024] [Indexed: 01/27/2025]
Abstract
BACKGROUND Arterial diseases like coronary artery disease (CAD), carotid stenosis (CS), peripheral artery disease (PAD), and abdominal aortic aneurysm (AAA) have high morbidity and mortality, making them key research areas. Their multifactorial nature complicates patient treatment and prevention. Biomarkers offer insights into the biochemical and molecular processes, while social factors also significantly impact patients' health and quality of life. This scoping review aims to search the literature for studies that have linked the biological mechanisms of arterial diseases through biomarkers with social issues and to analyze them, supporting the interdependence of biological and social sciences. METHODS After a rigorous selection process, adhering to the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidelines for Scoping Reviews, 30 articles were identified through Scopus, Web of Science, and PubMed. Inclusion and exclusion criteria were based on the population, intervention, comparator, outcome, time, and setting framework. Inclusion criteria were studies involving human subjects that explored the relationships among arterial diseases, biomarkers, and psychosocial factors, with no restrictions on publication date. Nonhuman studies, purely biological or medical analyses without psychosocial dimensions, and non-English publications were excluded. Eligible study types included experimental, observational, and review articles published in peer-reviewed journals. Data extraction focused on study characteristics, such as authors, publication year, country, methods, population, and findings. Results were synthesized narratively, as this format was deemed the most suitable for summarizing diverse findings. The quality or methodological rigor of the included studies was not formally assessed, consistent with the scoping review methodology. RESULTS In CAD, biomarkers such as high-sensitivity C-reactive protein are strongly associated with psychological stress, whereas lipoprotein (a) and the apolipoprotein B/apolipoprotein A1 ratio reflect lipid profiles that are influenced by socioeconomic factors and ethnicity. In CS, increased carotid intima-media thickness is linked to psychiatric conditions like attention deficit/hyperactivity disorder, and heat shock protein-70 levels are associated with socioeconomic status and gender. In PAD, inflammatory markers, including interleukin-6, intracellular adhesion molecule-1, and high-sensitivity C-reactive protein, mediate the connection between depression and disease severity, with gender and ethnicity influencing the expression of biomarkers and clinical outcomes. In AAA, factors like smoking and exposure to air pollution have increased matrix metalloproteinase levels and other inflammatory markers. Additionally, estradiol provides partial protection in women, underscoring the role of hormones and environmental influences in disease progression. Social determinants such as socioeconomic status, healthcare access, and ethnicity significantly affect biomarker levels and arterial disease progression. CONCLUSIONS These findings are crucial for the assumption that social determinants of health modulate the levels of inflammatory biomarkers involved in the progression of arterial diseases such as CAD, CS, PAD, and AAA. This highlights the need to integrate highly predictive mathematical systems into clinical practice, combining biological sciences with social sciences to achieve advanced standards in precision medicine. However, further studies are needed to validate these approaches fully.
Collapse
Affiliation(s)
- Enrica Scalise
- Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy; Interuniversity Center of Phlebolymphology (CIFL), "Magna Graecia" University, Catanzaro, Italy
| | - Davide Costa
- Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy; Interuniversity Center of Phlebolymphology (CIFL), "Magna Graecia" University, Catanzaro, Italy
| | - Giuseppe Gallelli
- Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy; Interuniversity Center of Phlebolymphology (CIFL), "Magna Graecia" University, Catanzaro, Italy
| | - Nicola Ielapi
- Department of Public Health and Infectious Disease, "Sapienza" University of Rome, Roma, Italy
| | - Davide Turchino
- Department of Public Health, University Federico II of Naples, Naples, Italy
| | - Giulio Accarino
- Department of Public Health, University Federico II of Naples, Naples, Italy; Vascular Surgery Unit, Struttura Ospedaliera ad Alta Specialità Mediterranea, Naples, Italy
| | - Teresa Faga
- Department of Health Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy
| | - Ashour Michael
- Department of Health Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy
| | | | - Michele Andreucci
- Department of Health Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy
| | - Raffaele Serra
- Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, Catanzaro, Italy; Interuniversity Center of Phlebolymphology (CIFL), "Magna Graecia" University, Catanzaro, Italy.
| |
Collapse
|
4
|
Akbasli IT, Birbilen AZ, Teksam O. Leveraging large language models to mimic domain expert labeling in unstructured text-based electronic healthcare records in non-english languages. BMC Med Inform Decis Mak 2025; 25:154. [PMID: 40165165 PMCID: PMC11959812 DOI: 10.1186/s12911-025-02871-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 01/14/2025] [Indexed: 04/02/2025] Open
Abstract
BACKGROUND The integration of big data and artificial intelligence (AI) in healthcare, particularly through the analysis of electronic health records (EHR), presents significant opportunities for improving diagnostic accuracy and patient outcomes. However, the challenge of processing and accurately labeling vast amounts of unstructured data remains a critical bottleneck, necessitating efficient and reliable solutions. This study investigates the ability of domain specific, fine-tuned large language models (LLMs) to classify unstructured EHR texts with typographical errors through named entity recognition tasks, aiming to improve the efficiency and reliability of supervised learning AI models in healthcare. METHODS Turkish clinical notes from pediatric emergency room admissions at Hacettepe University İhsan Doğramacı Children's Hospital from 2018 to 2023 were analyzed. The data were preprocessed with open source Python libraries and categorized using a pretrained GPT-3 model, "text-davinci-003," before and after fine-tuning with domain-specific data on respiratory tract infections (RTI). The model's predictions were compared against ground truth labels established by pediatric specialists. RESULTS Out of 24,229 patient records classified as poorly labeled, 18,879 were identified without typographical errors and confirmed for RTI through filtering methods. The fine-tuned model achieved a 99.88% accuracy, significantly outperforming the pretrained model's 78.54% accuracy in identifying RTI cases among the remaining records. The fine-tuned model demonstrated superior performance metrics across all evaluated aspects compared to the pretrained model. CONCLUSIONS Fine-tuned LLMs can categorize unstructured EHR data with high accuracy, closely approximating the performance of domain experts. This approach significantly reduces the time and costs associated with manual data labeling, demonstrating the potential to streamline the processing of large-scale healthcare data for AI applications.
Collapse
Affiliation(s)
- Izzet Turkalp Akbasli
- Division of Pediatric Emergency, Department of Pediatrics, Faculty of Medicine, Hacettepe University, Ankara, Turkey.
- Life Support Center, Digital Health and Artificial Intelligence on Critical Care, Hacettepe University, Ankara, Turkey.
| | - Ahmet Ziya Birbilen
- Division of Pediatric Emergency, Department of Pediatrics, Faculty of Medicine, Hacettepe University, Ankara, Turkey.
| | - Ozlem Teksam
- Division of Pediatric Emergency, Department of Pediatrics, Faculty of Medicine, Hacettepe University, Ankara, Turkey
| |
Collapse
|
5
|
Brenner JL, Anibal JT, Hazen LA, Song MJ, Huth HB, Xu D, Xu S, Wood BJ. IR-GPT: AI Foundation Models to Optimize Interventional Radiology. Cardiovasc Intervent Radiol 2025:10.1007/s00270-024-03945-0. [PMID: 40140092 DOI: 10.1007/s00270-024-03945-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2024] [Accepted: 12/12/2024] [Indexed: 03/28/2025]
Abstract
Foundation artificial intelligence (AI) models are capable of complex tasks that involve text, medical images, and many other types of data, but have not yet been customized for procedural medicine. This report reviews prior work in deep learning related to interventional radiology (IR), identifying barriers to generalization and deployment at scale. Moreover, this report outlines the potential design of an "IR-GPT" foundation model to provide a unified platform for AI in IR, including data collection, annotation, and training methods-while also contextualizing challenges and highlighting potential downstream applications.
Collapse
Affiliation(s)
- Jacqueline L Brenner
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| | - James T Anibal
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA.
- Computational Health Informatics Lab, Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK.
| | - Lindsey A Hazen
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| | - Miranda J Song
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| | - Hannah B Huth
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| | | | - Sheng Xu
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| | - Bradford J Wood
- Center for Interventional Oncology, NIH Clinical Center, National Institutes of Health (NIH), Bethesda, USA
| |
Collapse
|
6
|
Scodellaro R, Zschüntzsch J, Hell AK, Alves F. A first explainable-AI-based workflow integrating forward-forward and backpropagation-trained networks of label-free multiphoton microscopy images to assess human biopsies of rare neuromuscular disease. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2025; 265:108733. [PMID: 40154003 DOI: 10.1016/j.cmpb.2025.108733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/16/2024] [Revised: 03/06/2025] [Accepted: 03/19/2025] [Indexed: 04/01/2025]
Abstract
BACKGROUND AND OBJECTIVE Diagnosis of rare neuromuscular diseases often relies on muscle biopsy analysis, which varies based on the evaluator's experience. Advances in deep learning show promise in improving diagnostic accuracy by identifying standardized features and phenotypic expressions in biopsy images. Explainable artificial intelligence extracts these features from the neural network's "black box," ensuring compliance with European ethical standards for the use of clinical data in real-world applications. This study proposes a clinic-friendly workflow, based on explainable artificial intelligence. It combines forward-forward and backpropagation-trained convolutional networks to identify complementary features of Duchenne Muscular Dystrophy. Our proposal sets the forward-forward training, applied here for the first time on biomedical images, as a potential new standard for interpretable deep learning applications in clinics. METHODS We analyzed a multiphoton microscopy dataset of 1600 images from 16 human muscle biopsies obtained during elective spinal surgery, combining autofluorescence, second and third harmonic generation signals. Class Activation Maps unveiled the dual decision-making process of the convolutional network, independently trained with both standard backpropagation and forward-forward algorithms. We evaluated the significance of the discovered features by using the Mann Whitney method. Entire biopsies were analyzed by providing an attention metric, computed as the weighted mean of all significant parameters. RESULTS Backpropagation, gold standard for 35 years, and forward-forward achieved over 90 % accuracy in distinguishing healthy and diseased patients tissue. Class activation maps revealed that, when trained independently with both algorithms, the same network identifies Duchenne Muscular Dystrophy tissue by focusing on different features. Both methods identified intramuscular collagen as a key feature. Backpropagation also highlighted collagen waviness and fatty tissue. Forward-forward emphasized collagen density. We integrated these complementary insights, validated by significance analysis, into a standardized attention metric, allowing a multi-structural, quantitative assessment of tissue changes and highlighting areas for further clinical analysis. CONCLUSIONS Our workflow, using clinically routine biopsies and transparent diagnostic features, demonstrates the unique potential of forward-forward in providing novel, reliable, interpretable results from biomedical images. This paves the way for its dual use with backpropagation, shifting benchmarks by enabling the discovery of features potentially overlooked by backpropagation across biomedical datasets.
Collapse
Affiliation(s)
- Riccardo Scodellaro
- Translational Molecular Imaging, Max-Planck-Institute for Multidisciplinary Sciences, Göttingen, Germany
| | - Jana Zschüntzsch
- Department of Neurology, University Medical Center Göttingen, Göttingen, Germany
| | - Anna-Kathrin Hell
- Pediatric Orthopaedics, Department for Trauma Surgery, Orthopaedics and Plastic Surgery, University Medical Center Göttingen, Göttingen, Germany
| | - Frauke Alves
- Translational Molecular Imaging, Max-Planck-Institute for Multidisciplinary Sciences, Göttingen, Germany; Institute for Diagnostic and Interventional Radiology, University Medical Center Göttingen, Göttingen, Germany; Clinic for Haematology and Medical Oncology, University Medical Center Göttingen, Göttingen, Germany; Cluster of Excellence "Multiscale Bioimaging: from Molecular Machines to Networks of Excitable Cells" (MBExC), University of Göttingen, Göttingen, Germany.
| |
Collapse
|
7
|
Oh MY, Kim HS, Jung YM, Lee HC, Lee SB, Lee SM. Machine Learning-Based Explainable Automated Nonlinear Computation Scoring System for Health Score and an Application for Prediction of Perioperative Stroke: Retrospective Study. J Med Internet Res 2025; 27:e58021. [PMID: 40106818 PMCID: PMC11966079 DOI: 10.2196/58021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Revised: 03/24/2024] [Accepted: 10/30/2024] [Indexed: 03/22/2025] Open
Abstract
BACKGROUND Machine learning (ML) has the potential to enhance performance by capturing nonlinear interactions. However, ML-based models have some limitations in terms of interpretability. OBJECTIVE This study aimed to develop and validate a more comprehensible and efficient ML-based scoring system using SHapley Additive exPlanations (SHAP) values. METHODS We developed and validated the Explainable Automated nonlinear Computation scoring system for Health (EACH) framework score. We developed a CatBoost-based prediction model, identified key features, and automatically detected the top 5 steepest slope change points based on SHAP plots. Subsequently, we developed a scoring system (EACH) and normalized the score. Finally, the EACH score was used to predict perioperative stroke. We developed the EACH score using data from the Seoul National University Hospital cohort and validated it using data from the Boramae Medical Center, which was geographically and temporally different from the development set. RESULTS When applied for perioperative stroke prediction among 38,737 patients undergoing noncardiac surgery, the EACH score achieved an area under the curve (AUC) of 0.829 (95% CI 0.753-0.892). In the external validation, the EACH score demonstrated superior predictive performance with an AUC of 0.784 (95% CI 0.694-0.871) compared with a traditional score (AUC=0.528, 95% CI 0.457-0.619) and another ML-based scoring generator (AUC=0.564, 95% CI 0.516-0.612). CONCLUSIONS The EACH score is a more precise, explainable ML-based risk tool, proven effective in real-world data. The EACH score outperformed traditional scoring system and other prediction models based on different ML techniques in predicting perioperative stroke.
Collapse
Affiliation(s)
- Mi-Young Oh
- Department of Neurology, Sejong General Hospital, Sejong General Hospital, Bucheon-si, Republic of Korea
| | - Hee-Soo Kim
- Department of Medical Informatics, School of Medicine, Keimyung University, Daegu, Republic of Korea
| | - Young Mi Jung
- Department of Obstetrics and Gynecology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Hyung-Chul Lee
- Department of Anesthesiology and Pain Medicine, Seoul National University College of Medicine, Seoul, Republic of Korea
- Department of Anesthesiology and Pain Medicine, Seoul National University Hospital, Seoul, Republic of Korea
| | - Seung-Bo Lee
- Department of Medical Informatics, School of Medicine, Keimyung University, Daegu, Republic of Korea
| | - Seung Mi Lee
- Department of Obstetrics and Gynecology, College of Medicine, Seoul National University, Seoul, Republic of Korea
- Department of Obstetrics and Gynecology, Seoul National University Hospital, Seoul, Republic of Korea
- Innovative Medical Technology Research Institute, Seoul National University Hospital, Seoul, Republic of Korea
- Institute of Reproductive Medicine and Population & Medical Big Data Research Center, Seoul National University, Seoul, Republic of Korea
| |
Collapse
|
8
|
Yew SQ, Trivedi D, Adanan NIH, Chew BH. Facilitators and Barriers to the Implementation of Digital Health Technologies in Hospital Settings in Lower- and Middle-Income Countries Since the Onset of the COVID-19 Pandemic: Scoping Review. J Med Internet Res 2025; 27:e63482. [PMID: 40053793 PMCID: PMC11926458 DOI: 10.2196/63482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Revised: 11/01/2024] [Accepted: 12/09/2024] [Indexed: 03/09/2025] Open
Abstract
BACKGROUND Although the implementation process of digital health technologies (DHTs) has been extensively documented in high-income countries, the factors that facilitate and prevent their implementation in lower- and middle-income countries (LMICs) may differ for various reasons. OBJECTIVE To address this gap in research, this scoping review aims to determine the facilitators and barriers to implementing DHTs in LMIC hospital settings following the onset of the COVID-19 pandemic. Additionally, the review outlined the types of DHTs that have been implemented in LMICs' hospitals during this pandemic and finally developed a classification framework to categorize the landscape of DHTs. METHODS Systematic searches were conducted on PubMed, Scopus, Web of Science, and Google Scholar for studies published from March 2020 to December 2023. We extracted data on authors, publication years, study objectives, study countries, disease conditions, types of DHTs, fields of clinical medicine where the DHTs are applied, study designs, sample sizes, characteristics of the study population, study location, and data collection methods of the included studies. Both quantitative and qualitative data were utilized to conduct a thematic analysis, using a deductive method based on the Practical, Robust Implementation and Sustainability Model (PRISM), to identify facilitators and barriers to DHT implementation. Finally, all accessible DHTs were identified and organized to create a novel classification framework. RESULTS Twelve studies were included from 292 retrieved articles. Telemedicine (n=5) was the most commonly used DHT in LMICs' hospitals, followed by hospital information systems (n=4), electronic medical records (n=2), and mobile health (n=1). These 4 DHTs, among the other existing DHTs, allowed us to develop a novel classification framework for DHTs. The included studies used qualitative methods (n=4), which included interviews and focus groups, quantitative methods (n=5), or a combination of both (n=2). Among the 64 facilitators of DHT implementation, the availability of continuous on-the-job training (n=3), the ability of DHTs to prevent cross-infection (n=2), and positive previous experiences using DHTs (n=2) were the top 3 reported facilitators. However, of the 44 barriers to DHT implementation, patients with poor digital literacy and skills in DHTs (n=3), inadequate awareness regarding DHTs among health care professionals and stakeholders (n=2), and concerns regarding the accuracy of disease diagnosis and treatment through DHTs (n=2) were commonly reported. CONCLUSIONS In the postpandemic era, telemedicine, along with other DHTs, has seen increased implementation in hospitals within LMICs. All facilitators and barriers can be categorized into 6 themes, namely, (1) Aspects of the Health Care System; (2) Perspectives of Patients; (3) External Environment; (4) Implementation of Sustainable Infrastructure; (5) Characteristics of Health Care Organization; and (6) Characteristics of Patients.
Collapse
Affiliation(s)
- Sheng Qian Yew
- Department of Public Health Medicine, Faculty of Medicine, National University of Malaysia, Cheras, Malaysia
| | - Daksha Trivedi
- Centre for Research in Public Health and Community Care, University of Hertfordshire, Hertforshire, United Kingdom
| | | | - Boon How Chew
- Faculty of Medicine and Health Sciences, Department of Family Medicine, Serdang, Malaysia
| |
Collapse
|
9
|
Guo W, Chen Y. Investigating Whether AI Will Replace Human Physicians and Understanding the Interplay of the Source of Consultation, Health-Related Stigma, and Explanations of Diagnoses on Patients' Evaluations of Medical Consultations: Randomized Factorial Experiment. J Med Internet Res 2025; 27:e66760. [PMID: 40053785 PMCID: PMC11923482 DOI: 10.2196/66760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2024] [Revised: 01/25/2025] [Accepted: 01/31/2025] [Indexed: 03/09/2025] Open
Abstract
BACKGROUND The increasing use of artificial intelligence (AI) in medical diagnosis and consultation promises benefits such as greater accuracy and efficiency. However, there is little evidence to systematically test whether the ideal technological promises translate into an improved evaluation of the medical consultation from the patient's perspective. This perspective is significant because AI as a technological solution does not necessarily improve patient confidence in diagnosis and adherence to treatment at the functional level, create meaningful interactions between the medical agent and the patient at the relational level, evoke positive emotions, or reduce the patient's pessimism at the emotional level. OBJECTIVE This study aims to investigate, from a patient-centered perspective, whether AI or human-involved AI can replace the role of human physicians in diagnosis at the functional, relational, and emotional levels as well as how some health-related differences between human-AI and human-human interactions affect patients' evaluations of the medical consultation. METHODS A 3 (consultation source: AI vs human-involved AI vs human) × 2 (health-related stigma: low vs high) × 2 (diagnosis explanation: without vs with explanation) factorial experiment was conducted with 249 participants. The main effects and interaction effects of the variables were examined on individuals' functional, relational, and emotional evaluations of the medical consultation. RESULTS Functionally, people trusted the diagnosis of the human physician (mean 4.78-4.85, SD 0.06-0.07) more than medical AI (mean 4.34-4.55, SD 0.06-0.07) or human-involved AI (mean 4.39-4.56, SD 0.06-0.07; P<.001), but at the relational and emotional levels, there was no significant difference between human-AI and human-human interactions (P>.05). Health-related stigma had no significant effect on how people evaluated the medical consultation or contributed to preferring AI-powered systems over humans (P>.05); however, providing explanations of the diagnosis significantly improved the functional (P<.001), relational (P<.05), and emotional (P<.05) evaluations of the consultation for all 3 medical agents. CONCLUSIONS The findings imply that at the current stage of AI development, people trust human expertise more than accurate AI, especially for decisions traditionally made by humans, such as medical diagnosis, supporting the algorithm aversion theory. Surprisingly, even for highly stigmatized diseases such as AIDS, where we assume anonymity and privacy are preferred in medical consultations, the dehumanization of AI does not contribute significantly to the preference for AI-powered medical agents over humans, suggesting that instrumental needs of diagnosis override patient privacy concerns. Furthermore, explaining the diagnosis effectively improves treatment adherence, strengthens the physician-patient relationship, and fosters positive emotions during the consultation. This provides insights for the design of AI medical agents, which have long been criticized for lacking transparency while making highly consequential decisions. This study concludes by outlining theoretical contributions to research on health communication and human-AI interaction and discusses the implications for the design and application of medical AI.
Collapse
Affiliation(s)
- Weiqi Guo
- School of Foreign Languages, Renmin University of China, Beijing, China
| | - Yang Chen
- School of Journalism and Communication, Renmin University of China, Beijing, China
| |
Collapse
|
10
|
Cromack SC, Lew AM, Bazzetta SE, Xu S, Walter JR. The perception of artificial intelligence and infertility care among patients undergoing fertility treatment. J Assist Reprod Genet 2025; 42:855-863. [PMID: 39776390 PMCID: PMC11950478 DOI: 10.1007/s10815-024-03382-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Accepted: 12/23/2024] [Indexed: 01/11/2025] Open
Abstract
PURPOSE To characterize the opinions of patients undergoing infertility treatment on the use of artificial intelligence (AI) in their care. METHODS Patients planning or undergoing in vitro fertilization (IVF) or frozen embryo transfers were invited to complete an anonymous electronic survey from April to June 2024. The survey collected demographics, technological affinity, general perception of AI, and its applications to fertility care. Patient-reported trust of AI compared to a physician for fertility care (e.g. gamete selection, gonadotropin doing, and stimulation length) were analyzed. Descriptive statistics were calculated, and subgroup analyses by age, occupation, and parity were performed. Chi-squared tests were used to compare categorical variables. RESULTS A total of 200 patients completed the survey and were primarily female (n = 193/200) and of reproductive age (mean 37 years). Patients were well educated with high technological affinity. Respondents were familiar with AI (93%) and generally supported its use in medicine (55%), but fewer trusted AI-informed reproductive care (46%). More patients disagreed (37%) that AI should be used to determine gonadotropin dose or stimulation length compared to embryo selection (26.5%; p = 0.01). In the setting of disagreement between physician and AI recommendation, patients preferred the physician-based recommendation in all treatment-related decisions. However, a larger proportion favored AI recommendations for gamete (22%) and embryo (14.5%) selection, compared to gonadotropin dosing (6.5%) or stimulation length (7.0%). Most would not be willing to pay more for AI-informed fertility care. CONCLUSIONS In this highly educated infertile population familiar with AI, patients still prefer physician-based recommendations compared with AI.
Collapse
Affiliation(s)
- Sarah C Cromack
- Department of Obstetrics and Gynecology, Division of Reproductive Endocrinology and Infertility, Northwestern University, 259 E Erie St Suite 2400, Chicago, IL, 60611, USA
| | - Ashley M Lew
- Department of Obstetrics and Gynecology, Division of Reproductive Endocrinology and Infertility, Northwestern University, 259 E Erie St Suite 2400, Chicago, IL, 60611, USA
| | - Sarah E Bazzetta
- Department of Obstetrics and Gynecology, Division of Reproductive Endocrinology and Infertility, Northwestern University, 259 E Erie St Suite 2400, Chicago, IL, 60611, USA
| | - Shuai Xu
- Querrey Simpson Institute for Bioelectronics, Northwestern University, Chicago, IL, USA
| | - Jessica R Walter
- Department of Obstetrics and Gynecology, Division of Reproductive Endocrinology and Infertility, Northwestern University, 259 E Erie St Suite 2400, Chicago, IL, 60611, USA.
- Querrey Simpson Institute for Bioelectronics, Northwestern University, Chicago, IL, USA.
| |
Collapse
|
11
|
Psilopatis I, Heindl F, Cupisti S, Fischer U, Kohlmann V, Schneider M, Bader S, Krueckel A, Emons J. The role of artificial intelligence in gynecologic and obstetric emergencies. Eur J Obstet Gynecol Reprod Biol 2025; 306:94-100. [PMID: 39799741 DOI: 10.1016/j.ejogrb.2025.01.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2024] [Revised: 12/31/2024] [Accepted: 01/05/2025] [Indexed: 01/15/2025]
Abstract
OBJECTIVE To investigate the potential of artificial intelligence (AI) in emergency medicine, focusing on its utility in triaging and managing acute gynecologic and obstetric emergencies. METHODS AND MATERIALS This feasibility study assessed Chat-GPT's performance in triaging and recommending management interventions for gynecologic and obstetric emergencies, using ten fictive cases. Five common conditions were modeled for each specialty. Chat-GPT was tasked with proposing triage classifications and providing immediate management recommendations. Human experts independently reviewed each case, classified triage categories, and proposed management. Following this, experts evaluated Chat-GPT's recommendations, rating the AI's responses on accuracy and clinical applicability. RESULTS Chat-GPT's recommendations demonstrated high concordance with human evaluators. Chat-GPT's triage classifications matched those of human experts in most cases, though minor discrepancies in urgency ratings were observed. The AÍs suggestions were mostly rated as "very good" to "excellent." While Chat-GPT consistently delivered appropriate responses, some human evaluators noted slight differences in perceived urgency. CONCLUSIONS This study highlights Chat-GPT's potential as a clinical support tool in emergency medicine. Chat-GPT provided structured, evidence-based recommendations comparable to those of experienced clinicians, especially for high-stakes gynecologic and obstetric emergencies. Although encouraging, these results highlight the value of utilizing AI in addition to human knowledge, as variations in urgency ratings and management nuances highlight the necessity of human supervision in crucial decision-making.
Collapse
Affiliation(s)
- Iason Psilopatis
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Felix Heindl
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Susanne Cupisti
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Ulrike Fischer
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Valentina Kohlmann
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Michael Schneider
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Simon Bader
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Annika Krueckel
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Julius Emons
- Department of Gynecology and Obstetrics, University Clinic Erlangen, Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany.
| |
Collapse
|
12
|
Seth I, Marcaccini G, Lim K, Castrechini M, Cuomo R, Ng SKH, Ross RJ, Rozen WM. Management of Dupuytren's Disease: A Multi-Centric Comparative Analysis Between Experienced Hand Surgeons Versus Artificial Intelligence. Diagnostics (Basel) 2025; 15:587. [PMID: 40075834 PMCID: PMC11898831 DOI: 10.3390/diagnostics15050587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2025] [Revised: 02/24/2025] [Accepted: 02/24/2025] [Indexed: 03/14/2025] Open
Abstract
Background: Dupuytren's fibroproliferative disease affecting the hand's palmar fascia leads to progressive finger contractures and functional limitations. Management of this condition relies heavily on the expertise of hand surgeons, who tailor interventions based on clinical assessment. With the growing interest in artificial intelligence (AI) in medical decision-making, this study aims to evaluate the feasibility of integrating AI into the clinical management of Dupuytren's disease by comparing AI-generated recommendations with those of expert hand surgeons. Methods: This multicentric comparative study involved three experienced hand surgeons and five AI systems (ChatGPT, Gemini, Perplexity, DeepSeek, and Copilot). Twenty-two standardized clinical prompts representing various Dupuytren's disease scenarios were used to assess decision-making. Surgeons and AI systems provided management recommendations, which were analyzed for concordance, rationale, and predicted outcomes. Key metrics included union accuracy, surgeon agreement, precision, recall, and F1 scores. The study also evaluated AI performance in unanimous versus non-unanimous cases and inter-AI agreements. Results: Gemini and ChatGPT demonstrated the highest union accuracy (86.4% and 81.8%, respectively), while Copilot showed the lowest (40.9%). Surgeon agreement was highest for Gemini (45.5%) and ChatGPT (42.4%). AI systems performed better in unanimous cases (accuracy up to 92.0%) than in non-unanimous cases (accuracy as low as 35.0%). Inter-AI agreements ranged from 75.0% (ChatGPT-Gemini) to 48.0% (DeepSeek-Copilot). Precision, recall, and F1 scores were consistently higher for ChatGPT and Gemini than for other systems. Conclusions: AI systems, particularly Gemini and ChatGPT, show promise in aligning with expert surgical recommendations, especially in straightforward cases. However, significant variability exists, particularly in complex scenarios. AI should be viewed as complementary to clinical judgment, requiring further refinement and validation for integration into clinical practice.
Collapse
Affiliation(s)
- Ishith Seth
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia
- Faculty of Medicine and Surgery, Peninsula Clinical School, Monash University, Frankston, VIC 3199, Australia
- Department of Plastic and Reconstructive Surgery, Austin Health, Heidelberg, VIC 3199, Australia
| | - Gianluca Marcaccini
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia
- Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy
| | - Kaiyang Lim
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia
| | - Marco Castrechini
- Plastic Surgery Unit, Department of Surgery “P. Valdoni”, “Sapienza” University of Rome, 00185 Rome, Italy
| | - Roberto Cuomo
- Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy
| | - Sally Kiu-Huen Ng
- Department of Plastic and Reconstructive Surgery, Austin Health, Heidelberg, VIC 3199, Australia
| | - Richard J. Ross
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia
- Faculty of Medicine and Surgery, Peninsula Clinical School, Monash University, Frankston, VIC 3199, Australia
| | - Warren M. Rozen
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia
- Faculty of Medicine and Surgery, Peninsula Clinical School, Monash University, Frankston, VIC 3199, Australia
| |
Collapse
|
13
|
García-Barberán V, Gómez Del Pulgar ME, Guamán HM, Benito-Martin A. The times they are AI-changing: AI-powered advances in the application of extracellular vesicles to liquid biopsy in breast cancer. EXTRACELLULAR VESICLES AND CIRCULATING NUCLEIC ACIDS 2025; 6:128-140. [PMID: 40206803 PMCID: PMC11977355 DOI: 10.20517/evcna.2024.51] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Revised: 01/03/2025] [Accepted: 01/25/2025] [Indexed: 04/11/2025]
Abstract
Artificial intelligence (AI) is revolutionizing scientific research by facilitating a paradigm shift in data analysis and discovery. This transformation is characterized by a fundamental change in scientific methods and concepts due to AI's ability to process vast datasets with unprecedented speed and accuracy. In breast cancer research, AI aids in early detection, prognosis, and personalized treatment strategies. Liquid biopsy, a noninvasive tool for detecting circulating tumor traits, could ideally benefit from AI's analytical capabilities, enhancing the detection of minimal residual disease and improving treatment monitoring. Extracellular vesicles (EVs), which are key elements in cell communication and cancer progression, could be analyzed with AI to identify disease-specific biomarkers. AI combined with EV analysis promises an enhancement in diagnosis precision, aiding in early detection and treatment monitoring. Studies show that AI can differentiate cancer types and predict drug efficacy, exemplifying its potential in personalized medicine. Overall, the integration of AI in biomedical research and clinical practice promises significant changes and advancements in diagnostics, personalized medicine-based approaches, and our understanding of complex diseases like cancer.
Collapse
Affiliation(s)
- Vanesa García-Barberán
- Molecular Oncology Laboratory, Medical Oncology Department, Hospital Clínico Universitario San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid 28040, Spain
| | - María Elena Gómez Del Pulgar
- Molecular Oncology Laboratory, Medical Oncology Department, Hospital Clínico Universitario San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid 28040, Spain
| | - Heidy M. Guamán
- Molecular Oncology Laboratory, Medical Oncology Department, Hospital Clínico Universitario San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid 28040, Spain
| | - Alberto Benito-Martin
- Molecular Oncology Laboratory, Medical Oncology Department, Hospital Clínico Universitario San Carlos, Instituto de Investigación Sanitaria San Carlos (IdISSC), Madrid 28040, Spain
- Facultad de Medicina, Universidad Alfonso X el Sabio, Madrid 28691, Spain
| |
Collapse
|
14
|
Sedano R, Solitano V, Vuyyuru SK, Yuan Y, Hanžel J, Ma C, Nardone OM, Jairath V. Artificial intelligence to revolutionize IBD clinical trials: a comprehensive review. Therap Adv Gastroenterol 2025; 18:17562848251321915. [PMID: 39996136 PMCID: PMC11848901 DOI: 10.1177/17562848251321915] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2024] [Accepted: 02/04/2025] [Indexed: 02/26/2025] Open
Abstract
Integrating artificial intelligence (AI) into clinical trials for inflammatory bowel disease (IBD) has potential to be transformative to the field. This article explores how AI-driven technologies, including machine learning (ML), natural language processing, and predictive analytics, have the potential to enhance important aspects of IBD trials-from patient recruitment and trial design to data analysis and personalized treatment strategies. As AI advances, it has potential to improve long-standing challenges in trial efficiency, accuracy, and personalization with the goal of accelerating the discovery of novel therapies and improve outcomes for people living with IBD. AI can streamline multiple trial phases, from target identification and patient recruitment to data analysis and monitoring. By integrating multi-omics data, electronic health records, and imaging repositories, AI can uncover molecular targets and personalize trial strategies, ultimately expediting drug development. However, the adoption of AI in IBD clinical trials encounters significant challenges. These include technical barriers in data integration, ethical concerns regarding patient privacy, and regulatory issues related to AI validation standards. Additionally, AI models risk producing biased outcomes if training datasets lack diversity, potentially impacting underrepresented populations in clinical trials. Addressing these limitations requires standardized data formats, interdisciplinary collaboration, and robust ethical frameworks to ensure inclusivity and accuracy. Continued partnerships among clinicians, researchers, data scientists, and regulators will be essential to establish transparent, patient-centered AI frameworks. By overcoming these obstacles, AI has the potential to enhance the efficiency, equity, and efficacy of IBD clinical trials, ultimately benefiting patient care.
Collapse
Affiliation(s)
- Rocio Sedano
- Division of Gastroenterology, Department of Medicine, Western University, London, ON, Canada
- Department of Epidemiology and Biostatistics, Western University, London, ON, Canada
- Lawson Health Research Institute, London, ON, Canada
| | - Virginia Solitano
- Department of Epidemiology and Biostatistics, Western University, London, ON, Canada
- Division of Gastroenterology and Gastrointestinal Endoscopy, IRCCS Ospedale San Raffaele, Università Vita-Salute San Raffaele, Milan, Lombardy, Italy
| | - Sudheer K. Vuyyuru
- Division of Gastroenterology, Department of Medicine, Western University, London, ON, Canada
| | - Yuhong Yuan
- Division of Gastroenterology, Department of Medicine, Western University, London, ON, Canada
- Lawson Health Research Institute, London, ON, Canada
| | - Jurij Hanžel
- Department of Gastroenterology, University Medical Centre Ljubljana, University of Ljubljana, Ljubljana, Slovenia
| | - Christopher Ma
- Department of Community Health Sciences, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Division of Gastroenterology and Hepatology, Department of Medicine, University of Calgary, Calgary, AB, Canada
| | - Olga Maria Nardone
- Gastroenterology, Department of Public Health, University Federico II of Naples, Naples, Italy
| | - Vipul Jairath
- Division of Gastroenterology, Department of Medicine, Western University, London, ON, Canada
- Department of Epidemiology and Biostatistics, Western University, London, ON, Canada
- Lawson Health Research Institute, Room A10-219, University Hospital, 339 Windermere Rd, London, ON N6A 5A5, Canada
| |
Collapse
|
15
|
Kareemi H, Yadav K, Price C, Bobrovitz N, Meehan A, Li H, Goel G, Masood S, Grant L, Ben-Yakov M, Michalowski W, Vaillancourt C. Artificial intelligence-based clinical decision support in the emergency department: A scoping review. Acad Emerg Med 2025. [PMID: 39905631 DOI: 10.1111/acem.15099] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2024] [Accepted: 12/27/2024] [Indexed: 02/06/2025]
Abstract
OBJECTIVE Artificial intelligence (AI)-based clinical decision support (CDS) has the potential to augment high-stakes clinical decisions in the emergency department (ED). However, its current usage and translation to implementation remains poorly understood. We asked: (1) What is the current landscape of AI-CDS for individual patient care in the ED? and (2) What phases of development have AI-CDS tools achieved? METHODS We performed a scoping review of AI for prognostic, diagnostic, and treatment decisions regarding individual ED patient care. We searched five databases (MEDLINE, EMBASE, Cochrane Central, Scopus, Web of Science) and gray literature sources from January 1, 2010, to December 11, 2023. We adhered to guidelines from the Joanna Briggs Institute and PRISMA Extension for Scoping Reviews. We published our protocol on Open Science Framework (DOI 10.17605/OSF.IO/FDZ3Y). RESULTS Of 5168 unique records identified, we selected 605 studies for inclusion. The majority (369, 61%) were published in 2021-2023. The studies ranged over a variety of clinical applications, patient populations, and AI model types. Prognostic outcomes were most commonly assessed (270, 44.6%), followed by diagnostic (193, 31.9%) and disposition (115, 19%). Most studies remained in the earliest phase of preclinical development (572, 94.5%) with few advancing to later phases (33, 5.5%). CONCLUSIONS By thoroughly mapping the landscape of AI-CDS in the ED, we demonstrate a rapidly increasing volume of studies covering a breadth of clinical applications, yet few have achieved advanced phases of testing or implementation. A more granular understanding of the barriers and facilitators to implementing AI-CDS in the ED is needed.
Collapse
Affiliation(s)
- Hashim Kareemi
- Department of Emergency Medicine, University of British Columbia, Vancouver, British Columbia, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Krishan Yadav
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Ontario, Canada
| | - Courtney Price
- Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Niklas Bobrovitz
- Department of Emergency Medicine, University of Calgary, Calgary, Alberta, Canada
- Centre for Health Informatics, University of Calgary, Calgary, Alberta, Canada
| | - Andrew Meehan
- Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Henry Li
- Department of Emergency Medicine, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada
- Division of Pediatrics, Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | - Gautam Goel
- Department of Emergency Medicine, Queensway Carleton Hospital, Ottawa, Ontario, Canada
- Whiting School of Engineering, Johns Hopkins University, Baltimore, Maryland, USA
| | - Sameer Masood
- Department of Medicine, University of Toronto, Toronto, Ontario, Canada
- Toronto General Hospital Research Institute, University Health Network, Toronto, Ontario, Canada
| | - Lars Grant
- Department of Emergency Medicine, McGill University, Montreal, Quebec, Canada
- Lady Davis Institute for Medical Research, Montreal, Quebec, Canada
| | - Maxim Ben-Yakov
- Department of Medicine, University of Toronto, Toronto, Ontario, Canada
- Toronto General Hospital Research Institute, University Health Network, Toronto, Ontario, Canada
| | - Wojtek Michalowski
- Telfer School of Management, University of Ottawa, Ottawa, Ontario, Canada
| | - Christian Vaillancourt
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Emergency Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Ontario, Canada
| |
Collapse
|
16
|
Idnay B, Xu Z, Adams WG, Adibuzzaman M, Anderson NR, Bahroos N, Bell DS, Bumgardner C, Campion T, Castro M, Cimino JJ, Cohen IG, Dorr D, Elkin PL, Fan JW, Ferris T, Foran DJ, Hanauer D, Hogarth M, Huang K, Kalpathy-Cramer J, Kandpal M, Karnik NS, Katoch A, Lai AM, Lambert CG, Li L, Lindsell C, Liu J, Lu Z, Luo Y, McGarvey P, Mendonca EA, Mirhaji P, Murphy S, Osborne JD, Paschalidis IC, Harris PA, Prior F, Shaheen NJ, Shara N, Sim I, Tachinardi U, Waitman LR, Wright RJ, Zai AH, Zheng K, Lee SSJ, Malin BA, Natarajan K, Price II WN, Zhang R, Zhang Y, Xu H, Bian J, Weng C, Peng Y. Environment scan of generative AI infrastructure for clinical and translational science. NPJ HEALTH SYSTEMS 2025; 2:4. [PMID: 39872195 PMCID: PMC11762411 DOI: 10.1038/s44401-024-00009-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2024] [Accepted: 12/22/2024] [Indexed: 01/29/2025]
Abstract
This study reports a comprehensive environmental scan of the generative AI (GenAI) infrastructure in the national network for clinical and translational science across 36 institutions supported by the CTSA Program led by the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) at the United States. Key findings indicate a diverse range of institutional strategies, with most organizations in the experimental phase of GenAI deployment. The results underscore the need for a more coordinated approach to GenAI governance, emphasizing collaboration among senior leaders, clinicians, information technology staff, and researchers. Our analysis reveals that 53% of institutions identified data security as a primary concern, followed by lack of clinician trust (50%) and AI bias (44%), which must be addressed to ensure the ethical and effective implementation of GenAI technologies.
Collapse
Affiliation(s)
- Betina Idnay
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY USA
| | - Zihan Xu
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY USA
| | - William G. Adams
- Department of Pediatrics, Boston Medical Center, Boston, MA, USA; Chobanian & Avedisian School of Medicine, Boston University, Boston, MA USA
| | - Mohammad Adibuzzaman
- Oregon Clinical and Translational Research Institute, Oregon Health and Science University, Portland, OR USA
| | - Nicholas R. Anderson
- Department of Public Health Sciences, University of California, Davis, Davis, CA USA
| | - Neil Bahroos
- Keck School of Medicine, University of Southern California, Los Angeles, CA USA
| | - Douglas S. Bell
- Department of Medicine, David Geffen School of Medicine, University of California, Los Angeles, Los Angeles, CA USA
| | - Cody Bumgardner
- Department of Pathology and Laboratory Medicine, University of Kentucky College of Medicine, Lexington, KY USA
| | - Thomas Campion
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY USA
- Clinical and Translational Science Center, Weill Cornell Medicine, New York, NY USA
| | - Mario Castro
- Division of Pulmonary, Critical Care and Sleep Medicine, University of Kansas School of Medicine, Kansas City, KS USA
| | - James J. Cimino
- Department of Biomedical Informatics and Data Science, Heersink School of Medicine, University of Alabama, Birmingham, AL USA
| | - I. Glenn Cohen
- Harvard Law School, Petrie-Flom Center for Health Law Policy, Biotechnology, and Bioethics, Harvard University, Cambridge, MA USA
| | - David Dorr
- Oregon Clinical and Translational Research Institute, Oregon Health and Science University, Portland, OR USA
| | - Peter L. Elkin
- Department of Biomedical Informatics, University at Buffalo, Buffalo, NY USA
| | - Jungwei W. Fan
- Center for Clinical and Translational Science, Mayo Clinic, Rochester, MN USA
| | - Todd Ferris
- Technology and Digital Solutions, Stanford Medicine, Stanford University, Stanford, CA USA
| | - David J. Foran
- Center for Biomedical Informatics, Rutgers Cancer Institute, New Brunswick, NJ USA
| | - David Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI USA
| | - Mike Hogarth
- Altman Clinical and Translational Research Institute (ACTRI), University of California San Diego, La Jolla, CA USA
| | - Kun Huang
- Department of Biostatistics and Health Data Science, School of Medicine, Indiana University, Indianapolis, IN USA
| | | | - Manoj Kandpal
- Center for Clinical and Translational Science, Rockefeller University Hospital, Rockefeller University, New York, NY USA
| | - Niranjan S. Karnik
- AI.Health4All Center, Center for Clinical & Translational Science, and Department of Psychiatry, University of Illinois Chicago, Chicago, IL USA
| | - Avnish Katoch
- Department of Public Health Sciences, Penn State College of Medicine, Hershey, PA USA
- Penn State Clinical and Translational Science Institute, Hershey, USA
| | - Albert M. Lai
- Department of Medicine, Washington University School of Medicine, St. Louis, MO USA
| | - Christophe G. Lambert
- Division of Translational Informatics, Department of Internal Medicine, University of New Mexico Health Sciences Center, Albuquerque, NM USA
| | - Lang Li
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH USA
| | | | - Jinze Liu
- Department of Population Health, Virginia Commonwealth University, Richmond, VA USA
| | - Zhiyong Lu
- Division of Intramural Research, National Library of Medicine, National Institutes of Health, Bethesda, MD USA
| | - Yuan Luo
- Department of Preventive Medicine, Feinberg School of Medicine, Northwestern University, Chicago, IL USA
| | - Peter McGarvey
- Georgetown-Howard Universities Center for Clinical and Translational Science, Washington, DC USA
| | - Eneida A. Mendonca
- Division of Biomedical Informatics, Cincinnati Children’s Hospital Medical Center, Cincinnati, OH USA
| | - Parsa Mirhaji
- Institute for Clinical Translational Research, Albert Einstein College of Medicine, New York, NY USA
| | - Shawn Murphy
- Department of Neurology, Mass General Brigham, Somerville, MA USA
| | - John D. Osborne
- Department of Medicine, University of Alabama, Birmingham, AL USA
| | - Ioannis C. Paschalidis
- College of Engineering and Faculty of Computing & Data Sciences, Boston University, Boston, MA USA
| | - Paul A. Harris
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN USA
| | - Fred Prior
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR USA
| | - Nicholas J. Shaheen
- Division of Gastroenterology and Hepatology, University of North Carolina School of Medicine, Chapel Hill, North Carolina USA
| | - Nawar Shara
- Georgetown-Howard Universities Center for Clinical and Translational Science, Washington, DC USA
| | - Ida Sim
- Department of Medicine, University of California, San Francisco, San Francisco, CA USA
| | - Umberto Tachinardi
- Department of Biostatistics, Health Informatics and Data Sciences, University of Cincinnati College of Medicine, Cincinnati, OH USA
| | - Lemuel R. Waitman
- Department of Biomedical Informatics, Biostatistics, and Medical Epidemiology, School of Medicine, University of Missouri, Columbia, MO USA
| | - Rosalind J. Wright
- Department of Public Health, Icahn School of Medicine at Mount Sinai, New York, NY USA
| | - Adrian H. Zai
- Division of Health Informatics and Implementation Science, Department of Population and Quantitative Health Sciences, UMass Chan Medical School, Worcester, MA USA
| | - Kai Zheng
- Department of Informatics, University of California, Irvine, Irvine, CA USA
| | - Sandra Soo-Jin Lee
- Department of Medical Humanities and Ethics, Columbia University, New York, NY USA
| | - Bradley A. Malin
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN USA
| | - Karthik Natarajan
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY USA
| | | | - Rui Zhang
- Division of Computational Health Sciences, Medical School, University of Minnesota, Minneapolis, MN USA
| | - Yiye Zhang
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY USA
| | - Hua Xu
- Department of Biomedical Informatics and Data Science, Yale School of Medicine, Yale University, New Haven, CT USA
| | - Jiang Bian
- Health Outcomes & Biomedical Informatics, College of Medicine, University of Florida, Gainesville, FL USA
- Present Address: Biostatistics and Health Data Science, School of Medicine, Indiana University, IN, USA
- Present Address: Regenstrief Institute, Indianapolis, IN USA
| | - Chunhua Weng
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, NY USA
- The Irving Institute for Clinical and Translational Research, Columbia University, New York, NY USA
| | - Yifan Peng
- Department of Population Health Sciences, Weill Cornell Medicine, New York, NY USA
- Clinical and Translational Science Center, Weill Cornell Medicine, New York, NY USA
| |
Collapse
|
17
|
Auf H, Svedberg P, Nygren J, Nair M, Lundgren LE. The Use of AI in Mental Health Services to Support Decision-Making: Scoping Review. J Med Internet Res 2025; 27:e63548. [PMID: 39854710 PMCID: PMC11806275 DOI: 10.2196/63548] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 10/28/2024] [Accepted: 11/25/2024] [Indexed: 01/26/2025] Open
Abstract
BACKGROUND Recent advancements in artificial intelligence (AI) have changed the care processes in mental health, particularly in decision-making support for health care professionals and individuals with mental health problems. AI systems provide support in several domains of mental health, including early detection, diagnostics, treatment, and self-care. The use of AI systems in care flows faces several challenges in relation to decision-making support, stemming from technology, end-user, and organizational perspectives with the AI disruption of care processes. OBJECTIVE This study aims to explore the use of AI systems in mental health to support decision-making, focusing on 3 key areas: the characteristics of research on AI systems in mental health; the current applications, decisions, end users, and user flow of AI systems to support decision-making; and the evaluation of AI systems for the implementation of decision-making support, including elements influencing the long-term use. METHODS A scoping review of empirical evidence was conducted across 5 databases: PubMed, Scopus, PsycINFO, Web of Science, and CINAHL. The searches were restricted to peer-reviewed articles published in English after 2011. The initial screening at the title and abstract level was conducted by 2 reviewers, followed by full-text screening based on the inclusion criteria. Data were then charted and prepared for data analysis. RESULTS Of a total of 1217 articles, 12 (0.99%) met the inclusion criteria. These studies predominantly originated from high-income countries. The AI systems were used in health care, self-care, and hybrid care contexts, addressing a variety of mental health problems. Three types of AI systems were identified in terms of decision-making support: diagnostic and predictive AI, treatment selection AI, and self-help AI. The dynamics of the type of end-user interaction and system design were diverse in complexity for the integration and use of the AI systems to support decision-making in care processes. The evaluation of the use of AI systems highlighted several challenges impacting the implementation and functionality of the AI systems in care processes, including factors affecting accuracy, increase of demand, trustworthiness, patient-physician communication, and engagement with the AI systems. CONCLUSIONS The design, development, and implementation of AI systems to support decision-making present substantial challenges for the sustainable use of this technology in care processes. The empirical evidence shows that the evaluation of the use of AI systems in mental health is still in its early stages, with need for more empirically focused research on real-world use. The key aspects requiring further investigation include the evaluation of the use of AI-supported decision-making from human-AI interaction and human-computer interaction perspectives, longitudinal implementation studies of AI systems in mental health to assess the use, and the integration of shared decision-making in AI systems.
Collapse
Affiliation(s)
- Hassan Auf
- Halmstad University, School of Health and Welfare, Halmstad, Sweden
| | - Petra Svedberg
- Halmstad University, School of Health and Welfare, Halmstad, Sweden
| | - Jens Nygren
- Halmstad University, School of Health and Welfare, Halmstad, Sweden
| | - Monika Nair
- Halmstad University, School of Health and Welfare, Halmstad, Sweden
| | - Lina E Lundgren
- School of Business, Innovation and Sustainability, Halmstad University, Halmstad, Sweden
| |
Collapse
|
18
|
Dorosan M, Chen YL, Zhuang Q, Lam SWS. In Silico Evaluation of Algorithm-Based Clinical Decision Support Systems: Protocol for a Scoping Review. JMIR Res Protoc 2025; 14:e63875. [PMID: 39819973 PMCID: PMC11783031 DOI: 10.2196/63875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Revised: 09/30/2024] [Accepted: 10/09/2024] [Indexed: 01/19/2025] Open
Abstract
BACKGROUND Integrating algorithm-based clinical decision support (CDS) systems poses significant challenges in evaluating their actual clinical value. Such CDS systems are traditionally assessed via controlled but resource-intensive clinical trials. OBJECTIVE This paper presents a review protocol for preimplementation in silico evaluation methods to enable broadened impact analysis under simulated environments before clinical trials. METHODS We propose a scoping review protocol that follows an enhanced Arksey and O'Malley framework and PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines to investigate the scope and research gaps in the in silico evaluation of algorithm-based CDS models-specifically CDS decision-making end points and objectives, evaluation metrics used, and simulation paradigms used to assess potential impacts. The databases searched are PubMed, Embase, CINAHL, PsycINFO, Cochrane, IEEEXplore, Web of Science, and arXiv. A 2-stage screening process identified pertinent articles. The information extracted from articles was iteratively refined. The review will use thematic, trend, and descriptive analyses to meet scoping aims. RESULTS We conducted an automated search of the databases above in May 2023, with most title and abstract screenings completed by November 2023 and full-text screening extended from December 2023 to May 2024. Concurrent charting and full-text analysis were carried out, with the final analysis and manuscript preparation set for completion in July 2024. Publication of the review results is targeted from July 2024 to February 2025. As of April 2024, a total of 21 articles have been selected following a 2-stage screening process; these will proceed to data extraction and analysis. CONCLUSIONS We refined our data extraction strategy through a collaborative, multidisciplinary approach, planning to analyze results using thematic analyses to identify approaches to in silico evaluation. Anticipated findings aim to contribute to developing a unified in silico evaluation framework adaptable to various clinical workflows, detailing clinical decision-making characteristics, impact measures, and reusability of methods. The study's findings will be published and presented in forums combining artificial intelligence and machine learning, clinical decision-making, and health technology impact analysis. Ultimately, we aim to bridge the development-deployment gap through in silico evaluation-based potential impact assessments. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/63875.
Collapse
Affiliation(s)
- Michael Dorosan
- Health Services Research Centre, Singapore Health Services Pte Ltd, Singapore, Singapore
| | - Ya-Lin Chen
- Department of Biomedical Informatics and Medical Education, University of Washington, Seattle, WA, United States
| | - Qingyuan Zhuang
- Division of Supportive and Palliative Care, National Cancer Centre Singapore, Singapore, Singapore
- Data and Computational Science Core, National Cancer Centre Singapore, Singapore, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
| | - Shao Wei Sean Lam
- Health Services Research Centre, Singapore Health Services Pte Ltd, Singapore, Singapore
- Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
- Health Services Research Institute, SingHealth Duke-NUS Academic Medical Centre, Singapore, Singapore
- Health Services and Systems Research, Duke-NUS Medical School, National University of Singapore, Singapore, Singapore
- Lee Kong Chian School of Business, Singapore Management University, Singapore, Singapore
| |
Collapse
|
19
|
Xie Y, Zhai Y, Lu G. Evolution of artificial intelligence in healthcare: a 30-year bibliometric study. Front Med (Lausanne) 2025; 11:1505692. [PMID: 39882522 PMCID: PMC11775008 DOI: 10.3389/fmed.2024.1505692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2024] [Accepted: 12/31/2024] [Indexed: 01/31/2025] Open
Abstract
Introduction In recent years, the development of artificial intelligence (AI) technologies, including machine learning, deep learning, and large language models, has significantly supported clinical work. Concurrently, the integration of artificial intelligence with the medical field has garnered increasing attention from medical experts. This study undertakes a dynamic and longitudinal bibliometric analysis of AI publications within the healthcare sector over the past three decades to investigate the current status and trends of the fusion between medicine and artificial intelligence. Methods Following a search on the Web of Science, researchers retrieved all reviews and original articles concerning artificial intelligence in healthcare published between January 1993 and December 2023. The analysis employed Bibliometrix, Biblioshiny, and Microsoft Excel, incorporating the bibliometrix R package for data mining and analysis, and visualized the observed trends in bibliometrics. Results A total of 22,950 documents were collected in this study. From 1993 to 2023, there was a discernible upward trajectory in scientific output within bibliometrics. The United States and China emerged as primary contributors to medical artificial intelligence research, with Harvard University leading in publication volume among institutions. Notably, the rapid expansion of emerging topics such as COVID-19 and new drug discovery in recent years is noteworthy. Furthermore, the top five most cited papers in 2023 were all pertinent to the theme of ChatGPT. Conclusion This study reveals a sustained explosive growth trend in AI technologies within the healthcare sector in recent years, with increasingly profound applications in medicine. Additionally, medical artificial intelligence research is dynamically evolving with the advent of new technologies. Moving forward, concerted efforts to bolster international collaboration and enhance comprehension and utilization of AI technologies are imperative for fostering novel innovations in healthcare.
Collapse
Affiliation(s)
- Yaojue Xie
- Yangjiang Bainian Yanshen Medical Technology Co., Ltd., Yangjiang, China
| | - Yuansheng Zhai
- Department of Cardiology, Heart Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- NHC Key Laboratory of Assisted Circulation (Sun Yat-sen University), Guangzhou, China
| | - Guihua Lu
- Department of Cardiology, Heart Center, First Affiliated Hospital, Sun Yat-sen University, Guangzhou, China
- NHC Key Laboratory of Assisted Circulation (Sun Yat-sen University), Guangzhou, China
| |
Collapse
|
20
|
Chouvarda I, Colantonio S, Verde ASC, Jimenez-Pastor A, Cerdá-Alberich L, Metz Y, Zacharias L, Nabhani-Gebara S, Bobowicz M, Tsakou G, Lekadir K, Tsiknakis M, Martí-Bonmati L, Papanikolaou N. Differences in technical and clinical perspectives on AI validation in cancer imaging: mind the gap! Eur Radiol Exp 2025; 9:7. [PMID: 39812924 PMCID: PMC11735720 DOI: 10.1186/s41747-024-00543-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2024] [Accepted: 11/29/2024] [Indexed: 01/16/2025] Open
Abstract
Good practices in artificial intelligence (AI) model validation are key for achieving trustworthy AI. Within the cancer imaging domain, attracting the attention of clinical and technical AI enthusiasts, this work discusses current gaps in AI validation strategies, examining existing practices that are common or variable across technical groups (TGs) and clinical groups (CGs). The work is based on a set of structured questions encompassing several AI validation topics, addressed to professionals working in AI for medical imaging. A total of 49 responses were obtained and analysed to identify trends and patterns. While TGs valued transparency and traceability the most, CGs pointed out the importance of explainability. Among the topics where TGs may benefit from further exposure are stability and robustness checks, and mitigation of fairness issues. On the other hand, CGs seemed more reluctant towards synthetic data for validation and would benefit from exposure to cross-validation techniques, or segmentation metrics. Topics emerging from the open questions were utility, capability, adoption and trustworthiness. These findings on current trends in AI validation strategies may guide the creation of guidelines necessary for training the next generation of professionals working with AI in healthcare and contribute to bridging any technical-clinical gap in AI validation. RELEVANCE STATEMENT: This study recognised current gaps in understanding and applying AI validation strategies in cancer imaging and helped promote trust and adoption for interdisciplinary teams of technical and clinical researchers. KEY POINTS: Clinical and technical researchers emphasise interpretability, external validation with diverse data, and bias awareness in AI validation for cancer imaging. In cancer imaging AI research, clinical researchers prioritise explainability, while technical researchers focus on transparency and traceability, and see potential in synthetic datasets. Researchers advocate for greater homogenisation of AI validation practices in cancer imaging.
Collapse
Affiliation(s)
- Ioanna Chouvarda
- School of Medicine, Aristotle University of Thessaloniki, Thessaloniki, Greece.
| | - Sara Colantonio
- Institute of Information Science and Technologies of the National Research Council of Italy, Pisa, Italy
| | - Ana S C Verde
- Computational Clinical Imaging Group (CCIG), Champalimaud Research, Champalimaud Foundation, Lisbon, Portugal
| | | | - Leonor Cerdá-Alberich
- Biomedical Imaging Research Group (GIBI230), La Fe Health Research Institute, Valencia, Spain
| | - Yannick Metz
- Data Analysis and Visualization, University of Konstanz, Konstanz, Germany
| | | | - Shereen Nabhani-Gebara
- Faculty of Health, Science, Social Care & Education, Kingston University London, London, UK
| | - Maciej Bobowicz
- 2nd Department of Radiology, Medical University of Gdansk, Gdansk, Poland
| | - Gianna Tsakou
- Research and Development Lab, Gruppo Maggioli Greek Branch, Maroussi, Greece
| | - Karim Lekadir
- Departament de Matemàtiques i Informàtica, Artificial Intelligence in Medicine Lab (BCN-AIM), Universitat de Barcelona, Barcelona, Spain
- Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
| | - Manolis Tsiknakis
- Computational BioMedicine Laboratory (CBML), Foundation for Research and Technology-Hellas (FORTH), Heraklion, Greece
| | - Luis Martí-Bonmati
- Biomedical Imaging Research Group (GIBI230), La Fe Health Research Institute, Valencia, Spain
- Radiology Department, La Fe Polytechnic and University Hospital and Health Research Institute, Valencia, Spain
| | - Nikolaos Papanikolaou
- Computational Clinical Imaging Group (CCIG), Champalimaud Research, Champalimaud Foundation, Lisbon, Portugal
| |
Collapse
|
21
|
Díaz-Guerra DD, Hernández-Lugo MDLC, Broche-Pérez Y, Ramos-Galarza C, Iglesias-Serrano E, Fernández-Fleites Z. AI-assisted neurocognitive assessment protocol for older adults with psychiatric disorders. Front Psychiatry 2025; 15:1516065. [PMID: 39872430 PMCID: PMC11770049 DOI: 10.3389/fpsyt.2024.1516065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Accepted: 12/11/2024] [Indexed: 01/30/2025] Open
Abstract
Introduction Evaluating neurocognitive functions and diagnosing psychiatric disorders in older adults is challenging due to the complexity of symptoms and individual differences. An innovative approach that combines the accuracy of artificial intelligence (AI) with the depth of neuropsychological assessments is needed. Objectives This paper presents a novel protocol for AI-assisted neurocognitive assessment aimed at addressing the cognitive, emotional, and functional dimensions of older adults with psychiatric disorders. It also explores potential compensatory mechanisms. Methodology The proposed protocol incorporates a comprehensive, personalized approach to neurocognitive evaluation. It integrates a series of standardized and validated psychometric tests with individualized interpretation tailored to the patient's specific conditions. The protocol utilizes AI to enhance diagnostic accuracy by analyzing data from these tests and supplementing observations made by researchers. Anticipated results The AI-assisted protocol offers several advantages, including a thorough and customized evaluation of neurocognitive functions. It employs machine learning algorithms to analyze test results, generating an individualized neurocognitive profile that highlights patterns and trends useful for clinical decision-making. The integration of AI allows for a deeper understanding of the patient's cognitive and emotional state, as well as potential compensatory strategies. Conclusions By integrating AI with neuro-psychological evaluation, this protocol aims to significantly improve the quality of neurocognitive assessments. It provides a more precise and individualized analysis, which has the potential to enhance clinical decision-making and overall patient care for older adults with psychiatric disorders.
Collapse
Affiliation(s)
- Diego D. Díaz-Guerra
- Department of Psychology, Faculty of Social Sciences, Universidad Central “Marta Abreu” de Las Villas, Santa Clara, Villa Clara, Cuba
| | - Marena de la C. Hernández-Lugo
- Department of Psychology, Faculty of Social Sciences, Universidad Central “Marta Abreu” de Las Villas, Santa Clara, Villa Clara, Cuba
| | - Yunier Broche-Pérez
- Applied Behavior Analysis Department, Prisma Behavioral Center, Miami, FL, United States
| | - Carlos Ramos-Galarza
- Centro de Investigación en Mecatrónica y Sistemas Interactivos - MIST, Facultad de Psicología, Universidad Tecnológica Indoamérica, Quito, Ecuador
| | - Ernesto Iglesias-Serrano
- ”Dr. C. Luis San Juan Pérez” Provincial Teaching Psychiatric Hospital, Santa Clara, Villa Clara, Cuba
| | - Zoylen Fernández-Fleites
- Department of Psychology, Faculty of Social Sciences, Universidad Central “Marta Abreu” de Las Villas, Santa Clara, Villa Clara, Cuba
| |
Collapse
|
22
|
Li F, Wang S, Gao Z, Qing M, Pan S, Liu Y, Hu C. Harnessing artificial intelligence in sepsis care: advances in early detection, personalized treatment, and real-time monitoring. Front Med (Lausanne) 2025; 11:1510792. [PMID: 39835096 PMCID: PMC11743359 DOI: 10.3389/fmed.2024.1510792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2024] [Accepted: 12/10/2024] [Indexed: 01/22/2025] Open
Abstract
Sepsis remains a leading cause of morbidity and mortality worldwide due to its rapid progression and heterogeneous nature. This review explores the potential of Artificial Intelligence (AI) to transform sepsis management, from early detection to personalized treatment and real-time monitoring. AI, particularly through machine learning (ML) techniques such as random forest models and deep learning algorithms, has shown promise in analyzing electronic health record (EHR) data to identify patterns that enable early sepsis detection. For instance, random forest models have demonstrated high accuracy in predicting sepsis onset in intensive care unit (ICU) patients, while deep learning approaches have been applied to recognize complications such as sepsis-associated acute respiratory distress syndrome (ARDS). Personalized treatment plans developed through AI algorithms predict patient-specific responses to therapies, optimizing therapeutic efficacy and minimizing adverse effects. AI-driven continuous monitoring systems, including wearable devices, provide real-time predictions of sepsis-related complications, enabling timely interventions. Beyond these advancements, AI enhances diagnostic accuracy, predicts long-term outcomes, and supports dynamic risk assessment in clinical settings. However, ethical challenges, including data privacy concerns and algorithmic biases, must be addressed to ensure fair and effective implementation. The significance of this review lies in addressing the current limitations in sepsis management and highlighting how AI can overcome these hurdles. By leveraging AI, healthcare providers can significantly enhance diagnostic accuracy, optimize treatment protocols, and improve overall patient outcomes. Future research should focus on refining AI algorithms with diverse datasets, integrating emerging technologies, and fostering interdisciplinary collaboration to address these challenges and realize AI's transformative potential in sepsis care.
Collapse
Affiliation(s)
- Fang Li
- Department of General Surgery, Chongqing General Hospital, Chongqing, China
| | - Shengguo Wang
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Zhi Gao
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Maofeng Qing
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Shan Pan
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Yingying Liu
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Chengchen Hu
- Department of Stomatology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| |
Collapse
|
23
|
Thetbanthad P, Sathanarugsawait B, Praneetpolgrang P. Application of Generative Artificial Intelligence Models for Accurate Prescription Label Identification and Information Retrieval for the Elderly in Northern East of Thailand. J Imaging 2025; 11:11. [PMID: 39852324 PMCID: PMC11765698 DOI: 10.3390/jimaging11010011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2024] [Revised: 12/27/2024] [Accepted: 01/01/2025] [Indexed: 01/26/2025] Open
Abstract
This study introduces a novel AI-driven approach to support elderly patients in Thailand with medication management, focusing on accurate drug label interpretation. Two model architectures were explored: a Two-Stage Optical Character Recognition (OCR) and Large Language Model (LLM) pipeline combining EasyOCR with Qwen2-72b-instruct and a Uni-Stage Visual Question Answering (VQA) model using Qwen2-72b-VL. Both models operated in a zero-shot capacity, utilizing Retrieval-Augmented Generation (RAG) with DrugBank references to ensure contextual relevance and accuracy. Performance was evaluated on a dataset of 100 diverse prescription labels from Thai healthcare facilities, using RAG Assessment (RAGAs) metrics to assess Context Recall, Factual Correctness, Faithfulness, and Semantic Similarity. The Two-Stage model achieved high accuracy (94%) and strong RAGAs scores, particularly in Context Recall (0.88) and Semantic Similarity (0.91), making it well-suited for complex medication instructions. In contrast, the Uni-Stage model delivered faster response times, making it practical for high-volume environments such as pharmacies. This study demonstrates the potential of zero-shot AI models in addressing medication management challenges for the elderly by providing clear, accurate, and contextually relevant label interpretations. The findings underscore the adaptability of AI in healthcare, balancing accuracy and efficiency to meet various real-world needs.
Collapse
Affiliation(s)
| | | | - Prasong Praneetpolgrang
- School of Information Technology, Sripatum University, Bangkok 10900, Thailand; (P.T.); (B.S.)
| |
Collapse
|
24
|
Arvidsson R, Gunnarsson R, Entezarjou A, Sundemo D, Wikberg C. ChatGPT (GPT-4) versus doctors on complex cases of the Swedish family medicine specialist examination: an observational comparative study. BMJ Open 2024; 14:e086148. [PMID: 39730155 PMCID: PMC11683950 DOI: 10.1136/bmjopen-2024-086148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Accepted: 11/22/2024] [Indexed: 12/29/2024] Open
Abstract
BACKGROUND Recent breakthroughs in artificial intelligence research include the development of generative pretrained transformers (GPT). ChatGPT has been shown to perform well when answering several sets of medical multiple-choice questions. However, it has not been tested for writing free-text assessments of complex cases in primary care. OBJECTIVES To compare the performance of ChatGPT, version GPT-4, with that of real doctors. DESIGN AND SETTING A blinded observational comparative study conducted in the Swedish primary care setting. Responses from GPT-4 and real doctors to cases from the Swedish family medicine specialist examination were scored by blinded reviewers, and the scores were compared. PARTICIPANTS Anonymous responses from the Swedish family medicine specialist examination 2017-2022 were used. OUTCOME MEASURES Primary: the mean difference in scores between GPT-4's responses and randomly selected responses by human doctors, as well as between GPT-4's responses and top-tier responses by human doctors. Secondary: the correlation between differences in response length and response score; the intraclass correlation coefficient between reviewers; and the percentage of maximum score achieved by each group in different subject categories. RESULTS The mean scores were 6.0, 7.2 and 4.5 for randomly selected doctor responses, top-tier doctor responses and GPT-4 responses, respectively, on a 10-point scale. The scores for the random doctor responses were, on average, 1.6 points higher than those of GPT-4 (p<0.001, 95% CI 0.9 to 2.2) and the top-tier doctor scores were, on average, 2.7 points higher than those of GPT-4 (p<0.001, 95 % CI 2.2 to 3.3). Following the release of GPT-4o, the experiment was repeated, although this time with only a single reviewer scoring the answers. In this follow-up, random doctor responses were scored 0.7 points higher than those of GPT-4o (p=0.044). CONCLUSION In complex primary care cases, GPT-4 performs worse than human doctors taking the family medicine specialist examination. Future GPT-based chatbots may perform better, but comprehensive evaluations are needed before implementing chatbots for medical decision support in primary care.
Collapse
Affiliation(s)
- Rasmus Arvidsson
- General Practice / Family Medicine, School of Public Health and Community Medicine, Sahlgrenska Academy, University of Gothenburg Institute of Medicine, Gothenburg, Sweden
- Hälsocentralen Sankt Hans, Praktikertjänst AB, Lund, Sweden
| | - Ronny Gunnarsson
- General Practice / Family Medicine, School of Public Health and Community Medicine, Sahlgrenska Academy, University of Gothenburg Institute of Medicine, Gothenburg, Sweden
- Närhälsan, Vårdcentralen Hemlösa, Region Vastra Gotaland, Gothenburg, Sweden
| | - Artin Entezarjou
- General Practice / Family Medicine, School of Public Health and Community Medicine, Sahlgrenska Academy, University of Gothenburg Institute of Medicine, Gothenburg, Sweden
| | - David Sundemo
- General Practice / Family Medicine, School of Public Health and Community Medicine, Sahlgrenska Academy, University of Gothenburg Institute of Medicine, Gothenburg, Sweden
- Lerum Primary Healthcare Center, Närhälsan, Lerum, Sweden
| | - Carl Wikberg
- General Practice / Family Medicine, School of Public Health and Community Medicine, Sahlgrenska Academy, University of Gothenburg Institute of Medicine, Gothenburg, Sweden
- Research, Education, Development & Innovation, Primary Health Care, Region Vastra Gotaland, Gothenburg, Sweden
| |
Collapse
|
25
|
Malik S, Das R, Thongtan T, Thompson K, Dbouk N. AI in Hepatology: Revolutionizing the Diagnosis and Management of Liver Disease. J Clin Med 2024; 13:7833. [PMID: 39768756 PMCID: PMC11678868 DOI: 10.3390/jcm13247833] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2024] [Revised: 12/13/2024] [Accepted: 12/19/2024] [Indexed: 01/11/2025] Open
Abstract
The integration of artificial intelligence (AI) into hepatology is revolutionizing the diagnosis and management of liver diseases amidst a rising global burden of conditions like metabolic-associated steatotic liver disease (MASLD). AI harnesses vast datasets and complex algorithms to enhance clinical decision making and patient outcomes. AI's applications in hepatology span a variety of conditions, including autoimmune hepatitis, primary biliary cholangitis, primary sclerosing cholangitis, MASLD, hepatitis B, and hepatocellular carcinoma. It enables early detection, predicts disease progression, and supports more precise treatment strategies. Despite its transformative potential, challenges remain, including data integration, algorithm transparency, and computational demands. This review examines the current state of AI in hepatology, exploring its applications, limitations, and the opportunities it presents to enhance liver health and care delivery.
Collapse
Affiliation(s)
- Sheza Malik
- Department of Internal Medicine, Rochester General Hospital, Rochester, NY 14621, USA;
| | - Rishi Das
- Division of Digestive Diseases, Emory University School of Medicine, Atlanta, GA 30322, USA; (R.D.); (T.T.)
- Department of Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA;
| | - Thanita Thongtan
- Division of Digestive Diseases, Emory University School of Medicine, Atlanta, GA 30322, USA; (R.D.); (T.T.)
- Department of Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA;
| | - Kathryn Thompson
- Department of Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA;
| | - Nader Dbouk
- Division of Digestive Diseases, Emory University School of Medicine, Atlanta, GA 30322, USA; (R.D.); (T.T.)
- Department of Medicine, Emory University School of Medicine, Atlanta, GA 30322, USA;
- Emory Transplant Center, Emory University School of Medicine, Atlanta, GA 30322, USA
| |
Collapse
|
26
|
Akbari A, Adabi M, Masoodi M, Namazi A, Mansouri F, Tabaeian SP, Shokati Eshkiki Z. Artificial intelligence: clinical applications and future advancement in gastrointestinal cancers. Front Artif Intell 2024; 7:1446693. [PMID: 39764458 PMCID: PMC11701808 DOI: 10.3389/frai.2024.1446693] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2024] [Accepted: 12/02/2024] [Indexed: 04/01/2025] Open
Abstract
One of the foremost causes of global healthcare burden is cancer of the gastrointestinal tract. The medical records, lab results, radiographs, endoscopic images, tissue samples, and medical histories of patients with gastrointestinal malignancies provide an enormous amount of medical data. There are encouraging signs that the advent of artificial intelligence could enhance the treatment of gastrointestinal issues with this data. Deep learning algorithms can swiftly and effectively analyze unstructured, high-dimensional data, including texts, images, and waveforms, while advanced machine learning approaches could reveal new insights into disease risk factors and phenotypes. In summary, artificial intelligence has the potential to revolutionize various features of gastrointestinal cancer care, such as early detection, diagnosis, therapy, and prognosis. This paper highlights some of the many potential applications of artificial intelligence in this domain. Additionally, we discuss the present state of the discipline and its potential future developments.
Collapse
Affiliation(s)
- Abolfazl Akbari
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Maryam Adabi
- Infectious Ophthalmologic Research Center, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Mohsen Masoodi
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
| | - Abolfazl Namazi
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
- Department of Internal Medicine, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Fatemeh Mansouri
- Department of Microbiology, Faculty of Sciences, Qom Branch, Islamic Azad University, Qom, Iran
| | - Seidamir Pasha Tabaeian
- Colorectal Research Center, Iran University of Medical Sciences, Tehran, Iran
- Department of Internal Medicine, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Zahra Shokati Eshkiki
- Alimentary Tract Research Center, Clinical Sciences Research Institute, Imam Khomeini Hospital, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| |
Collapse
|
27
|
Namireddy SR, Gill SS, Peerbhai A, Kamath AG, Ramsay DSC, Ponniah HS, Salih A, Jankovic D, Kalasauskas D, Neuhoff J, Kramer A, Russo S, Thavarajasingam SG. Artificial intelligence in risk prediction and diagnosis of vertebral fractures. Sci Rep 2024; 14:30560. [PMID: 39702597 DOI: 10.1038/s41598-024-75628-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Accepted: 10/07/2024] [Indexed: 12/21/2024] Open
Abstract
With the increasing prevalence of vertebral fractures, accurate diagnosis and prognostication are essential. This study assesses the effectiveness of AI in diagnosing and predicting vertebral fractures through a systematic review and meta-analysis. A comprehensive search across major databases selected studies utilizing AI for vertebral fracture diagnosis or prognosis. Out of 14,161 studies initially identified, 79 were included, with 40 undergoing meta-analysis. Diagnostic models were stratified by pathology: non-pathological vertebral fractures, osteoporotic vertebral fractures, and vertebral compression fractures. The primary outcome measure was AUROC. AI showed high accuracy in diagnosing and predicting vertebral fractures: predictive AUROC = 0.82, osteoporotic vertebral fracture diagnosis AUROC = 0.92, non-pathological vertebral fracture diagnosis AUROC = 0.85, and vertebral compression fracture diagnosis AUROC = 0.87, all significant (p < 0.001). Traditional models had the highest median AUROC (0.90) for fracture prediction, while deep learning models excelled in diagnosing all fracture types. High heterogeneity (I² > 99%, p < 0.001) indicated significant variation in model design and performance. AI technologies show considerable promise in improving the diagnosis and prognostication of vertebral fractures, with high accuracy. However, observed heterogeneity and study biases necessitate further research. Future efforts should focus on standardizing AI models and validating them across diverse datasets to ensure clinical utility.
Collapse
Affiliation(s)
- Srikar R Namireddy
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Saran S Gill
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Amaan Peerbhai
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Abith G Kamath
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Daniele S C Ramsay
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Hariharan Subbiah Ponniah
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Ahmed Salih
- Imperial Brain & Spine Initiative, Imperial College London, London, UK
- Faculty of Medicine, Imperial College London, London, UK
| | - Dragan Jankovic
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstraße 1, Mainz, Germany
| | - Darius Kalasauskas
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstraße 1, Mainz, Germany
| | - Jonathan Neuhoff
- Center for Spinal Surgery and Neurotraumatology, Berufsgenossenschaftliche Unfallklinik Frankfurt am Main, Frankfurt, Germany
| | - Andreas Kramer
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstraße 1, Mainz, Germany
| | - Salvatore Russo
- Department of Neurosurgery, Imperial College Healthcare NHS Trust, London, UK
| | - Santhosh G Thavarajasingam
- Imperial Brain & Spine Initiative, Imperial College London, London, UK.
- Department of Neurosurgery, University Medical Center Mainz, Langenbeckstraße 1, Mainz, Germany.
| |
Collapse
|
28
|
Viderman D, Ayazbay A, Kalzhan B, Bayakhmetova S, Tungushpayev M, Abdildin Y. Artificial Intelligence in the Management of Patients with Respiratory Failure Requiring Mechanical Ventilation: A Scoping Review. J Clin Med 2024; 13:7535. [PMID: 39768462 PMCID: PMC11728182 DOI: 10.3390/jcm13247535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2024] [Revised: 11/25/2024] [Accepted: 12/06/2024] [Indexed: 01/04/2025] Open
Abstract
Background: Mechanical ventilation (MV) is one of the most frequently used organ replacement modalities in the intensive care unit (ICU). Artificial intelligence (AI) presents substantial potential in optimizing mechanical ventilation management. The utility of AI in MV lies in its ability to harness extensive data from electronic monitoring systems, facilitating personalized care tailored to individual patient needs. This scoping review aimed to consolidate and evaluate the existing evidence for the application of AI in managing respiratory failure among patients necessitating MV. Methods: The literature search was conducted in PubMed, Scopus, and the Cochrane Library. Studies investigating the utilization of AI in patients undergoing MV, including observational and randomized controlled trials, were selected. Results: Overall, 152 articles were screened, and 37 were included in the analysis. We categorized the goals of AI in the included studies into the following groups: (1) prediction of requirement in MV; (2) prediction of outcomes in MV; (3) prediction of weaning from MV; (4) prediction of hypoxemia after extubation; (5) prediction models for MV-associated severe acute kidney injury; (6) identification of long-term outcomes after prolonged MV; (7) prediction of survival. Conclusions: AI has been studied in a wide variety of patients with respiratory failure requiring MV. Common applications of AI in MV included the assessment of the performance of ML for mortality prediction in patients with respiratory failure, prediction and identification of the most appropriate time for extubation, detection of patient-ventilator asynchrony, ineffective expiration, and the prediction of the severity of the respiratory failure.
Collapse
Affiliation(s)
- Dmitriy Viderman
- Department of Surgery, School of Medicine, Nazarbayev University, 010000 Astana, Kazakhstan
- Department of Anesthesiology, Intensive Care, and Pain Medicine, National Research Oncology Center, 010000 Astana, Kazakhstan
| | - Ainur Ayazbay
- Department of Computer Science, School of Engineering and Digital Sciences, Nazarbayev University, 010000 Astana, Kazakhstan
| | - Bakhtiyar Kalzhan
- Department of Mechanical and Aerospace Engineering, School of Engineering and Digital Sciences, Nazarbayev University, 010000 Astana, Kazakhstan (Y.A.)
| | - Symbat Bayakhmetova
- Department of Surgery, School of Medicine, Nazarbayev University, 010000 Astana, Kazakhstan
| | - Meiram Tungushpayev
- Department of Surgery, School of Medicine, Nazarbayev University, 010000 Astana, Kazakhstan
| | - Yerkin Abdildin
- Department of Mechanical and Aerospace Engineering, School of Engineering and Digital Sciences, Nazarbayev University, 010000 Astana, Kazakhstan (Y.A.)
| |
Collapse
|
29
|
Owoyemi A, Okpara E, Salwei M, Boyd A. End user experience of a widely used artificial intelligence based sepsis system. JAMIA Open 2024; 7:ooae096. [PMID: 39386065 PMCID: PMC11458550 DOI: 10.1093/jamiaopen/ooae096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2024] [Revised: 06/27/2024] [Accepted: 09/05/2024] [Indexed: 10/12/2024] Open
Abstract
Objectives Research on the Epic Sepsis System (ESS) has predominantly focused on technical accuracy, neglecting the user experience of healthcare professionals. Understanding these experiences is crucial for the design of Artificial Intelligence (AI) systems in clinical settings. This study aims to explore the socio-technical dynamics affecting ESS adoption and use, based on user perceptions and experiences. Materials and Methods Resident doctors and nurses with recent ESS interaction were interviewed using purposive sampling until data saturation. A content analysis was conducted using Dedoose software, with codes generated from Sittig and Singh's and Salwei and Carayon's frameworks, supplemented by inductive coding for emerging themes. Results Interviews with 10 healthcare providers revealed mixed but generally positive or neutral perceptions of the ESS. Key discussion points included its workflow integration and usability. Findings were organized into 2 main domains: workflow fit, and usability and utility, highlighting the system's seamless electronic health record integration and identifying design gaps. Discussion This study offers insights into clinicians' experiences with the ESS, emphasizing the socio-technical factors that influence its adoption and effective use. The positive reception was tempered by identified design issues, with clinician perceptions varying by their professional experience and frequency of ESS interaction. Conclusion The findings highlight the need for ongoing ESS refinement, emphasizing a balance between technological advancement and clinical practicality. This research contributes to the understanding of AI system adoption in healthcare, suggesting improvements for future clinical AI tools.
Collapse
Affiliation(s)
- Ayomide Owoyemi
- Department of Biomedical and Health Informatics, University of Illinois at Chicago, Chicago, IL 60612, United States
| | - Ebere Okpara
- Department of Pharmacy Systems, Outcomes and Policy, University of Illinois at Chicago, Chicago, IL 60612, United States
| | - Megan Salwei
- Department of Anesthesiology, Vanderbilt University Medical Center, Nashville, TN 37232, United States
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN 37232, United States
| | - Andrew Boyd
- Department of Biomedical and Health Informatics, University of Illinois at Chicago, Chicago, IL 60612, United States
| |
Collapse
|
30
|
Weber S, Wyszynski M, Godefroid M, Plattfaut R, Niehaves B. How do medical professionals make sense (or not) of AI? A social-media-based computational grounded theory study and an online survey. Comput Struct Biotechnol J 2024; 24:146-159. [PMID: 38434249 PMCID: PMC10904922 DOI: 10.1016/j.csbj.2024.02.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 02/14/2024] [Accepted: 02/14/2024] [Indexed: 03/05/2024] Open
Abstract
To investigate opinions and attitudes of medical professionals towards adopting AI-enabled healthcare technologies in their daily business, we used a mixed-methods approach. Study 1 employed a qualitative computational grounded theory approach analyzing 181 Reddit threads in the several subreddits of r/medicine. By utilizing an unsupervised machine learning clustering method, we identified three key themes: (1) consequences of AI, (2) physician-AI relationship, and (3) a proposed way forward. In particular Reddit posts related to the first two themes indicated that the medical professionals' fear of being replaced by AI and skepticism toward AI played a major role in the argumentations. Moreover, the results suggest that this fear is driven by little or moderate knowledge about AI. Posts related to the third theme focused on factual discussions about how AI and medicine have to be designed to become broadly adopted in health care. Study 2 quantitatively examined the relationship between the fear of AI, knowledge about AI, and medical professionals' intention to use AI-enabled technologies in more detail. Results based on a sample of 223 medical professionals who participated in the online survey revealed that the intention to use AI technologies increases with increasing knowledge about AI and that this effect is moderated by the fear of being replaced by AI.
Collapse
Affiliation(s)
- Sebastian Weber
- University of Bremen, Digital Public, Bibliothekstr. 1, 28359 Bremen, Germany
| | - Marc Wyszynski
- University of Bremen, Digital Public, Bibliothekstr. 1, 28359 Bremen, Germany
| | - Marie Godefroid
- University of Siegen, Information Systems, Kohlbettstr. 15, 57072 Siegen, Germany
| | - Ralf Plattfaut
- University of Duisburg-Essen, Information Systems and Transformation Management, Universitätsstr. 9, 45141 Essen, Germany
| | - Bjoern Niehaves
- University of Bremen, Digital Public, Bibliothekstr. 1, 28359 Bremen, Germany
| |
Collapse
|
31
|
Yi RC, Gantz HY, Feldman SR. Utilizing artificial intelligence technology with emotional intelligence in clinical office visits. J DERMATOL TREAT 2024; 35:2374500. [PMID: 39042947 DOI: 10.1080/09546634.2024.2374500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 06/04/2024] [Indexed: 07/25/2024]
Affiliation(s)
- Robin C Yi
- Center for Dermatology Research, Department of Dermatology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
| | - Hannah Y Gantz
- Center for Dermatology Research, Department of Dermatology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
| | - Steven R Feldman
- Center for Dermatology Research, Department of Dermatology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
- Department of Pathology, Wake Forest University School of Medicine, Winston-Salem, North Carolina
- Department of Social Sciences & Health Policy, Wake Forest University School of Medicine, Winston-Salem, North Carolina
| |
Collapse
|
32
|
Nigru AS, Benini S, Bonetti M, Bragaglio G, Frigerio M, Maffezzoni F, Leonardi R. External validation of SpineNetV2 on a comprehensive set of radiological features for grading lumbosacral disc pathologies. NORTH AMERICAN SPINE SOCIETY JOURNAL 2024; 20:100564. [PMID: 39640208 PMCID: PMC11617751 DOI: 10.1016/j.xnsj.2024.100564] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/29/2024] [Revised: 10/16/2024] [Accepted: 10/17/2024] [Indexed: 12/07/2024]
Abstract
Background In recent years, the integration of Artificial Intelligence (AI) models has revolutionized the diagnosis of Low Back Pain (LBP) and associated disc pathologies. Among these, SpineNetV2 stands out as a state-of-the-art, open-access model for detecting and grading various intervertebral disc pathologies. However, ensuring the reliability and applicability of AI models like SpineNetV2 is paramount. Rigorous validation is essential to guarantee their robustness and generalizability across diverse patient cohorts and imaging protocols. Methods We conducted a retrospective analysis of MRI images of 1747 lumbosacral intervertebral discs (IVDs) from 353 patients (mean age, 54 ± 15.4 years, 44.5% female) with various spinal disorders, collected between September 2021 and February 2023 at X-Ray Service s.r.l. The SpineNetV2 system was used to grade 11 distinct lumbosacral disc pathologies, including Pfirrmann grading, disc narrowing, central canal stenosis, spondylolisthesis, (upper and lower) endplate defects, (upper and lower) marrow changes, (right and left) foraminal stenosis, and disc herniation, using T2-weighted sagittal MR images. Performance metrics included accuracy, balanced accuracy, precision, F1 score, Matthew's Correlation Coefficient, Brier Score Loss, Lin's concordance correlation coefficients, and Cohen's kappa coefficients. Two expert radiologists provide annotations for these discs. The evaluation of SpineNetV2's grading is compared against expert radiologists' assessments. Results SpineNetV2 demonstrated strong performance across various metrics, with high agreement scores (Cohen's Kappa, Lin's Concordance, and Matthew's Correlation Coefficient exceeding 0.7) for most pathologies. However, lower agreement was found for foraminal stenosis and disc herniation, underscoring the limitations of sagittal MR images for evaluating these conditions. Conclusions This study highlights the importance of external validation, emphasizing the need for comprehensive assessments of deep learning models. SpineNetV2 exhibits promising results in predicting disc pathologies, with findings guiding further improvements. The open-source release of SpineNetV2 enables researchers to independently validate and extend the model's capabilities. This collaborative approach promotes innovation and accelerates the development of more reliable and comprehensive deep learning tools for the assessment of spine pathology.
Collapse
Affiliation(s)
- Alemu Sisay Nigru
- Department of Information Engineering, University of Brescia, via Branze 38, Brescia 25123, Italy
- Department of Clinical and Experimental Sciences, University of Brescia, Viale Europa, 11, Brescia 25123, Italy
| | - Sergio Benini
- Department of Information Engineering, University of Brescia, via Branze 38, Brescia 25123, Italy
| | - Matteo Bonetti
- X-Ray Service s.r.l., Via Guglielmo Oberdan 126, Brescia, 25128, Italy
- Poliambulatorio Oberdan, Via Guglielmo Oberdan 126, Brescia, 25128, Italy
| | - Graziella Bragaglio
- X-Ray Service s.r.l., Via Guglielmo Oberdan 126, Brescia, 25128, Italy
- Poliambulatorio Oberdan, Via Guglielmo Oberdan 126, Brescia, 25128, Italy
| | - Michele Frigerio
- Poliambulatorio Oberdan, Via Guglielmo Oberdan 126, Brescia, 25128, Italy
| | - Federico Maffezzoni
- X-Ray Service s.r.l., Via Guglielmo Oberdan 126, Brescia, 25128, Italy
- Poliambulatorio Oberdan, Via Guglielmo Oberdan 126, Brescia, 25128, Italy
| | - Riccardo Leonardi
- Department of Information Engineering, University of Brescia, via Branze 38, Brescia 25123, Italy
| |
Collapse
|
33
|
Hogg HDJ, Brittain K, Talks J, Keane PA, Maniatopoulos G. Intervention design for artificial intelligence-enabled macular service implementation: a primary qualitative study. Implement Sci Commun 2024; 5:131. [PMID: 39593115 PMCID: PMC11600873 DOI: 10.1186/s43058-024-00667-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Accepted: 11/05/2024] [Indexed: 11/28/2024] Open
Abstract
BACKGROUND Neovascular age-related macular degeneration (nAMD) is one of the largest single-disease contributors to hospital outpatient appointments. Challenges in finding the clinical capacity to meet this demand can lead to sight-threatening delays in the macular services that provide treatment. Clinical artificial intelligence (AI) technologies pose one opportunity to rebalance demand and capacity in macular services. However, there is a lack of evidence to guide early-adopters seeking to use AI as a solution to demand-capacity imbalance. This study aims to provide guidance for these early adopters on how AI-enabled macular services may best be implemented by exploring what will influence the outcome of AI implementation and why. METHODS Thirty-six semi-structured interviews were conducted with participants. Data were analysed with the Nonadoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) framework to identify factors likely to influence implementation outcomes. These factors and the primary data then underwent a secondary analysis using the Fit between Individuals, Technology and Task (FITT) framework to propose an actionable intervention. RESULTS nAMD treatment should be initiated at face-to-face appointments with clinicians who recommend year-long periods of AI-enabled scheduling of treatments. This aims to maintain or enhance the quality of patient communication, whilst reducing consultation frequency. Appropriately trained photographers should take on the additional roles of inputting retinal imaging into the AI device and overseeing its communication to clinical colleagues, while ophthalmologists assume clinical oversight and consultation roles. Interoperability to facilitate this intervention would best be served by imaging equipment that can send images to the cloud securely for analysis by AI tools. Picture Archiving and Communication Software (PACS) should have the capability to output directly into electronic medical records (EMR) familiar to clinical and administrative staff. CONCLUSION There are many enablers to implementation and few of the remaining barriers relate directly to the AI technology itself. The proposed intervention requires local tailoring and prospective evaluation but can support early adopters in optimising the chances of success from initial efforts to implement AI-enabled macular services. PROTOCOL REGISTRATION Hogg HDJ, Brittain K, Teare D, Talks J, Balaskas K, Keane P, Maniatopoulos G. Safety and efficacy of an artificial intelligence-enabled decision tool for treatment decisions in neovascular age-related macular degeneration and an exploration of clinical pathway integration and implementation: protocol for a multi-methods validation study. BMJ Open. 2023 Feb 1;13(2):e069443. https://doi.org/10.1136/bmjopen-2022-069443 . PMID: 36725098; PMCID: PMC9896175.
Collapse
Affiliation(s)
- Henry David Jeffry Hogg
- Research, Development and Innovation, University Hospitals Birmingham NHS Foundation Trust, Level 2 ITM, Queen Elizabeth HospitalMindelsohn Way, Birmingham, B15 2GW, UK.
- Department of Applied Health Research, School of Health Sciences, College of Medicine and Health, University of Birmingham, Birmingham, UK.
- Moorfields Eye Hospital NHS Foundation Trust, London, UK.
| | - Katie Brittain
- Population Health Sciences Institute, Newcastle University, Newcastle Upon Tyne, UK
| | - James Talks
- Newcastle Eye Centre, Newcastle Upon Tyne Hospitals NHS Foundation Trust, Newcastle Upon Tyne, UK
| | - Pearse Andrew Keane
- Moorfields Eye Hospital NHS Foundation Trust, London, UK
- Institute of Ophthalmology, University College London, London, UK
| | - Gregory Maniatopoulos
- Population Health Sciences Institute, Newcastle University, Newcastle Upon Tyne, UK
- School of Business, Leicester University, Leicester, UK
| |
Collapse
|
34
|
Preti LM, Ardito V, Compagni A, Petracca F, Cappellaro G. Implementation of Machine Learning Applications in Health Care Organizations: Systematic Review of Empirical Studies. J Med Internet Res 2024; 26:e55897. [PMID: 39586084 PMCID: PMC11629039 DOI: 10.2196/55897] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 07/07/2024] [Accepted: 10/03/2024] [Indexed: 11/27/2024] Open
Abstract
BACKGROUND There is a growing enthusiasm for machine learning (ML) among academics and health care practitioners. Despite the transformative potential of ML-based applications for patient care, their uptake and implementation in health care organizations are sporadic. Numerous challenges currently impede or delay the widespread implementation of ML in clinical practice, and limited knowledge is available regarding how these challenges have been addressed. OBJECTIVE This work aimed to (1) examine the characteristics of ML-based applications and the implementation process in clinical practice, using the Consolidated Framework for Implementation Research (CFIR) for theoretical guidance and (2) synthesize the strategies adopted by health care organizations to foster successful implementation of ML. METHODS A systematic literature review was conducted based on the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The search was conducted in PubMed, Scopus, and Web of Science over a 10-year period (2013-2023). The search strategy was built around 4 blocks of keywords (artificial intelligence, implementation, health care, and study type). Only empirical studies documenting the implementation of ML applications in clinical settings were considered. The implementation process was investigated using a thematic analysis and coding procedure. RESULTS Thirty-four studies were selected for data synthesis. Selected papers were relatively recent, with only 9% (3/34) of records published before 2019. ML-based applications were implemented mostly within hospitals (29/34, 85%). In terms of clinical workflow, ML-based applications supported mostly prognosis (20/34, 59%) and diagnosis (10/34, 29%). The implementation efforts were analyzed using CFIR domains. As for the inner setting domain, access to knowledge and information (12/34, 35%), information technology infrastructure (11/34, 32%), and organizational culture (9/34, 26%) were among the most observed dimensions influencing the success of implementation. As for the ML innovation itself, factors deemed relevant were its design (15/34, 44%), the relative advantage with respect to existing clinical practice (14/34, 41%), and perceived complexity (14/34, 41%). As for the other domains (ie, processes, roles, and outer setting), stakeholder engagement (12/34, 35%), reflecting and evaluating practices (11/34, 32%), and the presence of implementation leaders (9/34, 26%) were the main factors identified as important. CONCLUSIONS This review sheds some light on the factors that are relevant and that should be accounted for in the implementation process of ML-based applications in health care. While the relevance of ML-specific dimensions, like trust, emerges clearly across several implementation domains, the evidence from this review highlighted that relevant implementation factors are not necessarily specific for ML but rather transversal for digital health technologies. More research is needed to further clarify the factors that are relevant to implementing ML-based applications at the organizational level and to support their uptake within health care organizations. TRIAL REGISTRATION PROSPERO 403873; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=403873. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR2-10.2196/47971.
Collapse
Affiliation(s)
- Luigi M Preti
- Center for Research on Health and Social Care Management (CERGAS), SDA Bocconi School of Management, Milan, Italy
| | - Vittoria Ardito
- Center for Research on Health and Social Care Management (CERGAS), SDA Bocconi School of Management, Milan, Italy
| | - Amelia Compagni
- Center for Research on Health and Social Care Management (CERGAS), SDA Bocconi School of Management, Milan, Italy
- Department of Social and Political Sciences, Bocconi University, Milan, Italy
| | - Francesco Petracca
- Center for Research on Health and Social Care Management (CERGAS), SDA Bocconi School of Management, Milan, Italy
| | - Giulia Cappellaro
- Center for Research on Health and Social Care Management (CERGAS), SDA Bocconi School of Management, Milan, Italy
- Department of Social and Political Sciences, Bocconi University, Milan, Italy
| |
Collapse
|
35
|
Szolnoky K, Nordström T, Eklund M. Tomorrow's patient management: LLMs empowered by external tools. Nat Rev Urol 2024:10.1038/s41585-024-00965-w. [PMID: 39567680 DOI: 10.1038/s41585-024-00965-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2024]
Affiliation(s)
- Kelvin Szolnoky
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
| | - Tobias Nordström
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
- Department of Clinical Sciences at Danderyd Hospital, Karolinska Institutet, Stockholm, Sweden
| | - Martin Eklund
- Department of Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden.
| |
Collapse
|
36
|
Hatem NAH, Ibrahim MIM, Yousuf SA. Assessing Yemeni university students' public perceptions toward the use of artificial intelligence in healthcare. Sci Rep 2024; 14:28299. [PMID: 39550433 PMCID: PMC11569219 DOI: 10.1038/s41598-024-80203-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 11/15/2024] [Indexed: 11/18/2024] Open
Abstract
Artificial intelligence (AI) integration in healthcare has emerged as a transformative force, promising to enhance medical diagnosis, treatment, and overall healthcare delivery. Hence, this study investigates university students' perceptions of using AI in healthcare. A cross-sectional survey was conducted at two major universities using a paper-based questionnaire from September 2023 to November 2023. Participants' views regarding using artificial intelligence in healthcare were investigated using 25 items distributed across five domains. The Mann-Whitney U test was applied to compare variables. Two hundred seventy-nine (279) students completed the questionnaire. More than half of the participants (52%, n = 145) expressed their belief in AI's potential to reduce treatment errors. However, about (61.6%, n = 172) of participants fear the influence of AI that could prevent doctors from learning to make correct patient care judgments, and it was widely agreed (69%) that doctors should ultimately maintain final control over patient care. Participants with experience with AI, such as engaging with AI chatbots, significantly reported higher scores in both the "Benefits and Positivity Toward AI in Healthcare" and "Concerns and Fears" domains (p = 0.024) and (p = 0.026), respectively. The identified cautious optimism, concerns, and fears highlight the delicate balance required for successful AI integration. The findings emphasize the importance of addressing specific concerns, promoting positive experiences with AI, and establishing transparent communication channels. Insights from such research can guide the development of ethical frameworks, policies, and targeted interventions, fostering a harmonious integration of AI into the healthcare landscape in developing countries.
Collapse
Affiliation(s)
- Najmaddin A H Hatem
- Department of Clinical Pharmacy, College of Clinical Pharmacy, Hodeidah University, Al-Hudaydah, Yemen.
| | | | - Seena A Yousuf
- Social Medicine and Public Health Department, Faculty of Medicine and Health Sciences, Aden University, Aden, Yemen
| |
Collapse
|
37
|
Zhang M, Tang E, Ding H, Zhang Y. Artificial Intelligence and the Future of Communication Sciences and Disorders: A Bibliometric and Visualization Analysis. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:4369-4390. [PMID: 39418583 DOI: 10.1044/2024_jslhr-24-00157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2024]
Abstract
PURPOSE As artificial intelligence (AI) takes an increasingly prominent role in health care, a growing body of research is being dedicated to its application in the investigation of communication sciences and disorders (CSD). This study aims to provide a comprehensive overview, serving as a valuable resource for researchers, developers, and professionals seeking to comprehend the evolving landscape of AI in CSD research. METHOD We conducted a bibliometric analysis of AI-based research in the discipline of CSD published up to December 2023. Utilizing the Web of Science and Scopus databases, we identified 15,035 publications, with 4,375 meeting our inclusion criteria. Based on the bibliometric data, we examined publication trends and patterns, characteristics of research activities, and research hotspot tendencies. RESULTS From 1985 onwards, there has been a consistent annual increase in publications, averaging 16.51%, notably surging from 2012 to 2023. The primary communication disorders studied include autism, aphasia, dysarthria, Parkinson's disease, and Alzheimer's disease. Noteworthy AI models instantiated in CSD research encompass support vector machine, convolutional neural network, and hidden Markov model, among others. CONCLUSIONS Compared to AI applications in other fields, the adoption of AI in CSD has lagged slightly behind. While CSD studies primarily use classical machine learning techniques, there is a growing trend toward the integration of deep learning methods. AI technology offers significant benefits for both research and clinical practice in CSD, but it also presents certain challenges. Moving forward, collaboration among technological, research, and clinical domains is essential to empower researchers and speech-language pathologists to effectively leverage AI technology for the study, diagnosis, assessment, and rehabilitation of CSD. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.27162564.
Collapse
Affiliation(s)
- Minyue Zhang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| | - Enze Tang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| | - Yang Zhang
- Department of Speech-Language-Hearing Sciences, University of Minnesota, Twin Cities, Minneapolis
- Masonic Institute for the Developing Brain, University of Minnesota, Twin Cities, Minneapolis
| |
Collapse
|
38
|
Kovoor JG, Smallbone H, Jenkins A, Stretton B, Santhosh S, Jacobsen JHW, Gupta AK, Zaka A, Nann SD, Jiang M, Luo Y, Withers C, Ataie S, Nematzadeh N, Warren LR, Marshall-Webb M, Chan W, McNeil K, Gluck S, Turner R, Tan M, South T, Gilbert T, Hopkins AM, Vanlint AS, Sweetman GM, Bates TR, Hansra A, Bacchi S. The future is bright: artificial intelligence for trainee medical officers in Australia and New Zealand. Intern Med J 2024; 54:1909-1912. [PMID: 39305119 DOI: 10.1111/imj.16518] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2024] [Accepted: 08/25/2024] [Indexed: 11/05/2024]
Abstract
Given their frontline role in Australia and Aotearoa New Zealand (ANZ) healthcare, trainee medical officers (TMOs) will play a crucial role in the development and use of artificial intelligence (AI) for clinical care, ongoing medical education and research. As 'digital natives', particularly those with technical expertise in AI, TMOs should also be leaders in informing the safe uptake and governance of AI within ANZ healthcare as they have a practical understanding of its associated risks and benefits. However, this is only possible if a culture of broad collaboration is instilled while the use of AI in ANZ is still in its initial phase.
Collapse
Affiliation(s)
- Joshua G Kovoor
- The University of Adelaide, Adelaide, South Australia, Australia
- Ballarat Base Hospital, Ballarat, Victoria, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
| | - Harry Smallbone
- Fiona Stanley Hospital, Perth, Western Australia, Australia
- The University of Western Australia, Perth, Western Australia, Australia
| | - Alexander Jenkins
- WA Data Science Innovation Hub, Perth, Western Australia, Australia
- Curtin University, Perth, Western Australia, Australia
| | - Brandon Stretton
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
- Royal Adelaide Hospital, Adelaide, South Australia, Australia
| | - Sanjana Santhosh
- Health and Information, Canberra, Australian Capital Territory, Australia
- The University of Queensland, Brisbane, Queensland, Australia
| | - Jonathan H W Jacobsen
- Health and Information, Canberra, Australian Capital Territory, Australia
- The University of Melbourne, Melbourne, Victoria, Australia
| | - Aashray K Gupta
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
- Prince of Wales Hospital, Sydney, New South Wales, Australia
- Gold Coast University Hospital, Gold Coast, Queensland, Australia
- Royal North Shore Hospital, Sydney, New South Wales, Australia
| | - Ammar Zaka
- Health and Information, Canberra, Australian Capital Territory, Australia
- Gold Coast University Hospital, Gold Coast, Queensland, Australia
| | - Silas D Nann
- Health and Information, Canberra, Australian Capital Territory, Australia
- Gold Coast University Hospital, Gold Coast, Queensland, Australia
| | - Melinda Jiang
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
- Royal Adelaide Hospital, Adelaide, South Australia, Australia
| | - Yuchen Luo
- The University of Melbourne, Melbourne, Victoria, Australia
- Austin Health, Melbourne, Victoria, Australia
| | - Caitlyn Withers
- The University of Queensland, Brisbane, Queensland, Australia
| | - Sara Ataie
- Flinders University, Adelaide, South Australia, Australia
| | | | - Leigh R Warren
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
| | - Matthew Marshall-Webb
- Health and Information, Canberra, Australian Capital Territory, Australia
- Box Hill Hospital, Melbourne, Victoria, Australia
| | - WengOnn Chan
- The University of Adelaide, Adelaide, South Australia, Australia
- The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Keith McNeil
- Commission on Excellence and Innovation in Health, Adelaide, South Australia, Australia
| | - Samuel Gluck
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
- Lyell McEwin Hospital, Adelaide, South Australia, Australia
| | | | - Melanie Tan
- The University of Melbourne, Melbourne, Victoria, Australia
| | - Tobin South
- Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
| | - Toby Gilbert
- The University of Adelaide, Adelaide, South Australia, Australia
- Lyell McEwin Hospital, Adelaide, South Australia, Australia
| | | | - Andrew S Vanlint
- The University of Adelaide, Adelaide, South Australia, Australia
- Health and Information, Canberra, Australian Capital Territory, Australia
- Lyell McEwin Hospital, Adelaide, South Australia, Australia
| | - Gregory M Sweetman
- Postgraduate Medical Council of Western Australia, Perth, Western Australia, Australia
| | - Timothy R Bates
- Postgraduate Medical Council of Western Australia, Perth, Western Australia, Australia
- St John of God Health Care, Perth, Western Australia, Australia
| | - Amandeep Hansra
- Australian Digital Health Agency, Sydney, New South Wales, Australia
- The University of Sydney, Sydney, New South Wales, Australia
| | - Stephen Bacchi
- Health and Information, Canberra, Australian Capital Territory, Australia
- Royal Adelaide Hospital, Adelaide, South Australia, Australia
- Flinders University, Adelaide, South Australia, Australia
- Lyell McEwin Hospital, Adelaide, South Australia, Australia
| |
Collapse
|
39
|
Reis FJJ, Carvalho MBLD, Neves GDA, Nogueira LC, Meziat-Filho N. Machine learning methods in physical therapy: A scoping review of applications in clinical context. Musculoskelet Sci Pract 2024; 74:103184. [PMID: 39278141 DOI: 10.1016/j.msksp.2024.103184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/05/2024] [Revised: 08/13/2024] [Accepted: 09/10/2024] [Indexed: 09/17/2024]
Abstract
BACKGROUND Machine learning (ML) efficiently processes large datasets, showing promise in enhancing clinical practice within physical therapy. OBJECTIVE The aim of this scoping review is to provide an overview of studies using ML approaches in clinical settings of physical therapy. DATA SOURCES A scoping review was performed in PubMed, EMBASE, PEDro, Cochrane, Web of Science, and Scopus. SELECTION CRITERIA We included studies utilizing ML methods. ML was defined as the utilization of computational systems to encode patterns and relationships, enabling predictions or classifications with minimal human interference. DATA EXTRACTION AND DATA SYNTHESIS Data were extracted regarding methods, data types, performance metrics, and model availability. RESULTS Forty-two studies were included. The majority were published after 2020 (n = 25). Fourteen studies (33.3%) were in the musculoskeletal physical therapy field, nine (21.4%) in neurological, and eight (19%) in sports physical therapy. We identified 44 different ML models, with random forest being the most used. Three studies reported on model availability. We identified several clinical applications for ML-based tools, including diagnosis (n = 14), prognosis (n = 7), treatment outcomes prediction (n = 7), clinical decision support (n = 5), movement analysis (n = 4), patient monitoring (n = 3), and personalized care plan (n = 2). LIMITATION Model performance metrics, costs, model interpretability, and explainability were not reported. CONCLUSION This scope review mapped the emerging landscape of machine learning applications in physical therapy. Despite the growing interest, the field still lacks high-quality studies on validation, model availability, and acceptability to advance from research to clinical practice.
Collapse
Affiliation(s)
- Felipe J J Reis
- Physical Therapy Department, Instituto Federal do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ, Brazil; School of Physical and Occupational Therapy, Faculty of Medicine, McGill University, Montreal, Canada; Pain in Motion Research Group, Department of Physiotherapy, Human Physiology and Anatomy, Faculty of Physical Education & Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium.
| | | | - Gabriela de Assis Neves
- Physical Therapy Department, Instituto Federal do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ, Brazil
| | - Leandro Calazans Nogueira
- Physical Therapy Department, Instituto Federal do Rio de Janeiro (IFRJ), Rio de Janeiro, RJ, Brazil; Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, RJ, Brazil
| | - Ney Meziat-Filho
- Postgraduate Program in Rehabilitation Sciences, Centro Universitário Augusto Motta (UNISUAM), Rio de Janeiro, RJ, Brazil; School of Rehabilitation Sciences, Faculty of Health Sciences, Institute of Applied Health Sciences, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
40
|
Voinea ȘV, Mămuleanu M, Teică RV, Florescu LM, Selișteanu D, Gheonea IA. GPT-Driven Radiology Report Generation with Fine-Tuned Llama 3. Bioengineering (Basel) 2024; 11:1043. [PMID: 39451418 PMCID: PMC11504957 DOI: 10.3390/bioengineering11101043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2024] [Revised: 10/05/2024] [Accepted: 10/16/2024] [Indexed: 10/26/2024] Open
Abstract
The integration of deep learning into radiology has the potential to enhance diagnostic processes, yet its acceptance in clinical practice remains limited due to various challenges. This study aimed to develop and evaluate a fine-tuned large language model (LLM), based on Llama 3-8B, to automate the generation of accurate and concise conclusions in magnetic resonance imaging (MRI) and computed tomography (CT) radiology reports, thereby assisting radiologists and improving reporting efficiency. A dataset comprising 15,000 radiology reports was collected from the University of Medicine and Pharmacy of Craiova's Imaging Center, covering a diverse range of MRI and CT examinations made by four experienced radiologists. The Llama 3-8B model was fine-tuned using transfer-learning techniques, incorporating parameter quantization to 4-bit precision and low-rank adaptation (LoRA) with a rank of 16 to optimize computational efficiency on consumer-grade GPUs. The model was trained over five epochs using an NVIDIA RTX 3090 GPU, with intermediary checkpoints saved for monitoring. Performance was evaluated quantitatively using Bidirectional Encoder Representations from Transformers Score (BERTScore), Recall-Oriented Understudy for Gisting Evaluation (ROUGE), Bilingual Evaluation Understudy (BLEU), and Metric for Evaluation of Translation with Explicit Ordering (METEOR) metrics on a held-out test set. Additionally, a qualitative assessment was conducted, involving 13 independent radiologists who participated in a Turing-like test and provided ratings for the AI-generated conclusions. The fine-tuned model demonstrated strong quantitative performance, achieving a BERTScore F1 of 0.8054, a ROUGE-1 F1 of 0.4998, a ROUGE-L F1 of 0.4628, and a METEOR score of 0.4282. In the human evaluation, the artificial intelligence (AI)-generated conclusions were preferred over human-written ones in approximately 21.8% of cases, indicating that the model's outputs were competitive with those of experienced radiologists. The average rating of the AI-generated conclusions was 3.65 out of 5, reflecting a generally favorable assessment. Notably, the model maintained its consistency across various types of reports and demonstrated the ability to generalize to unseen data. The fine-tuned Llama 3-8B model effectively generates accurate and coherent conclusions for MRI and CT radiology reports. By automating the conclusion-writing process, this approach can assist radiologists in reducing their workload and enhancing report consistency, potentially addressing some barriers to the adoption of deep learning in clinical practice. The positive evaluations from independent radiologists underscore the model's potential utility. While the model demonstrated strong performance, limitations such as dataset bias, limited sample diversity, a lack of clinical judgment, and the need for large computational resources require further refinement and real-world validation. Future work should explore the integration of such models into clinical workflows, address ethical and legal considerations, and extend this approach to generate complete radiology reports.
Collapse
Affiliation(s)
- Ștefan-Vlad Voinea
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania; (Ș.-V.V.); (M.M.)
| | - Mădălin Mămuleanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania; (Ș.-V.V.); (M.M.)
| | - Rossy Vlăduț Teică
- Doctoral School, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania;
| | - Lucian Mihai Florescu
- Department of Radiology and Medical Imaging, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (L.M.F.); (I.A.G.)
| | - Dan Selișteanu
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania; (Ș.-V.V.); (M.M.)
| | - Ioana Andreea Gheonea
- Department of Radiology and Medical Imaging, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (L.M.F.); (I.A.G.)
| |
Collapse
|
41
|
Gonzalez-Garcia A, Pérez-González S, Benavides C, Pinto-Carral A, Quiroga-Sánchez E, Marqués-Sánchez P. Impact of Artificial Intelligence-Based Technology on Nurse Management: A Systematic Review. J Nurs Manag 2024; 2024:3537964. [PMID: 40224848 PMCID: PMC11919197 DOI: 10.1155/2024/3537964] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 09/11/2024] [Accepted: 09/19/2024] [Indexed: 04/15/2025]
Abstract
Aim: To describe the use of artificial intelligence (AI) by nurse managers to enhance management, leadership, and healthcare outcomes. Background: AI represents a significant transformation in healthcare management by enhancing decision-making, communication, and resource optimization. However, the integration and strategic application of AI in nursing management are underexplored, particularly regarding its impact on leadership roles and healthcare delivery. Methods: Methodological guidelines described by PRISMA were followed, and quality was assessed using the Joanna Briggs Institute (JBI) methodology. The databases searched included the Web of Science, Scopus, CINAHLi, and PubMed. The review included quantitative, qualitative, and mixed-method studies published between January 2015 and April 2024. Results: Fourteen studies were selected for the review. The key findings indicate that AI technologies facilitate better resource management, risk assessment, and decision-making. AI also supports nurse managers in leading changes, enhancing communication, and optimizing administrative tasks. Conclusion: AI has been progressively integrated into nursing management, demonstrating significant benefits in operational efficiency, decision support, and leadership enhancement. However, challenges, such as resistance to technological change and ethical complexities, need to be addressed. Implications for Nursing Management: Specific training programs for nurse managers are essential to optimize the integration of AI. Such programs should focus on the management of AI applications and data analyses. In addition, creating interdisciplinary groups involving nurse managers, AI developers, and nursing staff is crucial for tailoring AI solutions to meet the unique needs of healthcare settings.
Collapse
Affiliation(s)
- Alberto Gonzalez-Garcia
- Faculty of Health Sciences, Nursing and Physiotherapy Department, University of Leon, León 24007, Spain
| | - Silvia Pérez-González
- Faculty of Health Sciences, Nursing and Physiotherapy Department, University of Leon, León 24007, Spain
| | - Carmen Benavides
- Department of Electric, Systems and Automatic Engineering, SALBIS Research Group, University of Leon, León 24007, Spain
| | - Arrate Pinto-Carral
- Faculty of Health Sciences, Nursing and Physiotherapy Department, SALBIS Research Group, Campus of Ponferrada, University of Leon, León 24402, Spain
| | - Enedina Quiroga-Sánchez
- Faculty of Health Sciences, Nursing and Physiotherapy Department, SALBIS Research Group, Campus of Ponferrada, University of Leon, León 24402, Spain
| | - Pilar Marqués-Sánchez
- Faculty of Health Sciences, Nursing and Physiotherapy Department, SALBIS Research Group, Campus of Ponferrada, University of Leon, León 24402, Spain
| |
Collapse
|
42
|
Wenderott K, Krups J, Zaruchas F, Weigl M. Effects of artificial intelligence implementation on efficiency in medical imaging-a systematic literature review and meta-analysis. NPJ Digit Med 2024; 7:265. [PMID: 39349815 PMCID: PMC11442995 DOI: 10.1038/s41746-024-01248-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2024] [Accepted: 08/31/2024] [Indexed: 10/04/2024] Open
Abstract
In healthcare, integration of artificial intelligence (AI) holds strong promise for facilitating clinicians' work, especially in clinical imaging. We aimed to assess the impact of AI implementation for medical imaging on efficiency in real-world clinical workflows and conducted a systematic review searching six medical databases. Two reviewers double-screened all records. Eligible records were evaluated for methodological quality. The outcomes of interest were workflow adaptation due to AI implementation, changes in time for tasks, and clinician workload. After screening 13,756 records, we identified 48 original studies to be incuded in the review. Thirty-three studies measured time for tasks, with 67% reporting reductions. Yet, three separate meta-analyses of 12 studies did not show significant effects after AI implementation. We identified five different workflows adapting to AI use. Most commonly, AI served as a secondary reader for detection tasks. Alternatively, AI was used as the primary reader for identifying positive cases, resulting in reorganizing worklists or issuing alerts. Only three studies scrutinized workload calculations based on the time saved through AI use. This systematic review and meta-analysis represents an assessment of the efficiency improvements offered by AI applications in real-world clinical imaging, predominantly revealing enhancements across the studies. However, considerable heterogeneity in available studies renders robust inferences regarding overall effectiveness in imaging tasks. Further work is needed on standardized reporting, evaluation of system integration, and real-world data collection to better understand the technological advances of AI in real-world healthcare workflows. Systematic review registration: Prospero ID CRD42022303439, International Registered Report Identifier (IRRID): RR2-10.2196/40485.
Collapse
Affiliation(s)
| | - Jim Krups
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| | - Fiona Zaruchas
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| | - Matthias Weigl
- Institute for Patient Safety, University Hospital Bonn, Bonn, Germany
| |
Collapse
|
43
|
Liu D, Chu J. Analysis of effectiveness in an artificial intelligent film reading system combined with liquid based cytology examination for cervical cancer screening. Am J Transl Res 2024; 16:4979-4987. [PMID: 39398548 PMCID: PMC11470330 DOI: 10.62347/evxv1402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 07/28/2024] [Indexed: 10/15/2024]
Abstract
OBJECTIVE To explore the effectiveness of combining an artificial intelligence (AI) film reading system with a cervical liquid-based ThinPrep cytology test (TCT) in cervical cancer screening. METHODS A total of 1200 adult women who underwent cervical cancer screening in the Gynecology Department of The Fifth People's Hospital of Jinan from July 2022 to June 2023 were included in the study. All participants underwent TCT followed by both manual and AI examination. The AI examination was performed using an AI film reading system that employed advanced machine learning algorithms and image processing techniques to analyze digital TCT slides. Pathological tissue biopsy was performed on all cases with abnormalities, and the results were used as the gold standard to analyze the effectiveness of the different screening methods. RESULTS TCT screening results revealed that the average time for manual film reading was shorter than that for the AI film reading system (P<0.001). The AI film reading system significantly detected more lesions than the manual film reading method (P<0.001). The overall compliance rate between AI imaging and manual imaging interpretation was 79.75%, with a corresponding Kappa value of 0.588, indicating moderate agreement between the two methods. The accuracy of the AI screening system for low-grade lesions and inflammation was 87.47%, compared to 79.41% for manual screening (P=0.018). For high-grade cancer lesions, the accuracy rates were 82.54% for AI and 75.90% for manual screening (P=0.241). The AI screening system had a sensitivity of 67.53% (104/154) for detecting high-grade lesions and cancers, higher than the 40.91% (63/154) sensitivity of manual screening. However, the specificity of the AI screening system was 94.07% (349/371), while manual screening had a specificity of 94.61% (351/371). The Youden index for AI screening system was 0.616, significantly higher than the 0.355 for manual screening. CONCLUSION In TCT screening, the AI screening system outperforms manual screening. The combination of the AI film reading system and TCT may hold significant value in cervical cancer screening, as well as in the early diagnosis and treatment of the disease.
Collapse
Affiliation(s)
- Dawei Liu
- State-Owned Assets Management Office, The Fifth People’s Hospital of JinanJinan 250000, Shandong, China
| | - Jingxue Chu
- Medical Experimental Diagnosis Center, Central Hospital Affiliated to Shandong First Medical UniversityJinan 250000, Shandong, China
| |
Collapse
|
44
|
Kosvyra A, Filos DT, Fotopoulos DT, Tsave O, Chouvarda I. Toward Ensuring Data Quality in Multi-Site Cancer Imaging Repositories. INFORMATION 2024; 15:533. [DOI: 10.3390/info15090533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2025] Open
Abstract
Cancer remains a major global health challenge, affecting diverse populations across various demographics. Integrating Artificial Intelligence (AI) into clinical settings to enhance disease outcome prediction presents notable challenges. This study addresses the limitations of AI-driven cancer care due to low-quality datasets by proposing a comprehensive three-step methodology to ensure high data quality in large-scale cancer-imaging repositories. Our methodology encompasses (i) developing a Data Quality Conceptual Model with specific metrics for assessment, (ii) creating a detailed data-collection protocol and a rule set to ensure data homogeneity and proper integration of multi-source data, and (iii) implementing a Data Integration Quality Check Tool (DIQCT) to verify adherence to quality requirements and suggest corrective actions. These steps are designed to mitigate biases, enhance data integrity, and ensure that integrated data meets high-quality standards. We applied this methodology within the INCISIVE project, an EU-funded initiative aimed at a pan-European cancer-imaging repository. The use-case demonstrated the effectiveness of our approach in defining quality rules and assessing compliance, resulting in improved data integration and higher data quality. The proposed methodology can assist the deployment of big data centralized or distributed repositories with data from diverse data sources, thus facilitating the development of AI tools.
Collapse
Affiliation(s)
- Alexandra Kosvyra
- Laboratory of Computing, Medical Informatics and Biomedical Imaging Technologies, School of Medicine, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
| | - Dimitrios T. Filos
- Laboratory of Computing, Medical Informatics and Biomedical Imaging Technologies, School of Medicine, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
| | - Dimitris Th. Fotopoulos
- Laboratory of Computing, Medical Informatics and Biomedical Imaging Technologies, School of Medicine, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
| | - Olga Tsave
- Laboratory of Computing, Medical Informatics and Biomedical Imaging Technologies, School of Medicine, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
| | - Ioanna Chouvarda
- Laboratory of Computing, Medical Informatics and Biomedical Imaging Technologies, School of Medicine, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece
| |
Collapse
|
45
|
Spoladore D, Stella F, Tosi M, Lorenzini EC, Bettini C. A knowledge-based decision support system to support family doctors in personalizing type-2 diabetes mellitus medical nutrition therapy. Comput Biol Med 2024; 180:109001. [PMID: 39126791 DOI: 10.1016/j.compbiomed.2024.109001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 07/12/2024] [Accepted: 08/05/2024] [Indexed: 08/12/2024]
Abstract
BACKGROUND Type-2 Diabetes Mellitus (T2D) is a growing concern worldwide, and family doctors are called to help diabetic patients manage this chronic disease, also with Medical Nutrition Therapy (MNT). However, MNT for Diabetes is usually standardized, while it would be much more effective if tailored to the patient. There is a gap in patient-tailored MNT which, if addressed, could support family doctors in delivering effective recommendations. In this context, decision support systems (DSSs) are valuable tools for physicians to support MNT for T2D patients - as long as DSSs are transparent to humans in their decision-making process. Indeed, the lack of transparency in data-driven DSS might hinder their adoption in clinical practice, thus leaving family physicians to adopt general nutrition guidelines provided by the national healthcare systems. METHOD This work presents a prototypical ontology-based clinical Decision Support System (OnT2D- DSS) aimed at assisting general practice doctors in managing T2D patients, specifically in creating a tailored dietary plan, leveraging clinical expert knowledge. OnT2D-DSS exploits clinical expert knowledge formalized as a domain ontology to identify a patient's phenotype and potential comorbidities, providing personalized MNT recommendations for macro- and micro-nutrient intake. The system can be accessed via a prototypical interface. RESULTS Two preliminary experiments are conducted to assess both the quality and correctness of the inferences provided by the system and the usability and acceptance of the OnT2D-DSS (conducted with nutrition experts and family doctors, respectively). CONCLUSIONS Overall, the system is deemed accurate by the nutrition experts and valuable by the family doctors, with minor suggestions for future improvements collected during the experiments.
Collapse
Affiliation(s)
- Daniele Spoladore
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing (STIIMA), National Research Council (Cnr), Lecco, Italy.
| | - Francesco Stella
- Institute of Intelligent Industrial Technologies and Systems for Advanced Manufacturing (STIIMA), National Research Council (Cnr), Lecco, Italy; Department of Computer Science, University of Milan, Milan, Italy.
| | - Martina Tosi
- Department of Health Sciences, University of Milan, Milan, Italy.
| | | | - Claudio Bettini
- Department of Computer Science, University of Milan, Milan, Italy.
| |
Collapse
|
46
|
Nair PP, Keskar M, Borghare PT, Methwani DA, Nasre Y, Chaudhary M. Artificial Intelligence in Dry Eye Disease: A Narrative Review. Cureus 2024; 16:e70056. [PMID: 39449873 PMCID: PMC11499626 DOI: 10.7759/cureus.70056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2024] [Accepted: 09/23/2024] [Indexed: 10/26/2024] Open
Abstract
Dry eye disease (DED) is a multifactorial condition affecting millions worldwide, characterized by discomfort, visual disturbance, and potential damage to the ocular surface. The complexity of its diagnosis and management, driven by the diversity of symptoms and underlying causes, presents significant challenges to clinicians. Artificial intelligence (AI) has emerged as a transformative tool in healthcare, offering potential solutions to these challenges through its data analysis, pattern recognition, and predictive modeling capabilities. This narrative review explores the role of AI in diagnosing, treating, and managing dry eye disease. AI-driven tools such as machine learning algorithms, imaging technologies, and diagnostic platforms are examined for their ability to enhance diagnostic accuracy, personalize treatment approaches, and optimize patient outcomes. Furthermore, the review addresses the limitations of AI technologies in ophthalmology, including the need for robust clinical validation, data privacy concerns, and the ethical considerations of integrating AI into clinical practice. The findings suggest that while AI holds promise for improving the care of patients with DED, ongoing research and development are crucial to realizing its full potential.
Collapse
Affiliation(s)
- Praveena P Nair
- Ophthalmology, Mandsaur Institute of Ayurved Education and Research, Bhunyakhedi, IND
- Ophthalmology, Parul institute of Ayurved, Parul University, Limda, IND
| | - Manjiri Keskar
- Ophthalmology, Parul institute of Ayurved, Parul University, Limda, IND
| | - Pramod T Borghare
- Otolaryngology, Mahatma Gandhi Ayurved College Hospital and Research, Wardha, IND
| | - Disha A Methwani
- Otolaryngology, NKP Salve Institute Of Medical Sciences & Research Centre And Lata Mangeshkar Hospital, Nagpur, IND
| | | | - Minakshi Chaudhary
- Nursing, Shalinitai Meghe College of Nursing, Datta Meghe Institute of Higher Education and Research, Wardha, IND
| |
Collapse
|
47
|
Wang Y, Han X, Li C, Luo L, Yin Q, Zhang J, Peng G, Shi D, He M. Impact of Gold-Standard Label Errors on Evaluating Performance of Deep Learning Models in Diabetic Retinopathy Screening: Nationwide Real-World Validation Study. J Med Internet Res 2024; 26:e52506. [PMID: 39141915 PMCID: PMC11358665 DOI: 10.2196/52506] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 12/30/2023] [Accepted: 03/22/2024] [Indexed: 08/16/2024] Open
Abstract
BACKGROUND For medical artificial intelligence (AI) training and validation, human expert labels are considered the gold standard that represents the correct answers or desired outputs for a given data set. These labels serve as a reference or benchmark against which the model's predictions are compared. OBJECTIVE This study aimed to assess the accuracy of a custom deep learning (DL) algorithm on classifying diabetic retinopathy (DR) and further demonstrate how label errors may contribute to this assessment in a nationwide DR-screening program. METHODS Fundus photographs from the Lifeline Express, a nationwide DR-screening program, were analyzed to identify the presence of referable DR using both (1) manual grading by National Health Service England-certificated graders and (2) a DL-based DR-screening algorithm with validated good lab performance. To assess the accuracy of labels, a random sample of images with disagreement between the DL algorithm and the labels was adjudicated by ophthalmologists who were masked to the previous grading results. The error rates of labels in this sample were then used to correct the number of negative and positive cases in the entire data set, serving as postcorrection labels. The DL algorithm's performance was evaluated against both pre- and postcorrection labels. RESULTS The analysis included 736,083 images from 237,824 participants. The DL algorithm exhibited a gap between the real-world performance and the lab-reported performance in this nationwide data set, with a sensitivity increase of 12.5% (from 79.6% to 92.5%, P<.001) and a specificity increase of 6.9% (from 91.6% to 98.5%, P<.001). In the random sample, 63.6% (560/880) of negative images and 5.2% (140/2710) of positive images were misclassified in the precorrection human labels. High myopia was the primary reason for misclassifying non-DR images as referable DR images, while laser spots were predominantly responsible for misclassified referable cases. The estimated label error rate for the entire data set was 1.2%. The label correction was estimated to bring about a 12.5% enhancement in the estimated sensitivity of the DL algorithm (P<.001). CONCLUSIONS Label errors based on human image grading, although in a small percentage, can significantly affect the performance evaluation of DL algorithms in real-world DR screening.
Collapse
Affiliation(s)
- Yueye Wang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
| | - Xiaotong Han
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Cong Li
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Lixia Luo
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Qiuxia Yin
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Jian Zhang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangdong Provincial Key Laboratory of Ophthalmology and Visual Science, Guangdong Provincial Clinical Research Center for Ocular Diseases, Guangzhou, China
| | - Guankai Peng
- Guangzhou Vision Tech Medical Technology Co, Ltd, Guangzhou, China
| | - Danli Shi
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Research Centre for SHARP Vision, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
| | - Mingguang He
- School of Optometry, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Research Centre for SHARP Vision, The Hong Kong Polytechnic University, Kowloon, China (Hong Kong)
- Centre for Eye and Vision Research, Hong Kong, China (Hong Kong)
| |
Collapse
|
48
|
Kamel Rahimi A, Pienaar O, Ghadimi M, Canfell OJ, Pole JD, Shrapnel S, van der Vegt AH, Sullivan C. Implementing AI in Hospitals to Achieve a Learning Health System: Systematic Review of Current Enablers and Barriers. J Med Internet Res 2024; 26:e49655. [PMID: 39094106 PMCID: PMC11329852 DOI: 10.2196/49655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2023] [Revised: 02/08/2024] [Accepted: 05/22/2024] [Indexed: 08/04/2024] Open
Abstract
BACKGROUND Efforts are underway to capitalize on the computational power of the data collected in electronic medical records (EMRs) to achieve a learning health system (LHS). Artificial intelligence (AI) in health care has promised to improve clinical outcomes, and many researchers are developing AI algorithms on retrospective data sets. Integrating these algorithms with real-time EMR data is rare. There is a poor understanding of the current enablers and barriers to empower this shift from data set-based use to real-time implementation of AI in health systems. Exploring these factors holds promise for uncovering actionable insights toward the successful integration of AI into clinical workflows. OBJECTIVE The first objective was to conduct a systematic literature review to identify the evidence of enablers and barriers regarding the real-world implementation of AI in hospital settings. The second objective was to map the identified enablers and barriers to a 3-horizon framework to enable the successful digital health transformation of hospitals to achieve an LHS. METHODS The PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines were adhered to. PubMed, Scopus, Web of Science, and IEEE Xplore were searched for studies published between January 2010 and January 2022. Articles with case studies and guidelines on the implementation of AI analytics in hospital settings using EMR data were included. We excluded studies conducted in primary and community care settings. Quality assessment of the identified papers was conducted using the Mixed Methods Appraisal Tool and ADAPTE frameworks. We coded evidence from the included studies that related to enablers of and barriers to AI implementation. The findings were mapped to the 3-horizon framework to provide a road map for hospitals to integrate AI analytics. RESULTS Of the 1247 studies screened, 26 (2.09%) met the inclusion criteria. In total, 65% (17/26) of the studies implemented AI analytics for enhancing the care of hospitalized patients, whereas the remaining 35% (9/26) provided implementation guidelines. Of the final 26 papers, the quality of 21 (81%) was assessed as poor. A total of 28 enablers was identified; 8 (29%) were new in this study. A total of 18 barriers was identified; 5 (28%) were newly found. Most of these newly identified factors were related to information and technology. Actionable recommendations for the implementation of AI toward achieving an LHS were provided by mapping the findings to a 3-horizon framework. CONCLUSIONS Significant issues exist in implementing AI in health care. Shifting from validating data sets to working with live data is challenging. This review incorporated the identified enablers and barriers into a 3-horizon framework, offering actionable recommendations for implementing AI analytics to achieve an LHS. The findings of this study can assist hospitals in steering their strategic planning toward successful adoption of AI.
Collapse
Affiliation(s)
- Amir Kamel Rahimi
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Digital Health Cooperative Research Centre, Australian Government, Sydney, Australia
| | - Oliver Pienaar
- The School of Mathematics and Physics, The University of Queensland, Brisbane, Australia
| | - Moji Ghadimi
- The School of Mathematics and Physics, The University of Queensland, Brisbane, Australia
| | - Oliver J Canfell
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Digital Health Cooperative Research Centre, Australian Government, Sydney, Australia
- Business School, The University of Queensland, Brisbane, Australia
- Department of Nutritional Sciences, Faculty of Life Sciences and Medicine, King's College London, London, United Kingdom
| | - Jason D Pole
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Dalla Lana School of Public Health, The University of Toronto, Toronto, ON, Canada
- ICES, Toronto, ON, Canada
| | - Sally Shrapnel
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- The School of Mathematics and Physics, The University of Queensland, Brisbane, Australia
| | - Anton H van der Vegt
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
| | - Clair Sullivan
- Queensland Digital Health Centre, Faculty of Medicine, The University of Queensland, Brisbane, Australia
- Metro North Hospital and Health Service, Department of Health, Queensland Government, Brisbane, Australia
| |
Collapse
|
49
|
Petrella RJ. The AI Future of Emergency Medicine. Ann Emerg Med 2024; 84:139-153. [PMID: 38795081 DOI: 10.1016/j.annemergmed.2024.01.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 01/23/2024] [Accepted: 01/24/2024] [Indexed: 05/27/2024]
Abstract
In the coming years, artificial intelligence (AI) and machine learning will likely give rise to profound changes in the field of emergency medicine, and medicine more broadly. This article discusses these anticipated changes in terms of 3 overlapping yet distinct stages of AI development. It reviews some fundamental concepts in AI and explores their relation to clinical practice, with a focus on emergency medicine. In addition, it describes some of the applications of AI in disease diagnosis, prognosis, and treatment, as well as some of the practical issues that they raise, the barriers to their implementation, and some of the legal and regulatory challenges they create.
Collapse
Affiliation(s)
- Robert J Petrella
- Emergency Departments, CharterCARE Health Partners, Providence and North Providence, RI; Emergency Department, Boston VA Medical Center, Boston, MA; Emergency Departments, Steward Health Care System, Boston and Methuen, MA; Harvard Medical School, Boston, MA; Department of Chemistry and Chemical Biology, Harvard University, Cambridge, MA; Department of Medicine, Brigham and Women's Hospital, Boston, MA.
| |
Collapse
|
50
|
Maita KC, Avila FR, Torres-Guzman RA, Garcia JP, De Sario Velasquez GD, Borna S, Brown SA, Haider CR, Ho OS, Forte AJ. The usefulness of artificial intelligence in breast reconstruction: a systematic review. Breast Cancer 2024; 31:562-571. [PMID: 38619786 DOI: 10.1007/s12282-024-01582-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 03/30/2024] [Indexed: 04/16/2024]
Abstract
BACKGROUND Artificial Intelligence (AI) offers an approach to predictive modeling. The model learns to determine specific patterns of undesirable outcomes in a dataset. Therefore, a decision-making algorithm can be built based on these patterns to prevent negative results. This systematic review aimed to evaluate the usefulness of AI in breast reconstruction. METHODS A systematic review was conducted in August 2022 following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. MEDLINE, EMBASE, SCOPUS, and Google Scholar online databases were queried to capture all publications studying the use of artificial intelligence in breast reconstruction. RESULTS A total of 23 studies were full text-screened after removing duplicates, and twelve articles fulfilled our inclusion criteria. The Machine Learning algorithms applied for neuropathic pain, lymphedema diagnosis, microvascular abdominal flap failure, donor site complications associated to muscle sparing Transverse Rectus Abdominis flap, surgical complications, financial toxicity, and patient-reported outcomes after breast surgery demonstrated that AI is a helpful tool to accurately predict patient results. In addition, one study used Computer Vision technology to assist in Deep Inferior Epigastric Perforator Artery detection for flap design, considerably reducing the preoperative time compared to manual identification. CONCLUSIONS In breast reconstruction, AI can help the surgeon by optimizing the perioperative patients' counseling to predict negative outcomes, allowing execution of timely interventions and reducing the postoperative burden, which leads to obtaining the most successful results and improving patient satisfaction.
Collapse
Affiliation(s)
- Karla C Maita
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Francisco R Avila
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | | | - John P Garcia
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | | | - Sahar Borna
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Sally A Brown
- Department of Administration, Mayo Clinic, Jacksonville, FL, USA
| | - Clifton R Haider
- Department of Physiology and Biomedical Engineering, Mayo Clinic, Rochester, MN, USA
| | - Olivia S Ho
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA
| | - Antonio Jorge Forte
- Division of Plastic Surgery, Mayo Clinic, 4500 San Pablo Rd, Jacksonville, FL, 32224, USA.
| |
Collapse
|