1
|
Xu X, Yang Y, Tan X, Zhang Z, Wang B, Yang X, Weng C, Yu R, Zhao Q, Quan S. Hepatic encephalopathy post-TIPS: Current status and prospects in predictive assessment. Comput Struct Biotechnol J 2024; 24:493-506. [PMID: 39076168 PMCID: PMC11284497 DOI: 10.1016/j.csbj.2024.07.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 07/05/2024] [Accepted: 07/05/2024] [Indexed: 07/31/2024] Open
Abstract
Transjugular intrahepatic portosystemic shunt (TIPS) is an essential procedure for the treatment of portal hypertension but can result in hepatic encephalopathy (HE), a serious complication that worsens patient outcomes. Investigating predictors of HE after TIPS is essential to improve prognosis. This review analyzes risk factors and compares predictive models, weighing traditional scores such as Child-Pugh, Model for End-Stage Liver Disease (MELD), and albumin-bilirubin (ALBI) against emerging artificial intelligence (AI) techniques. While traditional scores provide initial insights into HE risk, they have limitations in dealing with clinical complexity. Advances in machine learning (ML), particularly when integrated with imaging and clinical data, offer refined assessments. These innovations suggest the potential for AI to significantly improve the prediction of post-TIPS HE. The study provides clinicians with a comprehensive overview of current prediction methods, while advocating for the integration of AI to increase the accuracy of post-TIPS HE assessments. By harnessing the power of AI, clinicians can better manage the risks associated with TIPS and tailor interventions to individual patient needs. Future research should therefore prioritize the development of advanced AI frameworks that can assimilate diverse data streams to support clinical decision-making. The goal is not only to more accurately predict HE, but also to improve overall patient care and quality of life.
Collapse
Affiliation(s)
- Xiaowei Xu
- Department of Gastroenterology Nursing Unit, Ward 192, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou 325000, China
| | - Yun Yang
- School of Nursing, Wenzhou Medical University, Wenzhou 325001, China
| | - Xinru Tan
- The First School of Medicine, School of Information and Engineering, Wenzhou Medical University, Wenzhou 325001, China
| | - Ziyang Zhang
- School of Clinical Medicine, Guizhou Medical University, Guiyang 550025, China
| | - Boxiang Wang
- The First School of Medicine, School of Information and Engineering, Wenzhou Medical University, Wenzhou 325001, China
| | - Xiaojie Yang
- Wenzhou Medical University Renji College, Wenzhou 325000, China
| | - Chujun Weng
- The Fourth Affiliated Hospital Zhejiang University School of Medicine, Yiwu 322000, China
| | - Rongwen Yu
- Wenzhou Institute, University of Chinese Academy of Sciences, Wenzhou 325000, China
| | - Qi Zhao
- School of Computer Science and Software Engineering, University of Science and Technology Liaoning, Anshan 114051, China
| | - Shichao Quan
- Department of Big Data in Health Science, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou 325000, China
| |
Collapse
|
2
|
Hall JMM, Nguyen TV, Dinsmore AW, Perugini D, Perugini M, Fukunaga N, Asada Y, Schiewe M, Lim AYX, Lee C, Patel N, Bhadarka H, Chiang J, Bose DP, Mankee-Sookram S, Minto-Bain C, Bilen E, Diakiw SM. Use of federated learning to develop an artificial intelligence model predicting usable blastocyst formation from pre-ICSI oocyte images. Reprod Biomed Online 2024; 49:104403. [PMID: 39433005 DOI: 10.1016/j.rbmo.2024.104403] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 07/16/2024] [Accepted: 08/05/2024] [Indexed: 10/23/2024]
Abstract
RESEARCH QUESTION Can federated learning be used to develop an artificial intelligence (AI) model for evaluating oocyte competence using two-dimensional images of denuded oocytes in metaphase II prior to intracytoplasmic sperm injection (ICSI)? RESULTS The oocyte AI model demonstrated area under the curve (AUC) up to 0.65 on two blind test datasets. High sensitivity for predicting competent oocytes (83-88%) was offset by lower specificity (26-36%). Exclusion of confounding biological variables (male factor infertility and maternal age ≥35 years) improved AUC up to 14%, primarily due to increased specificity. AI score correlated with size of the zona pellucida and perivitelline space, and ooplasm appearance. AI score also correlated with blastocyst expansion grade and morphological quality. The sum of AI scores from oocytes in group culture images predicted the formation of two or more usable blastocysts (AUC 0.77). CONCLUSION An AI model to evaluate oocyte competence was developed using federated learning, representing an essential step in protecting patient data. The AI model was significantly predictive of oocyte competence, as defined by usable blastocyst formation, which is a critical factor for IVF success. Potential clinical utility ranges from selective oocyte fertilization to guiding treatment decisions regarding additional rounds of oocyte retrieval. DESIGN In total, 10,677 oocyte images with associated metadata were collected prospectively by eight IVF clinics across six countries. AI training used federated learning, where data were retained on regional servers to comply with data privacy laws. The final AI model required a single image as input to evaluate oocyte competence, which was defined by the formation of a usable blastocyst (≥expansion grade 3 by day 5 or 6 post ICSI).
Collapse
Affiliation(s)
- J M M Hall
- Life Whisperer Diagnostics (a subsidiary of Presagen), San Francisco, CA, USA, and Adelaide, Australia; Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, Australia; Adelaide Business School, The University of Adelaide, Adelaide, Australia
| | - T V Nguyen
- Life Whisperer Diagnostics (a subsidiary of Presagen), San Francisco, CA, USA, and Adelaide, Australia
| | - A W Dinsmore
- California Fertility Partners, Los Angeles, CA, USA
| | - D Perugini
- Life Whisperer Diagnostics (a subsidiary of Presagen), San Francisco, CA, USA, and Adelaide, Australia
| | - M Perugini
- Life Whisperer Diagnostics (a subsidiary of Presagen), San Francisco, CA, USA, and Adelaide, Australia; Adelaide Medical School, The University of Adelaide, Adelaide, Australia
| | - N Fukunaga
- Asada Institute for Reproductive Medicine, Nagoya, Japan
| | - Y Asada
- Asada Ladies Clinic, Nagoya, Japan
| | - M Schiewe
- California Fertility Partners, Los Angeles, CA, USA
| | - A Y X Lim
- Alpha IVF and Women's Specialists, Petaling Jaya, Selangor, Malaysia
| | - C Lee
- Alpha IVF and Women's Specialists, Petaling Jaya, Selangor, Malaysia
| | - N Patel
- Akanksha Hospital and Research Institute, Anand, Gujarat, India
| | - H Bhadarka
- Akanksha Hospital and Research Institute, Anand, Gujarat, India
| | - J Chiang
- Kensington Green Specialist Centre, Iskandar Puteri, Johor, Malaysia
| | - D P Bose
- Indore Infertility Clinic, Indore, Madhya Pradesh, India
| | - S Mankee-Sookram
- Trinidad and Tobago IVF and Fertility Centre, Maraval, Trinidad, Trinidad and Tobago
| | - C Minto-Bain
- Trinidad and Tobago IVF and Fertility Centre, Maraval, Trinidad, Trinidad and Tobago
| | - E Bilen
- Dokuz Eylül University, Inciraltı, Balçova/İzmir, Turkey
| | - S M Diakiw
- Life Whisperer Diagnostics (a subsidiary of Presagen), San Francisco, CA, USA, and Adelaide, Australia.
| |
Collapse
|
3
|
Obuchi SP, Kojima M, Suzuki H, Garbalosa JC, Imamura K, Ihara K, Hirano H, Sasai H, Fujiwara Y, Kawai H. Artificial intelligence detection of cognitive impairment in older adults during walking. ALZHEIMER'S & DEMENTIA (AMSTERDAM, NETHERLANDS) 2024; 16:e70012. [PMID: 39328904 PMCID: PMC11424983 DOI: 10.1002/dad2.70012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 08/19/2024] [Accepted: 08/25/2024] [Indexed: 09/28/2024]
Abstract
INTRODUCTION To detect early cognitive impairment in community-dwelling older adults, this study explored the viability of artificial intelligence (AI)-assisted linear acceleration and angular velocity analysis during walking. METHODS This cross-sectional study included 879 participants without dementia (female, 60.6%; mean age, 73.5 years) from the 2011 Comprehensive Gerontology Survey. Sensors attached to the pelvis and left ankle recorded the triaxial linear acceleration and angular velocity while the participants walked at a comfortable speed. Cognitive impairment was determined using Mini-Mental State Examination scores. Deep learning models were used to discern the linear acceleration and angular velocity data of 12,302 walking strides. RESULTS The models' average sensitivity, specificity, and area under the curve were 0.961, 0.643, and 0.833, respectively, across 30 testing datasets. DISCUSSION AI-enabled gait analysis can be used to detect signs of cognitive impairment. Integrating this AI model into smartphones may help detect dementia early, facilitating better prevention. Highlights Artificial intelligence (AI)-enabled gait analysis can be used to detect the early signs of cognitive decline.This AI model was constructed using data from a community-dwelling cohort.AI-assisted linear acceleration and angular velocity analysis during gait was used.The model may help in early detection of dementia.
Collapse
Affiliation(s)
- Shuichi P. Obuchi
- Research Team for Human CareTokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Motonaga Kojima
- Department of Physical TherapyUniversity of Tokyo Health SciencesTama‐shiTokyoJapan
| | - Hiroyuki Suzuki
- Research Team for Social Participation and Community HealthTokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Juan C. Garbalosa
- Department of Physical TherapyQuinnipiac UniversityHamdenConnecticutUSA
| | - Keigo Imamura
- Research Team for Human CareTokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Kazushige Ihara
- Graduate School of MedicineHirosaki UniversityHirsaki‐shiAomoriJapan
| | - Hirohiko Hirano
- Research Team for Promoting Independence and Mental HealthTokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Hiroyuki Sasai
- Research Team for Promoting Independence and Mental HealthTokyo Metropolitan Institute of Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Yoshinori Fujiwara
- Tokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| | - Hisashi Kawai
- Research Team for Human CareTokyo Metropolitan Institute for Geriatrics and GerontologyItabashi‐kuTokyoJapan
| |
Collapse
|
4
|
Lee CI, Tzeng CR, Li M, Lai HH, Chen CH, Huang Y, Chang TA, Chen CH, Huang CC, Lee MS, Liu M. Leveraging federated learning for boosting data privacy and performance in IVF embryo selection. J Assist Reprod Genet 2024; 41:1811-1820. [PMID: 38834757 PMCID: PMC11263320 DOI: 10.1007/s10815-024-03148-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Accepted: 05/18/2024] [Indexed: 06/06/2024] Open
Abstract
PURPOSE To study the effectiveness of federated learning in in vitro fertilization on embryo evaluation tasks. METHODS This is a retrospective cohort analysis. Two datasets were used in this study. The ploidy status dataset consisted of 10,065 embryo records, 3760 treatments, and 2479 infertile couples from 5 hospitals. The clinical pregnancy dataset consisted of 4495 embryo records, 4495 treatments, and 3704 infertile couples from 4 hospitals. Federated learning and the gradient boosting decision tree algorithm were utilized for modeling. RESULTS On the ploidy status dataset, the areas under the receiver operating characteristic curves of our model trained with federated learning were 71.78%, 73.10%, 69.39%, 69.72%, and 73.46% for 5 hospitals respectively, showing an average increase of 2.5% compared to those of our model trained without federated learning. On the clinical pregnancy dataset, the areas under the receiver operating characteristic curves of our model trained with federated learning were 72.03%, 56.77%, 61.63%, and 58.58% for 4 hospitals respectively, showing an average increase of 3.08%. CONCLUSIONS Federated learning can improve data privacy and data security and meanwhile improve the performance of embryo selection tasks by leveraging data from multiple sources. This study demonstrates the effectiveness of federated learning in embryo evaluation, and the results show the promise for future application.
Collapse
Affiliation(s)
- Chun-I Lee
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
- Department of Obstetrics and Gynecology, Chung Shan Medical University, Taichung, Taiwan
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | | | - Monty Li
- Becoming Reproductive Center, Taipei, Taiwan
| | - Hsing-Hua Lai
- Stork Fertility Center, Stork Ladies Clinic, Hsinchu, Taiwan
| | - Chi-Huang Chen
- Division of Reproductive Medicine, Department of Obstetrics and Gynecology, Taipei Medical University Hospital, Taipei, Taiwan
- Department of Obstetrics and Gynecology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Yulun Huang
- Binflux, Inc, 4F.-1, No. 9, Dehui St., Zhongshan Dist, Taipei, 10461, Taiwan
| | - T Arthur Chang
- Department of Obstetrics and Gynecology, University of Texas Health Science Center, San Antonio, TX, USA
| | - Chien-Hong Chen
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | - Chun-Chia Huang
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | - Maw-Sheng Lee
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan
- Department of Obstetrics and Gynecology, Chung Shan Medical University, Taichung, Taiwan
- Division of Infertility, Lee Women's Hospital, Taichung, Taiwan
| | - Mark Liu
- Binflux, Inc, 4F.-1, No. 9, Dehui St., Zhongshan Dist, Taipei, 10461, Taiwan.
| |
Collapse
|
5
|
Zhang F, Kreuter D, Chen Y, Dittmer S, Tull S, Shadbahr T, Preller J, Rudd JH, Aston JA, Schönlieb CB, Gleadall N, Roberts M. Recent methodological advances in federated learning for healthcare. PATTERNS (NEW YORK, N.Y.) 2024; 5:101006. [PMID: 39005485 PMCID: PMC11240178 DOI: 10.1016/j.patter.2024.101006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 07/16/2024]
Abstract
For healthcare datasets, it is often impossible to combine data samples from multiple sites due to ethical, privacy, or logistical concerns. Federated learning allows for the utilization of powerful machine learning algorithms without requiring the pooling of data. Healthcare data have many simultaneous challenges, such as highly siloed data, class imbalance, missing data, distribution shifts, and non-standardized variables, that require new methodologies to address. Federated learning adds significant methodological complexity to conventional centralized machine learning, requiring distributed optimization, communication between nodes, aggregation of models, and redistribution of models. In this systematic review, we consider all papers on Scopus published between January 2015 and February 2023 that describe new federated learning methodologies for addressing challenges with healthcare data. We reviewed 89 papers meeting these criteria. Significant systemic issues were identified throughout the literature, compromising many methodologies reviewed. We give detailed recommendations to help improve methodology development for federated learning in healthcare.
Collapse
Affiliation(s)
- Fan Zhang
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Daniel Kreuter
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Yichen Chen
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Sören Dittmer
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- ZeTeM, University of Bremen, Bremen, Germany
| | - Samuel Tull
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Tolou Shadbahr
- Research Program in Systems Oncology, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Jacobus Preller
- Addenbrooke’s Hospital, Cambridge University Hospitals NHS Trust, Cambridge, UK
| | - James H.F. Rudd
- Department of Medicine, University of Cambridge, Cambridge, UK
| | - John A.D. Aston
- Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
| | - Carola-Bibiane Schönlieb
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | | | - Michael Roberts
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- Department of Medicine, University of Cambridge, Cambridge, UK
| |
Collapse
|
6
|
Li M, Xiong X, Xu B, Dickson C. Chinese Oncologists' Perspectives on Integrating AI into Clinical Practice: Cross-Sectional Survey Study. JMIR Form Res 2024; 8:e53918. [PMID: 38838307 PMCID: PMC11187515 DOI: 10.2196/53918] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Revised: 02/21/2024] [Accepted: 04/03/2024] [Indexed: 06/07/2024] Open
Abstract
BACKGROUND The rapid development of artificial intelligence (AI) has brought significant interest to its potential applications in oncology. Although AI-powered tools are already being implemented in some Chinese hospitals, their integration into clinical practice raises several concerns for Chinese oncologists. OBJECTIVE This study aims to explore the concerns of Chinese oncologists regarding the integration of AI into clinical practice and to identify the factors influencing these concerns. METHODS A total of 228 Chinese oncologists participated in a cross-sectional web-based survey from April to June in 2023 in mainland China. The survey gauged their worries about AI with multiple-choice questions. The survey evaluated their views on the statements of "The impact of AI on the doctor-patient relationship" and "AI will replace doctors." The data were analyzed using descriptive statistics, and variate analyses were used to find correlations between the oncologists' backgrounds and their concerns. RESULTS The study revealed that the most prominent concerns were the potential for AI to mislead diagnosis and treatment (163/228, 71.5%); an overreliance on AI (162/228, 71%); data and algorithm bias (123/228, 54%); issues with data security and patient privacy (123/228, 54%); and a lag in the adaptation of laws, regulations, and policies in keeping up with AI's development (115/228, 50.4%). Oncologists with a bachelor's degree expressed heightened concerns related to data and algorithm bias (34/49, 69%; P=.03) and the lagging nature of legal, regulatory, and policy issues (32/49, 65%; P=.046). Regarding AI's impact on doctor-patient relationships, 53.1% (121/228) saw a positive impact, whereas 35.5% (81/228) found it difficult to judge, 9.2% (21/228) feared increased disputes, and 2.2% (5/228) believed that there is no impact. Although sex differences were not significant (P=.08), perceptions varied-male oncologists tended to be more positive than female oncologists (74/135, 54.8% vs 47/93, 50%). Oncologists with a bachelor's degree (26/49, 53%; P=.03) and experienced clinicians (≥21 years; 28/56, 50%; P=.054). found it the hardest to judge. Those with IT experience were significantly more positive (25/35, 71%) than those without (96/193, 49.7%; P=.02). Opinions regarding the possibility of AI replacing doctors were diverse, with 23.2% (53/228) strongly disagreeing, 14% (32/228) disagreeing, 29.8% (68/228) being neutral, 16.2% (37/228) agreeing, and 16.7% (38/228) strongly agreeing. There were no significant correlations with demographic and professional factors (all P>.05). CONCLUSIONS Addressing oncologists' concerns about AI requires collaborative efforts from policy makers, developers, health care professionals, and legal experts. Emphasizing transparency, human-centered design, bias mitigation, and education about AI's potential and limitations is crucial. Through close collaboration and a multidisciplinary strategy, AI can be effectively integrated into oncology, balancing benefits with ethical considerations and enhancing patient care.
Collapse
Affiliation(s)
- Ming Li
- Department of Health Policy Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, United States
| | - XiaoMin Xiong
- Chongqing Key Laboratory of Intelligent Oncology for Breast Cancer, Chongqing University Cancer Hospital, Chongqing University School of Medicine, Chongqing, China
| | - Bo Xu
- Chongqing Key Laboratory of Intelligent Oncology for Breast Cancer, Chongqing University Cancer Hospital, Chongqing University School of Medicine, Chongqing, China
- Department of Biochemistry and Molecular Biology, Key Laboratory of Breast Cancer Prevention and Therapy, Ministry of Education, National Cancer Research Center, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Conan Dickson
- Department of Health Policy Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, United States
| |
Collapse
|
7
|
Zhou J, Wang X, Li Y, Yang Y, Shi J. Federated-learning-based prognosis assessment model for acute pulmonary thromboembolism. BMC Med Inform Decis Mak 2024; 24:141. [PMID: 38802861 PMCID: PMC11131248 DOI: 10.1186/s12911-024-02543-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Accepted: 05/17/2024] [Indexed: 05/29/2024] Open
Abstract
BACKGROUND Acute pulmonary thromboembolism (PTE) is a common cardiovascular disease and recognizing low prognosis risk patients with PTE accurately is significant for clinical treatment. This study evaluated the value of federated learning (FL) technology in PTE prognosis risk assessment while ensuring the security of clinical data. METHODS A retrospective dataset consisted of PTE patients from 12 hospitals were collected, and 19 physical indicators of patients were included to train the FL-based prognosis assessment model to predict the 30-day death event. Firstly, multiple machine learning methods based on FL were compared to choose the superior model. And then performance of models trained on the independent (IID) and non-independent identical distributed(Non-IID) datasets was calculated and they were tested further on Real-world data. Besides, the optimal model was compared with pulmonary embolism severity index (PESI), simplified PESI (sPESI), Peking Union Medical College Hospital (PUMCH). RESULTS The area under the receiver operating characteristic curve (AUC) of logistic regression(0.842) outperformed convolutional neural network (0.819) and multi layer perceptron (0.784). Under IID, AUC of model trained using FL(Fed) on the training, validation and test sets was 0.852 ± 0.002, 0.867 ± 0.012 and 0.829 ± 0.004. Under Real-world, AUC of Fed was 0.855 ± 0.005, 0.882 ± 0.003 and 0.835 ± 0.005. Under IID and Real-world, AUC of Fed surpassed centralization model(NonFed) (0.847 ± 0.001, 0.841 ± 0.001 and 0.811 ± 0.001). Under Non-IID, although AUC of Fed (0.846 ± 0.047) outperformed NonFed (0.841 ± 0.001) on validation set, it (0.821 ± 0.016 and 0.799 ± 0.031) slightly lagged behind NonFed (0.847 ± 0.001 and 0.811 ± 0.001) on the training and test sets. In practice, AUC of Fed (0.853, 0.884 and 0.842) outshone PESI (0.812, 0.789 and 0.791), sPESI (0.817, 0.770 and 0.786) and PUMCH(0.848, 0.814 and 0.832) on the training, validation and test sets. Additionally, Fed (0.842) exhibited higher AUC values across test sets compared to those trained directly on the clients (0.758, 0.801, 0.783, 0.741, 0.788). CONCLUSIONS In this study, the FL based machine learning model demonstrated commendable efficacy on PTE prognostic risk prediction, rendering it well-suited for deployment in hospitals.
Collapse
Affiliation(s)
- Jun Zhou
- State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China
| | - Xin Wang
- Department of Ultrasound, Peking Union Medical College Hospital, Beijing, China
| | - Yiyao Li
- Department of Pulmonary and Critical Care Medicine, Peking Union Medical College Hospital, Beijing, China
| | - Yuqing Yang
- State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China.
| | - Juhong Shi
- Department of Pulmonary and Critical Care Medicine, Peking Union Medical College Hospital, Beijing, China.
| |
Collapse
|
8
|
Rong Y, Chen Q, Fu Y, Yang X, Al-Hallaq HA, Wu QJ, Yuan L, Xiao Y, Cai B, Latifi K, Benedict SH, Buchsbaum JC, Qi XS. NRG Oncology Assessment of Artificial Intelligence Deep Learning-Based Auto-segmentation for Radiation Therapy: Current Developments, Clinical Considerations, and Future Directions. Int J Radiat Oncol Biol Phys 2024; 119:261-280. [PMID: 37972715 PMCID: PMC11023777 DOI: 10.1016/j.ijrobp.2023.10.033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 09/16/2023] [Accepted: 10/14/2023] [Indexed: 11/19/2023]
Abstract
Deep learning neural networks (DLNN) in Artificial intelligence (AI) have been extensively explored for automatic segmentation in radiotherapy (RT). In contrast to traditional model-based methods, data-driven AI-based models for auto-segmentation have shown high accuracy in early studies in research settings and controlled environment (single institution). Vendor-provided commercial AI models are made available as part of the integrated treatment planning system (TPS) or as a stand-alone tool that provides streamlined workflow interacting with the main TPS. These commercial tools have drawn clinics' attention thanks to their significant benefit in reducing the workload from manual contouring and shortening the duration of treatment planning. However, challenges occur when applying these commercial AI-based segmentation models to diverse clinical scenarios, particularly in uncontrolled environments. Contouring nomenclature and guideline standardization has been the main task undertaken by the NRG Oncology. AI auto-segmentation holds the potential clinical trial participants to reduce interobserver variations, nomenclature non-compliance, and contouring guideline deviations. Meanwhile, trial reviewers could use AI tools to verify contour accuracy and compliance of those submitted datasets. In recognizing the growing clinical utilization and potential of these commercial AI auto-segmentation tools, NRG Oncology has formed a working group to evaluate the clinical utilization and potential of commercial AI auto-segmentation tools. The group will assess in-house and commercially available AI models, evaluation metrics, clinical challenges, and limitations, as well as future developments in addressing these challenges. General recommendations are made in terms of the implementation of these commercial AI models, as well as precautions in recognizing the challenges and limitations.
Collapse
Affiliation(s)
- Yi Rong
- Mayo Clinic Arizona, Phoenix, AZ
| | - Quan Chen
- City of Hope Comprehensive Cancer Center Duarte, CA
| | - Yabo Fu
- Memorial Sloan Kettering Cancer Center, Commack, NY
| | | | | | | | - Lulin Yuan
- Virginia Commonwealth University, Richmond, VA
| | - Ying Xiao
- University of Pennsylvania/Abramson Cancer Center, Philadelphia, PA
| | - Bin Cai
- The University of Texas Southwestern Medical Center, Dallas, TX
| | | | - Stanley H Benedict
- University of California Davis Comprehensive Cancer Center, Sacramento, CA
| | | | - X Sharon Qi
- University of California Los Angeles, Los Angeles, CA
| |
Collapse
|
9
|
Naik K, Goyal RK, Foschini L, Chak CW, Thielscher C, Zhu H, Lu J, Lehár J, Pacanoswki MA, Terranova N, Mehta N, Korsbo N, Fakhouri T, Liu Q, Gobburu J. Current Status and Future Directions: The Application of Artificial Intelligence/Machine Learning for Precision Medicine. Clin Pharmacol Ther 2024; 115:673-686. [PMID: 38103204 DOI: 10.1002/cpt.3152] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 11/28/2023] [Indexed: 12/18/2023]
Abstract
Technological innovations, such as artificial intelligence (AI) and machine learning (ML), have the potential to expedite the goal of precision medicine, especially when combined with increased capacity for voluminous data from multiple sources and expanded therapeutic modalities; however, they also present several challenges. In this communication, we first discuss the goals of precision medicine, and contextualize the use of AI in precision medicine by showcasing innovative applications (e.g., prediction of tumor growth and overall survival, biomarker identification using biomedical images, and identification of patient population for clinical practice) which were presented during the February 2023 virtual public workshop entitled "Application of Artificial Intelligence and Machine Learning for Precision Medicine," hosted by the US Food and Drug Administration (FDA) and University of Maryland Center of Excellence in Regulatory Science and Innovation (M-CERSI). Next, we put forward challenges brought about by the multidisciplinary nature of AI, particularly highlighting the need for AI to be trustworthy. To address such challenges, we subsequently note practical approaches, viz., differential privacy, synthetic data generation, and federated learning. The proposed strategies - some of which are highlighted presentations from the workshop - are for the protection of personal information and intellectual property. In addition, methods such as the risk-based management approach and the need for an agile regulatory ecosystem are discussed. Finally, we lay out a call for action that includes sharing of data and algorithms, development of regulatory guidance documents, and pooling of expertise from a broad-spectrum of stakeholders to enhance the application of AI in precision medicine.
Collapse
Affiliation(s)
- Kunal Naik
- Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Rahul K Goyal
- Center for Translational Medicine, University of Maryland School of Pharmacy, Baltimore, Maryland, USA
| | | | | | | | - Hao Zhu
- Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - James Lu
- Modeling & Simulation/Clinical Pharmacology, Genentech Inc., South San Francisco, California, USA
| | | | - Michael A Pacanoswki
- Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Nadia Terranova
- Quantitative Pharmacology, Ares Trading S.A. (an affiliate of Merck KGaA, Darmstadt, Germany), Lausanne, Switzerland
| | - Neha Mehta
- Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | | | - Tala Fakhouri
- Office of Medical Policy, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Qi Liu
- Office of Clinical Pharmacology, Office of Translational Sciences, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Jogarao Gobburu
- Center for Translational Medicine, University of Maryland School of Pharmacy, Baltimore, Maryland, USA
| |
Collapse
|
10
|
Li A, Mullin S, Elkin PL. Improving Prediction of Survival for Extremely Premature Infants Born at 23 to 29 Weeks Gestational Age in the Neonatal Intensive Care Unit: Development and Evaluation of Machine Learning Models. JMIR Med Inform 2024; 12:e42271. [PMID: 38354033 PMCID: PMC10902770 DOI: 10.2196/42271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 02/02/2023] [Accepted: 12/28/2023] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Infants born at extremely preterm gestational ages are typically admitted to the neonatal intensive care unit (NICU) after initial resuscitation. The subsequent hospital course can be highly variable, and despite counseling aided by available risk calculators, there are significant challenges with shared decision-making regarding life support and transition to end-of-life care. Improving predictive models can help providers and families navigate these unique challenges. OBJECTIVE Machine learning methods have previously demonstrated added predictive value for determining intensive care unit outcomes, and their use allows consideration of a greater number of factors that potentially influence newborn outcomes, such as maternal characteristics. Machine learning-based models were analyzed for their ability to predict the survival of extremely preterm neonates at initial admission. METHODS Maternal and newborn information was extracted from the health records of infants born between 23 and 29 weeks of gestation in the Medical Information Mart for Intensive Care III (MIMIC-III) critical care database. Applicable machine learning models predicting survival during the initial NICU admission were developed and compared. The same type of model was also examined using only features that would be available prepartum for the purpose of survival prediction prior to an anticipated preterm birth. Features most correlated with the predicted outcome were determined when possible for each model. RESULTS Of included patients, 37 of 459 (8.1%) expired. The resulting random forest model showed higher predictive performance than the frequently used Score for Neonatal Acute Physiology With Perinatal Extension II (SNAPPE-II) NICU model when considering extremely preterm infants of very low birth weight. Several other machine learning models were found to have good performance but did not show a statistically significant difference from previously available models in this study. Feature importance varied by model, and those of greater importance included gestational age; birth weight; initial oxygenation level; elements of the APGAR (appearance, pulse, grimace, activity, and respiration) score; and amount of blood pressure support. Important prepartum features also included maternal age, steroid administration, and the presence of pregnancy complications. CONCLUSIONS Machine learning methods have the potential to provide robust prediction of survival in the context of extremely preterm births and allow for consideration of additional factors such as maternal clinical and socioeconomic information. Evaluation of larger, more diverse data sets may provide additional clarity on comparative performance.
Collapse
Affiliation(s)
- Angie Li
- Department of Biomedical Informatics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, United States
| | - Sarah Mullin
- Department of Biomedical Informatics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, United States
| | - Peter L Elkin
- Department of Biomedical Informatics, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY, United States
| |
Collapse
|
11
|
Huang CT, Wang TJ, Kuo LK, Tsai MJ, Cia CT, Chiang DH, Chang PJ, Chong IW, Tsai YS, Chu YC, Liu CJ, Chen CH, Pai KC, Wu CL. Federated machine learning for predicting acute kidney injury in critically ill patients: a multicenter study in Taiwan. Health Inf Sci Syst 2023; 11:48. [PMID: 37822805 PMCID: PMC10562351 DOI: 10.1007/s13755-023-00248-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 09/20/2023] [Indexed: 10/13/2023] Open
Abstract
Purpose To address the contentious data sharing across hospitals, this study adopted a novel approach, federated learning (FL), to establish an aggregate model for acute kidney injury (AKI) prediction in critically ill patients in Taiwan. Methods This study used data from the Critical Care Database of Taichung Veterans General Hospital (TCVGH) from 2015 to 2020 and electrical medical records of the intensive care units (ICUs) between 2018 and 2020 of four referral centers in different areas across Taiwan. AKI prediction models were trained and validated thereupon. An FL-based prediction model across hospitals was then established. Results The study included 16,732 ICU admissions from the TCVGH and 38,424 ICU admissions from the other four hospitals. The complete model with 60 features and the parsimonious model with 21 features demonstrated comparable accuracies using extreme gradient boosting, neural network (NN), and random forest, with an area under the receiver-operating characteristic (AUROC) curve of approximately 0.90. The Shapley Additive Explanations plot demonstrated that the selected features were the key clinical components of AKI for critically ill patients. The AUROC curve of the established parsimonious model for external validation at the four hospitals ranged from 0.760 to 0.865. NN-based FL slightly improved the model performance at the four centers. Conclusion A reliable prediction model for AKI in ICU patients was developed with a lead time of 24 h, and it performed better when the novel FL platform across hospitals was implemented. Supplementary Information The online version contains supplementary material available at 10.1007/s13755-023-00248-5.
Collapse
Affiliation(s)
- Chun-Te Huang
- Institute of Emergency and Critical Care Medicine, National Yang-Ming Chiao Tung University, Taipei, Taiwan
- Nephrology and Critical Care Medicine, Department of Internal Medicine and Critical Care Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
| | - Tsai-Jung Wang
- Nephrology and Critical Care Medicine, Department of Internal Medicine and Critical Care Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
| | - Li-Kuo Kuo
- Department of Critical Care Medicine, MacKay Memorial Hospital, Taipei, Taiwan
| | - Ming-Ju Tsai
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, School of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan
| | - Cong-Tat Cia
- Division of Critical Care Medicine, Department of Internal Medicine, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Dung-Hung Chiang
- Department of Critical Care Medicine, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Po-Jen Chang
- Department of Information Technology, MacKay Memorial Hospital, Taipei, Taiwan
| | - Inn-Wen Chong
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, School of Medicine, College of Medicine, Kaohsiung Medical University, Kaohsiung, Taiwan
| | - Yi-Shan Tsai
- Department of Diagnostic Radiology, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Yuan-Chia Chu
- Department of Information Technology, Taipei Veterans General Hospital, Taipei, Taiwan
| | - Chia-Jen Liu
- Institute of Emergency and Critical Care Medicine, National Yang-Ming Chiao Tung University, Taipei, Taiwan
| | - Cheng-Hsu Chen
- Division of Nephrology, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
| | - Kai-Chih Pai
- College of Engineering, Tunghai University, Taichung, Taiwan
| | - Chieh-Liang Wu
- College of Medicine, National Chung Hshin University, Taichung, Taiwan
| |
Collapse
|
12
|
Nguyen TV, Diakiw SM, VerMilyea MD, Dinsmore AW, Perugini M, Perugini D, Hall JMM. Efficient automated error detection in medical data using deep-learning and label-clustering. Sci Rep 2023; 13:19587. [PMID: 37949906 PMCID: PMC10638377 DOI: 10.1038/s41598-023-45946-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2023] [Accepted: 10/26/2023] [Indexed: 11/12/2023] Open
Abstract
Medical datasets inherently contain errors from subjective or inaccurate test results, or from confounding biological complexities. It is difficult for medical experts to detect these elusive errors manually, due to lack of contextual information, limiting data privacy regulations, and the sheer scale of data to be reviewed. Current methods for training robust artificial intelligence (AI) models on data containing mislabeled examples generally fall into one of several categories-attempting to improve the robustness of the model architecture, the regularization techniques used, the loss function used during training, or selecting a subset of data that contains cleaner labels. This last category requires the ability to efficiently detect errors either prior to or during training, either relabeling them or removing them completely. More recent progress in error detection has focused on using multi-network learning to minimize deleterious effects of errors on training, however, using many neural networks to reach a consensus on which data should be removed can be computationally intensive and inefficient. In this work, a deep-learning based algorithm was used in conjunction with a label-clustering approach to automate error detection. For dataset with synthetic label flips added, these errors were identified with an accuracy of up to 85%, while requiring up to 93% less computing resources to complete compared to a previous model consensus approach developed previously. The resulting trained AI models exhibited greater training stability and up to a 45% improvement in accuracy, from 69 to over 99% compared to the consensus approach, at least 10% improvement on using noise-robust loss functions in a binary classification problem, and a 51% improvement for multi-class classification. These results indicate that practical, automated a priori detection of errors in medical data is possible, without human oversight.
Collapse
Affiliation(s)
- T V Nguyen
- Presagen, Adelaide, SA, 5000, Australia.
- School of Computing and Information Technology, University of Wollongong, Wollongong, NSW, 2522, Australia.
| | | | - M D VerMilyea
- Ovation Fertility, Austin, TX, 78731, USA
- Texas Fertility Center, Austin, TX, 78731, USA
| | - A W Dinsmore
- California Fertility Partners, Los Angeles, CA, 90025, USA
| | - M Perugini
- Presagen, Adelaide, SA, 5000, Australia
- Adelaide Medical School, The University of Adelaide, Adelaide, SA, 5000, Australia
| | | | - J M M Hall
- Presagen, Adelaide, SA, 5000, Australia
- Australian Research Council Centre of Excellence for Nanoscale BioPhotonics, Adelaide, SA, 5005, Australia
- School of Physical Sciences, The University of Adelaide, Adelaide, SA, 5005, Australia
| |
Collapse
|
13
|
Gu X, Sabrina F, Fan Z, Sohail S. A Review of Privacy Enhancement Methods for Federated Learning in Healthcare Systems. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:6539. [PMID: 37569079 PMCID: PMC10418741 DOI: 10.3390/ijerph20156539] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/26/2023] [Revised: 07/11/2023] [Accepted: 08/04/2023] [Indexed: 08/13/2023]
Abstract
Federated learning (FL) provides a distributed machine learning system that enables participants to train using local data to create a shared model by eliminating the requirement of data sharing. In healthcare systems, FL allows Medical Internet of Things (MIoT) devices and electronic health records (EHRs) to be trained locally without sending patients data to the central server. This allows healthcare decisions and diagnoses based on datasets from all participants, as well as streamlining other healthcare processes. In terms of user data privacy, this technology allows collaborative training without the need of sharing the local data with the central server. However, there are privacy challenges in FL arising from the fact that the model updates are shared between the client and the server which can be used for re-generating the client's data, breaching privacy requirements of applications in domains like healthcare. In this paper, we have conducted a review of the literature to analyse the existing privacy and security enhancement methods proposed for FL in healthcare systems. It has been identified that the research in the domain focuses on seven techniques: Differential Privacy, Homomorphic Encryption, Blockchain, Hierarchical Approaches, Peer to Peer Sharing, Intelligence on the Edge Device, and Mixed, Hybrid and Miscellaneous Approaches. The strengths, limitations, and trade-offs of each technique were discussed, and the possible future for these seven privacy enhancement techniques for healthcare FL systems was identified.
Collapse
Affiliation(s)
- Xin Gu
- School of Information Technology, King’s Own Institute, Sydney, NSW 2000, Australia;
| | - Fariza Sabrina
- School of Engineering and Technology, Central Queensland University, Sydney, NSW 2000, Australia;
| | - Zongwen Fan
- College of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
| | - Shaleeza Sohail
- College of Engineering, Science and Environment, The University of Newcastle, Callaghan, NSW 2308, Australia;
| |
Collapse
|
14
|
Wang J, Tian Y, Zhou T, Tong D, Ma J, Li J. A survey of artificial intelligence in rheumatoid arthritis. RHEUMATOLOGY AND IMMUNOLOGY RESEARCH 2023; 4:69-77. [PMID: 37485476 PMCID: PMC10362600 DOI: 10.2478/rir-2023-0011] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Accepted: 06/14/2023] [Indexed: 07/25/2023]
Abstract
The article offers a survey of currently notable artificial intelligence methods (released between 2019-2023), with a particular emphasis on the latest advancements in detecting rheumatoid arthritis (RA) at an early stage, providing early treatment, and managing the disease. We discussed challenges in these areas followed by specific artificial intelligence (AI) techniques and summarized advances, relevant strengths, and obstacles. Overall, the application of AI in the fields of RA has the potential to enable healthcare professionals to detect RA at an earlier stage, thereby facilitating timely intervention and better disease management. However, more research is required to confirm the precision and dependability of AI in RA, and several problems such as technological and ethical concerns related to these approaches must be resolved before their widespread adoption.
Collapse
Affiliation(s)
- Jiaqi Wang
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou311121, Zhejiang Province, China
| | - Yu Tian
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou310027, Zhejiang Province, China
| | - Tianshu Zhou
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou311121, Zhejiang Province, China
| | - Danyang Tong
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou311121, Zhejiang Province, China
| | - Jing Ma
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou311121, Zhejiang Province, China
| | - Jingsong Li
- Research Center for Healthcare Data Science, Zhejiang Laboratory, Hangzhou311121, Zhejiang Province, China
- Engineering Research Center of EMR and Intelligent Expert System, Ministry of Education, Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Science, Zhejiang University, Hangzhou310027, Zhejiang Province, China
| |
Collapse
|
15
|
Curchoe CL. Proceedings of the first world conference on AI in fertility. J Assist Reprod Genet 2023; 40:215-222. [PMID: 36598733 PMCID: PMC9935785 DOI: 10.1007/s10815-022-02704-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 12/22/2022] [Indexed: 01/05/2023] Open
|