1
|
Ajuwon BI, Awotundun ON, Richardson A, Roper K, Sheel M, Rahman N, Salako A, Lidbury BA. Machine learning prediction models for clinical management of blood-borne viral infections: a systematic review of current applications and future impact. Int J Med Inform 2023; 179:105244. [PMID: 37820561 DOI: 10.1016/j.ijmedinf.2023.105244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 09/08/2023] [Accepted: 10/03/2023] [Indexed: 10/13/2023]
Abstract
BACKGROUND Machine learning (ML) prediction models to support clinical management of blood-borne viral infections are becoming increasingly abundant in medical literature, with a number of competing models being developed for the same outcome or target population. However, evidence on the quality of these ML prediction models are limited. OBJECTIVE This study aimed to evaluate the development and quality of reporting of ML prediction models that could facilitate timely clinical management of blood-borne viral infections. METHODS We conducted narrative evidence synthesis following the synthesis without meta-analysis guidelines. We searched PubMed and Cochrane Central Register of Controlled Trials for all studies applying ML models for predicting clinical outcomes associated with hepatitis B virus (HBV), human immunodeficiency virus (HIV), or hepatitis C virus (HCV). RESULTS We found 33 unique ML prediction models aiming to support clinical decision making. Overall, 12 (36.4%) focused on HBV, 10 (30.3%) on HCV, 10 on HIV (30.3%) and two (6.1%) on co-infection. Among these, six (18.2%) addressed the diagnosis of infection, 16 (48.5%) the prognosis of infection, eight (24.2%) the prediction of treatment response, two (6.1%) progression through a cascade of care, and one (3.03%) focused on the choice of antiretroviral therapy (ART). Nineteen prediction models (57.6%) were developed using data from high-income countries. Evaluation of prediction models was limited to measures of performance. Detailed information on software code accessibility was often missing. Independent validation on new datasets and/or in other institutions was rarely done. CONCLUSION Promising approaches for ML prediction models in blood-borne viral infections were identified, but the lack of robust validation, interpretability/explainability, and poor quality of reporting hampered their clinical relevance. Our findings highlight important considerations that can inform standard reporting guidelines for ML prediction models in the future (e.g., TRIPOD-AI), and provides critical data to inform robust evaluation of the models.
Collapse
Affiliation(s)
- Busayo I Ajuwon
- National Centre for Epidemiology and Population Health, ANU College of Health and Medicine, The Australian National University, Acton, Australian Capital Territory, Australia; Department of Biosciences and Biotechnology, Faculty of Pure and Applied Sciences, Kwara State University, Malete, Nigeria.
| | - Oluwatosin N Awotundun
- Department of Epidemiology, Biostatistics and Occupational Health, Faculty of Medicine and Health Sciences, McGill University, Montreal, Canada
| | - Alice Richardson
- Statistical Support Network, The Australian National University, Acton, ACT, Australia
| | - Katrina Roper
- National Centre for Epidemiology and Population Health, ANU College of Health and Medicine, The Australian National University, Acton, Australian Capital Territory, Australia
| | - Meru Sheel
- Sydney School of Public Health, Faculty of Medicine and Health, The University of Sydney, New South Wales, Australia
| | - Nurudeen Rahman
- Department of Medical Parasitology and Infection Biology, Swiss Tropical and Public Health Institute, Basel, Switzerland
| | - Abideen Salako
- Department of Clinical Sciences, Nigerian Institute of Medical Research, Yaba, Lagos State, Nigeria
| | - Brett A Lidbury
- National Centre for Epidemiology and Population Health, ANU College of Health and Medicine, The Australian National University, Acton, Australian Capital Territory, Australia
| |
Collapse
|
2
|
Semi-supervised learning for MALDI–TOF mass spectrometry data classification: an application in the salmon industry. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08333-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
|
3
|
Baciu C, Xu C, Alim M, Prayitno K, Bhat M. Artificial intelligence applied to omics data in liver diseases: Enhancing clinical predictions. Front Artif Intell 2022; 5:1050439. [PMID: 36458100 PMCID: PMC9705954 DOI: 10.3389/frai.2022.1050439] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2022] [Accepted: 10/31/2022] [Indexed: 08/30/2023] Open
Abstract
Rapid development of biotechnology has led to the generation of vast amounts of multi-omics data, necessitating the advancement of bioinformatics and artificial intelligence to enable computational modeling to diagnose and predict clinical outcome. Both conventional machine learning and new deep learning algorithms screen existing data unbiasedly to uncover patterns and create models that can be valuable in informing clinical decisions. We summarized published literature on the use of AI models trained on omics datasets, with and without clinical data, to diagnose, risk-stratify, and predict survivability of patients with non-malignant liver diseases. A total of 20 different models were tested in selected studies. Generally, the addition of omics data to regular clinical parameters or individual biomarkers improved the AI model performance. For instance, using NAFLD fibrosis score to distinguish F0-F2 from F3-F4 fibrotic stages, the area under the curve (AUC) was 0.87. When integrating metabolomic data by a GMLVQ model, the AUC drastically improved to 0.99. The use of RF on multi-omics and clinical data in another study to predict progression of NAFLD to NASH resulted in an AUC of 0.84, compared to 0.82 when using clinical data only. A comparison of RF, SVM and kNN models on genomics data to classify immune tolerant phase in chronic hepatitis B resulted in AUC of 0.8793-0.8838 compared to 0.6759-0.7276 when using various serum biomarkers. Overall, the integration of omics was shown to improve prediction performance compared to models built only on clinical parameters, indicating a potential use for personalized medicine in clinical setting.
Collapse
Affiliation(s)
- Cristina Baciu
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
| | - Cherry Xu
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Faculty of Health Sciences, McMaster University, Hamilton, ON, Canada
| | - Mouaid Alim
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Departments of Computer Science and Cell and System Biology, University of Toronto, Toronto, ON, Canada
| | | | - Mamatha Bhat
- Ajmera Transplant Program, University Health Network, Toronto, ON, Canada
- Division of Gastroenterology and Hepatology, University Health Network and University of Toronto, Toronto, ON, Canada
- Toronto General Research Institute, University Health Network, Toronto, ON, Canada
| |
Collapse
|
4
|
Ge J, Kim WR, Lai JC, Kwong AJ. "Beyond MELD" - Emerging strategies and technologies for improving mortality prediction, organ allocation and outcomes in liver transplantation. J Hepatol 2022; 76:1318-1329. [PMID: 35589253 DOI: 10.1016/j.jhep.2022.03.003] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Revised: 02/24/2022] [Accepted: 03/04/2022] [Indexed: 02/06/2023]
Abstract
In this review article, we discuss the model for end-stage liver disease (MELD) score and its dual purpose in general and transplant hepatology. As the landscape of liver disease and transplantation has evolved considerably since the advent of the MELD score, we summarise emerging concepts, methodologies, and technologies that may improve mortality prognostication in the future. Finally, we explore how these novel concepts and technologies may be incorporated into clinical practice.
Collapse
Affiliation(s)
- Jin Ge
- Division of Gastroenterology and Hepatology, Department of Medicine, University of California - San Francisco, San Francisco, CA, USA
| | - W Ray Kim
- Division of Gastroenterology and Hepatology, Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA.
| | - Jennifer C Lai
- Division of Gastroenterology and Hepatology, Department of Medicine, University of California - San Francisco, San Francisco, CA, USA
| | - Allison J Kwong
- Division of Gastroenterology and Hepatology, Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
5
|
Spann A, Yasodhara A, Kang J, Watt K, Wang B, Goldenberg A, Bhat M. Applying Machine Learning in Liver Disease and Transplantation: A Comprehensive Review. Hepatology 2020; 71:1093-1105. [PMID: 31907954 DOI: 10.1002/hep.31103] [Citation(s) in RCA: 84] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2019] [Accepted: 12/05/2019] [Indexed: 12/13/2022]
Abstract
Machine learning (ML) utilizes artificial intelligence to generate predictive models efficiently and more effectively than conventional methods through detection of hidden patterns within large data sets. With this in mind, there are several areas within hepatology where these methods can be applied. In this review, we examine the literature pertaining to machine learning in hepatology and liver transplant medicine. We provide an overview of the strengths and limitations of ML tools and their potential applications to both clinical and molecular data in hepatology. ML has been applied to various types of data in liver disease research, including clinical, demographic, molecular, radiological, and pathological data. We anticipate that use of ML tools to generate predictive algorithms will change the face of clinical practice in hepatology and transplantation. This review will provide readers with the opportunity to learn about the ML tools available and potential applications to questions of interest in hepatology.
Collapse
Affiliation(s)
- Ashley Spann
- Division of Gastroenterology, Department of Medicine, Vanderbilt University Medical Center, Nashville, TN
| | | | - Justin Kang
- Multi Organ Transplant Program, Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada
| | - Kymberly Watt
- Division of Gastroenterology, Mayo Clinic, Rochester, MN
| | - Bo Wang
- Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| | - Anna Goldenberg
- Vector Institute for Artificial Intelligence, Toronto, ON, Canada
| | - Mamatha Bhat
- Multi Organ Transplant Program, Toronto General Hospital Research Institute, University Health Network, Toronto, ON, Canada.,Division of Gastroenterology, Department of Medicine, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
6
|
An MLP classifier for prediction of HBV-induced liver cirrhosis using routinely available clinical parameters. DISEASE MARKERS 2013; 35:653-60. [PMID: 24302810 PMCID: PMC3834663 DOI: 10.1155/2013/127962] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2013] [Revised: 09/25/2013] [Accepted: 10/09/2013] [Indexed: 12/13/2022]
Abstract
Background. Liver cirrhosis (LC) is the final stage of most of chronic liver diseases and is almost caused by chronic hepatitis B (CHB) in China. Liver biopsy is the reference method for the evaluation of liver cirrhosis. However, it is an invasive procedure with inherent risk. The aim of this study was to construct a new classifier based on the routine clinical markers for the prediction of HBV-induced LC. Subjects and Methods. We collected routine clinical parameters from 124 LC patients with CHB and 115 with CHB. Training set (n = 120) and test set (n = 119) were built for model construction and evaluation, respectively. Results. We describe a new classifier, MLP, for prediction of LC with CHB. MLP was built with seven routinely available clinical parameters, including age, ALT, AST, PT, PLT, HGB, and RDW. With optimal cutoff, we obtained a sensitivity of 95.2%, a specificity of 84.2%, and an overall accuracy of 89.9% on an independent test set, which were superior to those of FIB-4 and APRI. Conclusions. Our study suggests that the MLP classifier can be implemented for discriminating LC and non-LC cohorts by using machine learning method based on the routine available clinical parameters. It could be used for clinical practice in HBV-induced LC assessment.
Collapse
|