1
|
Jahangiri S, Abdollahi M, Rashedi E, Azadeh-Fard N. A machine learning model to predict heart failure readmission: toward optimal feature set. Front Artif Intell 2024; 7:1363226. [PMID: 38449791 PMCID: PMC10915081 DOI: 10.3389/frai.2024.1363226] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Accepted: 01/29/2024] [Indexed: 03/08/2024] Open
Abstract
Background Hospital readmissions for heart failure patients remain high despite efforts to reduce them. Predictive modeling using big data provides opportunities to identify high-risk patients and inform care management. However, large datasets can constrain performance. Objective This study aimed to develop a machine learning based prediction model leveraging a nationwide hospitalization database to predict 30-day heart failure readmissions. Another objective of this study is to find the optimal feature set that leads to the highest AUC value in the prediction model. Material and methods Heart failure patient data was extracted from the 2020 Nationwide Readmissions Database. A heuristic feature selection process incrementally incorporated predictors into logistic regression and random forest models, which yields a maximum increase in the AUC metric. Discrimination was evaluated through accuracy, sensitivity, specificity and AUC. Results A total of 566,019 discharges with heart failure diagnosis were recognized. Readmission rate was 8.9% for same-cause and 20.6% for all-cause diagnoses. Random forest outperformed logistic regression, achieving AUCs of 0.607 and 0.576 for same-cause and all-cause readmissions respectively. Heuristic feature selection resulted in the identification of optimal feature sets including 20 and 22 variables from a pool of 30 and 31 features for the same-cause and all-cause datasets. Key predictors included age, payment method, chronic kidney disease, disposition status, number of ICD-10-CM diagnoses, and post-care encounters. Conclusion The proposed model attained discrimination comparable to prior analyses that used smaller datasets. However, reducing the sample enhanced performance, indicating big data complexity. Improved techniques like heuristic feature selection enabled effective leveraging of the nationwide data. This study provides meaningful insights into predictive modeling methodologies and influential features for forecasting heart failure readmissions.
Collapse
Affiliation(s)
- Sonia Jahangiri
- Industrial and Systems Engineering Department, Rochester Institute of Technology, Rochester, NY, United States
| | - Masoud Abdollahi
- Industrial and Systems Engineering Department, Rochester Institute of Technology, Rochester, NY, United States
| | - Ehsan Rashedi
- Industrial and Systems Engineering Department, Rochester Institute of Technology, Rochester, NY, United States
| | - Nasibeh Azadeh-Fard
- Industrial and Systems Engineering Department, Rochester Institute of Technology, Rochester, NY, United States
| |
Collapse
|
2
|
Srinivasu PN, Sirisha U, Sandeep K, Praveen SP, Maguluri LP, Bikku T. An Interpretable Approach with Explainable AI for Heart Stroke Prediction. Diagnostics (Basel) 2024; 14:128. [PMID: 38248005 PMCID: PMC10813874 DOI: 10.3390/diagnostics14020128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 01/02/2024] [Accepted: 01/04/2024] [Indexed: 01/23/2024] Open
Abstract
Heart strokes are a significant global health concern, profoundly affecting the wellbeing of the population. Many research endeavors have focused on developing predictive models for heart strokes using ML and DL techniques. Nevertheless, prior studies have often failed to bridge the gap between complex ML models and their interpretability in clinical contexts, leaving healthcare professionals hesitant to embrace them for critical decision-making. This research introduces a meticulously designed, effective, and easily interpretable approach for heart stroke prediction, empowered by explainable AI techniques. Our contributions include a meticulously designed model, incorporating pivotal techniques such as resampling, data leakage prevention, feature selection, and emphasizing the model's comprehensibility for healthcare practitioners. This multifaceted approach holds the potential to significantly impact the field of healthcare by offering a reliable and understandable tool for heart stroke prediction. In our research, we harnessed the potential of the Stroke Prediction Dataset, a valuable resource containing 11 distinct attributes. Applying these techniques, including model interpretability measures such as permutation importance and explainability methods like LIME, has achieved impressive results. While permutation importance provides insights into feature importance globally, LIME complements this by offering local and instance-specific explanations. Together, they contribute to a comprehensive understanding of the Artificial Neural Network (ANN) model. The combination of these techniques not only aids in understanding the features that drive overall model performance but also helps in interpreting and validating individual predictions. The ANN model has achieved an outstanding accuracy rate of 95%.
Collapse
Affiliation(s)
- Parvathaneni Naga Srinivasu
- Department of Teleinformatics Engineering, Federal University of Ceará, Fortaleza 60455-970, Brazil
- Department of Computer Science and Engineering, Prasad V Potluri Siddhartha Institute of Technology, Vijayawada 520007, India; (U.S.); (S.P.P.)
| | - Uddagiri Sirisha
- Department of Computer Science and Engineering, Prasad V Potluri Siddhartha Institute of Technology, Vijayawada 520007, India; (U.S.); (S.P.P.)
| | - Kotte Sandeep
- Department of Information Technology, Dhanekula Institute of Engineering & Technology, Vijayawada 521139, India;
| | - S. Phani Praveen
- Department of Computer Science and Engineering, Prasad V Potluri Siddhartha Institute of Technology, Vijayawada 520007, India; (U.S.); (S.P.P.)
| | - Lakshmana Phaneendra Maguluri
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Vaddeswaram, Guntur 522302, India;
| | - Thulasi Bikku
- Computer Science and Engineering, Amrita School of Computing Amaravati, Amrita Vishwa Vidyapeetham, Amaravati 522503, India;
| |
Collapse
|
3
|
Yego NKK, Nkurunziza J, Kasozi J. Predicting health insurance uptake in Kenya using Random Forest: An analysis of socio-economic and demographic factors. PLoS One 2023; 18:e0294166. [PMID: 38032867 PMCID: PMC10688734 DOI: 10.1371/journal.pone.0294166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2023] [Accepted: 10/27/2023] [Indexed: 12/02/2023] Open
Abstract
Universal Health Coverage (UHC) is a global objective aimed at providing equitable access to essential and cost-effective healthcare services, irrespective of individuals' financial circumstances. Despite efforts to promote UHC through health insurance programs, the uptake in Kenya remains low. This study aimed to explore the factors influencing health insurance uptake and offer insights for effective policy development and outreach programs. The study utilized machine learning techniques on data from the 2021 FinAccess Survey. Among the models examined, the Random Forest model demonstrated the highest performance with notable metrics, including a high Kappa score of 0.9273, Recall score of 0.9640, F1 score of 0.9636, and Accuracy of 0.9636. The study identified several crucial predictors of health insurance uptake, ranked in ascending order of importance by the optimal model, including poverty vulnerability, social security usage, income, education, and marital status. The results suggest that affordability is a significant barrier to health insurance uptake. The study highlights the need to address affordability challenges and implement targeted interventions to improve health insurance uptake in Kenya, thereby advancing progress towards achieving Universal Health Coverage (UHC) and ensuring universal access to quality healthcare services.
Collapse
Affiliation(s)
- Nelson Kimeli Kemboi Yego
- African Center of Excellence in Data Science, University of Rwanda, Kigali, Rwanda
- Department of Mathematics and Computer Science, Moi University, Kenya
| | - Joseph Nkurunziza
- African Center of Excellence in Data Science, University of Rwanda, Kigali, Rwanda
- School of Economics, University of Rwanda, Kigali, Rwanda
| | - Juma Kasozi
- African Center of Excellence in Data Science, University of Rwanda, Kigali, Rwanda
- Department of Mathematics, Makerere University, Kampala, Uganda
| |
Collapse
|
4
|
Naveed I, Kaleem MF, Keshavjee K, Guergachi A. Artificial intelligence with temporal features outperforms machine learning in predicting diabetes. PLOS DIGITAL HEALTH 2023; 2:e0000354. [PMID: 37878561 PMCID: PMC10599553 DOI: 10.1371/journal.pdig.0000354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 08/19/2023] [Indexed: 10/27/2023]
Abstract
Diabetes mellitus type 2 is increasingly being called a modern preventable pandemic, as even with excellent available treatments, the rate of complications of diabetes is rapidly increasing. Predicting diabetes and identifying it in its early stages could make it easier to prevent, allowing enough time to implement therapies before it gets out of control. Leveraging longitudinal electronic medical record (EMR) data with deep learning has great potential for diabetes prediction. This paper examines the predictive competency of deep learning models in contrast to state-of-the-art machine learning models to incorporate the time dimension of risk. The proposed research investigates a variety of deep learning models and features for predicting diabetes. Model performance was appraised and compared in relation to predominant features, risk factors, training data density and visit history. The framework was implemented on the longitudinal EMR records of over 19K patients extracted from the Canadian Primary Care Sentinel Surveillance Network (CPCSSN). Empirical findings demonstrate that deep learning models consistently outperform other state-of-the-art competitors with prediction accuracy of above 91%, without overfitting. Fasting blood sugar, hemoglobin A1c and body mass index are the key predictors of future onset of diabetes. Overweight, middle aged patients and patients with hypertension are more vulnerable to developing diabetes, consistent with what is already known. Model performance improves as training data density or the visit history of a patient increases. This study confirms the ability of the LSTM deep learning model to incorporate the time dimension of risk in its predictive capabilities.
Collapse
Affiliation(s)
- Iqra Naveed
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | - Muhammad Farhat Kaleem
- Department of Electrical Engineering, University of Management and Technology, Lahore, Pakistan
| | - Karim Keshavjee
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
| | - Aziz Guergachi
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
- Ted Rogers School of Information Technology Management, Toronto Metropolitan University, Toronto, Canada
- Department of Mathematics and Statistics, York University, Toronto, Canada
| |
Collapse
|
5
|
Lee KCS, Breznen B, Ukhova A, Martin SS, Koehler F. Virtual healthcare solutions in heart failure: a literature review. Front Cardiovasc Med 2023; 10:1231000. [PMID: 37745104 PMCID: PMC10513031 DOI: 10.3389/fcvm.2023.1231000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 08/29/2023] [Indexed: 09/26/2023] Open
Abstract
The widespread adoption of mobile technologies offers an opportunity for a new approach to post-discharge care for patients with heart failure (HF). By enabling non-invasive remote monitoring and two-way, real-time communication between the clinic and home-based patients, as well as a host of other capabilities, mobile technologies have a potential to significantly improve remote patient care. This literature review summarizes clinical evidence related to virtual healthcare (VHC), defined as a care team + connected devices + a digital solution in post-release care of patients with HF. Searches were conducted on Embase (06/12/2020). A total of 171 studies were included for data extraction and evidence synthesis: 96 studies related to VHC efficacy, and 75 studies related to AI in HF. In addition, 15 publications were included from the search on studies scaling up VHC solutions in HF within the real-world setting. The most successful VHC interventions, as measured by the number of reported significant results, were those targeting reduction in rehospitalization rates. In terms of relative success rate, the two most effective interventions targeted patient self-care and all-cause hospital visits in their primary endpoint. Among the three categories of VHC identified in this review (telemonitoring, remote patient management, and patient self-empowerment) the integrated approach in remote patient management solutions performs the best in decreasing HF patients' re-admission rates and overall hospital visits. Given the increased amount of data generated by VHC technologies, artificial intelligence (AI) is being investigated as a tool to aid decision making in the context of primary diagnostics, identifying disease phenotypes, and predicting treatment outcomes. Currently, most AI algorithms are developed using data gathered in clinic and only a few studies deploy AI in the context of VHC. Most successes have been reported in predicting HF outcomes. Since the field of VHC in HF is relatively new and still in flux, this is not a typical systematic review capturing all published studies within this domain. Although the standard methodology for this type of reviews was followed, the nature of this review is qualitative. The main objective was to summarize the most promising results and identify potential research directions.
Collapse
Affiliation(s)
| | - Boris Breznen
- Evidence Synthesis, Evidinno Outcomes Research Inc., Vancouver, BC, Canada
| | | | - Seth Shay Martin
- Ciccarone Center for the Prevention of Cardiovascular Disease, Johns Hopkins University School of Medicine, Baltimore, MD, United States
| | - Friedrich Koehler
- Deutsches Herzzentrum der Charité (DHZC), Centre for Cardiovascular Telemedicine, Campus Charité Mitte, Berlin, Germany
- Division of Cardiology and Angiology, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
6
|
Jaltotage B, Ihdayhid AR, Lan NSR, Pathan F, Patel S, Arnott C, Figtree G, Kritharides L, Shamsul Islam SM, Chow CK, Rankin JM, Nicholls SJ, Dwivedi G. Artificial Intelligence in Cardiology: An Australian Perspective. Heart Lung Circ 2023; 32:894-904. [PMID: 37507275 DOI: 10.1016/j.hlc.2023.06.703] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 06/22/2023] [Accepted: 06/26/2023] [Indexed: 07/30/2023]
Abstract
Significant advances have been made in artificial intelligence technology in recent years. Many health care applications have been investigated to assist clinicians and the technology is close to being integrated into routine clinical practice. The high prevalence of cardiac disease in Australia places overwhelming demands on the existing health care system, challenging its capacity to provide quality patient care. Artificial intelligence has emerged as a promising solution. This discussion paper provides an Australian perspective on the current state of artificial intelligence in cardiology, including the benefits and challenges of implementation. This paper highlights some current artificial intelligence applications in cardiology, while also detailing challenges such as data privacy, ethical considerations, and integration within existing health infrastructures. Overall, this paper aims to provide insights into the potential benefits of artificial intelligence in cardiology, while also acknowledging the barriers that need to be addressed to ensure safe and effective implementation into an Australian health system.
Collapse
Affiliation(s)
- Biyanka Jaltotage
- Department of Cardiology, Fiona Stanley Hospital, Perth, Australia. https://twitter.com/cardiacimager
| | - Abdul Rahman Ihdayhid
- Department of Cardiology, Fiona Stanley Hospital, Perth, Australia; School of Medicine, Curtin University, Perth, Australia; Harry Perkins Institute of Medical Research, School of Medicine, University of Western Australia, Perth, Australia
| | - Nick S R Lan
- Department of Cardiology, Fiona Stanley Hospital, Perth, Australia; Harry Perkins Institute of Medical Research, School of Medicine, University of Western Australia, Perth, Australia
| | - Faraz Pathan
- Department of Cardiology, Nepean Hospital and Charles Perkins Centre, Nepean Clinical School, Faculty of Medicine and Health, Sydney University, Sydney, NSW, Australia
| | - Sanjay Patel
- Department of Cardiology, Royal Prince Alfred Hospital, Sydney, NSW, Australia and The George Institute for Global Health, University of New South Wales, Sydney, NSW, Australia
| | - Clare Arnott
- Department of Cardiology, Royal Prince Alfred Hospital, Sydney, NSW, Australia and The George Institute for Global Health, University of New South Wales, Sydney, NSW, Australia
| | - Gemma Figtree
- Kolling Institute, Royal North Shore Hospital and Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - Leonard Kritharides
- Department of Cardiology, Concord Repatriation General Hospital and ANZAC Research Institute, University of Sydney, Sydney, NSW, Australia
| | | | - Clara K Chow
- Westmead Applied Research Centre, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
| | - James M Rankin
- Department of Cardiology, Fiona Stanley Hospital, Perth, Australia
| | | | - Girish Dwivedi
- Department of Cardiology, Fiona Stanley Hospital, Perth, Australia; Harry Perkins Institute of Medical Research, School of Medicine, University of Western Australia, Perth, Australia.
| |
Collapse
|
7
|
Zalikha AK, Court T, Nham F, El-Othmani MM, Shah RP. Improved performance of machine learning models in predicting length of stay, discharge disposition, and inpatient mortality after total knee arthroplasty using patient-specific variables. ARTHROPLASTY 2023; 5:31. [PMID: 37393281 DOI: 10.1186/s42836-023-00187-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Accepted: 04/10/2023] [Indexed: 07/03/2023] Open
Abstract
BACKGROUND This study aimed to compare the performance of ten predictive models using different machine learning (ML) algorithms and compare the performance of models developed using patient-specific vs. situational variables in predicting select outcomes after primary TKA. METHODS Data from 2016 to 2017 from the National Inpatient Sample were used to identify 305,577 discharges undergoing primary TKA, which were included in the training, testing, and validation of 10 ML models. 15 predictive variables consisting of 8 patient-specific and 7 situational variables were utilized to predict length of stay (LOS), discharge disposition, and mortality. Using the best performing algorithms, models trained using either 8 patient-specific and 7 situational variables were then developed and compared. RESULTS For models developed using all 15 variables, Linear Support Vector Machine (LSVM) was the most responsive model for predicting LOS. LSVM and XGT Boost Tree were equivalently most responsive for predicting discharge disposition. LSVM and XGT Boost Linear were equivalently most responsive for predicting mortality. Decision List, CHAID, and LSVM were the most reliable models for predicting LOS and discharge disposition, while XGT Boost Tree, Decision List, LSVM, and CHAID were most reliable for mortality. Models developed using the 8 patient-specific variables outperformed those developed using the 7 situational variables, with few exceptions. CONCLUSION This study revealed that performance of different models varied, ranging from poor to excellent, and demonstrated that models developed using patient-specific variables were typically better predictive of quality metrics after TKA than those developed employing situational variables. LEVEL OF EVIDENCE III.
Collapse
Affiliation(s)
- Abdul K Zalikha
- Department of Orthopaedic Surgery and Sports Medicine, Detroit Medical Center, Detroit, MI, 48201, USA
| | - Tannor Court
- Department of Orthopaedic Surgery and Sports Medicine, Detroit Medical Center, Detroit, MI, 48201, USA
| | - Fong Nham
- Department of Orthopaedic Surgery and Sports Medicine, Detroit Medical Center, Detroit, MI, 48201, USA.
| | - Mouhanad M El-Othmani
- Department of Orthopaedic Surgery, Columbia University Medical Center, New York, NY, 10032, USA
| | - Roshan P Shah
- Department of Orthopaedic Surgery, Columbia University Medical Center, New York, NY, 10032, USA
| |
Collapse
|
8
|
Liu Z, Zhang T, Lin L, Long F, Guo H, Han L. Applications of radiomics-based analysis pipeline for predicting epidermal growth factor receptor mutation status. Biomed Eng Online 2023; 22:17. [PMID: 36810090 PMCID: PMC9945395 DOI: 10.1186/s12938-022-01049-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2022] [Accepted: 11/04/2022] [Indexed: 02/24/2023] Open
Abstract
BACKGROUND This study aimed to develop a pipeline for selecting the best feature engineering-based radiomic path to predict epidermal growth factor receptor (EGFR) mutant lung adenocarcinoma in 18F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT). METHODS The study enrolled 115 lung adenocarcinoma patients with EGFR mutation status from June 2016 and September 2017. We extracted radiomics features by delineating regions-of-interest around the entire tumor in 18F-FDG PET/CT images. The feature engineering-based radiomic paths were built by combining various methods of data scaling, feature selection, and many methods for predictive model-building. Next, a pipeline was developed to select the best path. RESULTS In the paths from CT images, the highest accuracy was 0.907 (95% confidence interval [CI]: 0.849, 0.966), the highest area under curve (AUC) was 0.917 (95% CI: 0.853, 0.981), and the highest F1 score was 0.908 (95% CI: 0.842, 0.974). In the paths based on PET images, the highest accuracy was 0.913 (95% CI: 0.863, 0.963), the highest AUC was 0.960 (95% CI: 0.926, 0.995), and the highest F1 score was 0.878 (95% CI: 0.815, 0.941). Additionally, a novel evaluation metric was developed to evaluate the comprehensive level of the models. Some feature engineering-based radiomic paths obtained promising results. CONCLUSIONS The pipeline is capable of selecting the best feature engineering-based radiomic path. Combining various feature engineering-based radiomic paths could compare their performances and identify paths built with the most appropriate methods to predict EGFR-mutant lung adenocarcinoma in 18FDG PET/CT. The pipeline proposed in this work can select the best feature engineering-based radiomic path.
Collapse
Affiliation(s)
- Zefeng Liu
- grid.412645.00000 0004 1757 9434Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052 People’s Republic of China
| | - Tianyou Zhang
- grid.412645.00000 0004 1757 9434Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052 People’s Republic of China
| | - Liying Lin
- grid.265021.20000 0000 9792 1228First Central Clinical College, Tianjin Medical University, 22 Qixiangtai Road, Heping District, Tianjin, 300070 People’s Republic of China
| | - Fenghua Long
- grid.506261.60000 0001 0706 7839Department of Radiology, Institute of Hematology and Blood Diseases Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin, 300041 People’s Republic of China
| | - Hongyu Guo
- Department of Radiology, Tianjin Medical University General Hospital, Tianjin, 300052, People's Republic of China.
| | - Li Han
- School of Medical Imaging, Tianjin Medical University, 9-307, Guangdong Rd. #1, Hexi, Tianjin, 300203, People's Republic of China. .,Department of Radiology, University of Michigan, Ann Arbor, Michigan, 48109, USA.
| |
Collapse
|
9
|
Xie M, Lei X, Zhong J, Ouyang J, Li G. Drug response prediction using graph representation learning and Laplacian feature selection. BMC Bioinformatics 2022; 23:532. [PMID: 36494630 PMCID: PMC9733001 DOI: 10.1186/s12859-022-05080-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2022] [Accepted: 11/22/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Knowing the responses of a patient to drugs is essential to make personalized medicine practical. Since the current clinical drug response experiments are time-consuming and expensive, utilizing human genomic information and drug molecular characteristics to predict drug responses is of urgent importance. Although a variety of computational drug response prediction methods have been proposed, their effectiveness is still not satisfying. RESULTS In this study, we propose a method called LGRDRP (Learning Graph Representation for Drug Response Prediction) to predict cell line-drug responses. At first, LGRDRP constructs a heterogeneous network integrating multiple kinds of information: cell line miRNA expression profiles, drug chemical structure similarity, gene-gene interaction, cell line-gene interaction and known cell line-drug responses. Then, for each cell line, learning graph representation and Laplacian feature selection are combined to obtain network topology features related to the cell line. The learning graph representation method learns network topology structure features, and the Laplacian feature selection method further selects out some most important ones from them. Finally, LGRDRP trains an SVM model to predict drug responses based on the selected features of the known cell line-drug responses. Our five-fold cross-validation results show that LGRDRP is significantly superior to the art-of-the-state methods in the measures of the average area under the receiver operating characteristics curve, the average area under the precision-recall curve and the recall rate of top-k predicted sensitive cell lines. CONCLUSIONS Our results demonstrated that the usage of multiple types of information about cell lines and drugs, the learning graph representation method, and the Laplacian feature selection is useful to the improvement of performance in predicting drug responses. We believe that such an approach would be easily extended to similar problems such as miRNA-disease relationship inference.
Collapse
Affiliation(s)
- Minzhu Xie
- grid.411427.50000 0001 0089 3695College of Information Science and Engineering, Hunan Normal University, Changsha, China ,grid.411427.50000 0001 0089 3695Key Laboratory of Computing and Stochastic Mathematics (LCSM) (Ministry of Education), School of Mathematics and Statistics, Hunan Normal University, Changsha, China
| | - Xiaowen Lei
- grid.411427.50000 0001 0089 3695College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Jianchen Zhong
- grid.411427.50000 0001 0089 3695College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Jianxing Ouyang
- grid.411427.50000 0001 0089 3695College of Information Science and Engineering, Hunan Normal University, Changsha, China
| | - Guijing Li
- grid.411427.50000 0001 0089 3695College of Information Science and Engineering, Hunan Normal University, Changsha, China
| |
Collapse
|
10
|
Identifying the Predictors of Patient-Centered Communication by Machine Learning Methods. Processes (Basel) 2022. [DOI: 10.3390/pr10122484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Patient-centered communication (PCC) quality is critical to increasing the quality of patient-centered care. Based on the nationally representative data of the Health Information National Trends Survey (HINTS) 2019–2020 (N = 4593), this study combined four machine learning methods, namely, Generalized Linear Models (GLM), Random Forests (Random Forests), Deep Neural Networks (Deep Learning), and Gradient Boosting Machines (GBM), to identify important PCC predictors through variable importance metrics. Fifteen variables were identified as important predictors, involving multiple dimensions, such as individual sociodemographic characteristics, health-related factors, and individual living habits. Among them, four novel potential associated variables are included, an individual’s level of verbal expression, exercise habits, etc., which significantly impacted respondents’ perceived PCC quality. This study revealed the value of combining feature selection with machine learning approaches to identify broad variables that could enhance PCC prediction and clinical decision-making, influence future PCC prediction research, and improve patient-centered care. In the future, other easy-to-interpret models can be combined to conduct further research on the impact direction and mechanism of important predictors on PCC.
Collapse
|
11
|
Peng S, Huang J, Liu X, Deng J, Sun C, Tang J, Chen H, Cao W, Wang W, Duan X, Luo X, Peng S. Interpretable machine learning for 28-day all-cause in-hospital mortality prediction in critically ill patients with heart failure combined with hypertension: A retrospective cohort study based on medical information mart for intensive care database-IV and eICU databases. Front Cardiovasc Med 2022; 9:994359. [PMID: 36312291 PMCID: PMC9597462 DOI: 10.3389/fcvm.2022.994359] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 09/15/2022] [Indexed: 11/13/2022] Open
Abstract
Background Heart failure (HF) combined with hypertension is an extremely important cause of in-hospital mortality, especially for the intensive care unit (ICU) patients. However, under intense working pressure, the medical staff are easily overwhelmed by the large number of clinical signals generated in the ICU, which may lead to treatment delay, sub-optimal care, or even wrong clinical decisions. Individual risk stratification is an essential strategy for managing ICU patients with HF combined with hypertension. Artificial intelligence, especially machine learning (ML), can develop superior models to predict the prognosis of these patients. This study aimed to develop a machine learning method to predict the 28-day mortality for ICU patients with HF combined with hypertension. Methods We enrolled all critically ill patients with HF combined with hypertension in the Medical Information Mart for IntensiveCare Database-IV (MIMIC-IV, v.1.4) and the eICU Collaborative Research Database (eICU-CRD) from 2008 to 2019. Subsequently, MIMIC-IV was divided into training cohort and testing cohort in an 8:2 ratio, and eICU-CRD was designated as the external validation cohort. The least absolute shrinkage and selection operator (LASSO) Cox regression with internal tenfold cross-validation was used for data dimension reduction and identifying the most valuable predictive features for 28-day mortality. Based on its accuracy and area under the curve (AUC), the best model in the validation cohort was selected. In addition, we utilized the Shapley Additive Explanations (SHAP) method to highlight the importance of model features, analyze the impact of individual features on model output, and visualize an individual’s Shapley values. Results A total of 3,458 and 6582 patients with HF combined with hypertension in MIMIC-IV and eICU-CRD were included. The patients, including 1,756 males, had a median (Q1, Q3) age of 75 (65, 84) years. After selection, 22 out of a total of 58 clinical parameters were extracted to develop the machine-learning models. Among four constructed models, the Neural Networks (NN) model performed the best predictive performance with an AUC of 0.764 and 0.674 in the test cohort and external validation cohort, respectively. In addition, a simplified model including seven variables was built based on NN, which also had good predictive performance (AUC: 0.741). Feature importance analysis showed that age, mechanical ventilation (MECHVENT), chloride, bun, anion gap, paraplegia, rdw (RDW), hyperlipidemia, peripheral capillary oxygen saturation (SpO2), respiratory rate, cerebrovascular disease, heart rate, white blood cell (WBC), international normalized ratio (INR), mean corpuscular hemoglobin concentration (MCHC), glucose, AIDS, mean corpuscular volume (MCV), N-terminal pro-brain natriuretic peptide (Npro. BNP), calcium, renal replacement therapy (RRT), and partial thromboplastin time (PTT) were the top 22 features of the NN model with the greatest impact. Finally, after hyperparameter optimization, SHAP plots were employed to make the NN-based model interpretable with an analytical description of how the constructed model visualizes the prediction of death. Conclusion We developed a predictive model to predict the 28-day mortality for ICU patients with HF combined with hypertension, which proved superior to the traditional logistic regression analysis. The SHAP method enables machine learning models to be more interpretable, thereby helping clinicians to better understand the reasoning behind the outcome and assess in-hospital outcomes for critically ill patients.
Collapse
Affiliation(s)
- Shengxian Peng
- Scientific Research Department, First People’s Hospital of Zigong City, Zigong, China
| | - Jian Huang
- Graduate School, Guangxi University of Chinese Medicine, Nanning, China
| | - Xiaozhu Liu
- Department of Cardiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Jiewen Deng
- Department of Neurosurgery, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Chenyu Sun
- AMITA Health Saint Joseph Hospital Chicago, Chicago, IL, United States
| | - Juan Tang
- Scientific Research Department, First People’s Hospital of Zigong City, Zigong, China
| | - Huaqiao Chen
- Department of Cardiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Wenzhai Cao
- Department of Cardiology, First People’s Hospital of Zigong City, Zigong, China
| | - Wei Wang
- Department of Cardiology, First People’s Hospital of Zigong City, Zigong, China,Information Department, First People’s Hospital of Zigong City, Zigong, China
| | - Xiangjie Duan
- Department of Infectious Diseases, The First People’s Hospital of Changde City, Changde, China
| | - Xianglin Luo
- Information Department, First People’s Hospital of Zigong City, Zigong, China
| | - Shuang Peng
- General Affairs Section, The People’s Hospital of Tongnan District, Chongqing, China,*Correspondence: Shuang Peng,
| |
Collapse
|
12
|
Croon PM, Selder JL, Allaart CP, Bleijendaal H, Chamuleau SAJ, Hofstra L, Išgum I, Ziesemer KA, Winter MM. Current state of artificial intelligence-based algorithms for hospital admission prediction in patients with heart failure: a scoping review . EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2022; 3:415-425. [PMID: 36712159 PMCID: PMC9707890 DOI: 10.1093/ehjdh/ztac035] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 05/20/2022] [Accepted: 05/31/2022] [Indexed: 05/04/2023]
Abstract
AIMS Patients with congestive heart failure (HF) are prone to clinical deterioration leading to hospital admissions, burdening both patients and the healthcare system. Predicting hospital admission in this patient group could enable timely intervention, with subsequent reduction of these admissions. To date, hospital admission prediction remains challenging. Increasing amounts of acquired data and development of artificial intelligence (AI) technology allow for the creation of reliable hospital prediction algorithms for HF patients. This scoping review describes the current literature on strategies and performance of AI-based algorithms for prediction of hospital admission in patients with HF. METHODS AND RESULTS PubMed, EMBASE, and the Web of Science were used to search for articles using machine learning (ML) and deep learning methods to predict hospitalization in patients with HF. After eligibility screening, 23 articles were included. Sixteen articles predicted 30-day hospital (re-)admission resulting in an area under the curve (AUC) ranging from 0.61 to 0.79. Six studies predicted hospital admission over longer time periods ranging from 6 months to 3 years, with AUC's ranging from 0.65 to 0.78. One study prospectively evaluated performance of a disposable sensory patch at home after hospitalization which resulted in an AUC of 0.89 for unplanned hospital admission prediction. CONCLUSION AI has the potential to enable prediction of hospital admission in HF patients. Improvement of data management, adding new data sources such as telemonitoring data and ML models and prospective and external validation of current models must be performed before clinical applicability is possible.
Collapse
Affiliation(s)
- P M Croon
- Corresponding author. Tel: +31646123217,
| | - J L Selder
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - C P Allaart
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - H Bleijendaal
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
- Department of Clinical Epidemiology, Biostatistics & Bioinformatics, Amsterdam UMC, University of Amsterdam, Meibergdreef 9, Amsterdam, The Netherlands
| | - S A J Chamuleau
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - L Hofstra
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - I Išgum
- Department of Biomedical Engineering and Physics, Amsterdam University Medical Centers-location AMC, University of Amsterdam, Amsterdam, The Netherlands
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers - Location AMC, University of Amsterdam, Amsterdam, The Netherlands
| | - K A Ziesemer
- Medical Library, Vrije Universiteit, Amsterdam, The Netherlands
| | - M M Winter
- Heart Center, Department of Clinical and Experimental Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
13
|
Lo-Thong-Viramoutou O, Charton P, Cadet XF, Grondin-Perez B, Saavedra E, Damour C, Cadet F. Non-linearity of Metabolic Pathways Critically Influences the Choice of Machine Learning Model. Front Artif Intell 2022; 5:744755. [PMID: 35757298 PMCID: PMC9226554 DOI: 10.3389/frai.2022.744755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 04/29/2022] [Indexed: 11/13/2022] Open
Abstract
The use of machine learning (ML) in life sciences has gained wide interest over the past years, as it speeds up the development of high performing models. Important modeling tools in biology have proven their worth for pathway design, such as mechanistic models and metabolic networks, as they allow better understanding of mechanisms involved in the functioning of organisms. However, little has been done on the use of ML to model metabolic pathways, and the degree of non-linearity associated with them is not clear. Here, we report the construction of different metabolic pathways with several linear and non-linear ML models. Different types of data are used; they lead to the prediction of important biological data, such as pathway flux and final product concentration. A comparison reveals that the data features impact model performance and highlight the effectiveness of non-linear models (e.g., QRF: RMSE = 0.021 nmol·min-1 and R2 = 1 vs. Bayesian GLM: RMSE = 1.379 nmol·min-1 R2 = 0.823). It turns out that the greater the degree of non-linearity of the pathway, the better suited a non-linear model will be. Therefore, a decision-making support for pathway modeling is established. These findings generally support the hypothesis that non-linear aspects predominate within the metabolic pathways. This must be taken into account when devising possible applications of these pathways for the identification of biomarkers of diseases (e.g., infections, cancer, neurodegenerative diseases) or the optimization of industrial production processes.
Collapse
Affiliation(s)
- Ophélie Lo-Thong-Viramoutou
- University of Paris, BIGR—Biologie Intégrée du Globule Rouge, Inserm, UMR_S1134, Paris, France
- Laboratory of Excellence GR-Ex, Paris, France
- Laboratory DSIMB, UMR_S1134, BIGR, Inserm, Faculty of Sciences and Technology, University of La Reunion, Saint-Denis, France
| | - Philippe Charton
- University of Paris, BIGR—Biologie Intégrée du Globule Rouge, Inserm, UMR_S1134, Paris, France
- Laboratory of Excellence GR-Ex, Paris, France
- Laboratory DSIMB, UMR_S1134, BIGR, Inserm, Faculty of Sciences and Technology, University of La Reunion, Saint-Denis, France
| | | | - Brigitte Grondin-Perez
- EnergyLab, EA 4079, Faculty of Sciences and Technology, University of La Reunion, Saint-Denis, France
| | - Emma Saavedra
- Departamento de Bioquímica, Instituto Nacional de Cardiología Ignacio Chávez, Mexico City, Mexico
| | - Cédric Damour
- EnergyLab, EA 4079, Faculty of Sciences and Technology, University of La Reunion, Saint-Denis, France
| | - Frédéric Cadet
- University of Paris, BIGR—Biologie Intégrée du Globule Rouge, Inserm, UMR_S1134, Paris, France
- Laboratory of Excellence GR-Ex, Paris, France
- Laboratory DSIMB, UMR_S1134, BIGR, Inserm, Faculty of Sciences and Technology, University of La Reunion, Saint-Denis, France
| |
Collapse
|
14
|
Predicting 30-day readmissions in patients with heart failure using administrative data: a machine learning approach. J Card Fail 2021; 28:710-722. [PMID: 34936894 DOI: 10.1016/j.cardfail.2021.12.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 12/02/2021] [Accepted: 12/09/2021] [Indexed: 12/23/2022]
Abstract
AIMS To develop machine-learning (ML) models trained on administrative data which predict risk of readmission in heart failure (HF) patients; evaluate and compare the ML model with the currently used LaCE score using clinically informative metrics. METHODS AND RESULTS This prognostic study was conducted in Alberta, Canada on 9,845 patients with confirmed HF admitted to hospital between 2012-2019. The outcome was unplanned all-cause hospital readmission within 30-days of discharge. 80% of the data was used for ML model development and 20% for independent validation. We reported, using the validation set, c-statistics (AUROCs)and performance metrics (likelihood ratio [LR], positive predictive values [PPV]) for the XGBoost model and a modified LaCE score within their respective predictive thresholds. Boosted tree-based classifiers had higher AUROCs (0.65 for XGBoost) compared to others (0.58 for Neural Network) and 0.57 for the modified LaCE. Within the predicted threshold range of the XGBoost classifier, the positive LR was 1.00 at the low end of predicted risk and 6.12 at the high end, resulting in a PPV (post-test probability) range of 21-62%; the pre-test probability of readmission was 20.9% using prevalence. The corresponding positive LRs and PPVs across LaCE score thresholds were 1.00-1.20 and 21-24%, respectively. CONCLUSION Despite predicting readmissions better than the LaCE, even the best ML model trained on administrative health data (XGBoost) did not provide substantially informative prediction performance as it only generated a moderate shift from pre to post-test probability. Health systems wishing to deploy such a tool should consider training ML models with additional data. Adding other techniques like Natural Language Processing, along with ML, to use other clinical information (like chart notes) might improve prediction performance.
Collapse
|
15
|
Teo K, Yong CW, Chuah JH, Hum YC, Tee YK, Xia K, Lai KW. Current Trends in Readmission Prediction: An Overview of Approaches. ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING 2021; 48:1-18. [PMID: 34422543 PMCID: PMC8366485 DOI: 10.1007/s13369-021-06040-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 07/30/2021] [Indexed: 12/03/2022]
Abstract
Hospital readmission shortly after discharge threatens the quality of patient care and leads to increased medical care costs. In the United States, hospitals with high readmission rates are subject to federal financial penalties. This concern calls for incentives for healthcare facilities to reduce their readmission rates by predicting patients who are at high risk of readmission. Conventional practices involve the use of rule-based assessment scores and traditional statistical methods, such as logistic regression, in developing risk prediction models. The recent advancements in machine learning driven by improved computing power and sophisticated algorithms have the potential to produce highly accurate predictions. However, the value of such models could be overrated. Meanwhile, the use of other flexible models that leverage simple algorithms offer great transparency in terms of feature interpretation, which is beneficial in clinical settings. This work presents an overview of the current trends in risk prediction models developed in the field of readmission. The various techniques adopted by researchers in recent years are described, and the topic of whether complex models outperform simple ones in readmission risk stratification is investigated.
Collapse
Affiliation(s)
- Kareen Teo
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Ching Wai Yong
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Joon Huang Chuah
- Department of Electrical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| | - Yan Chai Hum
- Department of Mechatronics and Biomedical Engineering, Universiti Tunku Abdul Rahman, 43000 Sungai Long, Malaysia
| | - Yee Kai Tee
- Department of Mechatronics and Biomedical Engineering, Universiti Tunku Abdul Rahman, 43000 Sungai Long, Malaysia
| | - Kaijian Xia
- Changshu Institute of Technology, Changshu, 215500 Jiangsu China
| | - Khin Wee Lai
- Department of Biomedical Engineering, Universiti Malaya, 50603 Kuala Lumpur, Malaysia
| |
Collapse
|
16
|
Arfat Y, Mittone G, Esposito R, Cantalupo B, DE Ferrari GM, Aldinucci M. A review of machine learning for cardiology. Minerva Cardiol Angiol 2021; 70:75-91. [PMID: 34338485 DOI: 10.23736/s2724-5683.21.05709-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper reviews recent cardiology literature and reports how Artificial Intelligence Tools (specifically, Machine Learning techniques) are being used by physicians in the field. Each technique is introduced with enough details to allow the understanding of how it works and its intent, but without delving into details that do not add immediate benefits and require expertise in the field. We specifically focus on the principal Machine Learning based risk scores used in cardiovascular research. After introducing them and summarizing their assumptions and biases, we discuss their merits and shortcomings. We report on how frequently they are adopted in the field and suggest why this is the case based on our expertise in Machine Learning. We complete the analysis by reviewing how corresponding statistical approaches compare with them. Finally, we discuss the main open issues in applying Machine Learning tools to cardiology tasks, also drafting possible future directions. Despite the growing interest in these tools, we argue that there are many still underutilized techniques: while Neural Networks are slowly being incorporated in cardiovascular research, other important techniques such as Semi-Supervised Learning and Federated Learning are still underutilized. The former would allow practitioners to harness the information contained in large datasets that are only partially labeled, while the latter would foster collaboration between institutions allowing building larger and better models.
Collapse
Affiliation(s)
- Yasir Arfat
- Computer Science Department, University of Turin, Turin, Italy -
| | | | | | | | - Gaetano M DE Ferrari
- Division of Cardiology, Cardiovascular and Thoracic Department, Città della Salute e della Scienza, Turin, Italy.,Cardiology, Department of Medical Sciences, University of Turin, Turin, Italy
| | - Marco Aldinucci
- Computer Science Department, University of Turin, Turin, Italy
| |
Collapse
|
17
|
A convolutional-recurrent neural network approach to resting-state EEG classification in Parkinson's disease. J Neurosci Methods 2021; 361:109282. [PMID: 34237382 DOI: 10.1016/j.jneumeth.2021.109282] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2021] [Revised: 06/12/2021] [Accepted: 07/04/2021] [Indexed: 11/24/2022]
Abstract
BACKGROUND Parkinson's disease (PD) is expected to become more common, particularly with an aging population. Diagnosis and monitoring of the disease typically rely on the laborious examination of physical symptoms by medical experts, which is necessarily limited and may not detect the prodromal stages of the disease. NEW METHOD We propose a lightweight (~20 K parameters) deep learning model to classify resting-state EEG recorded from people with PD and healthy controls (HC). The proposed CRNN model consists of convolutional neural networks (CNN) and a recurrent neural network (RNN) with gated recurrent units (GRUs). The 1D CNN layers are designed to extract spatiotemporal features across EEG channels, which are subsequently supplied to the GRUs to discover temporal features pertinent to the classification. RESULTS The CRNN model achieved 99.2% accuracy, 98.9% precision, and 99.4% recall in classifying PD from HC. Interrogating the model, we further demonstrate that the model is sensitive to dopaminergic medication effects and predominantly uses phase information in the EEG signals. COMPARISON WITH EXISTING METHODS The CRNN model achieves superior performance compared to baseline machine learning methods and other recently proposed deep learning model. CONCLUSION The approach proposed in this study adequately extracts spatial and temporal features in multi-channel EEG signals that enable accurate differentiation between PD and HC. The CRNN model has excellent potential for use as an oscillatory biomarker for assisting in the diagnosis and monitoring of people with PD. Future studies to further improve and validate the model's performance in clinical practice are warranted.
Collapse
|
18
|
Predicting mortality and hospitalization in heart failure using machine learning: A systematic literature review. IJC HEART & VASCULATURE 2021; 34:100773. [PMID: 33912652 PMCID: PMC8065274 DOI: 10.1016/j.ijcha.2021.100773] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Revised: 03/11/2021] [Accepted: 03/23/2021] [Indexed: 12/13/2022]
Abstract
Objective The partnership between humans and machines can enhance clinical decisions accuracy, leading to improved patient outcomes. Despite this, the application of machine learning techniques in the healthcare sector, particularly in guiding heart failure patient management, remains unpopular. This systematic review aims to identify factors restricting the integration of machine learning derived risk scores into clinical practice when treating adults with acute and chronic heart failure. Methods Four academic research databases and Google Scholar were searched to identify original research studies where heart failure patient data was used to build models predicting all-cause mortality, cardiac death, all-cause and heart failure-related hospitalization. Results Thirty studies met the inclusion criteria. The selected studies' sample size ranged between 71 and 716 790 patients, and the median age was 72.1 (interquartile range: 61.1–76.8) years. The minimum and maximum area under the receiver operating characteristic curve (AUC) for models predicting mortality were 0.48 and 0.92, respectively. Models predicting hospitalization had an AUC of 0.47 to 0.84. Nineteen studies (63%) used logistic regression, 53% random forests, and 37% of studies used decision trees to build predictive models. None of the models were built or externally validated using data originating from Africa or the Middle-East. Conclusions The variation in the aetiologies of heart failure, limited access to structured health data, distrust in machine learning techniques among clinicians and the modest accuracy of existing predictive models are some of the factors precluding the widespread use of machine learning derived risk calculators.
Collapse
|
19
|
Harrison JH, Gilbertson JR, Hanna MG, Olson NH, Seheult JN, Sorace JM, Stram MN. Introduction to Artificial Intelligence and Machine Learning for Pathology. Arch Pathol Lab Med 2021; 145:1228-1254. [PMID: 33493264 DOI: 10.5858/arpa.2020-0541-cp] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/10/2020] [Indexed: 11/06/2022]
Abstract
CONTEXT.— Recent developments in machine learning have stimulated intense interest in software that may augment or replace human experts. Machine learning may impact pathology practice by offering new capabilities in analysis, interpretation, and outcomes prediction using images and other data. The principles of operation and management of machine learning systems are unfamiliar to pathologists, who anticipate a need for additional education to be effective as expert users and managers of the new tools. OBJECTIVE.— To provide a background on machine learning for practicing pathologists, including an overview of algorithms, model development, and performance evaluation; to examine the current status of machine learning in pathology and consider possible roles and requirements for pathologists in local deployment and management of machine learning systems; and to highlight existing challenges and gaps in deployment methodology and regulation. DATA SOURCES.— Sources include the biomedical and engineering literature, white papers from professional organizations, government reports, electronic resources, and authors' experience in machine learning. References were chosen when possible for accessibility to practicing pathologists without specialized training in mathematics, statistics, or software development. CONCLUSIONS.— Machine learning offers an array of techniques that in recent published results show substantial promise. Data suggest that human experts working with machine learning tools outperform humans or machines separately, but the optimal form for this combination in pathology has not been established. Significant questions related to the generalizability of machine learning systems, local site verification, and performance monitoring remain to be resolved before a consensus on best practices and a regulatory environment can be established.
Collapse
Affiliation(s)
- James H Harrison
- From the Department of Pathology, University of Virginia School of Medicine, Charlottesville (Harrison)
| | - John R Gilbertson
- the Departments of Biomedical Informatics and Pathology, University of Pittsburgh, Pittsburgh, Pennsylvania (Gilbertson)
| | - Matthew G Hanna
- the Department of Pathology, Memorial Sloan Kettering Cancer Center, New York, New York (Hanna)
| | - Niels H Olson
- the Defense Innovation Unit, Mountain View, California (Olson).,the Department of Pathology, Uniformed Services University, Bethesda, Maryland (Olson)
| | - Jansen N Seheult
- the Department of Pathology, University of Pittsburgh, and Vitalant Specialty Labs, Pittsburgh, Pennsylvania (Seheult)
| | - James M Sorace
- the US Department of Health and Human Services, retired, Lutherville, Maryland (Sorace)
| | - Michelle N Stram
- the Department of Forensic Medicine, New York University, and Office of Chief Medical Examiner, New York, New York (Stram)
| |
Collapse
|
20
|
Romero-Brufau S, Wyatt KD, Boyum P, Mickelson M, Moore M, Cognetta-Rieke C. Implementation of Artificial Intelligence-Based Clinical Decision Support to Reduce Hospital Readmissions at a Regional Hospital. Appl Clin Inform 2020; 11:570-577. [PMID: 32877943 DOI: 10.1055/s-0040-1715827] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Hospital readmissions are a key quality metric, which has been tied to reimbursement. One strategy to reduce readmissions is to direct resources to patients at the highest risk of readmission. This strategy necessitates a robust predictive model coupled with effective, patient-centered interventions. OBJECTIVE The aim of this study was to reduce unplanned hospital readmissions through the use of artificial intelligence-based clinical decision support. METHODS A commercially vended artificial intelligence tool was implemented at a regional hospital in La Crosse, Wisconsin between November 2018 and April 2019. The tool assessed all patients admitted to general care units for risk of readmission and generated recommendations for interventions intended to decrease readmission risk. Similar hospitals were used as controls. Change in readmission rate was assessed by comparing the 6-month intervention period to the same months of the previous calendar year in exposure and control hospitals. RESULTS Among 2,460 hospitalizations assessed using the tool, 611 were designated by the tool as high risk. Sensitivity and specificity for risk assignment were 65% and 89%, respectively. Over 6 months following implementation, readmission rates decreased from 11.4% during the comparison period to 8.1% (p < 0.001). After accounting for the 0.5% decrease in readmission rates (from 9.3 to 8.8%) at control hospitals, the relative reduction in readmission rate was 25% (p < 0.001). Among patients designated as high risk, the number needed to treat to avoid one readmission was 11. CONCLUSION We observed a decrease in hospital readmission after implementing artificial intelligence-based clinical decision support. Our experience suggests that use of artificial intelligence to identify patients at the highest risk for readmission can reduce quality gaps when coupled with patient-centered interventions.
Collapse
Affiliation(s)
- Santiago Romero-Brufau
- Mayo Clinic Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota, United States.,Department of Biostatistics, Harvard T.H. Chan School of Public Health, Harvard University, Cambridge, Massachusetts, United States
| | - Kirk D Wyatt
- Division of Pediatric Hematology/Oncology, Department of Pediatric and Adolescent Medicine, Mayo Clinic, Rochester, Minnesota, United States
| | - Patricia Boyum
- Mayo Clinic Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota, United States
| | - Mindy Mickelson
- Mayo Clinic Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota, United States
| | - Matthew Moore
- Mayo Clinic Kern Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota, United States
| | - Cheristi Cognetta-Rieke
- Department of Nursing, Mayo Clinic Health System, La Crosse, La Crosse, Wisconsin, United States
| |
Collapse
|
21
|
Shukla S, Hassan MF, Khan MK, Jung LT, Awang A. An analytical model to minimize the latency in healthcare internet-of-things in fog computing environment. PLoS One 2019; 14:e0224934. [PMID: 31721807 PMCID: PMC6853307 DOI: 10.1371/journal.pone.0224934] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Accepted: 10/24/2019] [Indexed: 02/07/2023] Open
Abstract
Fog computing (FC) is an evolving computing technology that operates in a distributed environment. FC aims to bring cloud computing features close to edge devices. The approach is expected to fulfill the minimum latency requirement for healthcare Internet-of-Things (IoT) devices. Healthcare IoT devices generate various volumes of healthcare data. This large volume of data results in high data traffic that causes network congestion and high latency. An increase in round-trip time delay owing to large data transmission and large hop counts between IoTs and cloud servers render healthcare data meaningless and inadequate for end-users. Time-sensitive healthcare applications require real-time data. Traditional cloud servers cannot fulfill the minimum latency demands of healthcare IoT devices and end-users. Therefore, communication latency, computation latency, and network latency must be reduced for IoT data transmission. FC affords the storage, processing, and analysis of data from cloud computing to a network edge to reduce high latency. A novel solution for the abovementioned problem is proposed herein. It includes an analytical model and a hybrid fuzzy-based reinforcement learning algorithm in an FC environment. The aim is to reduce high latency among healthcare IoTs, end-users, and cloud servers. The proposed intelligent FC analytical model and algorithm use a fuzzy inference system combined with reinforcement learning and neural network evolution strategies for data packet allocation and selection in an IoT–FC environment. The approach is tested on simulators iFogSim (Net-Beans) and Spyder (Python). The obtained results indicated the better performance of the proposed approach compared with existing methods.
Collapse
Affiliation(s)
- Saurabh Shukla
- Centre for Research in Data Science (CeRDaS), Computer and Information Science Department, Universiti Teknologi PETRONAS(UTP), Seri Iskandar, Perak Darul Ridzuan, Malaysia
| | - Mohd Fadzil Hassan
- Centre for Research in Data Science (CeRDaS), Computer and Information Science Department, Universiti Teknologi PETRONAS(UTP), Seri Iskandar, Perak Darul Ridzuan, Malaysia
| | | | - Low Tang Jung
- Centre for Research in Data Science (CeRDaS), Computer and Information Science Department, Universiti Teknologi PETRONAS(UTP), Seri Iskandar, Perak Darul Ridzuan, Malaysia
| | - Azlan Awang
- Electrical and Electronic Engineering Department, Universiti Teknologi PETRONAS(UTP), Seri Iskandar, Perak Darul Ridzuan, Malaysia
| |
Collapse
|