1
|
Zilker S, Weinzierl S, Kraus M, Zschech P, Matzner M. A machine learning framework for interpretable predictions in patient pathways: The case of predicting ICU admission for patients with symptoms of sepsis. Health Care Manag Sci 2024:10.1007/s10729-024-09673-8. [PMID: 38771522 DOI: 10.1007/s10729-024-09673-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Accepted: 04/13/2024] [Indexed: 05/22/2024]
Abstract
Proactive analysis of patient pathways helps healthcare providers anticipate treatment-related risks, identify outcomes, and allocate resources. Machine learning (ML) can leverage a patient's complete health history to make informed decisions about future events. However, previous work has mostly relied on so-called black-box models, which are unintelligible to humans, making it difficult for clinicians to apply such models. Our work introduces PatWay-Net, an ML framework designed for interpretable predictions of admission to the intensive care unit (ICU) for patients with symptoms of sepsis. We propose a novel type of recurrent neural network and combine it with multi-layer perceptrons to process the patient pathways and produce predictive yet interpretable results. We demonstrate its utility through a comprehensive dashboard that visualizes patient health trajectories, predictive outcomes, and associated risks. Our evaluation includes both predictive performance - where PatWay-Net outperforms standard models such as decision trees, random forests, and gradient-boosted decision trees - and clinical utility, validated through structured interviews with clinicians. By providing improved predictive accuracy along with interpretable and actionable insights, PatWay-Net serves as a valuable tool for healthcare decision support in the critical case of patients with symptoms of sepsis.
Collapse
Affiliation(s)
- Sandra Zilker
- Technische Hochschule Nürnberg Georg Simon Ohm, Professorship for Business Analytics, Hohfederstraße 40, 90489, Nuremberg, Germany.
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Digital Industrial Service Systems, Fürther Straße 248, 90429, Nuremberg, Germany.
| | - Sven Weinzierl
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Digital Industrial Service Systems, Fürther Straße 248, 90429, Nuremberg, Germany
| | - Mathias Kraus
- University of Regensburg, Chair for Explainable AI in Business Value Creation, Bajuwarenstraße 4, 93053, Regensburg, Germany
| | - Patrick Zschech
- Leipzig University, Professorship for Intelligent Information Systems and Processes, Grimmaische Straße 12, 04109, Leipzig, Germany
| | - Martin Matzner
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair of Digital Industrial Service Systems, Fürther Straße 248, 90429, Nuremberg, Germany
| |
Collapse
|
2
|
Hu Y, Huerta J, Cordella N, Mishuris RG, Paschalidis IC. Personalized hypertension treatment recommendations by a data-driven model. BMC Med Inform Decis Mak 2023; 23:44. [PMID: 36859187 PMCID: PMC9979505 DOI: 10.1186/s12911-023-02137-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2022] [Accepted: 02/09/2023] [Indexed: 03/03/2023] Open
Abstract
BACKGROUND Hypertension is a prevalent cardiovascular disease with severe longer-term implications. Conventional management based on clinical guidelines does not facilitate personalized treatment that accounts for a richer set of patient characteristics. METHODS Records from 1/1/2012 to 1/1/2020 at the Boston Medical Center were used, selecting patients with either a hypertension diagnosis or meeting diagnostic criteria (≥ 130 mmHg systolic or ≥ 90 mmHg diastolic, n = 42,752). Models were developed to recommend a class of antihypertensive medications for each patient based on their characteristics. Regression immunized against outliers was combined with a nearest neighbor approach to associate with each patient an affinity group of other patients. This group was then used to make predictions of future Systolic Blood Pressure (SBP) under each prescription type. For each patient, we leveraged these predictions to select the class of medication that minimized their future predicted SBP. RESULTS The proposed model, built with a distributionally robust learning procedure, leads to a reduction of 14.28 mmHg in SBP, on average. This reduction is 70.30% larger than the reduction achieved by the standard-of-care and 7.08% better than the corresponding reduction achieved by the 2nd best model which uses ordinary least squares regression. All derived models outperform following the previous prescription or the current ground truth prescription in the record. We randomly sampled and manually reviewed 350 patient records; 87.71% of these model-generated prescription recommendations passed a sanity check by clinicians. CONCLUSION Our data-driven approach for personalized hypertension treatment yielded significant improvement compared to the standard-of-care. The model implied potential benefits of computationally deprescribing and can support situations with clinical equipoise.
Collapse
Affiliation(s)
- Yang Hu
- Department of Electrical and Computer Engineering, Division of Systems Engineering, Boston University, 8 Saint Mary's St., Boston, MA, 02215, USA
| | - Jasmine Huerta
- Department of Medicine, Boston Medical Center, School of Medicine, Boston University, Boston, MA, USA
| | - Nicholas Cordella
- Department of Medicine, Boston Medical Center, School of Medicine, Boston University, Boston, MA, USA
| | - Rebecca G Mishuris
- Department of Medicine, Boston Medical Center, School of Medicine, Boston University, Boston, MA, USA
| | - Ioannis Ch Paschalidis
- Department of Electrical and Computer Engineering, Division of Systems Engineering, Boston University, 8 Saint Mary's St., Boston, MA, 02215, USA.
- Department of Biomedical Engineering, Faculty of Computing & Data Sciences, Hariri Institute for Computing and Computational Science & Engineering, Boston University, 8 Saint Mary's St., Boston, MA, 02215, USA.
| |
Collapse
|
3
|
Visco V, Izzo C, Mancusi C, Rispoli A, Tedeschi M, Virtuoso N, Giano A, Gioia R, Melfi A, Serio B, Rusciano MR, Di Pietro P, Bramanti A, Galasso G, D’Angelo G, Carrizzo A, Vecchione C, Ciccarelli M. Artificial Intelligence in Hypertension Management: An Ace up Your Sleeve. J Cardiovasc Dev Dis 2023; 10:jcdd10020074. [PMID: 36826570 PMCID: PMC9963880 DOI: 10.3390/jcdd10020074] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 02/05/2023] [Accepted: 02/07/2023] [Indexed: 02/11/2023] Open
Abstract
Arterial hypertension (AH) is a progressive issue that grows in importance with the increased average age of the world population. The potential role of artificial intelligence (AI) in its prevention and treatment is firmly recognized. Indeed, AI application allows personalized medicine and tailored treatment for each patient. Specifically, this article reviews the benefits of AI in AH management, pointing out diagnostic and therapeutic improvements without ignoring the limitations of this innovative scientific approach. Consequently, we conducted a detailed search on AI applications in AH: the articles (quantitative and qualitative) reviewed in this paper were obtained by searching journal databases such as PubMed and subject-specific professional websites, including Google Scholar. The search terms included artificial intelligence, artificial neural network, deep learning, machine learning, big data, arterial hypertension, blood pressure, blood pressure measurement, cardiovascular disease, and personalized medicine. Specifically, AI-based systems could help continuously monitor BP using wearable technologies; in particular, BP can be estimated from a photoplethysmograph (PPG) signal obtained from a smartphone or a smartwatch using DL. Furthermore, thanks to ML algorithms, it is possible to identify new hypertension genes for the early diagnosis of AH and the prevention of complications. Moreover, integrating AI with omics-based technologies will lead to the definition of the trajectory of the hypertensive patient and the use of the most appropriate drug. However, AI is not free from technical issues and biases, such as over/underfitting, the "black-box" nature of many ML algorithms, and patient data privacy. In conclusion, AI-based systems will change clinical practice for AH by identifying patient trajectories for new, personalized care plans and predicting patients' risks and necessary therapy adjustments due to changes in disease progression and/or therapy response.
Collapse
Affiliation(s)
- Valeria Visco
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Carmine Izzo
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Costantino Mancusi
- Department of Advanced Biomedical Sciences, Federico II University of Naples, 80138 Naples, Italy
| | - Antonella Rispoli
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Michele Tedeschi
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Nicola Virtuoso
- Cardiology Unit, University Hospital “San Giovanni di Dio e Ruggi d’Aragona”, 84131 Salerno, Italy
| | - Angelo Giano
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Renato Gioia
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Americo Melfi
- Cardiology Unit, University Hospital “San Giovanni di Dio e Ruggi d’Aragona”, 84131 Salerno, Italy
| | - Bianca Serio
- Hematology and Transplant Center, University Hospital “San Giovanni di Dio e Ruggi d’Aragona”, 84131 Salerno, Italy
| | - Maria Rosaria Rusciano
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Paola Di Pietro
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Alessia Bramanti
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Gennaro Galasso
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
| | - Gianni D’Angelo
- Department of Computer Science, University of Salerno, 84084 Fisciano, Italy
| | - Albino Carrizzo
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
- Vascular Physiopathology Unit, IRCCS Neuromed, 86077 Pozzilli, Italy
| | - Carmine Vecchione
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
- Vascular Physiopathology Unit, IRCCS Neuromed, 86077 Pozzilli, Italy
| | - Michele Ciccarelli
- Department of Medicine, Surgery and Dentistry, University of Salerno, 84081 Baronissi, Italy
- Correspondence:
| |
Collapse
|
4
|
Morid MA, Sheng ORL, Dunbar J. Time Series Prediction Using Deep Learning Methods in Healthcare. ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS 2022. [DOI: 10.1145/3531326] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
Traditional Machine Learning (ML) methods face unique challenges when applied to healthcare predictive analytics. The high-dimensional nature of healthcare data necessitates labor-intensive and time-consuming processes when selecting an appropriate set of features for each new task. Furthermore, ML methods depend heavily on feature engineering to capture the sequential nature of patient data, oftentimes failing to adequately leverage the temporal patterns of medical events and their dependencies. In contrast, recent Deep Learning (DL) methods have shown promising performance for various healthcare prediction tasks by specifically addressing the high-dimensional and temporal challenges of medical data. DL techniques excel at learning useful representations of medical concepts and patient clinical data as well as their nonlinear interactions from high-dimensional raw or minimally-processed healthcare data.
In this paper we systematically reviewed research works that focused on advancing deep neural networks to leverage patient structured time series data for healthcare prediction tasks. To identify relevant studies, we searched MEDLINE, IEEE, Scopus, and ACM digital library for relevant publications through November 4
th
, 2021. Overall, we found that researchers have contributed to deep time series prediction literature in ten identifiable research streams: DL models, missing value handling, addressing temporal irregularity, patient representation, static data inclusion, attention mechanisms, interpretation, incorporation of medical ontologies, learning strategies, and scalability. This study summarizes research insights from these literature streams, identifies several critical research gaps, and suggests future research opportunities for DL applications using patient time series data.
Collapse
Affiliation(s)
- Mohammad Amin Morid
- Department of Information Systems and Analytics, Leavey School of Business, Santa Clara University, Santa Clara, CA, USA
| | - Olivia R. Liu Sheng
- Department of Operations and Information Systems, David Eccles School of Business, University of Utah, Salt Lake City, UT, USA
| | - Joseph Dunbar
- Department of Operations and Information Systems, David Eccles School of Business, University of Utah, Salt Lake City, UT, USA
| |
Collapse
|
5
|
Guo H, Li J, Liu H, He J. Learning dynamic treatment strategies for coronary heart diseases by artificial intelligence: real-world data-driven study. BMC Med Inform Decis Mak 2022; 22:39. [PMID: 35168623 PMCID: PMC8845235 DOI: 10.1186/s12911-022-01774-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2021] [Accepted: 02/01/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Coronary heart disease (CHD) has become the leading cause of death and one of the most serious epidemic diseases worldwide. CHD is characterized by urgency, danger and severity, and dynamic treatment strategies for CHD patients are needed. We aimed to build and validate an AI model for dynamic treatment recommendations for CHD patients with the goal of improving patient outcomes and learning best practices from clinicians to help clinical decision support for treating CHD patients. METHODS We formed the treatment strategy as a sequential decision problem, and applied an AI supervised reinforcement learning-long short-term memory (SRL-LSTM) framework that combined supervised learning (SL) and reinforcement learning (RL) with an LSTM network to track patients' states to learn a recommendation model that took a patient's diagnosis and evolving health status as input and provided a treatment recommendation in the form of whether to take specific drugs. The experiments were conducted by leveraging a real-world intensive care unit (ICU) database with 13,762 admitted patients diagnosed with CHD. We compared the performance of the applied SRL-LSTM model and several state-of-the-art SL and RL models in reducing the estimated in-hospital mortality and the Jaccard similarity with clinicians' decisions. We used a random forest algorithm to calculate the feature importance of both the clinician policy and the AI policy to illustrate the interpretability of the AI model. RESULTS Our experimental study demonstrated that the AI model could help reduce the estimated in-hospital mortality through its RL function and learn the best practice from clinicians through its SL function. The similarity between the clinician policy and the AI policy regarding the surviving patients was high, while for the expired patients, it was much lower. The dynamic treatment strategies made by the AI model were clinically interpretable and relied on sensible clinical features extracted according to monitoring indexes and risk factors for CHD patients. CONCLUSIONS We proposed a pipeline for constructing an AI model to learn dynamic treatment strategies for CHD patients that could improve patient outcomes and mimic the best practices of clinicians. And a lot of further studies and efforts are needed to make it practical.
Collapse
Affiliation(s)
- Haihong Guo
- School of Information, Renmin University of China, 59 Zhongguancun Street, Haidian District, Beijing, 100872, China
- Institute of Medical Information/Medical Library, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
- Key Laboratory of Data Engineering and Knowledge Engineering, Ministry of Education, Beijing, China
| | - Jiao Li
- Institute of Medical Information/Medical Library, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Hongyan Liu
- School of Economics and Management, Tsinghua University, Beijing, China
| | - Jun He
- School of Information, Renmin University of China, 59 Zhongguancun Street, Haidian District, Beijing, 100872, China.
- Key Laboratory of Data Engineering and Knowledge Engineering, Ministry of Education, Beijing, China.
| |
Collapse
|