1
|
Din Abdul Jabbar MA, Guo L, Nag S, Guo Y, Simmons Z, Pioro EP, Ramasamy S, Yeo CJJ. Predicting amyotrophic lateral sclerosis (ALS) progression with machine learning. Amyotroph Lateral Scler Frontotemporal Degener 2024; 25:242-255. [PMID: 38052485 DOI: 10.1080/21678421.2023.2285443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Accepted: 11/14/2023] [Indexed: 12/07/2023]
Abstract
OBJECTIVE To predict ALS progression with varying observation and prediction window lengths, using machine learning (ML). METHODS We used demographic, clinical, and laboratory parameters from 5030 patients in the Pooled Resource Open-Access ALS Clinical Trials (PRO-ACT) database to model ALS disease progression as fast (at least 1.5 points decline in ALS Functional Rating Scale-Revised (ALSFRS-R) per month) or non-fast, using Extreme Gradient Boosting (XGBoost) and Bayesian Long Short Term Memory (BLSTM). XGBoost identified predictors of progression while BLSTM provided a confidence level for each prediction. RESULTS ML models achieved area under receiver-operating-characteristics curve (AUROC) of 0.570-0.748 and were non-inferior to clinician assessments. Performance was similar with observation lengths of a single visit, 3, 6, or 12 months and on a holdout validation dataset, but was better for longer prediction lengths. 21 important predictors were identified, with the top 3 being days since disease onset, past ALSFRS-R and forced vital capacity. Nonstandard predictors included phosphorus, chloride and albumin. BLSTM demonstrated higher performance for the samples about which it was most confident. Patient screening by models may reduce hypothetical Phase II/III clinical trial sizes by 18.3%. CONCLUSION Similar accuracies across ML models using different observation lengths suggest that a clinical trial observation period could be shortened to a single visit and clinical trial sizes reduced. Confidence levels provided by BLSTM gave additional information on the trustworthiness of predictions, which could aid decision-making. The identified predictors of ALS progression are potential biomarkers and therapeutic targets for further research.
Collapse
Affiliation(s)
- Muzammil Arif Din Abdul Jabbar
- Department of Physiology, Development and Neuroscience, University of Cambridge, Cambridge, UK
- Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Ling Guo
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Sonakshi Nag
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Yang Guo
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Zachary Simmons
- Department of Neurology, Pennsylvania State University College of Medicine, State College, PA, USA
| | - Erik P Pioro
- Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Savitha Ramasamy
- Institute for Infocomm Research (I2R), Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
| | - Crystal Jing Jing Yeo
- Agency for Science, Technology and Research (A*STAR), Singapore, Singapore
- Department of Neurology, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
- Lee Kong Chien School of Medicine, Imperial College London and Nanyang Technological University Singapore, Singapore, Singapore
- School of Medicine, Medical Sciences and Nutrition, University of Aberdeen, Aberdeen, UK
- National Neuroscience Institute, Singapore, Singapore
- Duke-NUS Medical School, Singapore, Singapore
| |
Collapse
|
2
|
Jin W, Boss J, Bakulski KM, Goutman SA, Feldman EL, Fritsche LG, Mukherjee B. Improving prediction models of amyotrophic lateral sclerosis (ALS) using polygenic, pre-existing conditions, and survey-based risk scores in the UK Biobank. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.03.28.24305037. [PMID: 38585910 PMCID: PMC10996827 DOI: 10.1101/2024.03.28.24305037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/09/2024]
Abstract
Background and Objectives Amyotrophic lateral sclerosis (ALS) causes profound impairments in neurological function and a cure for this devastating disease remains elusive. Early detection and risk stratification are crucial for timely intervention and improving patient outcomes. This study aimed to identify predisposing genetic, phenotypic, and exposure-related factors for Amyotrophic lateral sclerosis using multi-modal data and assess their joint predictive potential. Methods Utilizing data from the UK Biobank, we analyzed an unrelated set of 292 ALS cases and 408,831 controls of European descent. Two polygenic risk scores (PRS) are constructed: "GWAS Hits PRS" and "PRS-CS," reflecting oligogenic and polygenic ALS risk profiles, respectively. Time-restricted phenome-wide association studies (PheWAS) were performed to identify pre-existing conditions increasing ALS risk, integrated into phenotypic risk scores (PheRS). A poly-exposure score ("PXS") captures the influence of environmental exposures measured through survey questionnaires. We evaluate the performance of these scores for predicting ALS incidence and stratifying risk, adjusting for baseline demographic covariates. Results Both PRSs modestly predicted ALS diagnosis, but with increased predictive power when combined (covariate-adjusted receiver operating characteristic [AAUC] = 0.584 [0.525, 0.639]). PheRS incorporated diagnoses 1 year before ALS onset (PheRS1) modestly discriminated cases from controls (AAUC = 0.515 [0.472, 0.564]). The "PXS" did not significantly predict ALS. However, a model incorporating PRSs and PheRS1 improved prediction of ALS (AAUC = 0.604 [0.547, 0.667]), outperforming a model combining all risk scores. This combined risk score identified the top 10% of risk score distribution with a 4-fold higher ALS risk (95% CI: [2.04, 7.73]) versus those in the 40%-60% range. Discussions By leveraging UK Biobank data, our study uncovers predisposing ALS factors, highlighting the improved effectiveness of multi-factorial prediction models to identify individuals at highest risk for ALS.
Collapse
Affiliation(s)
- Weijia Jin
- Department of Biostatistics, University of Florida, Gainesville, Florida 32603, United States of America
| | - Jonathan Boss
- Department of Biostatistics, University of Michigan, University of Michigan, Ann Arbor, Michigan 48109, United States of America
- Center for Precision Health Data Science, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| | - Kelly M. Bakulski
- Department of Epidemiology, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| | - Stephen A. Goutman
- Department of Neurology, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| | - Eva L. Feldman
- Department of Neurology, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| | - Lars G. Fritsche
- Department of Biostatistics, University of Michigan, University of Michigan, Ann Arbor, Michigan 48109, United States of America
- Center for Precision Health Data Science, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| | - Bhramar Mukherjee
- Department of Biostatistics, University of Michigan, University of Michigan, Ann Arbor, Michigan 48109, United States of America
- Center for Precision Health Data Science, University of Michigan, Ann Arbor, Michigan 48109, United States of America
- Department of Epidemiology, University of Michigan, Ann Arbor, Michigan 48109, United States of America
- Michigan Institute for Data Science, University of Michigan, Ann Arbor, Michigan 48109, United States of America
| |
Collapse
|
3
|
Piñeros-Fernández MC. Artificial Intelligence Applications in the Diagnosis of Neuromuscular Diseases: A Narrative Review. Cureus 2023; 15:e48458. [PMID: 37942130 PMCID: PMC10629626 DOI: 10.7759/cureus.48458] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/07/2023] [Indexed: 11/10/2023] Open
Abstract
The accurate diagnosis of neuromuscular diseases (NMD) is in many cases difficult; the starting point is the clinical approach based on the course of the disease and a careful physical examination of the patient. Electrodiagnostic tests, imaging, muscle biopsy, and genetics are fundamental complementary studies for the diagnosis of NMD. The large volume of data obtained from such studies makes it necessary to look for efficient solutions, such as artificial intelligence (AI) applications, which can help classify, synthesize, and organize the information of patients with NMD to facilitate their accurate and timely diagnosis. The objective of this study was to describe the usefulness of AI applications in the diagnosis of patients with neuromuscular diseases. A narrative review was done, including publications on artificial intelligence applied to the diagnostic methods of NMD currently existing. Twelve studies were included. Two of the studies focused on muscle ultrasound, five of the studies on muscle MRI, two studies on electromyography, two studies on amyotrophic lateral sclerosis (ALS) biomarkers, and one study on genes related to myopathies. The accuracy of classification using different classification algorithms used in each of the studies included in this narrative review was already 90% in most studies. In conclusion, the future design of more accurate algorithms applied to NMD with greater precision will have an impact on the earlier diagnosis of this group of diseases.
Collapse
Affiliation(s)
- Martha C Piñeros-Fernández
- Pediatric Neurology, Fundación Cardio Infantil - La Cardio, Bogotá, COL
- Pediatric Neurology, Cobos Medical Center, Bogotá, COL
| |
Collapse
|
4
|
Tavazzi E, Longato E, Vettoretti M, Aidos H, Trescato I, Roversi C, Martins AS, Castanho EN, Branco R, Soares DF, Guazzo A, Birolo G, Pala D, Bosoni P, Chiò A, Manera U, de Carvalho M, Miranda B, Gromicho M, Alves I, Bellazzi R, Dagliati A, Fariselli P, Madeira SC, Di Camillo B. Artificial intelligence and statistical methods for stratification and prediction of progression in amyotrophic lateral sclerosis: A systematic review. Artif Intell Med 2023; 142:102588. [PMID: 37316101 DOI: 10.1016/j.artmed.2023.102588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 04/14/2023] [Accepted: 05/16/2023] [Indexed: 06/16/2023]
Abstract
BACKGROUND Amyotrophic Lateral Sclerosis (ALS) is a fatal neurodegenerative disorder characterised by the progressive loss of motor neurons in the brain and spinal cord. The fact that ALS's disease course is highly heterogeneous, and its determinants not fully known, combined with ALS's relatively low prevalence, renders the successful application of artificial intelligence (AI) techniques particularly arduous. OBJECTIVE This systematic review aims at identifying areas of agreement and unanswered questions regarding two notable applications of AI in ALS, namely the automatic, data-driven stratification of patients according to their phenotype, and the prediction of ALS progression. Differently from previous works, this review is focused on the methodological landscape of AI in ALS. METHODS We conducted a systematic search of the Scopus and PubMed databases, looking for studies on data-driven stratification methods based on unsupervised techniques resulting in (A) automatic group discovery or (B) a transformation of the feature space allowing patient subgroups to be identified; and for studies on internally or externally validated methods for the prediction of ALS progression. We described the selected studies according to the following characteristics, when applicable: variables used, methodology, splitting criteria and number of groups, prediction outcomes, validation schemes, and metrics. RESULTS Of the starting 1604 unique reports (2837 combined hits between Scopus and PubMed), 239 were selected for thorough screening, leading to the inclusion of 15 studies on patient stratification, 28 on prediction of ALS progression, and 6 on both stratification and prediction. In terms of variables used, most stratification and prediction studies included demographics and features derived from the ALSFRS or ALSFRS-R scores, which were also the main prediction targets. The most represented stratification methods were K-means, and hierarchical and expectation-maximisation clustering; while random forests, logistic regression, the Cox proportional hazard model, and various flavours of deep learning were the most widely used prediction methods. Predictive model validation was, albeit unexpectedly, quite rarely performed in absolute terms (leading to the exclusion of 78 eligible studies), with the overwhelming majority of included studies resorting to internal validation only. CONCLUSION This systematic review highlighted a general agreement in terms of input variable selection for both stratification and prediction of ALS progression, and in terms of prediction targets. A striking lack of validated models emerged, as well as a general difficulty in reproducing many published studies, mainly due to the absence of the corresponding parameter lists. While deep learning seems promising for prediction applications, its superiority with respect to traditional methods has not been established; there is, instead, ample room for its application in the subfield of patient stratification. Finally, an open question remains on the role of new environmental and behavioural variables collected via novel, real-time sensors.
Collapse
Affiliation(s)
- Erica Tavazzi
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Enrico Longato
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Martina Vettoretti
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Helena Aidos
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Isotta Trescato
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Chiara Roversi
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Andreia S Martins
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Eduardo N Castanho
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Ruben Branco
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Diogo F Soares
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Alessandro Guazzo
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy
| | - Giovanni Birolo
- Department of Medical Sciences, University of Torino, Corso Dogliotti 14, Turin, 10126, Italy
| | - Daniele Pala
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Via Ferrata 5, Pavia, 27100, Italy
| | - Pietro Bosoni
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Via Ferrata 5, Pavia, 27100, Italy
| | - Adriano Chiò
- Department of Neurosciences "Rita Levi Montalcini", University of Turin, Via Cherasco 15, Turin, 10126, Italy
| | - Umberto Manera
- Department of Neurosciences "Rita Levi Montalcini", University of Turin, Via Cherasco 15, Turin, 10126, Italy
| | - Mamede de Carvalho
- Faculdade de Medicina, Instituto de Medicina Molecular João Lobo Antunes, Universidade de Lisboa, Av. Prof. Egas Moniz, Lisbon, 1649-028, Portugal
| | - Bruno Miranda
- Faculdade de Medicina, Instituto de Medicina Molecular João Lobo Antunes, Universidade de Lisboa, Av. Prof. Egas Moniz, Lisbon, 1649-028, Portugal
| | - Marta Gromicho
- Faculdade de Medicina, Instituto de Medicina Molecular João Lobo Antunes, Universidade de Lisboa, Av. Prof. Egas Moniz, Lisbon, 1649-028, Portugal
| | - Inês Alves
- Faculdade de Medicina, Instituto de Medicina Molecular João Lobo Antunes, Universidade de Lisboa, Av. Prof. Egas Moniz, Lisbon, 1649-028, Portugal
| | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Via Ferrata 5, Pavia, 27100, Italy
| | - Arianna Dagliati
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Via Ferrata 5, Pavia, 27100, Italy
| | - Piero Fariselli
- Department of Medical Sciences, University of Torino, Corso Dogliotti 14, Turin, 10126, Italy
| | - Sara C Madeira
- LASIGE and Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Campo Grande, Lisbon, 1749-016, Portugal
| | - Barbara Di Camillo
- Department of Information Engineering, University of Padova, Via Gradenigo 6/b, Padua, 35131, Italy; Department of Comparative Biomedicine and Food Science, University of Padova, Agripolis, Viale dell'Università, 16, Legnaro (PD), 35020, Italy.
| |
Collapse
|
5
|
Ramamoorthy D, Severson K, Ghosh S, Sachs K, Glass JD, Fournier CN, Herrington TM, Berry JD, Ng K, Fraenkel E. Identifying patterns in amyotrophic lateral sclerosis progression from sparse longitudinal data. NATURE COMPUTATIONAL SCIENCE 2022; 2:605-616. [PMID: 38177466 PMCID: PMC10766562 DOI: 10.1038/s43588-022-00299-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Accepted: 07/14/2022] [Indexed: 01/06/2024]
Abstract
The clinical presentation of amyotrophic lateral sclerosis (ALS), a fatal neurodegenerative disease, varies widely across patients, making it challenging to determine if potential therapeutics slow progression. We sought to determine whether there were common patterns of disease progression that could aid in the design and analysis of clinical trials. We developed an approach based on a mixture of Gaussian processes to identify clusters of patients sharing similar disease progression patterns, modeling their average trajectories and the variability in each cluster. We show that ALS progression is frequently nonlinear, with periods of stable disease preceded or followed by rapid decline. We also show that our approach can be extended to Alzheimer's and Parkinson's diseases. Our results advance the characterization of disease progression of ALS and provide a flexible modeling approach that can be applied to other progressive diseases.
Collapse
Affiliation(s)
| | - Kristen Severson
- Center for Computational Health and MIT-IBM Watson AI Lab, IBM Research, Cambridge, MA, USA
| | - Soumya Ghosh
- Center for Computational Health and MIT-IBM Watson AI Lab, IBM Research, Cambridge, MA, USA
| | - Karen Sachs
- Department of Biological Engineering, MIT, Cambridge, MA, USA
- Next Generation Analytics, Palo Alto, CA, USA
| | - Jonathan D Glass
- Department of Neurology, Emory University School of Medicine, Atlanta, GA, USA
| | | | - Todd M Herrington
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
- Department of Neurology, Harvard Medical School, Boston, MA, USA
| | - James D Berry
- Department of Neurology, Massachusetts General Hospital, Boston, MA, USA
| | - Kenney Ng
- Center for Computational Health and MIT-IBM Watson AI Lab, IBM Research, Cambridge, MA, USA
| | - Ernest Fraenkel
- Department of Biological Engineering, MIT, Cambridge, MA, USA.
| |
Collapse
|
6
|
Pancotti C, Birolo G, Rollo C, Sanavia T, Di Camillo B, Manera U, Chiò A, Fariselli P. Deep learning methods to predict amyotrophic lateral sclerosis disease progression. Sci Rep 2022; 12:13738. [PMID: 35962027 PMCID: PMC9374680 DOI: 10.1038/s41598-022-17805-9] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 08/01/2022] [Indexed: 11/10/2022] Open
Abstract
Amyotrophic lateral sclerosis (ALS) is a highly complex and heterogeneous neurodegenerative disease that affects motor neurons. Since life expectancy is relatively low, it is essential to promptly understand the course of the disease to better target the patient's treatment. Predictive models for disease progression are thus of great interest. One of the most extensive and well-studied open-access data resources for ALS is the Pooled Resource Open-Access ALS Clinical Trials (PRO-ACT) repository. In 2015, the DREAM-Phil Bowen ALS Prediction Prize4Life Challenge was held on PRO-ACT data, where competitors were asked to develop machine learning algorithms to predict disease progression measured through the slope of the ALSFRS score between 3 and 12 months. However, although it has already been successfully applied in several studies on ALS patients, to the best of our knowledge deep learning approaches still remain unexplored on the ALSFRS slope prediction in PRO-ACT cohort. Here, we investigate how deep learning models perform in predicting ALS progression using the PRO-ACT data. We developed three models based on different architectures that showed comparable or better performance with respect to the state-of-the-art models, thus representing a valid alternative to predict ALS disease progression.
Collapse
Affiliation(s)
- Corrado Pancotti
- Department of Medical Sciences, University of Turin, 10126, Turin, Italy
| | - Giovanni Birolo
- Department of Medical Sciences, University of Turin, 10126, Turin, Italy.
| | - Cesare Rollo
- Department of Medical Sciences, University of Turin, 10126, Turin, Italy
| | - Tiziana Sanavia
- Department of Medical Sciences, University of Turin, 10126, Turin, Italy
| | - Barbara Di Camillo
- Department of Information Engineering, University of Padua, 35131, Padua, Italy
| | - Umberto Manera
- ALS Center, "Rita Levi Montalcini" Department of Neuroscience, University of Turin, 10126, Turin, Italy
| | - Adriano Chiò
- ALS Center, "Rita Levi Montalcini" Department of Neuroscience, University of Turin, 10126, Turin, Italy
| | - Piero Fariselli
- Department of Medical Sciences, University of Turin, 10126, Turin, Italy
| |
Collapse
|
7
|
Faghri F, Brunn F, Dadu A, Zucchi E, Martinelli I, Mazzini L, Vasta R, Canosa A, Moglia C, Calvo A, Nalls MA, Campbell RH, Mandrioli J, Traynor BJ, Chiò A. Identifying and predicting amyotrophic lateral sclerosis clinical subgroups: a population-based machine-learning study. Lancet Digit Health 2022; 4:e359-e369. [PMID: 35341712 PMCID: PMC9038712 DOI: 10.1016/s2589-7500(21)00274-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 10/17/2021] [Accepted: 11/26/2021] [Indexed: 02/07/2023]
Abstract
BACKGROUND Amyotrophic lateral sclerosis (ALS) is known to represent a collection of overlapping syndromes. Various classification systems based on empirical observations have been proposed, but it is unclear to what extent they reflect ALS population substructures. We aimed to use machine-learning techniques to identify the number and nature of ALS subtypes to obtain a better understanding of this heterogeneity, enhance our understanding of the disease, and improve clinical care. METHODS In this retrospective study, we applied unsupervised Uniform Manifold Approximation and Projection [UMAP]) modelling, semi-supervised (neural network UMAP) modelling, and supervised (ensemble learning based on LightGBM) modelling to a population-based discovery cohort of patients who were diagnosed with ALS while living in the Piedmont and Valle d'Aosta regions of Italy, for whom detailed clinical data, such as age at symptom onset, were available. We excluded patients with missing Revised ALS Functional Rating Scale (ALSFRS-R) feature values from the unsupervised and semi-supervised steps. We replicated our findings in an independent population-based cohort of patients who were diagnosed with ALS while living in the Emilia Romagna region of Italy. FINDINGS Between Jan 1, 1995, and Dec 31, 2015, 2858 patients were entered in the discovery cohort. After excluding 497 (17%) patients with missing ALSFRS-R feature values, data for 42 clinical features across 2361 (83%) patients were available for the unsupervised and semi-supervised analysis. We found that semi-supervised machine learning produced the optimum clustering of the patients with ALS. These clusters roughly corresponded to the six clinical subtypes defined by the Chiò classification system (ie, bulbar, respiratory, flail arm, classical, pyramidal, and flail leg ALS). Between Jan 1, 2009, and March 1, 2018, 1097 patients were entered in the replication cohort. After excluding 108 (10%) patients with missing ALSFRS-R feature values, data for 42 clinical features across 989 patients were available for the unsupervised and semi-supervised analysis. All 1097 patients were included in the supervised analysis. The same clusters were identified in the replication cohort. By contrast, other ALS classification schemes, such as the El Escorial categories, Milano-Torino clinical staging, and King's clinical stages, did not adequately label the clusters. Supervised learning identified 11 clinical parameters that predicted ALS clinical subtypes with high accuracy (area under the curve 0·982 [95% CI 0·980-0·983]). INTERPRETATION Our data-driven study provides insight into the ALS population substructure and confirms that the Chiò classification system successfully identifies ALS subtypes. Additional validation is required to determine the accuracy and clinical use of these algorithms in assigning clinical subtypes. Nevertheless, our algorithms offer a broad insight into the clinical heterogeneity of ALS and help to determine the actual subtypes of disease that exist within this fatal neurodegenerative syndrome. The systematic identification of ALS subtypes will improve clinical care and clinical trial design. FUNDING US National Institute on Aging, US National Institutes of Health, Italian Ministry of Health, European Commission, University of Torino Rita Levi Montalcini Department of Neurosciences, Emilia Romagna Regional Health Authority, and Italian Ministry of Education, University, and Research. TRANSLATIONS For the Italian and German translations of the abstract see Supplementary Materials section.
Collapse
Affiliation(s)
- Faraz Faghri
- Neuromuscular Diseases Research Section, Laboratory of Neurogenetics, US National Institute on Aging, Bethesda, MD, USA; Center for Alzheimer's and Related Dementias, US National Institute on Aging, Bethesda, MD, USA; Data Tecnica International, Glen Echo, MD, USA; Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Fabian Brunn
- Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Anant Dadu
- Center for Alzheimer's and Related Dementias, US National Institute on Aging, Bethesda, MD, USA; Data Tecnica International, Glen Echo, MD, USA; Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Elisabetta Zucchi
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy
| | - Ilaria Martinelli
- Neurology Unit, Department of Neurosciences, Azienda Ospedaliero Universitaria di Modena, Modena, Italy
| | - Letizia Mazzini
- ALS Centre, Department of Neurology, Maggiore della Carità University Hospital, Novara, Italy
| | - Rosario Vasta
- Rita Levi Montalcini, Department of Neuroscience, University of Turin, Turin, Italy
| | - Antonio Canosa
- Rita Levi Montalcini, Department of Neuroscience, University of Turin, Turin, Italy
| | - Cristina Moglia
- Rita Levi Montalcini, Department of Neuroscience, University of Turin, Turin, Italy
| | - Andrea Calvo
- Rita Levi Montalcini, Department of Neuroscience, University of Turin, Turin, Italy
| | - Michael A Nalls
- Center for Alzheimer's and Related Dementias, US National Institute on Aging, Bethesda, MD, USA; Data Tecnica International, Glen Echo, MD, USA
| | - Roy H Campbell
- Department of Computer Science, University of Illinois at Urbana-Champaign, Champaign, IL, USA
| | - Jessica Mandrioli
- Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Modena, Italy; Neurology Unit, Department of Neurosciences, Azienda Ospedaliero Universitaria di Modena, Modena, Italy
| | - Bryan J Traynor
- Neuromuscular Diseases Research Section, Laboratory of Neurogenetics, US National Institute on Aging, Bethesda, MD, USA; Department of Neurology, Johns Hopkins University Medical Center, Baltimore, MD, USA; Reta Lila Weston Institute, UCL Queen Square Institute of Neurology, University College London, London, UK.
| | - Adriano Chiò
- Rita Levi Montalcini, Department of Neuroscience, University of Turin, Turin, Italy; Institute of Cognitive Sciences and Technologies, CNR, Rome, Italy; Neurology 1 and ALS Centre, Azienda Ospedaliero Universitaria Città della Salute e della Scienza, Turin, Italy
| |
Collapse
|
8
|
Goutman SA, Hardiman O, Al-Chalabi A, Chió A, Savelieff MG, Kiernan MC, Feldman EL. Recent advances in the diagnosis and prognosis of amyotrophic lateral sclerosis. Lancet Neurol 2022; 21:480-493. [PMID: 35334233 PMCID: PMC9513753 DOI: 10.1016/s1474-4422(21)00465-8] [Citation(s) in RCA: 145] [Impact Index Per Article: 72.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 11/24/2021] [Accepted: 12/16/2021] [Indexed: 12/14/2022]
Abstract
The diagnosis of amyotrophic lateral sclerosis can be challenging due to its heterogeneity in clinical presentation and overlap with other neurological disorders. Diagnosis early in the disease course can improve outcomes as timely interventions can slow disease progression. An evolving awareness of disease genotypes and phenotypes and new diagnostic criteria, such as the recent Gold Coast criteria, could expedite diagnosis. Improved prognosis, such as that achieved with the survival model from the European Network for the Cure of ALS, could inform the patient and their family about disease course and improve end-of-life planning. Novel staging and scoring systems can help monitor disease progression and might potentially serve as clinical trial outcomes. Lastly, new tools, such as fluid biomarkers, imaging modalities, and neuromuscular electrophysiological measurements, might increase diagnostic and prognostic accuracy.
Collapse
Affiliation(s)
| | - Orla Hardiman
- Academic Unit of Neurology, Trinity Biomedical Sciences Institute, Trinity College Dublin, Dublin, Ireland
| | - Ammar Al-Chalabi
- Department of Basic and Clinical Neuroscience, Maurice Wohl Clinical Neuroscience Institute, and Department of Neurology, King's College London, London, UK
| | - Adriano Chió
- Rita Levi Montalcini Department of Neurosciences, University of Turin, Turin, Italy
| | | | - Matthew C Kiernan
- Brain and Mind Centre, University of Sydney, Sydney, NSW, Australia; Department of Neurology, Royal Prince Alfred Hospital, Sydney, NSW, Australia
| | - Eva L Feldman
- Department of Neurology, University of Michigan, Ann Arbor, MI, USA.
| |
Collapse
|
9
|
Papaiz F, Dourado MET, Valentim RADM, de Morais AHF, Arrais JP. Machine Learning Solutions Applied to Amyotrophic Lateral Sclerosis Prognosis: A Review. FRONTIERS IN COMPUTER SCIENCE 2022. [DOI: 10.3389/fcomp.2022.869140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
The prognosis of Amyotrophic Lateral Sclerosis (ALS), a complex and rare disease, represents a challenging and essential task to better comprehend its progression and improve patients' quality of life. The use of Machine Learning (ML) techniques in healthcare has produced valuable contributions to the prognosis field. This article presents a systematic and critical review of primary studies that used ML applied to the ALS prognosis, searching for databases, relevant predictor biomarkers, the ML algorithms and techniques, and their outcomes. We focused on studies that analyzed biomarkers commonly present in the ALS disease clinical practice, such as demographic, clinical, laboratory, and imaging data. Hence, we investigate studies to provide an overview of solutions that can be applied to develop decision support systems and be used by a higher number of ALS clinical settings. The studies were retrieved from PubMed, Science Direct, IEEEXplore, and Web of Science databases. After completing the searching and screening process, 10 articles were selected to be analyzed and summarized. The studies evaluated and used different ML algorithms, techniques, datasets, sample sizes, biomarkers, and performance metrics. Based on the results, three distinct types of prediction were identified: Disease Progression, Survival Time, and Need for Support. The biomarkers identified as relevant in more than one study were the ALSFRS/ALSFRS-R, disease duration, Forced Vital Capacity, Body Mass Index, age at onset, and Creatinine. In general, the studies presented promissory results that can be applied in developing decision support systems. Besides, we discussed the open challenges, the limitations identified, and future research opportunities.
Collapse
|
10
|
Zhang R, Zhang Y, Liu Y, Guo Y, Shen Y, Deng D, Qiu YJ, Dinov ID. Kimesurface Representation and Tensor Linear Modeling of Longitudinal Data. Neural Comput Appl 2022; 34:6377-6396. [PMID: 35936508 PMCID: PMC9355340 DOI: 10.1007/s00521-021-06789-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2021] [Accepted: 11/21/2021] [Indexed: 11/25/2022]
Abstract
Many modern techniques for analyzing time-varying longitudinal data rely on parametric models to interrogate the time-courses of univariate or multivariate processes. Typical analytic objectives include utilizing retrospective observations to model current trends, predict prospective trajectories, derive categorical traits, or characterize various relations. Among the many mathematical, statistical, and computational strategies for analyzing longitudinal data, tensor-based linear modeling offers a unique algebraic approach that encodes different characterizations of the observed measurements in terms of state indices. This paper introduces a new method of representing, modeling, and analyzing repeated-measurement longitudinal data using a generalization of event order from the positive reals to the complex plane. Using complex time (kime), we transform classical time-varying signals as 2D manifolds called kimesurfaces. This kime characterization extends the classical protocols for analyzing time-series data and offers unique opportunities to design novel inference, prediction, classification, and regression techniques based on the corresponding kimesurface manifolds. We define complex time and illustrate alternative time-series to kimesurface transformations. Using the Laplace transform and its inverse, we demonstrate the bijective mapping between time-series and kimesurfaces. A proposed general tensor regression based linear model is validated using functional Magnetic Resonance Imaging (fMRI) data. This kimesurface representation method can be used with a wide range of machine learning algorithms, artificial intelligence tools, analytical approaches, and inferential techniques to interrogate multivariate, complex-domain, and complex-range longitudinal processes.
Collapse
Affiliation(s)
- Rongqian Zhang
- Department of Statistics, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Yupeng Zhang
- Department of Mathematics, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Yuyao Liu
- Department of Statistics, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Yunjie Guo
- Electrical Computer Engineering Division, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Yueyang Shen
- Electrical Computer Engineering Division, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Daxuan Deng
- Electrical Computer Engineering Division, University of Michigan, Ann Arbor, MI 48109, USA
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
| | - Yongkai Joshua Qiu
- Department of Mathematics, University of Michigan, Ann Arbor, MI 48109, USA
| | - Ivo D. Dinov
- Statistics Online Computational Resource, Department of Health Behavior and Biological Sciences, University of Michigan, Ann Arbor, MI 48109, USA
- Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI 48109, USA
| |
Collapse
|
11
|
Tavazzi E, Daberdaku S, Zandonà A, Vasta R, Nefussy B, Lunetta C, Mora G, Mandrioli J, Grisan E, Tarlarini C, Calvo A, Moglia C, Drory V, Gotkine M, Chiò A, Di Camillo B. Predicting functional impairment trajectories in amyotrophic lateral sclerosis: a probabilistic, multifactorial model of disease progression. J Neurol 2022; 269:3858-3878. [PMID: 35266043 PMCID: PMC9217910 DOI: 10.1007/s00415-022-11022-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 02/09/2022] [Accepted: 02/09/2022] [Indexed: 12/02/2022]
Abstract
Objective To employ Artificial Intelligence to model, predict and simulate the amyotrophic lateral sclerosis (ALS) progression over time in terms of variable interactions, functional impairments, and survival. Methods We employed demographic and clinical variables, including functional scores and the utilisation of support interventions, of 3940 ALS patients from four Italian and two Israeli registers to develop a new approach based on Dynamic Bayesian Networks (DBNs) that models the ALS evolution over time, in two distinct scenarios of variable availability. The method allows to simulate patients’ disease trajectories and predict the probability of functional impairment and survival at different time points. Results DBNs explicitly represent the relationships between the variables and the pathways along which they influence the disease progression. Several notable inter-dependencies were identified and validated by comparison with literature. Moreover, the implemented tool allows the assessment of the effect of different markers on the disease course, reproducing the probabilistically expected clinical progressions. The tool shows high concordance in terms of predicted and real prognosis, assessed as time to functional impairments and survival (integral of the AU-ROC in the first 36 months between 0.80–0.93 and 0.84–0.89 for the two scenarios, respectively). Conclusions Provided only with measurements commonly collected during the first visit, our models can predict time to the loss of independence in walking, breathing, swallowing, communicating, and survival and it can be used to generate in silico patient cohorts with specific characteristics. Our tool provides a comprehensive framework to support physicians in treatment planning and clinical decision-making. Supplementary Information The online version contains supplementary material available at 10.1007/s00415-022-11022-0.
Collapse
Affiliation(s)
- Erica Tavazzi
- Department of Information Engineering, University of Padova, Padua, Italy
| | | | - Alessandro Zandonà
- Department of Information Engineering, University of Padova, Padua, Italy
| | - Rosario Vasta
- Department of Neuroscience, University of Torino, "Rita Levi Montalcini", Turin, Italy
| | | | | | - Gabriele Mora
- Istituti Clinici Scientifici Maugeri IRCCS, Milan, Italy
| | | | - Enrico Grisan
- Department of Information Engineering, University of Padova, Padua, Italy
- School of Engineering, London South Bank University, London, UK
| | | | - Andrea Calvo
- Department of Neuroscience, University of Torino, "Rita Levi Montalcini", Turin, Italy
| | - Cristina Moglia
- Department of Neuroscience, University of Torino, "Rita Levi Montalcini", Turin, Italy
| | - Vivian Drory
- Tel Aviv Sourasky Medical Center, Tel Aviv, Israel
| | - Marc Gotkine
- Hadassah University Hospital Medical Center, Jerusalem, Israel
| | - Adriano Chiò
- Department of Neuroscience, University of Torino, "Rita Levi Montalcini", Turin, Italy
| | - Barbara Di Camillo
- Department of Information Engineering, University of Padova, Padua, Italy.
- Department of Comparative Biomedicine and Food Science, University of Padova, Via Gradenigo 6/B, 35131, Padua, Italy.
| |
Collapse
|
12
|
Solovyev R, Kalinin AA, Gabruseva T. 3D convolutional neural networks for stalled brain capillary detection. Comput Biol Med 2021; 141:105089. [PMID: 34920160 DOI: 10.1016/j.compbiomed.2021.105089] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2021] [Revised: 11/26/2021] [Accepted: 11/26/2021] [Indexed: 01/08/2023]
Abstract
Adequate blood supply is critical for normal brain function. Brain vasculature dysfunctions, including stalled blood flow in cerebral capillaries, are associated with cognitive decline and pathogenesis in Alzheimer's disease. Recent advances in imaging technology enabled generation of high-quality 3D images that can be used to visualize stalled blood vessels. However, localization of stalled vessels in 3D images is often required as the first step for downstream analysis. When performed manually, this process is tedious, time-consuming, and error-prone. Here, we describe a deep learning-based approach for automatic detection of stalled capillaries in brain images based on 3D convolutional neural networks. Our approach includes custom 3D data augmentations and a weights transfer method that re-uses weights from 2D models pre-trained on natural images for initialization of 3D networks. We used an ensemble of several 3D models to produce the winning submission to the "Clog Loss: Advance Alzheimer's Research with Stall Catchers" machine learning competition that challenged the participants with classifying blood vessels in 3D image stacks as stalled or flowing. In this setting, our approach outperformed other methods and demonstrated state-of-the-art results, achieving 85% Matthews correlation coefficient, 85% sensitivity, and 99.3% specificity. The source code for our solution is publicly available.
Collapse
Affiliation(s)
- Roman Solovyev
- Institute for Design Problems in Microelectronics of Russian Academy of Sciences, 3, Sovetskaya Street, Moscow, 124 365, Russian Federation.
| | - Alexandr A Kalinin
- Shenzhen Research Institute of Big Data, Shenzhen, 518 172, Guangdong, China; Department of Computational Medicine and Bioinformatics, University of Michigan, Ann Arbor, MI 48 109, USA
| | | |
Collapse
|
13
|
Anderson C, Bekele Z, Qiu Y, Tschannen D, Dinov ID. Modeling and prediction of pressure injury in hospitalized patients using artificial intelligence. BMC Med Inform Decis Mak 2021; 21:253. [PMID: 34461876 PMCID: PMC8406893 DOI: 10.1186/s12911-021-01608-5] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Accepted: 08/08/2021] [Indexed: 02/03/2023] Open
Abstract
BACKGROUND Hospital-acquired pressure injuries (PIs) induce significant patient suffering, inflate healthcare costs, and increase clinical co-morbidities. PIs are mostly due to bed-immobility, sensory impairment, bed positioning, and length of hospital stay. In this study, we use electronic health records and administrative data to examine the contributing factors to PI development using artificial intelligence (AI). METHODS We used advanced data science techniques to first preprocess the data and then train machine learning classifiers to predict the probability of developing PIs. The AI training was based on large, incongruent, incomplete, heterogeneous, and time-varying data of hospitalized patients. Both model-based statistical methods and model-free AI strategies were used to forecast PI outcomes and determine the salient features that are highly predictive of the outcomes. RESULTS Our findings reveal that PI prediction by model-free techniques outperform model-based forecasts. The performance of all AI methods is improved by rebalancing the training data and by including the Braden in the model learning phase. Compared to neural networks and linear modeling, with and without rebalancing or using Braden scores, Random forest consistently generated the optimal PI forecasts. CONCLUSIONS AI techniques show promise to automatically identify patients at risk for hospital acquired PIs in different surgical services. Our PI prediction model provide a first generation of AI guidance to prescreen patients at risk for developing PIs. CLINICAL IMPACT This study provides a foundation for designing, implementing, and assessing novel interventions addressing specific healthcare needs. Specifically, this approach allows examining the impact of various dynamic, personalized, and clinical-environment effects on PI prevention for hospital patients receiving care from various surgical services.
Collapse
Affiliation(s)
- Christine Anderson
- grid.214458.e0000000086837370School of Nursing, University of Michigan, Ann Arbor, MI 48109 USA
| | - Zerihun Bekele
- grid.214458.e0000000086837370Statistics Online Computational Resource (SOCR), University of Michigan, Ann Arbor, MI 48109 USA
| | - Yongkai Qiu
- grid.131063.60000 0001 2168 0066Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, Notre Dame, IN 46556 USA
| | - Dana Tschannen
- grid.214458.e0000000086837370School of Nursing, University of Michigan, Ann Arbor, MI 48109 USA
| | - Ivo D. Dinov
- grid.214458.e0000000086837370School of Nursing, University of Michigan, Ann Arbor, MI 48109 USA ,grid.214458.e0000000086837370Statistics Online Computational Resource (SOCR), University of Michigan, Ann Arbor, MI 48109 USA ,grid.214458.e0000000086837370Department of Health Behavior and Biological Sciences (HBBS), School of Nursing, University of Michigan, Ann Arbor, MI 48109 USA ,grid.214458.e0000000086837370Michigan Institute for Data Science (MIDAS), University of Michigan, Ann Arbor, MI 48109 USA
| |
Collapse
|
14
|
Noshad M, Choi J, Sun Y, Hero A, Dinov ID. A data value metric for quantifying information content and utility. JOURNAL OF BIG DATA 2021; 8:82. [PMID: 34777945 PMCID: PMC8550565 DOI: 10.1186/s40537-021-00446-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 03/27/2021] [Indexed: 06/13/2023]
Abstract
Data-driven innovation is propelled by recent scientific advances, rapid technological progress, substantial reductions of manufacturing costs, and significant demands for effective decision support systems. This has led to efforts to collect massive amounts of heterogeneous and multisource data, however, not all data is of equal quality or equally informative. Previous methods to capture and quantify the utility of data include value of information (VoI), quality of information (QoI), and mutual information (MI). This manuscript introduces a new measure to quantify whether larger volumes of increasingly more complex data enhance, degrade, or alter their information content and utility with respect to specific tasks. We present a new information-theoretic measure, called Data Value Metric (DVM), that quantifies the useful information content (energy) of large and heterogeneous datasets. The DVM formulation is based on a regularized model balancing data analytical value (utility) and model complexity. DVM can be used to determine if appending, expanding, or augmenting a dataset may be beneficial in specific application domains. Subject to the choices of data analytic, inferential, or forecasting techniques employed to interrogate the data, DVM quantifies the information boost, or degradation, associated with increasing the data size or expanding the richness of its features. DVM is defined as a mixture of a fidelity and a regularization terms. The fidelity captures the usefulness of the sample data specifically in the context of the inferential task. The regularization term represents the computational complexity of the corresponding inferential method. Inspired by the concept of information bottleneck in deep learning, the fidelity term depends on the performance of the corresponding supervised or unsupervised model. We tested the DVM method for several alternative supervised and unsupervised regression, classification, clustering, and dimensionality reduction tasks. Both real and simulated datasets with weak and strong signal information are used in the experimental validation. Our findings suggest that DVM captures effectively the balance between analytical-value and algorithmic-complexity. Changes in the DVM expose the tradeoffs between algorithmic complexity and data analytical value in terms of the sample-size and the feature-richness of a dataset. DVM values may be used to determine the size and characteristics of the data to optimize the relative utility of various supervised or unsupervised algorithms.
Collapse
Affiliation(s)
- Morteza Noshad
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109 USA
- Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA 94305 USA
| | - Jerome Choi
- Statistics Online Computational Resource, University of Michigan, Ann Arbor, MI 48109 USA
- Department of Statistics, University of Michigan, Ann Arbor, MI 48109 USA
| | - Yuming Sun
- Statistics Online Computational Resource, University of Michigan, Ann Arbor, MI 48109 USA
- Department of Biostatistics, University of Michigan, Ann Arbor, MI 48109 USA
| | - Alfred Hero
- Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, MI 48109 USA
- Department of Statistics, University of Michigan, Ann Arbor, MI 48109 USA
- Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI 48109 USA
| | - Ivo D. Dinov
- Statistics Online Computational Resource, University of Michigan, Ann Arbor, MI 48109 USA
- Michigan Institute for Data Science, University of Michigan, Ann Arbor, MI 48109 USA
| |
Collapse
|
15
|
Greco A, Chiesa MR, Da Prato I, Romanelli AM, Dolciotti C, Cavallini G, Masciandaro SM, Scilingo EP, Del Carratore R, Bongioanni P. Using blood data for the differential diagnosis and prognosis of motor neuron diseases: a new dataset for machine learning applications. Sci Rep 2021; 11:3371. [PMID: 33564045 PMCID: PMC7873306 DOI: 10.1038/s41598-021-82940-8] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Accepted: 01/20/2021] [Indexed: 12/16/2022] Open
Abstract
Early differential diagnosis of several motor neuron diseases (MNDs) is extremely challenging due to the high number of overlapped symptoms. The routine clinical practice is based on clinical history and examination, usually accompanied by electrophysiological tests. However, although previous studies have demonstrated the involvement of altered metabolic pathways, biomarker-based monitoring tools are still far from being applied. In this study, we aim at characterizing and discriminating patients with involvement of both upper and lower motor neurons (i.e., amyotrophic lateral sclerosis (ALS) patients) from those with selective involvement of the lower motor neuron (LMND), by using blood data exclusively. To this end, in the last ten years, we built a database including 692 blood data and related clinical observations from 55 ALS and LMND patients. Each blood sample was described by 108 analytes. Starting from this outstanding number of features, we performed a characterization of the two groups of patients through statistical and classification analyses of blood data. Specifically, we implemented a support vector machine with recursive feature elimination (SVM-RFE) to automatically diagnose each patient into the ALS or LMND groups and to recognize whether they had a fast or slow disease progression. The classification strategy through the RFE algorithm also allowed us to reveal the most informative subset of blood analytes including novel potential biomarkers of MNDs. Our results show that we successfully devised subject-independent classifiers for the differential diagnosis and prognosis of ALS and LMND with remarkable average accuracy (up to 94%), using blood data exclusively.
Collapse
Affiliation(s)
- Alberto Greco
- Department of Information Engineering, Faculty of Engineering, University of Pisa, Pisa, Italy.
| | | | - Ilaria Da Prato
- Institute of Clinical Physiology Research, CNR-Pisa, Pisa, Italy.,NeuroCare onlus, Pisa, Italy
| | | | | | | | | | - Enzo Pasquale Scilingo
- Department of Information Engineering, Faculty of Engineering, University of Pisa, Pisa, Italy
| | | | - Paolo Bongioanni
- Severe Acquired Brain Injuries Dpt Section, Azienda Ospedaliero-Universitaria, Pisa, Italy.,NeuroCare onlus, Pisa, Italy
| |
Collapse
|
16
|
Manifold learning for amyotrophic lateral sclerosis functional loss assessment : Development and validation of a prognosis model. J Neurol 2020; 268:825-850. [PMID: 32886252 DOI: 10.1007/s00415-020-10181-2] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 08/05/2020] [Accepted: 08/06/2020] [Indexed: 12/11/2022]
Abstract
Amyotrophic lateral sclerosis (ALS) is an inexorably progressive neurodegenerative condition with no effective disease-modifying therapy at present. Given the striking clinical heterogeneity of the condition, the development and validation of reliable prognostic models is a recognised research priority. We present a prognostic model for functional decline in ALS where outcome uncertainty is taken into account. Patient data were reduced and projected onto a 2D space using Uniform Manifold Approximation and Projection (UMAP), a novel non-linear dimension reduction technique. Information from 3756 patients was included. Development data were sourced from past clinical trials. Real-world population data were used as validation data. Predictors included age, gender, region of onset, symptom duration, weight at baseline, functional impairment, and estimated rate of functional loss. UMAP projection of patients showed an informative 2D data distribution. As limited data availability precluded complex model designs, the projection was divided into three zones defined by a functional impairment range probability. Zone membership allowed individual patient prediction. Patients belonging to the first zone had a probability of [Formula: see text] (± [Formula: see text]) to have an ALSFRS score over 20 at 1-year follow-up. Patients within the second zone had a probability of [Formula: see text] (± [Formula: see text]) to have an ALSFRS score between 10 and 30 at 1 year follow-up. Finally, patients within the third zone had a probability of [Formula: see text] (± [Formula: see text]) to have an ALSFRS score lower than 20 at 1 year follow-up. This approach requires a limited set of features, is easily updated, improves with additional patient data, and accounts for results uncertainty. This method could therefore be used in a clinical setting for patient stratification and outcome projection.
Collapse
|
17
|
Grollemund V, Chat GL, Secchi-Buhour MS, Delbot F, Pradat-Peyre JF, Bede P, Pradat PF. Development and validation of a 1-year survival prognosis estimation model for Amyotrophic Lateral Sclerosis using manifold learning algorithm UMAP. Sci Rep 2020; 10:13378. [PMID: 32770027 PMCID: PMC7414917 DOI: 10.1038/s41598-020-70125-8] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 07/23/2020] [Indexed: 02/08/2023] Open
Abstract
Amyotrophic Lateral Sclerosis (ALS) is an inexorably progressive neurodegenerative condition with no effective disease modifying therapies. The development and validation of reliable prognostic models is a recognised research priority. We present a prognostic model for survival in ALS where result uncertainty is taken into account. Patient data were reduced and projected onto a 2D space using Uniform Manifold Approximation and Projection (UMAP), a novel non-linear dimension reduction technique. Information from 5,220 patients was included as development data originating from past clinical trials, and real-world population data as validation data. Predictors included age, gender, region of onset, symptom duration, weight at baseline, functional impairment, and estimated rate of functional loss. UMAP projection of patients shows an informative 2D data distribution. As limited data availability precluded complex model designs, the projection was divided into three zones with relevant survival rates. These rates were defined using confidence bounds: high, intermediate, and low 1-year survival rates at respectively [Formula: see text] ([Formula: see text]), [Formula: see text] ([Formula: see text]) and [Formula: see text] ([Formula: see text]). Predicted 1-year survival was estimated using zone membership. This approach requires a limited set of features, is easily updated, improves with additional patient data, and accounts for results uncertainty.
Collapse
Affiliation(s)
- Vincent Grollemund
- Laboratoire d'Informatique de Paris 6, Sorbonne Université, Paris, 75005, France.
- FRS Consulting, Paris, 75009, France.
| | | | | | - François Delbot
- Laboratoire d'Informatique de Paris 6, Sorbonne Université, Paris, 75005, France
- Nanterre Université, Modal'X, Nanterre, 92014, France
| | - Jean-François Pradat-Peyre
- Laboratoire d'Informatique de Paris 6, Sorbonne Université, Paris, 75005, France
- Nanterre Université, Modal'X, Nanterre, 92014, France
| | - Peter Bede
- Laboratoire d'Imagerie Biomédicale, Sorbonne Université, Paris, 75005, France
- Département de Neurologie, Pitié-Salpêtrière University Hospital, APHP, Paris, 75013, France
- Computational Neuroimaging Group, Trinity College, Dublin, D02 PN40, Ireland
| | - Pierre-François Pradat
- Laboratoire d'Imagerie Biomédicale, Sorbonne Université, Paris, 75005, France
- Département de Neurologie, Pitié-Salpêtrière University Hospital, APHP, Paris, 75013, France
- Antnagelvin Hospital, Northern Ireland Center for Stratified Medecine, Biomedical Sciences Research Institute Ulster University, C-TRIC, Londonderry, BT47 6SB, United Kingdom
| |
Collapse
|
18
|
Boxer AL, Gold M, Feldman H, Boeve BF, Dickinson SLJ, Fillit H, Ho C, Paul R, Pearlman R, Sutherland M, Verma A, Arneric SP, Alexander BM, Dickerson BC, Dorsey ER, Grossman M, Huey ED, Irizarry MC, Marks WJ, Masellis M, McFarland F, Niehoff D, Onyike CU, Paganoni S, Panzara MA, Rockwood K, Rohrer JD, Rosen H, Schuck RN, Soares HD, Tatton N. New directions in clinical trials for frontotemporal lobar degeneration: Methods and outcome measures. Alzheimers Dement 2020; 16:131-143. [PMID: 31668596 PMCID: PMC6949386 DOI: 10.1016/j.jalz.2019.06.4956] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
INTRODUCTION Frontotemporal lobar degeneration (FTLD) is the most common form of dementia for those under 60 years of age. Increasing numbers of therapeutics targeting FTLD syndromes are being developed. METHODS In March 2018, the Association for Frontotemporal Degeneration convened the Frontotemporal Degeneration Study Group meeting in Washington, DC, to discuss advances in the clinical science of FTLD. RESULTS Challenges exist for conducting clinical trials in FTLD. Two of the greatest challenges are (1) the heterogeneity of FTLD syndromes leading to difficulties in efficiently measuring treatment effects and (2) the rarity of FTLD disorders leading to recruitment challenges. DISCUSSION New personalized endpoints that are clinically meaningful to individuals and their families should be developed. Personalized approaches to analyzing MRI data, development of new fluid biomarkers and wearable technologies will help to improve the power to detect treatment effects in FTLD clinical trials and enable new, clinical trial designs, possibly leveraged from the experience of oncology trials. A computational visualization and analysis platform that can support novel analyses of combined clinical, genetic, imaging, biomarker data with other novel modalities will be critical to the success of these endeavors.
Collapse
Affiliation(s)
- Adam L. Boxer
- Memory and Aging Center, Department of Neurology, University of California San Francisco, San Francisco, CA
| | | | - Howard Feldman
- Department of Neurosciences, University of California San Diego, San Diego, CA
| | | | | | | | - Carole Ho
- Denali Therapeutics, San Francisco, CA
| | | | | | | | | | | | | | | | - Earl Ray Dorsey
- Center for Health and Technology, University of Rochester, Rochester, NY
| | - Murray Grossman
- Department of Neurology, University of Pennsylvania, Philadelphia, PA
| | - Edward D. Huey
- Departments of Psychiatry and Neurology, Columbia University, NY
| | | | - William J. Marks
- Clinical Neurology, Verily Life Sciences, South San Francisco, CA
| | - Mario Masellis
- Hurvitz Brain Sciences Research Program, Sunnybrook Research Institute, University of Toronto, ON, Canada; Department of Medicine (Neurology), Sunnybrook Health Sciences Centre, University of Toronto, ON, Canada
| | | | - Debra Niehoff
- Association for Frontotemporal Degeneration, Radnor, PA
| | - Chiadi U. Onyike
- Department Geriatric Psychiatry and Neuropsychiatry, Johns Hopkins University, Baltimore, MD
| | - Sabrina Paganoni
- Healey Center for ALS, Massachusetts General Hospital, Boston, MA
| | | | - Kenneth Rockwood
- Division of Geriatric Medicine, Dalhousie University, Halifax, NS
| | - Jonathan D. Rohrer
- Dementia Research Centre, UCL Institute of Neurology, Queen Square, London, UK
| | - Howard Rosen
- Memory and Aging Center, Department of Neurology, University of California San Francisco, San Francisco, CA
| | - Robert N. Schuck
- Office of Clinical Pharmacology, Center for Drug Evaluation and Research, FDA, Silver Spring, MD
| | | | - Nadine Tatton
- Association for Frontotemporal Degeneration, Radnor, PA
| |
Collapse
|
19
|
Goutman SA, Brown MB, Cudkowicz M, Atassi N, Feldman EL. ALS/SURV: a modification of the CAFS statistic. Amyotroph Lateral Scler Frontotemporal Degener 2019; 20:576-583. [PMID: 31334681 PMCID: PMC6768708 DOI: 10.1080/21678421.2019.1643375] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2018] [Revised: 07/02/2019] [Accepted: 07/07/2019] [Indexed: 12/12/2022]
Abstract
We present a composite endpoint that can be used in amyotrophic lateral sclerosis (ALS) trials, which combines functional status (via the ALS functional rating scale) and survival, denoted ALS/SURV. ALS/SURV modifies and extends the combined assessment of function and survival (CAFS) score and assigns rankings to participants that withdraw or are lost to follow up in a way that does not disproportionately lower and skew ranks for those participants that reach study endpoint (either death or study completion). ALS/SURV has properties of: (1) ordering participants that completed the study from the shortest surviving participant to the last observed death followed by worst function to best function; (2) ordering participants withdrawing at time of withdrawal by their decline in functional status relative to all the participants still in the study; and (3) then maintaining this ordering at time of withdrawal relative to participants still in the study. These properties allow ALS/SURV to better account for participant drop out compared to CAFS. We derive and compare the rankings of participants from the ceftriaxone treatment trial for ALS/SURV and CAFS and demonstrate that ALS/SURV does not modify the ordering of participants that complete a study by the results of participants who withdraw. Additionally, ALS/SURV can be summarized as either median functional status or median survival along with interquartile range, thereby adding clinical meaning to the statistic. Finally, by applying normal deviates, confidence intervals can be computed and used to estimate power for future studies. In summary, the above properties support the role for ALS/SURV as a new ALS composite statistic.
Collapse
Affiliation(s)
- Stephen A Goutman
- Department of Neurology, University of Michigan , Ann Arbor , MI , USA
- Program for Neurology Research and Discovery, University of Michigan , Ann Arbor , MI , USA
| | - Morton B Brown
- Department of Biostatistics, University of Michigan , Ann Arbor , MI , USA and
| | - Merit Cudkowicz
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School , Boston , MA , USA
| | - Nazem Atassi
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School , Boston , MA , USA
| | - Eva L Feldman
- Department of Neurology, University of Michigan , Ann Arbor , MI , USA
- Program for Neurology Research and Discovery, University of Michigan , Ann Arbor , MI , USA
| |
Collapse
|
20
|
Telmoudi AJ, Soltani M, Ben Belgacem Y, Chaari A. Modeling and state of health estimation of nickel–metal hydride battery using an EPSO-based fuzzy c-regression model. Soft comput 2019. [DOI: 10.1007/s00500-019-04343-2] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|