1
|
Wang Y, Liu S, Spiteri AG, Huynh ALH, Chu C, Masters CL, Goudey B, Pan Y, Jin L. Understanding machine learning applications in dementia research and clinical practice: a review for biomedical scientists and clinicians. Alzheimers Res Ther 2024; 16:175. [PMID: 39085973 PMCID: PMC11293066 DOI: 10.1186/s13195-024-01540-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 07/21/2024] [Indexed: 08/02/2024]
Abstract
Several (inter)national longitudinal dementia observational datasets encompassing demographic information, neuroimaging, biomarkers, neuropsychological evaluations, and muti-omics data, have ushered in a new era of potential for integrating machine learning (ML) into dementia research and clinical practice. ML, with its proficiency in handling multi-modal and high-dimensional data, has emerged as an innovative technique to facilitate early diagnosis, differential diagnosis, and to predict onset and progression of mild cognitive impairment and dementia. In this review, we evaluate current and potential applications of ML, including its history in dementia research, how it compares to traditional statistics, the types of datasets it uses and the general workflow. Moreover, we identify the technical barriers and challenges of ML implementations in clinical practice. Overall, this review provides a comprehensive understanding of ML with non-technical explanations for broader accessibility to biomedical scientists and clinicians.
Collapse
Affiliation(s)
- Yihan Wang
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia
| | - Shu Liu
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia
- The ARC Training Centre in Cognitive Computing for Medical Technologies, The University of Melbourne, Carlton, VIC, 3010, Australia
| | - Alanna G Spiteri
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
| | - Andrew Liem Hieu Huynh
- Department of Aged Care, Austin Health, Heidelberg, VIC, 3084, Australia
- Department of Medicine, Austin Health, University of Melbourne, Heidelberg, VIC, 3084, Australia
| | - Chenyin Chu
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia
| | - Colin L Masters
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
| | - Benjamin Goudey
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia
- The ARC Training Centre in Cognitive Computing for Medical Technologies, The University of Melbourne, Carlton, VIC, 3010, Australia
| | - Yijun Pan
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia.
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia.
| | - Liang Jin
- The Florey Institute of Neuroscience and Mental Health, 30 Royal Parade, Parkville, VIC, 3052, Australia
- Florey Department of Neuroscience and Mental Health, The University of Melbourne, 30 Royal Parade, Parkville, VIC, 3052, Australia
| |
Collapse
|
2
|
Jiang S, Colditz GA. Modeling correlated pairs of mammogram images. Stat Med 2024; 43:1660-1668. [PMID: 38351511 DOI: 10.1002/sim.10002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2022] [Revised: 10/30/2023] [Accepted: 12/10/2023] [Indexed: 03/16/2024]
Abstract
Mammography remains the primary screening strategy for breast cancer, which continues to be the most prevalent cancer diagnosis among women globally. Because screening mammograms capture both the left and right breast, there is a nonnegligible correlation between the pair of images. Previous studies have explored the concept of averaging between the pair of images after proper image registration; however, no comparison has been made in directly utilizing the paired images. In this paper, we extend the bivariate functional principal component analysis over triangulations to jointly characterize the pair of imaging data bounded in an irregular domain and then nest the extracted features within the survival model to predict the onset of breast cancer. The method is applied to our motivating data from the Joanne Knight Breast Health Cohort at Siteman Cancer Center. Our findings indicate that there was no statistically significant difference in model discrimination performance between averaging the pair of images and jointly modeling the two images. Although the breast cancer study did not reveal any significant difference, it is worth noting that the methods proposed here can be readily extended to other studies involving paired or multivariate imaging data.
Collapse
Affiliation(s)
- Shu Jiang
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, Missouri, USA
| | - Graham A Colditz
- Division of Public Health Sciences, Washington University School of Medicine, St. Louis, Missouri, USA
| |
Collapse
|
3
|
Gomon D, Putter H, Fiocco M, Signorelli M. Dynamic prediction of survival using multivariate functional principal component analysis: A strict landmarking approach. Stat Methods Med Res 2024; 33:256-272. [PMID: 38196243 DOI: 10.1177/09622802231224631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2024]
Abstract
Dynamically predicting patient survival probabilities using longitudinal measurements has become of great importance with routine data collection becoming more common. Many existing models utilize a multi-step landmarking approach for this problem, mostly due to its ease of use and versatility but unfortunately most fail to do so appropriately. In this article we make use of multivariate functional principal component analysis to summarize the available longitudinal information, and employ a Cox proportional hazards model for prediction. Additionally, we consider a centred functional principal component analysis procedure in an attempt to remove the natural variation incurred by the difference in age of the considered subjects. We formalize the difference between a 'relaxed' landmarking approach where only validation data is landmarked and a 'strict' landmarking approach where both the training and validation data are landmarked. We show that a relaxed landmarking approach fails to effectively use the information contained in the longitudinal outcomes, thereby producing substantially worse prediction accuracy than a strict landmarking approach.
Collapse
Affiliation(s)
- Daniel Gomon
- Mathematical Institute, Leiden University, Leiden, the Netherlands
| | - Hein Putter
- Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, the Netherlands
| | - Marta Fiocco
- Mathematical Institute, Leiden University, Leiden, the Netherlands
- Department of Biomedical Data Sciences, Leiden University Medical Centre, Leiden, the Netherlands
| | - Mirko Signorelli
- Mathematical Institute, Leiden University, Leiden, the Netherlands
| |
Collapse
|
4
|
Jiang S, Colditz GA. Association of Breast Density With Risk of Breast Cancer-Reply. JAMA Oncol 2023; 9:1734. [PMID: 37796487 DOI: 10.1001/jamaoncol.2023.4249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/06/2023]
Affiliation(s)
- Shu Jiang
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine in St Louis, St Louis, Missouri
| | - Graham A Colditz
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine in St Louis, St Louis, Missouri
| |
Collapse
|
5
|
Devaux A, Helmer C, Genuer R, Proust-Lima C. Random survival forests with multivariate longitudinal endogenous covariates. Stat Methods Med Res 2023; 32:2331-2346. [PMID: 37886845 DOI: 10.1177/09622802231206477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2023]
Abstract
Predicting the individual risk of clinical events using the complete patient history is a major challenge in personalized medicine. Analytical methods have to account for a possibly large number of time-dependent predictors, which are often characterized by irregular and error-prone measurements, and are truncated early by the event. In this work, we extended the competing-risk random survival forests to handle such endogenous longitudinal predictors when predicting event probabilities. The method, implemented in the R package DynForest, internally transforms the time-dependent predictors at each node of each tree into time-fixed features (using mixed models) that can then be used as splitting candidates. The final individual event probability is computed as the average of leaf-specific Aalen-Johansen estimators over the trees. Using simulations, we compared the performances of DynForest to accurately predict an event with (i) a joint modeling alternative when considering two longitudinal predictors only, and with (ii) a regression calibration method that ignores the informative truncation by the event when dealing with a large number of longitudinal predictors. Through an application in dementia research, we also illustrated how DynForest can be used to develop a dynamic prediction tool for dementia from multimodal repeated markers, and quantify the importance of each marker.
Collapse
Affiliation(s)
- Anthony Devaux
- Univ. Bordeaux, INSERM, BPH, U1219, Bordeaux, France
- The George Institute for Global Health, UNSW Sydney, Australia
- School of Population Health, UNSW Sydney, Australia
| | | | - Robin Genuer
- Univ. Bordeaux, INSERM, INRIA, BPH, U1219, Bordeaux, France
| | | |
Collapse
|
6
|
Sun T, Ding Y. Neural network on interval-censored data with application to the prediction of Alzheimer's disease. Biometrics 2023; 79:2677-2690. [PMID: 35960189 PMCID: PMC10177011 DOI: 10.1111/biom.13734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2021] [Accepted: 08/01/2022] [Indexed: 11/28/2022]
Abstract
Alzheimer's disease (AD) is a progressive and polygenic disorder that affects millions of individuals each year. Given that there have been few effective treatments yet for AD, it is highly desirable to develop an accurate model to predict the full disease progression profile based on an individual's genetic characteristics for early prevention and clinical management. This work uses data composed of all four phases of the Alzheimer's Disease Neuroimaging Initiative (ADNI) study, including 1740 individuals with 8 million genetic variants. We tackle several challenges in this data, characterized by large-scale genetic data, interval-censored outcome due to intermittent assessments, and left truncation in one study phase (ADNIGO). Specifically, we first develop a semiparametric transformation model on interval-censored and left-truncated data and estimate parameters through a sieve approach. Then we propose a computationally efficient generalized score test to identify variants associated with AD progression. Next, we implement a novel neural network on interval-censored data (NN-IC) to construct a prediction model using top variants identified from the genome-wide test. Comprehensive simulation studies show that the NN-IC outperforms several existing methods in terms of prediction accuracy. Finally, we apply the NN-IC to the full ADNI data and successfully identify subgroups with differential progression risk profiles. Data used in the preparation of this article were obtained from the ADNI database.
Collapse
Affiliation(s)
- Tao Sun
- Center for Applied Statistics, School of Statistics, Renmin University of China, Beijing, China
- Department of Biostatistics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Ying Ding
- Department of Biostatistics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
7
|
Jiang S, Cao J, Rosner B, Colditz GA. Supervised two-dimensional functional principal component analysis with time-to-event outcomes and mammogram imaging data. Biometrics 2023; 79:1359-1369. [PMID: 34854477 PMCID: PMC9160217 DOI: 10.1111/biom.13611] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Revised: 11/07/2021] [Accepted: 11/15/2021] [Indexed: 12/24/2022]
Abstract
Screening mammography aims to identify breast cancer early and secondarily measures breast density to classify women at higher or lower than average risk for future breast cancer in the general population. Despite the strong association of individual mammography features to breast cancer risk, the statistical literature on mammogram imaging data is limited. While functional principal component analysis (FPCA) has been studied in the literature for extracting image-based features, it is conducted independently of the time-to-event response variable. With the consideration of building a prognostic model for precision prevention, we present a set of flexible methods, supervised FPCA (sFPCA) and functional partial least squares (FPLS), to extract image-based features associated with the failure time while accommodating the added complication from right censoring. Throughout the article, we hope to demonstrate that one method is favored over the other under different clinical setups. The proposed methods are applied to the motivating data set from the Joanne Knight Breast Health cohort at Siteman Cancer Center. Our approaches not only obtain the best prediction performance compared to the benchmark model, but also reveal different risk patterns within the mammograms.
Collapse
Affiliation(s)
- Shu Jiang
- Division of Public Health Sciences, Washington University School of Medicine in St. Louis, Missouri
| | - Jiguo Cao
- Department of Statistics and Actuarial Science, Simon Fraser University, Canada
| | - Bernard Rosner
- Channing Division of Network Medicine, Harvard Medical School, Massachusetts
| | - Graham A Colditz
- Division of Public Health Sciences, Washington University School of Medicine in St. Louis, Missouri
| |
Collapse
|
8
|
Shi H, Jiang S, Cao J. Dynamic prediction with time-dependent marker in survival analysis using supervised functional principal component analysis. Stat Med 2022; 41:3547-3560. [PMID: 35574725 PMCID: PMC10025984 DOI: 10.1002/sim.9433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 02/27/2022] [Accepted: 04/26/2022] [Indexed: 11/11/2022]
Abstract
Time-varying biomarkers reflect important information on disease progression over time. Dynamic prediction for event occurrence on a real-time basis, utilizing time-varying information, is crucial in making accurate clinical decisions. Functional principal component analysis (FPCA) has been widely adopted in the literature for extracting features from time-varying biomarker trajectories. However, feature extraction via FPCA is conducted independent of the time-to-event response, which may not produce optimal results when the goal lies in prediction. With this consideration, we propose a novel supervised FPCA, where the functional principal components are determined to optimize the association between the time-varying biomarker and time-to-event outcome. The proposed framework also accommodates irregularly spaced and sparse longitudinal data. Our method is empirically shown to retain better discrimination and calibration performance than the unsupervised FPCA method in simulation studies. Application of the proposed method is also illustrated in the Alzheimer's Disease Neuroimaging Initiative database.
Collapse
Affiliation(s)
- Haolun Shi
- Department of Statistics and Actuarial Science, Simon Fraser University, Burnaby, British Columbia, Canada
| | - Shu Jiang
- Division of Public Health Sciences, Washington University School of Medicine in St. Louis, St. Louis, Missouri, USA
| | - Jiguo Cao
- Department of Statistics and Actuarial Science, Simon Fraser University, Burnaby, British Columbia, Canada
| |
Collapse
|
9
|
Devaux A, Genuer R, Peres K, Proust-Lima C. Individual dynamic prediction of clinical endpoint from large dimensional longitudinal biomarker history: a landmark approach. BMC Med Res Methodol 2022; 22:188. [PMID: 35818025 PMCID: PMC9275051 DOI: 10.1186/s12874-022-01660-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 06/15/2022] [Indexed: 11/16/2022] Open
Abstract
Background The individual data collected throughout patient follow-up constitute crucial information for assessing the risk of a clinical event, and eventually for adapting a therapeutic strategy. Joint models and landmark models have been proposed to compute individual dynamic predictions from repeated measures to one or two markers. However, they hardly extend to the case where the patient history includes much more repeated markers. Our objective was thus to propose a solution for the dynamic prediction of a health event that may exploit repeated measures of a possibly large number of markers. Methods We combined a landmark approach extended to endogenous markers history with machine learning methods adapted to survival data. Each marker trajectory is modeled using the information collected up to the landmark time, and summary variables that best capture the individual trajectories are derived. These summaries and additional covariates are then included in different prediction methods adapted to survival data, namely regularized regressions and random survival forests, to predict the event from the landmark time. We also show how predictive tools can be combined into a superlearner. The performances are evaluated by cross-validation using estimators of Brier Score and the area under the Receiver Operating Characteristic curve adapted to censored data. Results We demonstrate in a simulation study the benefits of machine learning survival methods over standard survival models, especially in the case of numerous and/or nonlinear relationships between the predictors and the event. We then applied the methodology in two prediction contexts: a clinical context with the prediction of death in primary biliary cholangitis, and a public health context with age-specific prediction of death in the general elderly population. Conclusions Our methodology, implemented in R, enables the prediction of an event using the entire longitudinal patient history, even when the number of repeated markers is large. Although introduced with mixed models for the repeated markers and methods for a single right censored time-to-event, the technique can be used with any other appropriate modeling technique for the markers and can be easily extended to competing risks setting. Supplementary Information The online version contains supplementary material available at (10.1186/s12874-022-01660-3).
Collapse
Affiliation(s)
| | - Robin Genuer
- INSERM, BPH, U1219, Univ. Bordeaux, Bordeaux, France.,INRIA Bordeaux Sud-Ouest, Talence, France
| | - Karine Peres
- INSERM, BPH, U1219, Univ. Bordeaux, Bordeaux, France
| | | |
Collapse
|
10
|
Pickett KL, Suresh K, Campbell KR, Davis S, Juarez-Colunga E. Random survival forests for dynamic predictions of a time-to-event outcome using a longitudinal biomarker. BMC Med Res Methodol 2021; 21:216. [PMID: 34657597 PMCID: PMC8520610 DOI: 10.1186/s12874-021-01375-x] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Accepted: 08/21/2021] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND Risk prediction models for time-to-event outcomes play a vital role in personalized decision-making. A patient's biomarker values, such as medical lab results, are often measured over time but traditional prediction models ignore their longitudinal nature, using only baseline information. Dynamic prediction incorporates longitudinal information to produce updated survival predictions during follow-up. Existing methods for dynamic prediction include joint modeling, which often suffers from computational complexity and poor performance under misspecification, and landmarking, which has a straightforward implementation but typically relies on a proportional hazards model. Random survival forests (RSF), a machine learning algorithm for time-to-event outcomes, can capture complex relationships between the predictors and survival without requiring prior specification and has been shown to have superior predictive performance. METHODS We propose an alternative approach for dynamic prediction using random survival forests in a landmarking framework. With a simulation study, we compared the predictive performance of our proposed method with Cox landmarking and joint modeling in situations where the proportional hazards assumption does not hold and the longitudinal marker(s) have a complex relationship with the survival outcome. We illustrated the use of the RSF landmark approach in two clinical applications to assess the performance of various RSF model building decisions and to demonstrate its use in obtaining dynamic predictions. RESULTS In simulation studies, RSF landmarking outperformed joint modeling and Cox landmarking when a complex relationship between the survival and longitudinal marker processes was present. It was also useful in application when there were several predictors for which the clinical relevance was unknown and multiple longitudinal biomarkers were present. Individualized dynamic predictions can be obtained from this method and the variable importance metric is useful for examining the changing predictive power of variables over time. In addition, RSF landmarking is easily implementable in standard software and using suggested specifications requires less computation time than joint modeling. CONCLUSIONS RSF landmarking is a nonparametric, machine learning alternative to current methods for obtaining dynamic predictions when there are complex or unknown relationships present. It requires little upfront decision-making and has comparable predictive performance and has preferable computational speed.
Collapse
Affiliation(s)
- Kaci L Pickett
- Department of Pediatrics, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
| | - Krithika Suresh
- Department of Biostatistics and Informatics, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
- Adult and Child Consortium for Health Outcomes and Delivery Science, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
| | - Kristen R Campbell
- Department of Pediatrics, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
| | - Scott Davis
- Division of Renal Diseases and Hypertension, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
| | - Elizabeth Juarez-Colunga
- Department of Pediatrics, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
- Department of Biostatistics and Informatics, University of Colorado Anschutz Medical Campus, Aurora, 80045 Colorado USA
| |
Collapse
|