1
|
Dufumier B, Gori P, Petiton S, Louiset R, Mangin JF, Grigis A, Duchesnay E. Exploring the potential of representation and transfer learning for anatomical neuroimaging: Application to psychiatry. Neuroimage 2024; 296:120665. [PMID: 38848981 DOI: 10.1016/j.neuroimage.2024.120665] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 05/15/2024] [Accepted: 05/31/2024] [Indexed: 06/09/2024] Open
Abstract
The perspective of personalized medicine for brain disorders requires efficient learning models for anatomical neuroimaging-based prediction of clinical conditions. There is now a consensus on the benefit of deep learning (DL) in addressing many medical imaging tasks, such as image segmentation. However, for single-subject prediction problems, recent studies yielded contradictory results when comparing DL with Standard Machine Learning (SML) on top of classical feature extraction. Most existing comparative studies were limited in predicting phenotypes of little clinical interest, such as sex and age, and using a single dataset. Moreover, they conducted a limited analysis of the employed image pre-processing and feature selection strategies. This paper extensively compares DL and SML prediction capacity on five multi-site problems, including three increasingly complex clinical applications in psychiatry namely schizophrenia, bipolar disorder, and Autism Spectrum Disorder (ASD) diagnosis. To compensate for the relative scarcity of neuroimaging data on these clinical datasets, we also evaluate three pre-training strategies for transfer learning from brain imaging of the general healthy population: self-supervised learning, generative modeling and supervised learning with age. Overall, we find similar performance between randomly initialized DL and SML for the three clinical tasks and a similar scaling trend for sex prediction. This was replicated on an external dataset. We also show highly correlated discriminative brain regions between DL and linear ML models in all problems. Nonetheless, we demonstrate that self-supervised pre-training on large-scale healthy population imaging datasets (N≈10k), along with Deep Ensemble, allows DL to learn robust and transferable representations to smaller-scale clinical datasets (N≤1k). It largely outperforms SML on 2 out of 3 clinical tasks both in internal and external test sets. These findings suggest that the improvement of DL over SML in anatomical neuroimaging mainly comes from its capacity to learn meaningful and useful abstract representations of the brain anatomy, and it sheds light on the potential of transfer learning for personalized medicine in psychiatry.
Collapse
Affiliation(s)
- Benoit Dufumier
- Université Paris-Saclay, CEA, CNRS, UMR9027 Baobab, NeuroSpin, Saclay, France; LTCI, Télécom Paris, IPParis, Palaiseau, France.
| | - Pietro Gori
- LTCI, Télécom Paris, IPParis, Palaiseau, France
| | - Sara Petiton
- Université Paris-Saclay, CEA, CNRS, UMR9027 Baobab, NeuroSpin, Saclay, France
| | - Robin Louiset
- Université Paris-Saclay, CEA, CNRS, UMR9027 Baobab, NeuroSpin, Saclay, France; LTCI, Télécom Paris, IPParis, Palaiseau, France
| | | | - Antoine Grigis
- Université Paris-Saclay, CEA, CNRS, UMR9027 Baobab, NeuroSpin, Saclay, France
| | - Edouard Duchesnay
- Université Paris-Saclay, CEA, CNRS, UMR9027 Baobab, NeuroSpin, Saclay, France
| |
Collapse
|
2
|
Griffiths-King D, Wood AG, Novak J. Predicting 'Brainage' in late childhood to adolescence (6-17yrs) using structural MRI, morphometric similarity, and machine learning. Sci Rep 2023; 13:15591. [PMID: 37730747 PMCID: PMC10511546 DOI: 10.1038/s41598-023-42414-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Accepted: 09/10/2023] [Indexed: 09/22/2023] Open
Abstract
Brain development is regularly studied using structural MRI. Recently, studies have used a combination of statistical learning and large-scale imaging databases of healthy children to predict an individual's age from structural MRI. This data-driven, predicted 'Brainage' typically differs from the subjects chronological age, with this difference a potential measure of individual difference. Few studies have leveraged higher-order or connectomic representations of structural MRI data for this Brainage approach. We leveraged morphometric similarity as a network-level approach to structural MRI to generate predictive models of age. We benchmarked these novel Brainage approaches using morphometric similarity against more typical, single feature (i.e., cortical thickness) approaches. We showed that these novel methods did not outperform cortical thickness or cortical volume measures. All models were significantly biased by age, but robust to motion confounds. The main results show that, whilst morphometric similarity mapping may be a novel way to leverage additional information from a T1-weighted structural MRI beyond individual features, in the context of a Brainage framework, morphometric similarity does not provide more accurate predictions of age. Morphometric similarity as a network-level approach to structural MRI may be poorly positioned to study individual differences in brain development in healthy participants in this way.
Collapse
Affiliation(s)
- Daniel Griffiths-King
- Aston Institute of Health and Neurodevelopment, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
| | - Amanda G Wood
- Aston Institute of Health and Neurodevelopment, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK
- School of Psychology, Faculty of Health, Melbourne Burwood Campus, Deakin University, Geelong, VIC, Australia
- Murdoch Children's Research Institute, Melbourne, VIC, Australia
| | - Jan Novak
- Aston Institute of Health and Neurodevelopment, College of Health and Life Sciences, Aston University, Birmingham, B4 7ET, UK.
| |
Collapse
|
3
|
Wagner DT, Tilmans L, Peng K, Niedermeier M, Rohl M, Ryan S, Yadav D, Takacs N, Garcia-Fraley K, Koso M, Dikici E, Prevedello LM, Nguyen XV. Artificial Intelligence in Neuroradiology: A Review of Current Topics and Competition Challenges. Diagnostics (Basel) 2023; 13:2670. [PMID: 37627929 PMCID: PMC10453240 DOI: 10.3390/diagnostics13162670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 08/07/2023] [Accepted: 08/09/2023] [Indexed: 08/27/2023] Open
Abstract
There is an expanding body of literature that describes the application of deep learning and other machine learning and artificial intelligence methods with potential relevance to neuroradiology practice. In this article, we performed a literature review to identify recent developments on the topics of artificial intelligence in neuroradiology, with particular emphasis on large datasets and large-scale algorithm assessments, such as those used in imaging AI competition challenges. Numerous applications relevant to ischemic stroke, intracranial hemorrhage, brain tumors, demyelinating disease, and neurodegenerative/neurocognitive disorders were discussed. The potential applications of these methods to spinal fractures, scoliosis grading, head and neck oncology, and vascular imaging were also reviewed. The AI applications examined perform a variety of tasks, including localization, segmentation, longitudinal monitoring, diagnostic classification, and prognostication. While research on this topic is ongoing, several applications have been cleared for clinical use and have the potential to augment the accuracy or efficiency of neuroradiologists.
Collapse
Affiliation(s)
- Daniel T. Wagner
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Luke Tilmans
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Kevin Peng
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | | | - Matt Rohl
- College of Arts and Sciences, The Ohio State University, Columbus, OH 43210, USA
| | - Sean Ryan
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Divya Yadav
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Noah Takacs
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Krystle Garcia-Fraley
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Mensur Koso
- College of Medicine, The Ohio State University, Columbus, OH 43210, USA
| | - Engin Dikici
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Luciano M. Prevedello
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| | - Xuan V. Nguyen
- Department of Radiology, The Ohio State University Wexner Medical Center, Columbus, OH 43210, USA (L.M.P.)
| |
Collapse
|
4
|
Wilmskoetter J, Busby N, He X, Caciagli L, Roth R, Kristinsson S, Davis KA, Rorden C, Bassett DS, Fridriksson J, Bonilha L. Dynamic network properties of the superior temporal gyrus mediate the impact of brain age gap on chronic aphasia severity. Commun Biol 2023; 6:727. [PMID: 37452209 PMCID: PMC10349039 DOI: 10.1038/s42003-023-05119-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 07/07/2023] [Indexed: 07/18/2023] Open
Abstract
Brain structure deteriorates with aging and predisposes an individual to more severe language impairments (aphasia) after a stroke. However, the underlying mechanisms of this relation are not well understood. Here we use an approach to model brain network properties outside the stroke lesion, network controllability, to investigate relations among individualized structural brain connections, brain age, and aphasia severity in 93 participants with chronic post-stroke aphasia. Controlling for the stroke lesion size, we observe that lower average controllability of the posterior superior temporal gyrus (STG) mediates the relation between advanced brain aging and aphasia severity. Lower controllability of the left posterior STG signifies that activity in the left posterior STG is less likely to yield a response in other brain regions due to the topological properties of the structural brain networks. These results indicate that advanced brain aging among individuals with post-stroke aphasia is associated with disruption of dynamic properties of a critical language-related area, the STG, which contributes to worse aphasic symptoms. Because brain aging is variable among individuals with aphasia, our results provide further insight into the mechanisms underlying the variance in clinical trajectories in post-stroke aphasia.
Collapse
Affiliation(s)
- Janina Wilmskoetter
- Department of Health and Rehabilitation Sciences, College of Health Professions, Medical University of South Carolina, Charleston, SC, USA.
| | - Natalie Busby
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA
| | - Xiaosong He
- Department of Psychology, University of Science and Technology of China, Beijing, China
| | - Lorenzo Caciagli
- Department of Bioengineering, School of Engineering & Applied Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Rebecca Roth
- Department of Neurology, Emory University, Atlanta, GA, USA
| | - Sigfus Kristinsson
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA
| | - Kathryn A Davis
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - Chris Rorden
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Dani S Bassett
- Department of Bioengineering, School of Engineering & Applied Science, University of Pennsylvania, Philadelphia, PA, USA
- Department of Neurology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Electrical and Systems Engineering, School of Engineering & Applied Science, University of Pennsylvania, Philadelphia, PA, USA
- Department of Physics & Astronomy, School of Arts & Sciences, University of Pennsylvania, Philadelphia, PA, USA
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Santa Fe Institute, Santa Fe, New Mexico, NM, USA
| | - Julius Fridriksson
- Department of Communication Sciences and Disorders, University of South Carolina, Columbia, SC, USA
| | | |
Collapse
|
5
|
Griffiths-King DJ, Wood AG, Novak J. Predicting 'Brainage' in the Developmental Period using Structural MRI, Morphometric Similarity, and Machine Learning. RESEARCH SQUARE 2023:rs.3.rs-2583936. [PMID: 36909598 PMCID: PMC10002817 DOI: 10.21203/rs.3.rs-2583936/v1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Abstract
Brain development is regularly studied using structural MRI. Recently, studies have used a combination of statistical learning and large-scale imaging databases of healthy-children to predict an individual's age from structural MRI. This data-driven, 'brainage' typically differs from the subjects chronological age, with this difference a potential measure of individual difference. Few studies have leveraged higher-order or connectomic representations of structural MRI data for this brainage approach. We leveraged morphometric similarity as a network-level approach to structural MRI to generate predictive models of age. We benchmarked these novel brain-age approaches using morphometric similarity against more typical, single feature (i.e. cortical thickness) approaches. We showed that these novel methods did not outperform cortical thickness or cortical volume measures. All models were significantly biased by age, but robust to motion confounds. The main results show that, whilst morphometric similarity mapping may be a novel way to leverage additional information from a T1-weighted structural MRI beyond individual features, in the context of a brain-age framework, morphometric similarity does not explain more variance than individual structural features. Morphometric similarity as a network-level approach to structural MRI may be poorly positioned to study individual differences in brain development in healthy individuals.
Collapse
|
6
|
Yin C, Imms P, Cheng M, Amgalan A, Chowdhury NF, Massett RJ, Chaudhari NN, Chen X, Thompson PM, Bogdan P, Irimia A. Anatomically interpretable deep learning of brain age captures domain-specific cognitive impairment. Proc Natl Acad Sci U S A 2023; 120:e2214634120. [PMID: 36595679 PMCID: PMC9926270 DOI: 10.1073/pnas.2214634120] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 11/10/2022] [Indexed: 01/05/2023] Open
Abstract
The gap between chronological age (CA) and biological brain age, as estimated from magnetic resonance images (MRIs), reflects how individual patterns of neuroanatomic aging deviate from their typical trajectories. MRI-derived brain age (BA) estimates are often obtained using deep learning models that may perform relatively poorly on new data or that lack neuroanatomic interpretability. This study introduces a convolutional neural network (CNN) to estimate BA after training on the MRIs of 4,681 cognitively normal (CN) participants and testing on 1,170 CN participants from an independent sample. BA estimation errors are notably lower than those of previous studies. At both individual and cohort levels, the CNN provides detailed anatomic maps of brain aging patterns that reveal sex dimorphisms and neurocognitive trajectories in adults with mild cognitive impairment (MCI, N = 351) and Alzheimer's disease (AD, N = 359). In individuals with MCI (54% of whom were diagnosed with dementia within 10.9 y from MRI acquisition), BA is significantly better than CA in capturing dementia symptom severity, functional disability, and executive function. Profiles of sex dimorphism and lateralization in brain aging also map onto patterns of neuroanatomic change that reflect cognitive decline. Significant associations between BA and neurocognitive measures suggest that the proposed framework can map, systematically, the relationship between aging-related neuroanatomy changes in CN individuals and in participants with MCI or AD. Early identification of such neuroanatomy changes can help to screen individuals according to their AD risk.
Collapse
Affiliation(s)
- Chenzhong Yin
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Phoebe Imms
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
| | - Mingxi Cheng
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Anar Amgalan
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
| | - Nahian F. Chowdhury
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
| | - Roy J. Massett
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
| | - Nikhil N. Chaudhari
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
- Corwin D. Denney Research Center, Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Xinghe Chen
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Paul M. Thompson
- Corwin D. Denney Research Center, Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
- Imaging Genetics Center, Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Marina del Rey, CA90033
- Department of Quantitative & Computational Biology, Dana & David Dornsife College of Arts & Sciences, University of Southern California, Los Angeles, CA90089
- Department of Ophthalmology, Keck School of Medicine, University of Southern California, Los Angeles, CA90033
- Department of Neurology, Keck School of Medicine, University of Southern California, Los Angeles, CA90033
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA90033
- Department of Psychiatry, Keck School of Medicine, University of Southern California, Los Angeles, CA90033
- Department of Behavioral Sciences, Keck School of Medicine, University of Southern California, Los Angeles, CA90033
| | - Paul Bogdan
- Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
| | - Andrei Irimia
- Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA90089
- Corwin D. Denney Research Center, Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA90089
- Department of Quantitative & Computational Biology, Dana & David Dornsife College of Arts & Sciences, University of Southern California, Los Angeles, CA90089
| | | |
Collapse
|
7
|
Structural and Functional MRI Data Differentially Predict Chronological Age and Behavioral Memory Performance. eNeuro 2022; 9:9/6/ENEURO.0212-22.2022. [PMID: 36376083 PMCID: PMC9665883 DOI: 10.1523/eneuro.0212-22.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 08/02/2022] [Indexed: 11/16/2022] Open
Abstract
Human cognitive abilities decline with increasing chronological age, with decreased explicit memory performance being most strongly affected. However, some older adults show "successful aging," that is, relatively preserved cognitive ability in old age. One explanation for this could be higher brain-structural integrity in these individuals. Alternatively, the brain might recruit existing resources more efficiently or employ compensatory cognitive strategies. Here, we approached this question by testing multiple candidate variables from structural and functional neuroimaging for their ability to predict chronological age and memory performance, respectively. Prediction was performed using support vector machine (SVM) classification and regression across and within two samples of young (N = 106) and older (N = 153) adults. The candidate variables were (1) behavioral response frequencies in an episodic memory test; (2) recently described functional magnetic resonance imaging (fMRI) scores reflecting preservation of functional memory networks; (3) whole-brain fMRI contrasts for novelty processing and subsequent memory; (4) resting-state fMRI maps quantifying voxel-wise signal fluctuation; and (5) gray matter volume estimated from structural MRIs. While age group could be reliably decoded from all variables, chronological age within young and older subjects was best predicted from gray matter volume. In contrast, memory performance was best predicted from task-based fMRI contrasts and particularly single-value fMRI scores, whereas gray matter volume has no predictive power with respect to memory performance in healthy adults. Our results suggest that superior memory performance in healthy older adults is better explained by efficient recruitment of memory networks rather than by preserved brain structure.
Collapse
|
8
|
OpenBHB: a Large-Scale Multi-Site Brain MRI Data-set for Age Prediction and Debiasing. Neuroimage 2022; 263:119637. [PMID: 36122684 DOI: 10.1016/j.neuroimage.2022.119637] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2022] [Revised: 09/07/2022] [Accepted: 09/15/2022] [Indexed: 11/24/2022] Open
Abstract
Prediction of chronological age from neuroimaging in the healthy population is an important issue because the deviations from normal brain age may highlight abnormal trajectories towards brain disorders. As a first step, ML models have emerged to predict chronological age from brain MRI, as a proxy measure of biological age. However, there is currently no consensus w.r.t which Machine Learning (ML) model is best suited for this task, largely because of a lack of public benchmark. Furthermore, new large emerging population neuroimaging datasets are often biased by the acquisition center images are coming from. This bias heavily deteriorates models generalization capacities, especially for Deep Learning (DL) algorithms that are known to overfit rapidly on the simplest features (known as simplicity bias). Here we propose a new public benchmarking resource, namely Open Big Healthy Brains (OpenBHB), along with a challenge for both brain age prediction and site-effect removal through a representation learning framework. OpenBHB is large-scale, gathering >5K 3D T1 brain MRI from Healthy Controls (HC) and highly multi-sites, aggregating >60 centers worldwide and 10 studies. OpenBHB is expected to grow both in terms of available modalities and number of subjects. All OpenBHB datasets are uniformly preprocessed, including quality check, with container technologies that consist in: 3D Voxel-Based Morphometry maps (VBM from CAT12), quasi-raw (simple linear alignment of images), and Surface-Based Morphometry indices (SBM, from FreeSurfer). The OpenBHB challenge is permanent and we provide all tools, materials and tutorials for participants to easily submit and benchmark their model against each other on a public leaderboard.
Collapse
|
9
|
Millar PR, Luckett PH, Gordon BA, Benzinger TLS, Schindler SE, Fagan AM, Cruchaga C, Bateman RJ, Allegri R, Jucker M, Lee JH, Mori H, Salloway SP, Yakushev I, Morris JC, Ances BM. Predicting brain age from functional connectivity in symptomatic and preclinical Alzheimer disease. Neuroimage 2022; 256:119228. [PMID: 35452806 PMCID: PMC9178744 DOI: 10.1016/j.neuroimage.2022.119228] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 03/28/2022] [Accepted: 04/19/2022] [Indexed: 12/29/2022] Open
Abstract
"Brain-predicted age" quantifies apparent brain age compared to normative neuroimaging trajectories. Advanced brain-predicted age has been well established in symptomatic Alzheimer disease (AD), but is underexplored in preclinical AD. Prior brain-predicted age studies have typically used structural MRI, but resting-state functional connectivity (FC) remains underexplored. Our model predicted age from FC in 391 cognitively normal, amyloid-negative controls (ages 18-89). We applied the trained model to 145 amyloid-negative, 151 preclinical AD, and 156 symptomatic AD participants to test group differences. The model accurately predicted age in the training set. FC-predicted brain age gaps (FC-BAG) were significantly older in symptomatic AD and significantly younger in preclinical AD compared to controls. There was minimal correspondence between networks predictive of age and AD. Elevated FC-BAG may reflect network disruption during symptomatic AD. Reduced FC-BAG in preclinical AD was opposite to the expected direction, and may reflect a biphasic response to preclinical AD pathology or may be driven by inconsistency between age-related vs. AD-related networks. Overall, FC-predicted brain age may be a sensitive AD biomarker.
Collapse
Affiliation(s)
- Peter R Millar
- Department of Neurology, Washington University, St. Louis, MO 63110, USA.
| | - Patrick H Luckett
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Brian A Gordon
- Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Tammie LS Benzinger
- Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | - Suzanne E Schindler
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Anne M Fagan
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Carlos Cruchaga
- Department of Psychiatry, Washington University in St. Louis, St. Louis, MO, USA
| | - Randall J Bateman
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Ricardo Allegri
- Department of Cognitive Neurology, Institute for Neurological Research Fleni, Buenos Aires, Argentina
| | - Mathias Jucker
- German Center for Neurodegenerative Diseases (DZNE), Tübingen, Germany,Hertie Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Jae-Hong Lee
- Department of Neurology, University of Ulsan College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Hiroshi Mori
- Department of Clinical Neuroscience, Osaka City University Medical School, Abenoku, Osaka, 545-8585, Japan, Nagaoka Sutoku University
| | | | - Igor Yakushev
- Department of Nuclear Medicine, Technical University of Munich, Munich, Germany
| | - John C Morris
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA
| | - Beau M Ances
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, USA; Department of Radiology, Washington University in St. Louis, St. Louis, MO, USA
| | | |
Collapse
|
10
|
Leenings R, Winter NR, Dannlowski U, Hahn T. Recommendations for machine learning benchmarks in neuroimaging. Neuroimage 2022; 257:119298. [PMID: 35561945 DOI: 10.1016/j.neuroimage.2022.119298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Revised: 04/19/2022] [Accepted: 05/09/2022] [Indexed: 11/30/2022] Open
Abstract
The field of neuroimaging has embraced methods from machine learning in a variety of ways. Although an increasing number of initiatives have published open-access neuroimaging datasets, specifically designed benchmarks are rare in the field. In this article, we first describe how benchmarks in computer science and biomedical imaging have fostered methodological progress in machine learning. Second, we identify the special characteristics of neuroimaging data and outline what researchers have to ensure when establishing a neuroimaging benchmark, how datasets should be composed and how adequate evaluation criteria can be chosen. Based on lessons learned from machine learning benchmarks, we argue for an extended evaluation procedure that, next to applying suitable performance metrics, focuses on scientifically relevant aspects such as explainability, robustness, uncertainty, computational efficiency and code quality. Lastly, we envision a collaborative neuroimaging benchmarking platform that combines the discussed aspects in a collaborative and agile framework, allowing researchers across disciplines to work together on the key predictive problems of the field of neuroimaging and psychiatry.
Collapse
Affiliation(s)
- Ramona Leenings
- University of Münster, Institute for Translational Psychiatry, Albert-Schweitzer-Campus 1, Münster 48149, Germany; University of Münster, Faculty of Mathematics and Computer Science, Münster, Germany.
| | - Nils R Winter
- University of Münster, Institute for Translational Psychiatry, Albert-Schweitzer-Campus 1, Münster 48149, Germany
| | - Udo Dannlowski
- University of Münster, Institute for Translational Psychiatry, Albert-Schweitzer-Campus 1, Münster 48149, Germany
| | - Tim Hahn
- University of Münster, Institute for Translational Psychiatry, Albert-Schweitzer-Campus 1, Münster 48149, Germany
| |
Collapse
|
11
|
Bron EE, Klein S, Reinke A, Papma JM, Maier-Hein L, Alexander DC, Oxtoby NP. Ten years of image analysis and machine learning competitions in dementia. Neuroimage 2022; 253:119083. [PMID: 35278709 DOI: 10.1016/j.neuroimage.2022.119083] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 02/18/2022] [Accepted: 03/08/2022] [Indexed: 11/24/2022] Open
Abstract
Machine learning methods exploiting multi-parametric biomarkers, especially based on neuroimaging, have huge potential to improve early diagnosis of dementia and to predict which individuals are at-risk of developing dementia. To benchmark algorithms in the field of machine learning and neuroimaging in dementia and assess their potential for use in clinical practice and clinical trials, seven grand challenges have been organized in the last decade: MIRIAD (2012), Alzheimer's Disease Big Data DREAM (2014), CADDementia (2014), Machine Learning Challenge (2014), MCI Neuroimaging (2017), TADPOLE (2017), and the Predictive Analytics Competition (2019). Based on two challenge evaluation frameworks, we analyzed how these grand challenges are complementing each other regarding research questions, datasets, validation approaches, results and impact. The seven grand challenges addressed questions related to screening, clinical status estimation, prediction and monitoring in (pre-clinical) dementia. There was little overlap in clinical questions, tasks and performance metrics. Whereas this aids providing insight on a broad range of questions, it also limits the validation of results across challenges. The validation process itself was mostly comparable between challenges, using similar methods for ensuring objective comparison, uncertainty estimation and statistical testing. In general, winning algorithms performed rigorous data pre-processing and combined a wide range of input features. Despite high state-of-the-art performances, most of the methods evaluated by the challenges are not clinically used. To increase impact, future challenges could pay more attention to statistical analysis of which factors (i.e., features, models) relate to higher performance, to clinical questions beyond Alzheimer's disease, and to using testing data beyond the Alzheimer's Disease Neuroimaging Initiative. Grand challenges would be an ideal venue for assessing the generalizability of algorithm performance to unseen data of other cohorts. Key for increasing impact in this way are larger testing data sizes, which could be reached by sharing algorithms rather than data to exploit data that cannot be shared. Given the potential and lessons learned in the past ten years, we are excited by the prospects of grand challenges in machine learning and neuroimaging for the next ten years and beyond.
Collapse
Affiliation(s)
- Esther E Bron
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands.
| | - Stefan Klein
- Department of Radiology and Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands.
| | - Annika Reinke
- Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg 69120, Germany.
| | - Janne M Papma
- Department of Neurology, Erasmus MC, Rotterdam, the Netherlands.
| | - Lena Maier-Hein
- Division of Computer Assisted Medical Interventions (CAMI), German Cancer Research Center (DKFZ), Heidelberg 69120, Germany.
| | - Daniel C Alexander
- Centre for Medical Image Computing, Department of Computer Science, University College London, London WC1E 6BT, UK.
| | - Neil P Oxtoby
- Centre for Medical Image Computing, Department of Computer Science, University College London, London WC1E 6BT, UK.
| |
Collapse
|