1
|
Schultz V, Hedderich DM, Schmitz-Koep B, Schinz D, Zimmer C, Yakushev I, Apostolova I, Özden C, Opfer R, Buchert R. Removing outliers from the normative database improves regional atrophy detection in single-subject voxel-based morphometry. Neuroradiology 2024; 66:507-519. [PMID: 38378906 PMCID: PMC10937771 DOI: 10.1007/s00234-024-03304-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 02/03/2024] [Indexed: 02/22/2024]
Abstract
PURPOSE Single-subject voxel-based morphometry (VBM) compares an individual T1-weighted MRI to a sample of normal MRI in a normative database (NDB) to detect regional atrophy. Outliers in the NDB might result in reduced sensitivity of VBM. The primary aim of the current study was to propose a method for outlier removal ("NDB cleaning") and to test its impact on the performance of VBM for detection of Alzheimer's disease (AD) and frontotemporal lobar degeneration (FTLD). METHODS T1-weighted MRI of 81 patients with biomarker-confirmed AD (n = 51) or FTLD (n = 30) and 37 healthy subjects with simultaneous FDG-PET/MRI were included as test dataset. Two different NDBs were used: a scanner-specific NDB (37 healthy controls from the test dataset) and a non-scanner-specific NDB comprising 164 normal T1-weighted MRI from 164 different MRI scanners. Three different quality metrics based on leave-one-out testing of the scans in the NDB were implemented. A scan was removed if it was an outlier with respect to one or more quality metrics. VBM maps generated with and without NDB cleaning were assessed visually for the presence of AD or FTLD. RESULTS Specificity of visual interpretation of the VBM maps for detection of AD or FTLD was 100% in all settings. Sensitivity was increased by NDB cleaning with both NDBs. The effect was statistically significant for the multiple-scanner NDB (from 0.47 [95%-CI 0.36-0.58] to 0.61 [0.49-0.71]). CONCLUSION NDB cleaning has the potential to improve the sensitivity of VBM for the detection of AD or FTLD without increasing the risk of false positive findings.
Collapse
Affiliation(s)
- Vivian Schultz
- Department of Neuroradiology, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Ismaninger Str. 22, 81675, Munich, Germany.
| | - Dennis M Hedderich
- Department of Neuroradiology, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Ismaninger Str. 22, 81675, Munich, Germany
| | - Benita Schmitz-Koep
- Department of Neuroradiology, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Ismaninger Str. 22, 81675, Munich, Germany
| | - David Schinz
- Department of Neuroradiology, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Ismaninger Str. 22, 81675, Munich, Germany
- Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen (FAU), Nürnberg, Germany
| | - Claus Zimmer
- Department of Neuroradiology, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Ismaninger Str. 22, 81675, Munich, Germany
| | - Igor Yakushev
- Department of Nuclear Medicine, Klinikum Rechts Der Isar, Technical University of Munich, School of Medicine and Health, Munich, Germany
| | - Ivayla Apostolova
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Cansu Özden
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | | | - Ralph Buchert
- Department of Diagnostic and Interventional Radiology and Nuclear Medicine, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
2
|
Bucholc M, James C, Khleifat AA, Badhwar A, Clarke N, Dehsarvi A, Madan CR, Marzi SJ, Shand C, Schilder BM, Tamburin S, Tantiangco HM, Lourida I, Llewellyn DJ, Ranson JM. Artificial intelligence for dementia research methods optimization. Alzheimers Dement 2023; 19:5934-5951. [PMID: 37639369 DOI: 10.1002/alz.13441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 07/19/2023] [Accepted: 07/23/2023] [Indexed: 08/31/2023]
Abstract
Artificial intelligence (AI) and machine learning (ML) approaches are increasingly being used in dementia research. However, several methodological challenges exist that may limit the insights we can obtain from high-dimensional data and our ability to translate these findings into improved patient outcomes. To improve reproducibility and replicability, researchers should make their well-documented code and modeling pipelines openly available. Data should also be shared where appropriate. To enhance the acceptability of models and AI-enabled systems to users, researchers should prioritize interpretable methods that provide insights into how decisions are generated. Models should be developed using multiple, diverse datasets to improve robustness, generalizability, and reduce potentially harmful bias. To improve clarity and reproducibility, researchers should adhere to reporting guidelines that are co-produced with multiple stakeholders. If these methodological challenges are overcome, AI and ML hold enormous promise for changing the landscape of dementia research and care. HIGHLIGHTS: Machine learning (ML) can improve diagnosis, prevention, and management of dementia. Inadequate reporting of ML procedures affects reproduction/replication of results. ML models built on unrepresentative datasets do not generalize to new datasets. Obligatory metrics for certain model structures and use cases have not been defined. Interpretability and trust in ML predictions are barriers to clinical translation.
Collapse
Affiliation(s)
- Magda Bucholc
- Cognitive Analytics Research Lab, School of Computing, Engineering & Intelligent Systems, Ulster University, Derry, UK
| | - Charlotte James
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| | - Ahmad Al Khleifat
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, UK
| | - AmanPreet Badhwar
- Multiomics Investigation of Neurodegenerative Diseases (MIND) Lab, Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal, Montréal, Quebec, Canada
- Institut de génie biomédical, Université de Montréal, Montréal, Quebec, Canada
- Département de Pharmacologie et Physiologie, Université de Montréal, Montréal, Quebec, Canada
| | - Natasha Clarke
- Multiomics Investigation of Neurodegenerative Diseases (MIND) Lab, Centre de Recherche de l'Institut Universitaire de Gériatrie de Montréal, Montréal, Quebec, Canada
| | - Amir Dehsarvi
- Aberdeen Biomedical Imaging Centre, School of Medicine, Medical Sciences, and Nutrition, University of Aberdeen, Aberdeen, UK
| | | | - Sarah J Marzi
- UK Dementia Research Institute, Imperial College London, London, UK
- Department of Brain Sciences, Imperial College London, London, UK
| | - Cameron Shand
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK
| | - Brian M Schilder
- UK Dementia Research Institute, Imperial College London, London, UK
- Department of Brain Sciences, Imperial College London, London, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | | | - David J Llewellyn
- University of Exeter Medical School, Exeter, UK
- The Alan Turing Institute, London, UK
| | | |
Collapse
|
3
|
Winchester LM, Harshfield EL, Shi L, Badhwar A, Khleifat AA, Clarke N, Dehsarvi A, Lengyel I, Lourida I, Madan CR, Marzi SJ, Proitsi P, Rajkumar AP, Rittman T, Silajdžić E, Tamburin S, Ranson JM, Llewellyn DJ. Artificial intelligence for biomarker discovery in Alzheimer's disease and dementia. Alzheimers Dement 2023; 19:5860-5871. [PMID: 37654029 PMCID: PMC10840606 DOI: 10.1002/alz.13390] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/13/2023] [Accepted: 06/19/2023] [Indexed: 09/02/2023]
Abstract
With the increase in large multimodal cohorts and high-throughput technologies, the potential for discovering novel biomarkers is no longer limited by data set size. Artificial intelligence (AI) and machine learning approaches have been developed to detect novel biomarkers and interactions in complex data sets. We discuss exemplar uses and evaluate current applications and limitations of AI to discover novel biomarkers. Remaining challenges include a lack of diversity in the data sets available, the sheer complexity of investigating interactions, the invasiveness and cost of some biomarkers, and poor reporting in some studies. Overcoming these challenges will involve collecting data from underrepresented populations, developing more powerful AI approaches, validating the use of noninvasive biomarkers, and adhering to reporting guidelines. By harnessing rich multimodal data through AI approaches and international collaborative innovation, we are well positioned to identify clinically useful biomarkers that are accurate, generalizable, unbiased, and acceptable in clinical practice. HIGHLIGHTS: Artificial intelligence and machine learning approaches may accelerate dementia biomarker discovery. Remaining challenges include data set suitability due to size and bias in cohort selection. Multimodal data, diverse data sets, improved machine learning approaches, real-world validation, and interdisciplinary collaboration are required.
Collapse
Affiliation(s)
| | - Eric L Harshfield
- Department of Clinical Neurosciences, Stroke Research Group, University of Cambridge, Cambridge, UK
| | - Liu Shi
- Novo Nordisk Research Centre Oxford (NNRCO), Headington, UK
| | - AmanPreet Badhwar
- Département de Pharmacologie et Physiologie, Institut de Génie Biomédical, Faculté de Médecine, Université de Montréal, Montreal, Canada
- Centre de recherche de l'Institut Universitaire de Gériatrie (CRIUGM), Montreal, Canada
| | - Ahmad Al Khleifat
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Natasha Clarke
- Centre de recherche de l'Institut Universitaire de Gériatrie (CRIUGM), Montreal, Canada
| | - Amir Dehsarvi
- School of Medicine, Medical Sciences, and Nutrition, University of Aberdeen, Aberdeen, UK
| | - Imre Lengyel
- Wellcome-Wolfson Institute of Experimental Medicine, Queen's University, Belfast, UK
| | - Ilianna Lourida
- Health and Community Sciences, University of Exeter Medical School, Exeter, UK
| | | | - Sarah J Marzi
- UK Dementia Research Institute at Imperial College London, London, UK
- Department of Brain Sciences, Imperial College London, London, UK
| | - Petroula Proitsi
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Anto P Rajkumar
- Institute of Mental Health, Mental Health and Clinical Neurosciences academic unit, University of Nottingham, Nottingham, UK, Mental health services of older people, Nottinghamshire healthcare NHS foundation trust, Nottingham, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, UK
| | - Edina Silajdžić
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | - Janice M Ranson
- Health and Community Sciences, University of Exeter Medical School, Exeter, UK
| | - David J Llewellyn
- Health and Community Sciences, University of Exeter Medical School, Exeter, UK
- The Alan Turing Institute, London, UK
| |
Collapse
|
4
|
De Francesco S, Crema C, Archetti D, Muscio C, Reid RI, Nigri A, Bruzzone MG, Tagliavini F, Lodi R, D'Angelo E, Boeve B, Kantarci K, Firbank M, Taylor JP, Tiraboschi P, Redolfi A. Differential diagnosis of neurodegenerative dementias with the explainable MRI based machine learning algorithm MUQUBIA. Sci Rep 2023; 13:17355. [PMID: 37833302 PMCID: PMC10575864 DOI: 10.1038/s41598-023-43706-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 09/27/2023] [Indexed: 10/15/2023] Open
Abstract
Biomarker-based differential diagnosis of the most common forms of dementia is becoming increasingly important. Machine learning (ML) may be able to address this challenge. The aim of this study was to develop and interpret a ML algorithm capable of differentiating Alzheimer's dementia, frontotemporal dementia, dementia with Lewy bodies and cognitively normal control subjects based on sociodemographic, clinical, and magnetic resonance imaging (MRI) variables. 506 subjects from 5 databases were included. MRI images were processed with FreeSurfer, LPA, and TRACULA to obtain brain volumes and thicknesses, white matter lesions and diffusion metrics. MRI metrics were used in conjunction with clinical and demographic data to perform differential diagnosis based on a Support Vector Machine model called MUQUBIA (Multimodal Quantification of Brain whIte matter biomArkers). Age, gender, Clinical Dementia Rating (CDR) Dementia Staging Instrument, and 19 imaging features formed the best set of discriminative features. The predictive model performed with an overall Area Under the Curve of 98%, high overall precision (88%), recall (88%), and F1 scores (88%) in the test group, and good Label Ranking Average Precision score (0.95) in a subset of neuropathologically assessed patients. The results of MUQUBIA were explained by the SHapley Additive exPlanations (SHAP) method. The MUQUBIA algorithm successfully classified various dementias with good performance using cost-effective clinical and MRI information, and with independent validation, has the potential to assist physicians in their clinical diagnosis.
Collapse
Affiliation(s)
- Silvia De Francesco
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy.
| | - Claudio Crema
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Damiano Archetti
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| | - Cristina Muscio
- ASST Bergamo Ovest, Bergamo, Italy
- Division of Neurology V/Neuropathology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Robert I Reid
- Department of Information Technology, Mayo Clinic and Foundation, Rochester, Minnesota, USA
| | - Anna Nigri
- Department of Neuroradiology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Maria Grazia Bruzzone
- Department of Neuroradiology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Fabrizio Tagliavini
- Scientific Directorate, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Raffaele Lodi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Bologna, Italy
| | - Egidio D'Angelo
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
- IRCCS Mondino Foundation, Pavia, Italy
| | - Brad Boeve
- Department of Neurology, Mayo Clinic, Rochester, Minnesota, USA
| | - Kejal Kantarci
- Department of Radiology, Mayo Clinic, Rochester, Minnesota, USA
| | - Michael Firbank
- Translational and Clinical Research Institute, Newcastle University, Campus for Ageing and Vitality, Newcastle Upon Tyne, UK
| | - John-Paul Taylor
- Translational and Clinical Research Institute, Newcastle University, Campus for Ageing and Vitality, Newcastle Upon Tyne, UK
| | - Pietro Tiraboschi
- Division of Neurology V/Neuropathology, Fondazione IRCCS Istituto Neurologico Carlo Besta, Milan, Italy
| | - Alberto Redolfi
- Laboratory of Neuroinformatics, IRCCS Istituto Centro San Giovanni di Dio Fatebenefratelli, Brescia, Italy
| |
Collapse
|
5
|
Bottani S, Burgos N, Maire A, Saracino D, Ströer S, Dormont D, Colliot O. Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse. Med Image Anal 2023; 89:102903. [PMID: 37523918 DOI: 10.1016/j.media.2023.102903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 06/01/2023] [Accepted: 07/12/2023] [Indexed: 08/02/2023]
Abstract
A variety of algorithms have been proposed for computer-aided diagnosis of dementia from anatomical brain MRI. These approaches achieve high accuracy when applied to research data sets but their performance on real-life clinical routine data has not been evaluated yet. The aim of this work was to study the performance of such approaches on clinical routine data, based on a hospital data warehouse, and to compare the results to those obtained on a research data set. The clinical data set was extracted from the hospital data warehouse of the Greater Paris area, which includes 39 different hospitals. The research set was composed of data from the Alzheimer's Disease Neuroimaging Initiative data set. In the clinical set, the population of interest was identified by exploiting the diagnostic codes from the 10th revision of the International Classification of Diseases that are assigned to each patient. We studied how the imbalance of the training sets, in terms of contrast agent injection and image quality, may bias the results. We demonstrated that computer-aided diagnosis performance was strongly biased upwards (over 17 percent points of balanced accuracy) by the confounders of image quality and contrast agent injection, a phenomenon known as the Clever Hans effect or shortcut learning. When these biases were removed, the performance was very poor. In any case, the performance was considerably lower than on the research data set. Our study highlights that there are still considerable challenges for translating dementia computer-aided diagnosis systems to clinical routine.
Collapse
Affiliation(s)
- Simona Bottani
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière, Paris, 75013, France
| | - Ninon Burgos
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière, Paris, 75013, France
| | | | - Dario Saracino
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière, Paris, 75013, France; IM2A, Reference Centre for Rare or Early-Onset Dementias, Département de Neurologie, AP-HP, Hôpital de la Pitié Salpêtrière, Paris, 75013, France
| | - Sebastian Ströer
- AP-HP, Hôpital de la Pitié Salpêtrière, Department of Neuroradiology, Paris, 75013, France
| | - Didier Dormont
- AP-HP, Hôpital de la Pitié Salpêtrière, Department of Neuroradiology, Paris, 75013, France; Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière, DMU DIAMENT, Paris, 75013, France
| | - Olivier Colliot
- Sorbonne Université, Institut du Cerveau - Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière, Paris, 75013, France.
| |
Collapse
|
6
|
Chouliaras L, O'Brien JT. The use of neuroimaging techniques in the early and differential diagnosis of dementia. Mol Psychiatry 2023; 28:4084-4097. [PMID: 37608222 PMCID: PMC10827668 DOI: 10.1038/s41380-023-02215-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/15/2023] [Revised: 07/27/2023] [Accepted: 08/03/2023] [Indexed: 08/24/2023]
Abstract
Dementia is a leading cause of disability and death worldwide. At present there is no disease modifying treatment for any of the most common types of dementia such as Alzheimer's disease (AD), Vascular dementia, Lewy Body Dementia (LBD) and Frontotemporal dementia (FTD). Early and accurate diagnosis of dementia subtype is critical to improving clinical care and developing better treatments. Structural and molecular imaging has contributed to a better understanding of the pathophysiology of neurodegenerative dementias and is increasingly being adopted into clinical practice for early and accurate diagnosis. In this review we summarise the contribution imaging has made with particular focus on multimodal magnetic resonance imaging (MRI) and positron emission tomography imaging (PET). Structural MRI is widely used in clinical practice and can help exclude reversible causes of memory problems but has relatively low sensitivity for the early and differential diagnosis of dementia subtypes. 18F-fluorodeoxyglucose PET has high sensitivity and specificity for AD and FTD, while PET with ligands for amyloid and tau can improve the differential diagnosis of AD and non-AD dementias, including recognition at prodromal stages. Dopaminergic imaging can assist with the diagnosis of LBD. The lack of a validated tracer for α-synuclein or TAR DNA-binding protein 43 (TDP-43) imaging remain notable gaps, though work is ongoing. Emerging PET tracers such as 11C-UCB-J for synaptic imaging may be sensitive early markers but overall larger longitudinal multi-centre cross diagnostic imaging studies are needed.
Collapse
Affiliation(s)
- Leonidas Chouliaras
- Department of Psychiatry, University of Cambridge School of Clinical Medicine, Cambridge, UK
- Specialist Dementia and Frailty Service, Essex Partnership University NHS Foundation Trust, St Margaret's Hospital, Epping, UK
| | - John T O'Brien
- Department of Psychiatry, University of Cambridge School of Clinical Medicine, Cambridge, UK.
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK.
| |
Collapse
|
7
|
Azevedo T, Bethlehem RAI, Whiteside DJ, Swaddiwudhipong N, Rowe JB, Lió P, Rittman T. Identifying healthy individuals with Alzheimer's disease neuroimaging phenotypes in the UK Biobank. COMMUNICATIONS MEDICINE 2023; 3:100. [PMID: 37474615 PMCID: PMC10359360 DOI: 10.1038/s43856-023-00313-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 06/05/2023] [Indexed: 07/22/2023] Open
Abstract
BACKGROUND Identifying prediagnostic neurodegenerative disease is a critical issue in neurodegenerative disease research, and Alzheimer's disease (AD) in particular, to identify populations suitable for preventive and early disease-modifying trials. Evidence from genetic and other studies suggests the neurodegeneration of Alzheimer's disease measured by brain atrophy starts many years before diagnosis, but it is unclear whether these changes can be used to reliably detect prediagnostic sporadic disease. METHODS We trained a Bayesian machine learning neural network model to generate a neuroimaging phenotype and AD score representing the probability of AD using structural MRI data in the Alzheimer's Disease Neuroimaging Initiative (ADNI) Cohort (cut-off 0.5, AUC 0.92, PPV 0.90, NPV 0.93). We go on to validate the model in an independent real-world dataset of the National Alzheimer's Coordinating Centre (AUC 0.74, PPV 0.65, NPV 0.80) and demonstrate the correlation of the AD-score with cognitive scores in those with an AD-score above 0.5. We then apply the model to a healthy population in the UK Biobank study to identify a cohort at risk for Alzheimer's disease. RESULTS We show that the cohort with a neuroimaging Alzheimer's phenotype has a cognitive profile in keeping with Alzheimer's disease, with strong evidence for poorer fluid intelligence, and some evidence of poorer numeric memory, reaction time, working memory, and prospective memory. We found some evidence in the AD-score positive cohort for modifiable risk factors of hypertension and smoking. CONCLUSIONS This approach demonstrates the feasibility of using AI methods to identify a potentially prediagnostic population at high risk for developing sporadic Alzheimer's disease.
Collapse
Affiliation(s)
- Tiago Azevedo
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - Richard A I Bethlehem
- Brain Mapping Unit, Department of Psychiatry, University of Cambridge, Cambridge, UK
- Autism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - David J Whiteside
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - Nol Swaddiwudhipong
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - James B Rowe
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK
| | - Pietro Lió
- Department of Computer Science and Technology, University of Cambridge, Cambridge, UK
| | - Timothy Rittman
- Department of Clinical Neurosciences and Cambridge University Hospitals NHS Trust, University of Cambridge, Cambridge, UK.
| |
Collapse
|
8
|
Wyss P, Ginsbourger D, Shou H, Davatzikos C, Klöppel S, Abdulkadir A. Adaptive data-driven selection of sequences of biological and cognitive markers in pre-clinical diagnosis of dementia. Sci Rep 2023; 13:6406. [PMID: 37076487 PMCID: PMC10115887 DOI: 10.1038/s41598-023-32867-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2022] [Accepted: 04/04/2023] [Indexed: 04/21/2023] Open
Abstract
Effective clinical decision procedures must balance multiple competing objectives such as time-to-decision, acquisition costs, and accuracy. We describe and evaluate POSEIDON, a data-driven method for PrOspective SEquentIal DiagnOsis with Neutral zones to individualize clinical classifications. We evaluated the framework with an application in which the algorithm sequentially proposes to include cognitive, imaging, or molecular markers if a sufficiently more accurate prognosis of clinical decline to manifest Alzheimer's disease is expected. Over a wide range of cost parameter data-driven tuning lead to quantitatively lower total cost compared to ad hoc fixed sets of measurements. The classification accuracy based on all longitudinal data from participants that was acquired over 4.8 years on average was 0.89. The sequential algorithm selected 14 percent of available measurements and concluded after an average follow-up time of 0.74 years at the expense of 0.05 lower accuracy. Sequential classifiers were competitive from a multi-objective perspective since they could dominate fixed sets of measurements by making fewer errors using less resources. Nevertheless, the trade-off of competing objectives depends on inherently subjective prescribed cost parameters. Thus, despite the effectiveness of the method, the implementation into consequential clinical applications will remain controversial and evolve around the choice of cost parameters.
Collapse
Affiliation(s)
- Patric Wyss
- University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland
- Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland
| | - David Ginsbourger
- Institute of Mathematical Statistics and Actuarial Science, University of Bern, Bern, Switzerland
| | - Haochang Shou
- Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine at the University of Pennsylvania, Philadelphia, USA
- Center for Biomedical Image Computing and Analytics (CBICA), Perelman School of Medicine at the University of Pennsylvania, Philadelphia, USA
| | - Christos Davatzikos
- Artificial Intelligence in Biomedical Imaging Laboratory (AIBIL), Perelman School of Medicine at the University of Pennsylvania, Philadelphia, USA
| | - Stefan Klöppel
- University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland
| | - Ahmed Abdulkadir
- Artificial Intelligence in Biomedical Imaging Laboratory (AIBIL), Perelman School of Medicine at the University of Pennsylvania, Philadelphia, USA.
- Department of Clinical Neurosciences, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland.
| |
Collapse
|
9
|
Bucholc M, James C, Al Khleifat A, Badhwar A, Clarke N, Dehsarvi A, Madan CR, Marzi SJ, Shand C, Schilder BM, Tamburin S, Tantiangco HM, Lourida I, Llewellyn DJ, Ranson JM. Artificial Intelligence for Dementia Research Methods Optimization. ARXIV 2023:arXiv:2303.01949v1. [PMID: 36911275 PMCID: PMC10002770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Subscribe] [Scholar Register] [Indexed: 03/14/2023]
Abstract
INTRODUCTION Machine learning (ML) has been extremely successful in identifying key features from high-dimensional datasets and executing complicated tasks with human expert levels of accuracy or greater. METHODS We summarize and critically evaluate current applications of ML in dementia research and highlight directions for future research. RESULTS We present an overview of ML algorithms most frequently used in dementia research and highlight future opportunities for the use of ML in clinical practice, experimental medicine, and clinical trials. We discuss issues of reproducibility, replicability and interpretability and how these impact the clinical applicability of dementia research. Finally, we give examples of how state-of-the-art methods, such as transfer learning, multi-task learning, and reinforcement learning, may be applied to overcome these issues and aid the translation of research to clinical practice in the future. DISCUSSION ML-based models hold great promise to advance our understanding of the underlying causes and pathological mechanisms of dementia.
Collapse
Affiliation(s)
- Magda Bucholc
- Cognitive Analytics Research Lab, School of Computing, Engineering & Intelligent Systems, Ulster University, Derry, UK
| | - Charlotte James
- NIHR Bristol Biomedical Research Centre, University Hospitals Bristol and Weston NHS Foundation Trust and University of Bristol, Bristol, UK
| | - Ahmad Al Khleifat
- Department of Basic and Clinical Neuroscience, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, United Kingdom
| | - AmanPreet Badhwar
- Multiomics Investigation of Neurodegenerative Diseases (MIND) Lab, Centre de Recherche de l’Institut Universitaire de Gériatrie de Montréal, Montréal, Canada
- Institut de génie biomédical, Université de Montréal, Montréal, Canada
- Département de Pharmacologie et Physiologie, Université de Montréal, Montréal, Canada
| | - Natasha Clarke
- Multiomics Investigation of Neurodegenerative Diseases (MIND) Lab, Centre de Recherche de l’Institut Universitaire de Gériatrie de Montréal, Montréal, Canada
| | - Amir Dehsarvi
- Aberdeen Biomedical Imaging Centre, School of Medicine, Medical Sciences, and Nutrition, University of Aberdeen, Aberdeen, UK
| | | | - Sarah J. Marzi
- UK Dementia Research Institute, Imperial College London, London, UK
- Department of Brain Sciences, Imperial College London, London, UK
| | - Cameron Shand
- Centre for Medical Image Computing, Department of Computer Science, University College London, London, UK
| | - Brian M. Schilder
- UK Dementia Research Institute, Imperial College London, London, UK
- Department of Brain Sciences, Imperial College London, London, UK
| | - Stefano Tamburin
- Department of Neurosciences, Biomedicine and Movement Sciences, University of Verona, Verona, Italy
| | | | | | - David J. Llewellyn
- University of Exeter Medical School, Exeter, UK
- The Alan Turing Institute, London, UK
| | | |
Collapse
|
10
|
Hedderich DM, Schmitz-Koep B, Schuberth M, Schultz V, Schlaeger SJ, Schinz D, Rubbert C, Caspers J, Zimmer C, Grimmer T, Yakushev I. Impact of normative brain volume reports on the diagnosis of neurodegenerative dementia disorders in neuroradiology: A real-world, clinical practice study. Front Aging Neurosci 2022; 14:971863. [PMID: 36313028 PMCID: PMC9597632 DOI: 10.3389/fnagi.2022.971863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Accepted: 09/20/2022] [Indexed: 12/02/2022] Open
Abstract
Background: Normative brain volume reports (NBVR) are becoming more available in the work-up of patients with suspected dementia disorders, potentially leveraging the value of structural MRI in clinical settings. The present study aims to investigate the impact of NBVRs on the diagnosis of neurodegenerative dementia disorders in real-world clinical practice. Methods: We retrospectively analyzed data of 112 memory clinic patients, who were consecutively referred for MRI and 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET) during a 12-month period. Structural MRI was assessed by two residents with 2 and 3 years of neuroimaging experience. Statements and diagnostic confidence regarding the presence of a neurodegenerative disorder in general (first level) and Alzheimer’s disease (AD) pattern in particular (second level) were recorded without and with NBVR information. FDG-PET served as the reference standard. Results: Overall, despite a trend towards increased accuracy, the impact of NBVRs on diagnostic accuracy was low and non-significant. We found a significant drop of sensitivity (0.75–0.58; p < 0.001) and increase of specificity (0.62–0.85; p < 0.001) for rater 1 at identifying patients with neurodegenerative dementia disorders. Diagnostic confidence increased for rater 2 (p < 0.001). Conclusions: Overall, NBVRs had a limited impact on diagnostic accuracy in real-world clinical practice. Potentially, NBVR might increase diagnostic specificity and confidence of neuroradiology residents. To this end, a well-defined framework for integration of NBVR in the diagnostic process and improved algorithms of NBVR generation are essential.
Collapse
Affiliation(s)
- Dennis M. Hedderich
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
- *Correspondence: Dennis M. Hedderich
| | - Benita Schmitz-Koep
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - Madeleine Schuberth
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - Vivian Schultz
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - Sarah J. Schlaeger
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - David Schinz
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - Christian Rubbert
- Department of Diagnostic and Interventional Radiology, Medical Faculty, University Dusseldorf, Dusseldorf, Germany
| | - Julian Caspers
- Department of Diagnostic and Interventional Radiology, Medical Faculty, University Dusseldorf, Dusseldorf, Germany
| | - Claus Zimmer
- Department of Neuroradiology, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| | - Timo Grimmer
- Department of Psychiatry and Psychotherapy, Klinikum rechts der Isar, Sch, Munich, Germany
| | - Igor Yakushev
- Department of Nuclear Medicine, Klinikum rechts der Isar, School of Medicine, Technical University of Munich, Munich, Germany
| |
Collapse
|
11
|
Frizzell TO, Glashutter M, Liu CC, Zeng A, Pan D, Hajra SG, D’Arcy RC, Song X. Artificial intelligence in brain MRI analysis of Alzheimer's disease over the past 12 years: A systematic review. Ageing Res Rev 2022; 77:101614. [PMID: 35358720 DOI: 10.1016/j.arr.2022.101614] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Revised: 03/02/2022] [Accepted: 03/24/2022] [Indexed: 12/17/2022]
Abstract
INTRODUCTION Multiple structural brain changes in Alzheimer's disease (AD) and mild cognitive impairment (MCI) have been revealed on magnetic resonance imaging (MRI). There is a fast-growing effort in applying artificial intelligence (AI) to analyze these data. Here, we review and evaluate the AI studies in brain MRI analysis with synthesis. METHODS A systematic review of the literature, spanning the years from 2009 to 2020, was completed using the PubMed database. AI studies using MRI imaging to investigate normal aging, mild cognitive impairment, and AD-dementia were retrieved for review. Bias assessment was completed using the PROBAST criteria. RESULTS 97 relevant studies were included in the review. The studies were typically focused on the classification of AD, MCI, and normal aging (71% of the reported studies) and the prediction of MCI conversion to AD (25%). The best performance was achieved by using the deep learning-based convolution neural network algorithms (weighted average accuracy 89%), in contrast to 76-86% using Logistic Regression, Support Vector Machines, and other AI methods. DISCUSSION The synthesized evidence is paramount to developing sophisticated AI approaches to reliably capture and quantify multiple subtle MRI changes in the whole brain that exemplify the complexity and heterogeneity of AD and brain aging.
Collapse
|
12
|
McKenna MC, Murad A, Huynh W, Lope J, Bede P. The changing landscape of neuroimaging in frontotemporal lobar degeneration: from group-level observations to single-subject data interpretation. Expert Rev Neurother 2022; 22:179-207. [PMID: 35227146 DOI: 10.1080/14737175.2022.2048648] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
INTRODUCTION While the imaging signatures of frontotemporal lobar degeneration (FTLD) phenotypes and genotypes are well-characterised based on group-level descriptive analyses, the meaningful interpretation of single MRI scans remains challenging. Single-subject MRI classification frameworks rely on complex computational models and large training datasets to categorise individual patients into diagnostic subgroups based on distinguishing imaging features. Reliable individual subject data interpretation is hugely important in the clinical setting to expedite the diagnosis and classify individuals into relevant prognostic categories. AREAS COVERED This article reviews (1) the neuroimaging studies that propose single-subject MRI classification strategies in symptomatic and pre-symptomatic FTLD, (2) potential practical implications and (3) the limitations of current single-subject data interpretation models. EXPERT OPINION Classification studies in FTLD have demonstrated the feasibility of categorising individual subjects into diagnostic groups based on multiparametric imaging data. Preliminary data indicate that pre-symptomatic FTLD mutation carriers may also be reliably distinguished from controls. Despite momentous advances in the field, significant further improvements are needed before these models can be developed into viable clinical applications.
Collapse
Affiliation(s)
| | - Aizuri Murad
- Computational Neuroimaging Group, Trinity College Dublin, Ireland
| | - William Huynh
- Brain and Mind Centre, University of Sydney, Australia
| | - Jasmin Lope
- Computational Neuroimaging Group, Trinity College Dublin, Ireland
| | - Peter Bede
- Computational Neuroimaging Group, Trinity College Dublin, Ireland.,Pitié-Salpêtrière University Hospital, Sorbonne University, France
| |
Collapse
|
13
|
McKenna MC, Tahedl M, Murad A, Lope J, Hardiman O, Hutchinson S, Bede P. White matter microstructure alterations in frontotemporal dementia: Phenotype-associated signatures and single-subject interpretation. Brain Behav 2022; 12:e2500. [PMID: 35072974 PMCID: PMC8865163 DOI: 10.1002/brb3.2500] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 11/22/2021] [Accepted: 01/01/2022] [Indexed: 12/26/2022] Open
Abstract
BACKGROUND Frontotemporal dementias (FTD) include a genetically heterogeneous group of conditions with distinctive molecular, radiological and clinical features. The majority of radiology studies in FTD compare FTD subgroups to healthy controls to describe phenotype- or genotype-associated imaging signatures. While the characterization of group-specific imaging traits is academically important, the priority of clinical imaging is the meaningful interpretation of individual datasets. METHODS To demonstrate the feasibility of single-subject magnetic resonance imaging (MRI) interpretation, we have evaluated the white matter profile of 60 patients across the clinical spectrum of FTD. A z-score-based approach was implemented, where the diffusivity metrics of individual patients were appraised with reference to demographically matched healthy controls. Fifty white matter tracts were systematically evaluated in each subject with reference to normative data. RESULTS The z-score-based approach successfully detected white matter pathology in single subjects, and group-level inferences were analogous to the outputs of standard track-based spatial statistics. CONCLUSIONS Our findings suggest that it is possible to meaningfully evaluate the diffusion profile of single FTD patients if large normative datasets are available. In contrast to the visual review of FLAIR and T2-weighted images, computational imaging offers objective, quantitative insights into white matter integrity changes even at single-subject level.
Collapse
Affiliation(s)
- Mary Clare McKenna
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland
| | - Marlene Tahedl
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland
| | - Aizuri Murad
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland
| | - Jasmin Lope
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland
| | - Orla Hardiman
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland
| | | | - Peter Bede
- Computational Neuroimaging Group, Trinity College Dublin, Dublin, Ireland.,Department of Neurology, St James's Hospital, Dublin, Ireland
| |
Collapse
|
14
|
Pemberton HG, Zaki LAM, Goodkin O, Das RK, Steketee RME, Barkhof F, Vernooij MW. Technical and clinical validation of commercial automated volumetric MRI tools for dementia diagnosis-a systematic review. Neuroradiology 2021; 63:1773-1789. [PMID: 34476511 PMCID: PMC8528755 DOI: 10.1007/s00234-021-02746-3] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Accepted: 06/02/2021] [Indexed: 12/22/2022]
Abstract
Developments in neuroradiological MRI analysis offer promise in enhancing objectivity and consistency in dementia diagnosis through the use of quantitative volumetric reporting tools (QReports). Translation into clinical settings should follow a structured framework of development, including technical and clinical validation steps. However, published technical and clinical validation of the available commercial/proprietary tools is not always easy to find and pathways for successful integration into the clinical workflow are varied. The quantitative neuroradiology initiative (QNI) framework highlights six necessary steps for the development, validation and integration of quantitative tools in the clinic. In this paper, we reviewed the published evidence regarding regulatory-approved QReports for use in the memory clinic and to what extent this evidence fulfils the steps of the QNI framework. We summarize unbiased technical details of available products in order to increase the transparency of evidence and present the range of reporting tools on the market. Our intention is to assist neuroradiologists in making informed decisions regarding the adoption of these methods in the clinic. For the 17 products identified, 11 companies have published some form of technical validation on their methods, but only 4 have published clinical validation of their QReports in a dementia population. Upon systematically reviewing the published evidence for regulatory-approved QReports in dementia, we concluded that there is a significant evidence gap in the literature regarding clinical validation, workflow integration and in-use evaluation of these tools in dementia MRI diagnosis.
Collapse
Affiliation(s)
- Hugh G Pemberton
- Centre for Medical Image Computing (CMIC), Department of Medical Physics and Bioengineering, University College London, London, UK.
- UCL Queen Square Institute of Neurology, University College London, London, UK.
- Dementia Research Centre, UCL Queen Square Institute of Neurology, University College London, London, UK.
| | - Lara A M Zaki
- Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Olivia Goodkin
- Centre for Medical Image Computing (CMIC), Department of Medical Physics and Bioengineering, University College London, London, UK
- UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Ravi K Das
- Clinical, Educational and Health Psychology, University College London, London, UK
| | - Rebecca M E Steketee
- Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - Frederik Barkhof
- Centre for Medical Image Computing (CMIC), Department of Medical Physics and Bioengineering, University College London, London, UK
- UCL Queen Square Institute of Neurology, University College London, London, UK
- Radiology & Nuclear Medicine, VU University Medical Center, Amsterdam, The Netherlands
| | - Meike W Vernooij
- Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
- Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| |
Collapse
|
15
|
Wibawa P, Matta G, Das S, Eratne D, Farrand S, Desmond P, Velakoulis D, Gaillard F. Bringing psychiatrists into the picture: Automated measurement of regional MRI brain volume in patients with suspected dementia. Aust N Z J Psychiatry 2021; 55:799-808. [PMID: 33726553 DOI: 10.1177/0004867421998444] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
OBJECTIVE The volumes of various brain regions can be rapidly quantified using automated magnetic resonance imaging tools. While these appear to be useful at face value, their formal clinical utility is not yet understood, particularly for non-neuroradiologists and in patients presenting with suspected dementia. This study investigated the utility of an automated normative morphometry tool on determinations of brain atrophy by psychiatrists and radiologists in a tertiary hospital. METHODS Consecutive magnetic resonance scans (n = 110) of patients referred with suspected neurodegenerative disorders were obtained retrospectively and rated by two neuroradiologists, two general radiologists and four psychiatrists over two sessions. First, conventional magnetic resonance sequences were shown. Then, morphometry colour-coded maps, which segmented T1-weighted magnetisation prepared rapid gradient echo images into brain regions and visualised these regions in colour according to their volumetric standard deviation from a normative population, were added to the second reading which occurred ⩾6 weeks later. Presence and laterality of atrophy in frontal, parietal and temporal lobes and hippocampal regions were measured using a digital checklist. The primary outcome of inter-rater agreement on atrophy was measured with Fleiss' Kappa (κ). We also evaluated the accuracy of the atrophy ratings for differentiating post hoc diagnosis of subjective cognitive impairment, mild cognitive impairment and dementia. RESULTS Agreement among all raters was fair in frontal lobe and moderate in other regions with conventional method (κ = 0.362-0.555). With morphometry, higher agreement was seen in all regions (κ = 0.551-0.654), reaching significant improvement in the frontal and temporal lobes. No significant improvement was seen within the various disciplines, except in frontal lobes rated by psychiatrists. Accuracy of atrophy ratings on determining post hoc diagnosis was significantly improved for distinguishing subjective cognitive impairment versus dementia. CONCLUSION In routine clinical assessment, automated normative morphometry complements the determination of regional atrophy and improves inter-rater agreement regardless of neuroradiology experience.
Collapse
Affiliation(s)
- Pierre Wibawa
- Neuropsychiatry Unit, The Royal Melbourne Hospital, Melbourne, VIC, Australia
- Melbourne Neuropsychiatry Centre, The University of Melbourne, Melbourne, VIC, Australia
| | - Gabrielle Matta
- Neuropsychiatry Unit, The Royal Melbourne Hospital, Melbourne, VIC, Australia
| | - Sourav Das
- College of Science and Engineering, James Cook University, Townsville, QLD, Australia
| | - Dhamidhu Eratne
- Neuropsychiatry Unit, The Royal Melbourne Hospital, Melbourne, VIC, Australia
- Melbourne Neuropsychiatry Centre, The University of Melbourne, Melbourne, VIC, Australia
| | - Sarah Farrand
- Department of Radiology and Medicine, The Royal Melbourne Hospital, The University of Melbourne, Melbourne, VIC, Australia
- Department of Radiology, The Royal Melbourne Hospital, Melbourne, VIC, Australia
| | - Patricia Desmond
- Department of Radiology and Medicine, The Royal Melbourne Hospital, The University of Melbourne, Melbourne, VIC, Australia
- Department of Radiology, The Royal Melbourne Hospital, Melbourne, VIC, Australia
| | - Dennis Velakoulis
- Neuropsychiatry Unit, The Royal Melbourne Hospital, Melbourne, VIC, Australia
- Melbourne Neuropsychiatry Centre, The University of Melbourne, Melbourne, VIC, Australia
| | - Frank Gaillard
- Department of Radiology and Medicine, The Royal Melbourne Hospital, The University of Melbourne, Melbourne, VIC, Australia
- Department of Radiology, The Royal Melbourne Hospital, Melbourne, VIC, Australia
| |
Collapse
|
16
|
Effect of MRI acquisition acceleration via compressed sensing and parallel imaging on brain volumetry. MAGNETIC RESONANCE MATERIALS IN PHYSICS, BIOLOGY AND MEDICINE 2021; 34:487-497. [PMID: 33502667 PMCID: PMC8338844 DOI: 10.1007/s10334-020-00906-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/15/2020] [Revised: 12/15/2020] [Accepted: 12/30/2020] [Indexed: 11/06/2022]
Abstract
Objectives To investigate the effect of compressed SENSE (CS), an acceleration technique combining parallel imaging and compressed sensing, on potential bias and precision of brain volumetry and evaluate it in the context of normative brain volumetry. Materials and methods In total, 171 scans from scan-rescan experiments on three healthy subjects were analyzed. Each subject received 3D-T1-weighted brain MRI scans at increasing degrees of acceleration (CS-factor = 1/4/8/12/16/20/32). Single-scan acquisition times ranged from 00:41 min (CS-factor = 32) to 21:52 min (CS-factor = 1). Brain segmentation and volumetry was performed using two different software tools: md.brain, a proprietary software based on voxel-based morphometry, and FreeSurfer, an open-source software based on surface-based morphometry. Four sub-volumes were analyzed: brain parenchyma (BP), total gray matter, total white matter, and cerebrospinal fluid (CSF). Coefficient of variation (CoV) of the repeated measurements as a measure of intra-subject reliability was calculated. Intraclass correlation coefficient (ICC) with regard to increasing CS-factor was calculated as another measure of reliability. Noise-to-contrast ratio as a measure of image quality was calculated for each dataset to analyze the association between acceleration factor, noise and volumetric brain measurements. Results For all sub-volumes, there is a systematic bias proportional to the CS-factor which is dependent on the utilized software and subvolume. Measured volumes deviated significantly from the reference standard (CS-factor = 1), e.g. ranging from 1 to 13% for BP. The CS-induced systematic bias is driven by increased image noise. Except for CSF, reliability of brain volumetry remains high, demonstrated by low CoV (< 1% for CS-factor up to 20) and good to excellent ICC for CS-factor up to 12. Conclusion CS-acceleration has a systematic biasing effect on volumetric brain measurements. Supplementary Information The online version contains supplementary material available at 10.1007/s10334-020-00906-9.
Collapse
|
17
|
Venkatraghavan V, Vinke EJ, Bron EE, Niessen WJ, Arfan Ikram M, Klein S, Vernooij MW. Progression along data-driven disease timelines is predictive of Alzheimer's disease in a population-based cohort. Neuroimage 2021; 238:118233. [PMID: 34091030 DOI: 10.1016/j.neuroimage.2021.118233] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2020] [Revised: 04/11/2021] [Accepted: 06/01/2021] [Indexed: 11/15/2022] Open
Abstract
Data-driven disease progression models have provided important insight into the timeline of brain changes in AD phenotypes. However, their utility in predicting the progression of pre-symptomatic AD in a population-based setting has not yet been investigated. In this study, we investigated if the disease timelines constructed in a case-controlled setting, with subjects stratified according to APOE status, are generalizable to a population-based cohort, and if progression along these disease timelines is predictive of AD. Seven volumetric biomarkers derived from structural MRI were considered. We estimated APOE-specific disease timelines of changes in these biomarkers using a recently proposed method called co-initialized discriminative event-based modeling (co-init DEBM). This method can also estimate a disease stage for new subjects by calculating their position along the disease timelines. The model was trained and cross-validated on the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset, and tested on the population-based Rotterdam Study (RS) cohort. We compared the diagnostic and prognostic value of the disease stage in the two cohorts. Furthermore, we investigated if the rate of change of disease stage in RS participants with longitudinal MRI data was predictive of AD. In ADNI, the estimated disease timeslines for ϵ4 non-carriers and carriers were found to be significantly different from one another (p<0.001). The estimate disease stage along the respective timelines distinguished AD subjects from controls with an AUC of 0.83 in both APOEϵ4 non-carriers and carriers. In the RS cohort, we obtained an AUC of 0.83 and 0.85 in ϵ4 non-carriers and carriers, respectively. Progression along the disease timelines as estimated by the rate of change of disease stage showed a significant difference (p<0.005) for subjects with pre-symptomatic AD as compared to the general aging population in RS. It distinguished pre-symptomatic AD subjects with an AUC of 0.81 in APOEϵ4 non-carriers and 0.88 in carriers, which was better than any individual volumetric biomarker, or its rate of change, could achieve. Our results suggest that co-init DEBM trained on case-controlled data is generalizable to a population-based cohort setting and that progression along the disease timelines is predictive of the development of AD in the general population. We expect that this approach can help to identify at-risk individuals from the general population for targeted clinical trials as well as to provide biomarker based objective assessment in such trials.
Collapse
Affiliation(s)
- Vikram Venkatraghavan
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Elisabeth J Vinke
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands; Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Esther E Bron
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Wiro J Niessen
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands; Quantitative Imaging Group, Dept. of Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft, The Netherlands
| | - M Arfan Ikram
- Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Stefan Klein
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Meike W Vernooij
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands; Department of Epidemiology, Erasmus MC, University Medical Center Rotterdam, The Netherlands.
| | | |
Collapse
|
18
|
Feis RA, van der Grond J, Bouts MJRJ, Panman JL, Poos JM, Schouten TM, de Vos F, Jiskoot LC, Dopper EGP, van Buchem MA, van Swieten JC, Rombouts SARB. Classification using fractional anisotropy predicts conversion in genetic frontotemporal dementia, a proof of concept. Brain Commun 2021; 2:fcaa079. [PMID: 33543126 PMCID: PMC7846185 DOI: 10.1093/braincomms/fcaa079] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2019] [Revised: 04/29/2020] [Accepted: 05/11/2020] [Indexed: 11/14/2022] Open
Abstract
Frontotemporal dementia is a highly heritable and devastating neurodegenerative disease. About 10–20% of all frontotemporal dementia is caused by known pathogenic mutations, but a reliable tool to predict clinical conversion in mutation carriers is lacking. In this retrospective proof-of-concept case-control study, we investigate whether MRI-based and cognition-based classifiers can predict which mutation carriers from genetic frontotemporal dementia families will develop symptoms (‘convert’) within 4 years. From genetic frontotemporal dementia families, we included 42 presymptomatic frontotemporal dementia mutation carriers. We acquired anatomical, diffusion-weighted imaging, and resting-state functional MRI, as well as neuropsychological data. After 4 years, seven mutation carriers had converted to frontotemporal dementia (‘converters’), while 35 had not (‘non-converters’). We trained regularized logistic regression models on baseline MRI and cognitive data to predict conversion to frontotemporal dementia within 4 years, and quantified prediction performance using area under the receiver operating characteristic curves. The prediction model based on fractional anisotropy, with highest contribution of the forceps minor, predicted conversion to frontotemporal dementia beyond chance level (0.81 area under the curve, family-wise error corrected P = 0.025 versus chance level). Other MRI-based and cognitive features did not outperform chance level. Even in a small sample, fractional anisotropy predicted conversion in presymptomatic frontotemporal dementia mutation carriers beyond chance level. After validation in larger data sets, conversion prediction in genetic frontotemporal dementia may facilitate early recruitment into clinical trials.
Collapse
Affiliation(s)
- Rogier A Feis
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands.,Institute of Psychology, Leiden University, 2333 AK, Leiden, the Netherlands
| | - Jeroen van der Grond
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands
| | - Mark J R J Bouts
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands.,Institute of Psychology, Leiden University, 2333 AK, Leiden, the Netherlands
| | - Jessica L Panman
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Department of Neurology, Erasmus Medical Centre, 3015 GD, Rotterdam, the Netherlands
| | - Jackie M Poos
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Department of Neurology, Erasmus Medical Centre, 3015 GD, Rotterdam, the Netherlands
| | - Tijn M Schouten
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands.,Institute of Psychology, Leiden University, 2333 AK, Leiden, the Netherlands
| | - Frank de Vos
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands.,Institute of Psychology, Leiden University, 2333 AK, Leiden, the Netherlands
| | - Lize C Jiskoot
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Department of Neurology, Erasmus Medical Centre, 3015 GD, Rotterdam, the Netherlands.,Dementia Research Centre, University College London, London, WC1N 3AR, UK
| | - Elise G P Dopper
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Department of Neurology, Erasmus Medical Centre, 3015 GD, Rotterdam, the Netherlands
| | - Mark A van Buchem
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands
| | - John C van Swieten
- Department of Neurology, Erasmus Medical Centre, 3015 GD, Rotterdam, the Netherlands
| | - Serge A R B Rombouts
- Department of Radiology, Leiden University Medical Centre, 2333 ZA, Leiden, the Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, 2333 ZA, Leiden, the Netherlands.,Institute of Psychology, Leiden University, 2333 AK, Leiden, the Netherlands
| |
Collapse
|
19
|
Yu Q, Mai Y, Ruan Y, Luo Y, Zhao L, Fang W, Cao Z, Li Y, Liao W, Xiao S, Mok VCT, Shi L, Liu J. An MRI-based strategy for differentiation of frontotemporal dementia and Alzheimer's disease. Alzheimers Res Ther 2021; 13:23. [PMID: 33436059 PMCID: PMC7805212 DOI: 10.1186/s13195-020-00757-5] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Accepted: 12/21/2020] [Indexed: 02/06/2023]
Abstract
BACKGROUND The differential diagnosis of frontotemporal dementia (FTD) and Alzheimer's disease (AD) is difficult due to the overlaps of clinical symptoms. Structural magnetic resonance imaging (sMRI) presents distinct brain atrophy and potentially helps in their differentiation. In this study, we aim at deriving a novel integrated index by leveraging the volumetric measures in brain regions with significant difference between AD and FTD and developing an MRI-based strategy for the differentiation of FTD and AD. METHODS In this study, the data were acquired from three different databases, including 47 subjects with FTD, 47 subjects with AD, and 47 normal controls in the NACC database; 50 subjects with AD in the ADNI database; and 50 subjects with FTD in the FTLDNI database. The MR images of all subjects were automatically segmented, and the brain atrophy, including the AD resemblance atrophy index (AD-RAI), was quantified using AccuBrain®. A novel MRI index, named the frontotemporal dementia index (FTDI), was derived as the ratio between the weighted sum of the volumetric indexes in "FTD dominant" structures over that obtained from "AD dominant" structures. The weights and the identification of "FTD/AD dominant" structures were acquired from the statistical analysis of NACC data. The differentiation performance of FTDI was validated using independent data from ADNI and FTLDNI databases. RESULTS AD-RAI is a proven imaging biomarker to identify AD and FTD from NC with significantly higher values (p < 0.001 and AUC = 0.88) as we reported before, while no significant difference was found between AD and FTD (p = 0.647). FTDI showed excellent accuracy in identifying FTD from AD (AUC = 0.90; SEN = 89%, SPE = 75% with threshold value = 1.08). The validation using independent data from ADNI and FTLDNI datasets also confirmed the efficacy of FTDI (AUC = 0.93; SEN = 96%, SPE = 70% with threshold value = 1.08). CONCLUSIONS Brain atrophy in AD, FTD, and normal elderly shows distinct patterns. In addition to AD-RAI that is designed to detect abnormal brain atrophy in dementia, a novel index specific to FTD is proposed and validated. By combining AD-RAI and FTDI, an MRI-based decision strategy was further proposed as a promising solution for the differential diagnosis of AD and FTD in clinical practice.
Collapse
Affiliation(s)
- Qun Yu
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Yingren Mai
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Yuting Ruan
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Yishan Luo
- BrainNow Research Institute, Shenzhen, China
| | - Lei Zhao
- BrainNow Research Institute, Shenzhen, China
| | - Wenli Fang
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Zhiyu Cao
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Yi Li
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Wang Liao
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Songhua Xiao
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China
| | - Vincent C T Mok
- BrainNow Research Institute, Shenzhen, China
- Gerald Choa Neuroscience Centre, Lui Che Woo Institute of Innovative Medicine, Division of Neurology, Department of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Lin Shi
- BrainNow Research Institute, Shenzhen, China.
- Department of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Hong Kong SAR, China.
| | - Jun Liu
- Department of Neurology, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, No. 107 Yanjiang West Road, Guangzhou, Guangdong, China.
- Guangdong Province Key Laboratory of Brain Function and Disease, Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China.
- Laboratory of RNA and Major Diseases of Brain and Heart, Sun Yat-sen Memorial Hospital, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
20
|
Abstract
Magnetic resonance imaging (MRI) is a noninvasive imaging tool for neuroradiological diagnosis. Numerous concepts of automated MRI analysis and the use of machine learning have been proposed to assist diagnosis and prognosis. While these academic innovations have proven effective in principle within controlled environments, their application to clinical practice has faced unmet requirements, such as the ability to perform reliably across a heterogeneous population, to work robustly in the presence of comorbidities, and to be invariant to scanner hardware and image quality. The lack of realistic confidence bounds and the inability to handle missing data have also reduced the application of most of these methods outside of academic studies. Mastering the complex challenges in the diagnostic process may help researchers discover novel biological constructs in multimodal data and improve stratification for clinical trials, paving the way for precision medicine. This review presents the state of the art of computerized brain MRI analysis for diagnostic purposes. We critically evaluate the current clinical usefulness of the methods and highlight challenges and future perspectives of the field.
Collapse
Affiliation(s)
- Saima Rathore
- Center for Biomedical Image Computing and Analytics, Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
| | - Ahmed Abdulkadir
- Center for Biomedical Image Computing and Analytics, Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
- University Hospital of of Old Age Psychiatry and Psychotherapy, University of Bern, 3008 Bern, Switzerland
| | - Christos Davatzikos
- Center for Biomedical Image Computing and Analytics, Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania 19104, USA
| |
Collapse
|
21
|
Automated voxel- and region-based analysis of gray matter and cerebrospinal fluid space in primary dementia disorders. Brain Res 2020; 1739:146800. [DOI: 10.1016/j.brainres.2020.146800] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Revised: 02/26/2020] [Accepted: 03/20/2020] [Indexed: 11/20/2022]
|
22
|
Ducharme S, Dols A, Laforce R, Devenney E, Kumfor F, van den Stock J, Dallaire-Théroux C, Seelaar H, Gossink F, Vijverberg E, Huey E, Vandenbulcke M, Masellis M, Trieu C, Onyike C, Caramelli P, de Souza LC, Santillo A, Waldö ML, Landin-Romero R, Piguet O, Kelso W, Eratne D, Velakoulis D, Ikeda M, Perry D, Pressman P, Boeve B, Vandenberghe R, Mendez M, Azuar C, Levy R, Le Ber I, Baez S, Lerner A, Ellajosyula R, Pasquier F, Galimberti D, Scarpini E, van Swieten J, Hornberger M, Rosen H, Hodges J, Diehl-Schmid J, Pijnenburg Y. Recommendations to distinguish behavioural variant frontotemporal dementia from psychiatric disorders. Brain 2020; 143:1632-1650. [PMID: 32129844 PMCID: PMC7849953 DOI: 10.1093/brain/awaa018] [Citation(s) in RCA: 145] [Impact Index Per Article: 36.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2019] [Revised: 11/27/2019] [Accepted: 12/08/2019] [Indexed: 12/12/2022] Open
Abstract
The behavioural variant of frontotemporal dementia (bvFTD) is a frequent cause of early-onset dementia. The diagnosis of bvFTD remains challenging because of the limited accuracy of neuroimaging in the early disease stages and the absence of molecular biomarkers, and therefore relies predominantly on clinical assessment. BvFTD shows significant symptomatic overlap with non-degenerative primary psychiatric disorders including major depressive disorder, bipolar disorder, schizophrenia, obsessive-compulsive disorder, autism spectrum disorders and even personality disorders. To date, ∼50% of patients with bvFTD receive a prior psychiatric diagnosis, and average diagnostic delay is up to 5-6 years from symptom onset. It is also not uncommon for patients with primary psychiatric disorders to be wrongly diagnosed with bvFTD. The Neuropsychiatric International Consortium for Frontotemporal Dementia was recently established to determine the current best clinical practice and set up an international collaboration to share a common dataset for future research. The goal of the present paper was to review the existing literature on the diagnosis of bvFTD and its differential diagnosis with primary psychiatric disorders to provide consensus recommendations on the clinical assessment. A systematic literature search with a narrative review was performed to determine all bvFTD-related diagnostic evidence for the following topics: bvFTD history taking, psychiatric assessment, clinical scales, physical and neurological examination, bedside cognitive tests, neuropsychological assessment, social cognition, structural neuroimaging, functional neuroimaging, CSF and genetic testing. For each topic, responsible team members proposed a set of minimal requirements, optimal clinical recommendations, and tools requiring further research or those that should be developed. Recommendations were listed if they reached a ≥ 85% expert consensus based on an online survey among all consortium participants. New recommendations include performing at least one formal social cognition test in the standard neuropsychological battery for bvFTD. We emphasize the importance of 3D-T1 brain MRI with a standardized review protocol including validated visual atrophy rating scales, and to consider volumetric analyses if available. We clarify the role of 18F-fluorodeoxyglucose PET for the exclusion of bvFTD when normal, whereas non-specific regional metabolism abnormalities should not be over-interpreted in the case of a psychiatric differential diagnosis. We highlight the potential role of serum or CSF neurofilament light chain to differentiate bvFTD from primary psychiatric disorders. Finally, based on the increasing literature and clinical experience, the consortium determined that screening for C9orf72 mutation should be performed in all possible/probable bvFTD cases or suspected cases with strong psychiatric features.
Collapse
Affiliation(s)
- Simon Ducharme
- Department of Psychiatry, McGill University Health Centre, McGill University, Montreal, Canada
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, 3801 University Str., Montreal, Quebec, H3A 2B4, Canada
| | - Annemiek Dols
- Department of Old Age Psychiatry, GGZ InGeest, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Robert Laforce
- Clinique Interdisciplinaire de Mémoire (CIME), Laval University, Quebec, Canada
| | - Emma Devenney
- Brain and Mind Centre, University of Sydney, Sydney, Australia
| | - Fiona Kumfor
- Brain and Mind Centre, University of Sydney, Sydney, Australia
| | - Jan van den Stock
- Laboratory for Translational Neuropsychiatry, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | | | - Harro Seelaar
- Department of Neurology, Erasmus University Medical Centre, Rotterdam, The Netherlands
| | - Flora Gossink
- Department of Old Age Psychiatry, GGZ InGeest, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Everard Vijverberg
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| | - Edward Huey
- Taub Institute for Research on Alzheimer’s Disease and the Aging Brain, Department of Psychiatry, Colombia University, New York, USA
| | - Mathieu Vandenbulcke
- Department of Geriatric Psychiatry, University Hospitals Leuven, Leuven, Belgium
| | - Mario Masellis
- Department of Neurology, Sunnybrook Health Sciences Centre, Toronto, Canada
| | - Calvin Trieu
- Department of Old Age Psychiatry, GGZ InGeest, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Chiadi Onyike
- Division of Geriatric Psychiatry and Neuropsychiatry, Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, USA
| | - Paulo Caramelli
- Behavioral and Cognitive Neurology Research Group, Department of Internal Medicine, Faculdade de Medicina, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Leonardo Cruz de Souza
- Behavioral and Cognitive Neurology Research Group, Department of Internal Medicine, Faculdade de Medicina, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | | | - Maria Landqvist Waldö
- Division of Clinical Sciences Helsingborg, Department of Clinical Sciences Lund, Lund University, Lund, Sweden
| | | | - Olivier Piguet
- Division of Clinical Sciences Helsingborg, Department of Clinical Sciences Lund, Lund University, Lund, Sweden
| | - Wendy Kelso
- Neuropsychiatry Unit, Royal Melbourne Hospital, Melbourne, Australia
| | - Dhamidhu Eratne
- Neuropsychiatry Unit, Royal Melbourne Hospital, Melbourne, Australia
| | - Dennis Velakoulis
- Neuropsychiatry Unit, Royal Melbourne Hospital, Melbourne, Australia
| | - Manabu Ikeda
- Department of Psychiatry, Osaka University Graduate School of Medicine, Osaka, Japan
| | - David Perry
- Department of Neurology, UCSF Weill Institute for Neurosciences, University of California San Francisco, San Francisco, USA
| | - Peter Pressman
- Department of Neurology, University of Colorado Denver, Aurora, USA
| | - Bradley Boeve
- Department of Neurology, Mayo Clinic, Rochester, Minnesota, USA
| | - Rik Vandenberghe
- Department of Neurology, University Hospital Leuven, Leuven, Belgium
| | - Mario Mendez
- Department of Neurology, UCLA Medical Centre, University of California Los Angeles, Los Angeles, USA
| | - Carole Azuar
- Department of Neurology, Hôpital La Pitié Salpêtrière, Paris, France
| | - Richard Levy
- Department of Neurology, Hôpital La Pitié Salpêtrière, Paris, France
| | - Isabelle Le Ber
- Department of Neurology, Hôpital La Pitié Salpêtrière, Paris, France
| | - Sandra Baez
- Department of Psychology, Andes University, Bogota, Colombia
| | - Alan Lerner
- Department of Neurology, University Hospital Cleveland Medical Center, Cleveland, USA
| | - Ratnavalli Ellajosyula
- Department of Neurology, Manipal Hospital and Annasawmy Mudaliar Hospital, Bangalore, India
| | - Florence Pasquier
- Univ Lille, Inserm U1171, Memory Center, CHU Lille, DISTAlz, Lille, France
| | - Daniela Galimberti
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Centro Dino Ferrari, Milan, Italy
- Fondazione IRCCS Ca’ Granda, Ospedale Policlinico, Neurodegenerative Diseases Unit Milan, Italy
| | - Elio Scarpini
- Department of Biomedical, Surgical and Dental Sciences, University of Milan, Centro Dino Ferrari, Milan, Italy
- Fondazione IRCCS Ca’ Granda, Ospedale Policlinico, Neurodegenerative Diseases Unit Milan, Italy
| | - John van Swieten
- Department of Neurology, Erasmus University Medical Centre, Rotterdam, The Netherlands
| | | | - Howard Rosen
- Memory and Aging Center, University of California San Francisco, San Francisco, USA
| | - John Hodges
- Brain and Mind Centre, University of Sydney, Sydney, Australia
| | - Janine Diehl-Schmid
- Department of Psychiatry and Psychotherapy, Technical University of Munich, School of Medicine, Munich, Germany
| | - Yolande Pijnenburg
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, The Netherlands
| |
Collapse
|
23
|
Traschütz A, Enkirch SJ, Polomac N, Widmann CN, Schild HH, Heneka MT, Hattingen E. The Entorhinal Cortex Atrophy Score Is Diagnostic and Prognostic in Mild Cognitive Impairment. J Alzheimers Dis 2020; 75:99-108. [DOI: 10.3233/jad-181150] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Affiliation(s)
- Andreas Traschütz
- Department of Neurology, University Hospital of Bonn, Bonn, Germany
- Department of Neurodegenerative Diseases, Hertie-Institute for Clinical Brain Research and Center of Neurology, University of Tübingen, Tübingen, Germany
| | - S. Jonas Enkirch
- Department of Radiology, University Hospital of Bonn, Bonn, Germany
| | - Nenad Polomac
- Institute of Neuroradiology, Goethe University Frankfurt, Frankfurt, Germany
| | - Catherine N. Widmann
- Department of Neurodegenerative Diseases and Gerontopsychiatry/Neurology, University Hospital of Bonn, Bonn, Germany
| | - Hans H. Schild
- Department of Radiology, University Hospital of Bonn, Bonn, Germany
| | - Michael T. Heneka
- Department of Neurodegenerative Diseases and Gerontopsychiatry/Neurology, University Hospital of Bonn, Bonn, Germany
- German Center for Neurodegenerative Diseases (DZNE), Bonn, Germany
| | - Elke Hattingen
- Department of Radiology, University Hospital of Bonn, Bonn, Germany
- Institute of Neuroradiology, Goethe University Frankfurt, Frankfurt, Germany
| |
Collapse
|
24
|
Mårtensson G, Ferreira D, Granberg T, Cavallin L, Oppedal K, Padovani A, Rektorova I, Bonanni L, Pardini M, Kramberger MG, Taylor JP, Hort J, Snædal J, Kulisevsky J, Blanc F, Antonini A, Mecocci P, Vellas B, Tsolaki M, Kłoszewska I, Soininen H, Lovestone S, Simmons A, Aarsland D, Westman E. The reliability of a deep learning model in clinical out-of-distribution MRI data: A multicohort study. Med Image Anal 2020; 66:101714. [PMID: 33007638 DOI: 10.1016/j.media.2020.101714] [Citation(s) in RCA: 65] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Revised: 04/17/2020] [Accepted: 04/24/2020] [Indexed: 01/12/2023]
Abstract
Deep learning (DL) methods have in recent years yielded impressive results in medical imaging, with the potential to function as clinical aid to radiologists. However, DL models in medical imaging are often trained on public research cohorts with images acquired with a single scanner or with strict protocol harmonization, which is not representative of a clinical setting. The aim of this study was to investigate how well a DL model performs in unseen clinical datasets-collected with different scanners, protocols and disease populations-and whether more heterogeneous training data improves generalization. In total, 3117 MRI scans of brains from multiple dementia research cohorts and memory clinics, that had been visually rated by a neuroradiologist according to Scheltens' scale of medial temporal atrophy (MTA), were included in this study. By training multiple versions of a convolutional neural network on different subsets of this data to predict MTA ratings, we assessed the impact of including images from a wider distribution during training had on performance in external memory clinic data. Our results showed that our model generalized well to datasets acquired with similar protocols as the training data, but substantially worse in clinical cohorts with visibly different tissue contrasts in the images. This implies that future DL studies investigating performance in out-of-distribution (OOD) MRI data need to assess multiple external cohorts for reliable results. Further, by including data from a wider range of scanners and protocols the performance improved in OOD data, which suggests that more heterogeneous training data makes the model generalize better. To conclude, this is the most comprehensive study to date investigating the domain shift in deep learning on MRI data, and we advocate rigorous evaluation of DL models on clinical data prior to being certified for deployment.
Collapse
Affiliation(s)
- Gustav Mårtensson
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden.
| | - Daniel Ferreira
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
| | - Tobias Granberg
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Department of Radiology, Karolinska University Hospital, Stockholm, Sweden
| | - Lena Cavallin
- Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden; Department of Radiology, Karolinska University Hospital, Stockholm, Sweden
| | - Ketil Oppedal
- Centre for Age-Related Medicine, Stavanger University Hospital, Stavanger, Norway; Stavanger Medical Imaging Laboratory (SMIL), Department of Radiology, Stavanger University Hospital, Stavanger, Norway; Department of Electrical Engineering and Computer Science, University of Stavanger, Stavanger, Norway
| | - Alessandro Padovani
- Neurology Unit, Department of Clinical and Experimental Sciences, University of Brescia, Brescia, Italy
| | - Irena Rektorova
- 1st Department of Neurology, Medical Faculty, St. Anne's Hospital and CEITEC, Masaryk University, Brno, Czech Republic
| | - Laura Bonanni
- Department of Neuroscience Imaging and Clinical Sciences and CESI, University G d'Annunzio of Chieti-Pescara, Chieti, Italy
| | - Matteo Pardini
- Department of Neuroscience (DINOGMI), University of Genoa and Neurology Clinics, Polyclinic San Martino Hospital, Genoa, Italy
| | - Milica G Kramberger
- Department of Neurology, University Medical Centre Ljubljana, Medical faculty, University of Ljubljana, Slovenia
| | - John-Paul Taylor
- Institute of Neuroscience, Newcastle University, Newcastle upon Tyne, UK
| | - Jakub Hort
- Memory Clinic, Department of Neurology, Charles University, 2nd Faculty of Medicine and Motol University Hospital, Prague, Czech Republic
| | - Jón Snædal
- Landspitali University Hospital, Reykjavik, Iceland
| | - Jaime Kulisevsky
- Movement Disorders Unit, Neurology Department, Sant Pau Hospital, Barcelona, Spain; Institut d'Investigacions Biomédiques Sant Pau (IIB-Sant Pau), Barcelona, Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Barcelona, Spain; Universitat Autónoma de Barcelona (U.A.B.), Barcelona, Spain
| | - Frederic Blanc
- Day Hospital of Geriatrics, Memory Resource and Research Centre (CM2R) of Strasbourg, Department of Geriatrics, Hôpitaux Universitaires de Strasbourg, Strasbourg, France; University of Strasbourg and French National Centre for Scientific Research (CNRS), ICube Laboratory and Fédération de Médecine Translationnelle de Strasbourg (FMTS), Team Imagerie Multimodale Intégrative en Santé (IMIS)/ICONE, Strasbourg, France
| | - Angelo Antonini
- Department of Neuroscience, University of Padua, Padua & Fondazione Ospedale San Camillo, Venezia, Venice, Italy
| | - Patrizia Mecocci
- Institute of Gerontology and Geriatrics, University of Perugia, Perugia, Italy
| | - Bruno Vellas
- UMR INSERM 1027, gerontopole, CHU, University of Toulouse, France
| | - Magda Tsolaki
- 3rd Department of Neurology, Memory and Dementia Unit, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | | | - Hilkka Soininen
- Institute of Clinical Medicine, Neurology, University of Eastern Finland, Finland; Neurocenter, Neurology, Kuopio University Hospital, Kuopio, Finland
| | - Simon Lovestone
- Department of Psychiatry, Warneford Hospital, University of Oxford, Oxford, UK
| | - Andrew Simmons
- NIHR Biomedical Research Centre for Mental Health, London, UK; NIHR Biomedical Research Unit for Dementia, London, UK; Department of Neuroimaging, Centre for Neuroimaging Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Dag Aarsland
- Centre for Age-Related Medicine, Stavanger University Hospital, Stavanger, Norway; Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Eric Westman
- Division of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden; Department of Neuroimaging, Centre for Neuroimaging Sciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| |
Collapse
|
25
|
Holmes RB, Negus IS, Wiltshire SJ, Thorne GC, Young P. Creation of an anthropomorphic CT head phantom for verification of image segmentation. Med Phys 2020; 47:2380-2391. [PMID: 32160322 PMCID: PMC7383927 DOI: 10.1002/mp.14127] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2019] [Revised: 02/21/2020] [Accepted: 02/21/2020] [Indexed: 12/25/2022] Open
Abstract
Purpose Many methods are available to segment structural magnetic resonance (MR) images of the brain into different tissue types. These have generally been developed for research purposes but there is some clinical use in the diagnosis of neurodegenerative diseases such as dementia. The potential exists for computed tomography (CT) segmentation to be used in place of MRI segmentation, but this will require a method to verify the accuracy of CT processing, particularly if algorithms developed for MR are used, as MR has notably greater tissue contrast. Methods To investigate these issues we have created a three‐dimensional (3D) printed brain with realistic Hounsfield unit (HU) values based on tissue maps segmented directly from an individual T1 MRI scan of a normal subject. Several T1 MRI scans of normal subjects from the ADNI database were segmented using SPM12 and used to create stereolithography files of different tissues for 3D printing. The attenuation properties of several material blends were investigated, and three suitable formulations were used to print an object expected to have realistic geometry and attenuation properties. A skull was simulated by coating the object with plaster of Paris impregnated bandages. Using two CT scanners, the realism of the phantom was assessed by the measurement of HU values, SPM12 segmentation and comparison with the source data used to create the phantom. Results Realistic relative HU values were measured although a subtraction of 60 was required to obtain equivalence with the expected values (gray matter 32.9–35.8 phantom, 29.9–34.2 literature). Segmentation of images acquired at different kVps/mAs showed excellent agreement with the source data (Dice Similarity Coefficient 0.79 for gray matter). The performance of two scanners with two segmentation methods was compared, with the scanners found to have similar performance and with one segmentation method clearly superior to the other. Conclusion The ability to use 3D printing to create a realistic (in terms of geometry and attenuation properties) head phantom has been demonstrated and used in an initial assessment of CT segmentation accuracy using freely available software developed for MRI.
Collapse
Affiliation(s)
- Robin B Holmes
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Ian S Negus
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Sophie J Wiltshire
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Gareth C Thorne
- Department of Medical Physics and Bioengineering, University Hospitals Bristol NHS Foundation Trust, Bristol, BS28HW, UK
| | - Peter Young
- Umea Functional Brain Imaging Center, Umea University, 901 87, Umea, Sweden
| | | |
Collapse
|
26
|
Lombardi G, Crescioli G, Cavedo E, Lucenteforte E, Casazza G, Bellatorre A, Lista C, Costantino G, Frisoni G, Virgili G, Filippini G. Structural magnetic resonance imaging for the early diagnosis of dementia due to Alzheimer's disease in people with mild cognitive impairment. Cochrane Database Syst Rev 2020; 3:CD009628. [PMID: 32119112 PMCID: PMC7059964 DOI: 10.1002/14651858.cd009628.pub2] [Citation(s) in RCA: 56] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
BACKGROUND Mild cognitive impairment (MCI) due to Alzheimer's disease is the symptomatic predementia phase of Alzheimer's disease dementia, characterised by cognitive and functional impairment not severe enough to fulfil the criteria for dementia. In clinical samples, people with amnestic MCI are at high risk of developing Alzheimer's disease dementia, with annual rates of progression from MCI to Alzheimer's disease estimated at approximately 10% to 15% compared with the base incidence rates of Alzheimer's disease dementia of 1% to 2% per year. OBJECTIVES To assess the diagnostic accuracy of structural magnetic resonance imaging (MRI) for the early diagnosis of dementia due to Alzheimer's disease in people with MCI versus the clinical follow-up diagnosis of Alzheimer's disease dementia as a reference standard (delayed verification). To investigate sources of heterogeneity in accuracy, such as the use of qualitative visual assessment or quantitative volumetric measurements, including manual or automatic (MRI) techniques, or the length of follow-up, and age of participants. MRI was evaluated as an add-on test in addition to clinical diagnosis of MCI to improve early diagnosis of dementia due to Alzheimer's disease in people with MCI. SEARCH METHODS On 29 January 2019 we searched Cochrane Dementia and Cognitive Improvement's Specialised Register and the databases, MEDLINE, Embase, BIOSIS Previews, Science Citation Index, PsycINFO, and LILACS. We also searched the reference lists of all eligible studies identified by the electronic searches. SELECTION CRITERIA We considered cohort studies of any size that included prospectively recruited people of any age with a diagnosis of MCI. We included studies that compared the diagnostic test accuracy of baseline structural MRI versus the clinical follow-up diagnosis of Alzheimer's disease dementia (delayed verification). We did not exclude studies on the basis of length of follow-up. We included studies that used either qualitative visual assessment or quantitative volumetric measurements of MRI to detect atrophy in the whole brain or in specific brain regions, such as the hippocampus, medial temporal lobe, lateral ventricles, entorhinal cortex, medial temporal gyrus, lateral temporal lobe, amygdala, and cortical grey matter. DATA COLLECTION AND ANALYSIS Four teams of two review authors each independently reviewed titles and abstracts of articles identified by the search strategy. Two teams of two review authors each independently assessed the selected full-text articles for eligibility, extracted data and solved disagreements by consensus. Two review authors independently assessed the quality of studies using the QUADAS-2 tool. We used the hierarchical summary receiver operating characteristic (HSROC) model to fit summary ROC curves and to obtain overall measures of relative accuracy in subgroup analyses. We also used these models to obtain pooled estimates of sensitivity and specificity when sufficient data sets were available. MAIN RESULTS We included 33 studies, published from 1999 to 2019, with 3935 participants of whom 1341 (34%) progressed to Alzheimer's disease dementia and 2594 (66%) did not. Of the participants who did not progress to Alzheimer's disease dementia, 2561 (99%) remained stable MCI and 33 (1%) progressed to other types of dementia. The median proportion of women was 53% and the mean age of participants ranged from 63 to 87 years (median 73 years). The mean length of clinical follow-up ranged from 1 to 7.6 years (median 2 years). Most studies were of poor methodological quality due to risk of bias for participant selection or the index test, or both. Most of the included studies reported data on the volume of the total hippocampus (pooled mean sensitivity 0.73 (95% confidence interval (CI) 0.64 to 0.80); pooled mean specificity 0.71 (95% CI 0.65 to 0.77); 22 studies, 2209 participants). This evidence was of low certainty due to risk of bias and inconsistency. Seven studies reported data on the atrophy of the medial temporal lobe (mean sensitivity 0.64 (95% CI 0.53 to 0.73); mean specificity 0.65 (95% CI 0.51 to 0.76); 1077 participants) and five studies on the volume of the lateral ventricles (mean sensitivity 0.57 (95% CI 0.49 to 0.65); mean specificity 0.64 (95% CI 0.59 to 0.70); 1077 participants). This evidence was of moderate certainty due to risk of bias. Four studies with 529 participants analysed the volume of the total entorhinal cortex and four studies with 424 participants analysed the volume of the whole brain. We did not estimate pooled sensitivity and specificity for the volume of these two regions because available data were sparse and heterogeneous. We could not statistically evaluate the volumes of the lateral temporal lobe, amygdala, medial temporal gyrus, or cortical grey matter assessed in small individual studies. We found no evidence of a difference between studies in the accuracy of the total hippocampal volume with regards to duration of follow-up or age of participants, but the manual MRI technique was superior to automatic techniques in mixed (mostly indirect) comparisons. We did not assess the relative accuracy of the volumes of different brain regions measured by MRI because only indirect comparisons were available, studies were heterogeneous, and the overall accuracy of all regions was moderate. AUTHORS' CONCLUSIONS The volume of hippocampus or medial temporal lobe, the most studied brain regions, showed low sensitivity and specificity and did not qualify structural MRI as a stand-alone add-on test for an early diagnosis of dementia due to Alzheimer's disease in people with MCI. This is consistent with international guidelines, which recommend imaging to exclude non-degenerative or surgical causes of cognitive impairment and not to diagnose dementia due to Alzheimer's disease. In view of the low quality of most of the included studies, the findings of this review should be interpreted with caution. Future research should not focus on a single biomarker, but rather on combinations of biomarkers to improve an early diagnosis of Alzheimer's disease dementia.
Collapse
Affiliation(s)
- Gemma Lombardi
- University of FlorenceDepartment of Neurosciences, Psychology, Drug Research and Child Health (NEUROFARBA)Largo Brambilla, 3FlorenceItaly50134
| | - Giada Crescioli
- University of FlorenceDepartment of Neurosciences, Psychology, Drug Research and Child Health (NEUROFARBA)Largo Brambilla, 3FlorenceItaly50134
| | - Enrica Cavedo
- Pitie‐Salpetriere Hospital, Sorbonne UniversityAlzheimer Precision Medicine (APM), AP‐HP47 boulevard de l'HopitalParisFrance75013
| | - Ersilia Lucenteforte
- University of PisaDepartment of Clinical and Experimental MedicineVia Savi 10PisaItaly56126
| | - Giovanni Casazza
- Università degli Studi di MilanoDipartimento di Scienze Biomediche e Cliniche "L. Sacco"via GB Grassi 74MilanItaly20157
| | | | - Chiara Lista
- Fondazione I.R.C.C.S. Istituto Neurologico Carlo BestaNeuroepidemiology UnitVia Celoria, 11MilanoItaly20133
| | - Giorgio Costantino
- Ospedale Maggiore Policlinico, Università degli Studi di MilanoUOC Pronto Soccorso e Medicina D'Urgenza, Fondazione IRCCS Ca' GrandaMilanItaly
| | | | - Gianni Virgili
- University of FlorenceDepartment of Neurosciences, Psychology, Drug Research and Child Health (NEUROFARBA)Largo Brambilla, 3FlorenceItaly50134
| | - Graziella Filippini
- Carlo Besta Foundation and Neurological InstituteScientific Director’s Officevia Celoria, 11MilanItaly20133
| | | |
Collapse
|
27
|
Feis RA, Bouts MJRJ, de Vos F, Schouten TM, Panman JL, Jiskoot LC, Dopper EGP, van der Grond J, van Swieten JC, Rombouts SARB. A multimodal MRI-based classification signature emerges just prior to symptom onset in frontotemporal dementia mutation carriers. J Neurol Neurosurg Psychiatry 2019; 90:1207-1214. [PMID: 31203211 DOI: 10.1136/jnnp-2019-320774] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Revised: 04/26/2019] [Accepted: 05/12/2019] [Indexed: 12/13/2022]
Abstract
BACKGROUND Multimodal MRI-based classification may aid early frontotemporal dementia (FTD) diagnosis. Recently, presymptomatic FTD mutation carriers, who have a high risk of developing FTD, were separated beyond chance level from controls using MRI-based classification. However, it is currently unknown how these scores from classification models progress as mutation carriers approach symptom onset. In this longitudinal study, we investigated multimodal MRI-based classification scores between presymptomatic FTD mutation carriers and controls. Furthermore, we contrasted carriers that converted during follow-up ('converters') and non-converting carriers ('non-converters'). METHODS We acquired anatomical MRI, diffusion tensor imaging and resting-state functional MRI in 55 presymptomatic FTD mutation carriers and 48 healthy controls at baseline, and at 2, 4, and 6 years of follow-up as available. At each time point, FTD classification scores were calculated using a behavioural variant FTD classification model. Classification scores were tested in a mixed-effects model for mean differences and differences over time. RESULTS Presymptomatic mutation carriers did not have higher classification score increase over time than controls (p=0.15), although carriers had higher FTD classification scores than controls on average (p=0.032). However, converters (n=6) showed a stronger classification score increase over time than non-converters (p<0.001). CONCLUSIONS Our findings imply that presymptomatic FTD mutation carriers may remain similar to controls in terms of MRI-based classification scores until they are close to symptom onset. This proof-of-concept study shows the promise of longitudinal MRI data acquisition in combination with machine learning to contribute to early FTD diagnosis.
Collapse
Affiliation(s)
- Rogier A Feis
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands .,Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.,Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Mark J R J Bouts
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.,Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Frank de Vos
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.,Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Tijn M Schouten
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.,Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Jessica L Panman
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Department of Neurology, Erasmus Medical Centre, Rotterdam, The Netherlands
| | - Lize C Jiskoot
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Department of Neurology, Erasmus Medical Centre, Rotterdam, The Netherlands
| | - Elise G P Dopper
- Department of Neurology, Erasmus Medical Centre, Rotterdam, The Netherlands
| | - Jeroen van der Grond
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands
| | - John C van Swieten
- Department of Neurology, Erasmus Medical Centre, Rotterdam, The Netherlands.,Department of Clinical Genetics, VU University Medical Centre, Amsterdam, The Netherlands
| | - Serge A R B Rombouts
- Department of Radiology, Leiden University Medical Centre, Leiden, The Netherlands.,Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands.,Institute of Psychology, Leiden University, Leiden, The Netherlands
| |
Collapse
|
28
|
Abstract
BACKGROUND This paper aims to synthesise the literature on machine learning (ML) and big data applications for mental health, highlighting current research and applications in practice. METHODS We employed a scoping review methodology to rapidly map the field of ML in mental health. Eight health and information technology research databases were searched for papers covering this domain. Articles were assessed by two reviewers, and data were extracted on the article's mental health application, ML technique, data type, and study results. Articles were then synthesised via narrative review. RESULTS Three hundred papers focusing on the application of ML to mental health were identified. Four main application domains emerged in the literature, including: (i) detection and diagnosis; (ii) prognosis, treatment and support; (iii) public health, and; (iv) research and clinical administration. The most common mental health conditions addressed included depression, schizophrenia, and Alzheimer's disease. ML techniques used included support vector machines, decision trees, neural networks, latent Dirichlet allocation, and clustering. CONCLUSIONS Overall, the application of ML to mental health has demonstrated a range of benefits across the areas of diagnosis, treatment and support, research, and clinical administration. With the majority of studies identified focusing on the detection and diagnosis of mental health conditions, it is evident that there is significant room for the application of ML to other areas of psychology and mental health. The challenges of using ML techniques are discussed, as well as opportunities to improve and advance the field.
Collapse
Affiliation(s)
- Adrian B R Shatte
- Federation University, School of Science, Engineering & Information Technology,Melbourne,Australia
| | - Delyse M Hutchinson
- Deakin University, Centre for Social and Early Emotional Development, School of Psychology, Faculty of Health,Geelong,Australia
| | - Samantha J Teague
- Deakin University, Centre for Social and Early Emotional Development, School of Psychology, Faculty of Health,Geelong,Australia
| |
Collapse
|
29
|
Vernooij MW, Pizzini FB, Schmidt R, Smits M, Yousry TA, Bargallo N, Frisoni GB, Haller S, Barkhof F. Dementia imaging in clinical practice: a European-wide survey of 193 centres and conclusions by the ESNR working group. Neuroradiology 2019; 61:633-642. [PMID: 30852630 PMCID: PMC6511357 DOI: 10.1007/s00234-019-02188-y] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2019] [Accepted: 02/12/2019] [Indexed: 12/11/2022]
Abstract
PURPOSE Through a European-wide survey, we assessed the current clinical practice of imaging in the primary evaluation of dementia, with respect to standardised imaging, evaluation and reporting. METHODS An online questionnaire was emailed to all European Society of Neuroradiology (ESNR) members (n = 1662) and non-members who had expressed their interest in ESNR activities in the past (n = 6400). The questionnaire featured 42 individual items, divided into multiple choice, single best choice and free text answers. Information was gathered on the context of the practices, available and preferred imaging modalities, applied imaging protocols and standards for interpretation, reporting and communication. RESULTS A total of 193 unique (non-duplicate) entries from the European academic and non-academic institutions were received from a total of 28 countries. Of these, 75% were neuroradiologists, 12% general radiologists and 11% (neuro) radiologists in training. Of responding centres, 38% performed more than five scans/week for suspected dementia. MRI was primarily used in 72% of centres. Over 90% of centres acquired a combination of T2w, FLAIR, T1w, DWI and T2*w sequences. Visual rating scales were used in 75% of centres, most often the Fazekas and medial temporal atrophy scale; 32% of respondents lacked full confidence in their use. Only 23% of centres performed volumetric analysis. A minority of centres (28%) used structured reports. CONCLUSIONS Current practice in dementia imaging is fairly homogeneous across Europe, in terms of image acquisition and image interpretation. Hurdles identified include training on the use of visual rating scales, implementation of volumetric assessment and structured reporting.
Collapse
Affiliation(s)
- M W Vernooij
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands.
- Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam, The Netherlands.
| | - F B Pizzini
- Neuroradiology, Department of Diagnostics and Pathology, Verona University Hospital, Verona, Italy
| | - R Schmidt
- Department of Neurology, Clinical Division of Neurogeriatrics, Medical University Graz, Graz, Austria
| | - M Smits
- Department of Radiology & Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam, The Netherlands
| | - T A Yousry
- Lysholm Department of Neuroradiology, UCL Institute of Neurology, London, UK
| | - N Bargallo
- Magnetic Resonance Image Core Facility, IDIBAPS and Center of Diagnostic Image (CDIC), Hospital Clinic, Barcelona, Spain
| | - G B Frisoni
- University Hospitals and University of Geneva, Geneva, Switzerland
| | - S Haller
- CIRD - Centre d'Imagerie Rive Droite|, Geneva, Switzerland
- Department of Surgical Sciences, Radiology, Uppsala University, Uppsala, Sweden
- Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - F Barkhof
- Lysholm Department of Neuroradiology, UCL Institute of Neurology, London, UK
- Department of Radiology and Nuclear Medicine, VU University Medical Centre, Amsterdam UMC, Amsterdam, The Netherlands
| |
Collapse
|
30
|
Zeng P, Huang J, Wu S, Qian C, Chen F, Sun W, Tao W, Liao Y, Zhang J, Yang Z, Zhong S, Zhang Z, Xiao L, Huang B. Characterizing the Structural Pattern Predicting Medication Response in Herpes Zoster Patients Using Multivoxel Pattern Analysis. Front Neurosci 2019; 13:534. [PMID: 31191228 PMCID: PMC6546876 DOI: 10.3389/fnins.2019.00534] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2019] [Accepted: 05/08/2019] [Indexed: 12/29/2022] Open
Abstract
Herpes zoster (HZ) can cause a blistering skin rash with severe neuropathic pain. Pharmacotherapy is the most common treatment for HZ patients. However, most patients are usually the elderly or those that are immunocompromised, and thus often suffer from side effects or easily get intractable post-herpetic neuralgia (PHN) if medication fails. It is challenging for clinicians to tailor treatment to patients, due to the lack of prognosis information on the neurological pathogenesis that underlies HZ. In the current study, we aimed at characterizing the brain structural pattern of HZ before treatment with medication that could help predict medication responses. High-resolution structural magnetic resonance imaging (MRI) scans of 14 right-handed HZ patients (aged 61.0 ± 7.0, 8 males) with poor response and 15 (aged 62.6 ± 8.3, 5 males) age- (p = 0.58), gender-matched (p = 0.20) patients responding well, were acquired and analyzed. Multivoxel pattern analysis (MVPA) with a searchlight algorithm and support vector machine (SVM), was applied to identify the spatial pattern of the gray matter (GM) volume, with high predicting accuracy. The predictive regions, with an accuracy higher than 79%, were located within the cerebellum, posterior insular cortex (pIC), middle and orbital frontal lobes (mFC and OFC), anterior and middle cingulum (ACC and MCC), precuneus (PCu) and cuneus. Among these regions, mFC, pIC and MCC displayed significant increases of GM volumes in patients with poor response, compared to those with a good response. The combination of sMRI and MVPA might be a useful tool to explore the neuroanatomical imaging biomarkers of HZ-related pain associated with medication responses.
Collapse
Affiliation(s)
- Ping Zeng
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| | - Jiabin Huang
- Department of Pain Medicine and Shenzhen Municipal Key Laboratory for Pain Medicine, Shenzhen Sixth Hospital of Guangdong Medical University, Shenzhen, China
| | - Songxiong Wu
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| | - Chengrui Qian
- Department of Pain Medicine and Shenzhen Municipal Key Laboratory for Pain Medicine, Shenzhen Sixth Hospital of Guangdong Medical University, Shenzhen, China
| | - Fuyong Chen
- Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China.,Department of Neurosurgery, Shenzhen University General Hospital, Shenzhen, China
| | - Wuping Sun
- Department of Pain Medicine and Shenzhen Municipal Key Laboratory for Pain Medicine, Shenzhen Sixth Hospital of Guangdong Medical University, Shenzhen, China
| | - Wei Tao
- Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China.,Department of Neurosurgery, Shenzhen University General Hospital, Shenzhen, China
| | - Yuliang Liao
- Department of Pain Medicine and Shenzhen Municipal Key Laboratory for Pain Medicine, Shenzhen Sixth Hospital of Guangdong Medical University, Shenzhen, China
| | - Jianing Zhang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| | - Zefan Yang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| | - Shaonan Zhong
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| | - Zhiguo Zhang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China
| | - Lizu Xiao
- Department of Pain Medicine and Shenzhen Municipal Key Laboratory for Pain Medicine, Shenzhen Sixth Hospital of Guangdong Medical University, Shenzhen, China
| | - Bingsheng Huang
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, China.,Clinical Research Center for Neurological Diseases, Shenzhen University, Shenzhen, China
| |
Collapse
|
31
|
Bruin W, Denys D, van Wingen G. Diagnostic neuroimaging markers of obsessive-compulsive disorder: Initial evidence from structural and functional MRI studies. Prog Neuropsychopharmacol Biol Psychiatry 2019; 91:49-59. [PMID: 30107192 DOI: 10.1016/j.pnpbp.2018.08.005] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/24/2018] [Revised: 07/30/2018] [Accepted: 08/09/2018] [Indexed: 01/09/2023]
Abstract
As of yet, no diagnostic biomarkers are available for obsessive-compulsive disorder (OCD), and its diagnosis relies entirely upon the recognition of behavioural features assessed through clinical interview. Neuroimaging studies have shown that various brain structures are abnormal in OCD patients compared to healthy controls. However, the majority of these results are based on average differences between groups, which limits diagnostic usage in clinical practice. In recent years, a growing number of studies have applied multivariate pattern analysis (MVPA) techniques on neuroimaging data to extract patterns of altered brain structure, function and connectivity typical for OCD. MVPA techniques can be used to develop predictive models that extract regularities in data to classify individual subjects based on their diagnosis. In the present paper, we reviewed the literature of MVPA studies using data from different imaging modalities to distinguish OCD patients from controls. A systematic search retrieved twelve articles that fulfilled the inclusion and exclusion criteria. Reviewed studies have been able to classify OCD diagnosis with accuracies ranging from 66% up to 100%. Features important for classification were different across imaging modalities and widespread throughout the brain. Although studies have shown promising results, sample sizes used are typically small which can lead to high variance of the estimated model accuracy, cohort-specific solutions and lack of generalizability of findings. Some of the challenges are discussed that need to be overcome in order to move forward toward clinical applications.
Collapse
Affiliation(s)
- Willem Bruin
- Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Neuroscience, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, the Netherlands.
| | - Damiaan Denys
- Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Neuroscience, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, the Netherlands
| | - Guido van Wingen
- Department of Psychiatry, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Neuroscience, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
32
|
Kim JP, Kim J, Park YH, Park SB, Lee JS, Yoo S, Kim EJ, Kim HJ, Na DL, Brown JA, Lockhart SN, Seo SW, Seong JK. Machine learning based hierarchical classification of frontotemporal dementia and Alzheimer's disease. NEUROIMAGE-CLINICAL 2019; 23:101811. [PMID: 30981204 PMCID: PMC6458431 DOI: 10.1016/j.nicl.2019.101811] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/09/2018] [Revised: 03/30/2019] [Accepted: 04/01/2019] [Indexed: 01/18/2023]
Abstract
Background In a clinical setting, an individual subject classification model rather than a group analysis would be more informative. Specifically, the subtlety of cortical atrophy in some frontotemporal dementia (FTD) patients and overlapping patterns of atrophy among three FTD clinical syndromes including behavioral variant FTD (bvFTD), non-fluent/agrammatic variant primary progressive aphasia (nfvPPA), and semantic variant PPA (svPPA) give rise to the need for classification models at the individual level. In this study, we aimed to classify each individual subject into one of the diagnostic categories in a hierarchical manner by employing a machine learning-based classification method. Methods We recruited 143 patients with FTD, 50 patients with Alzheimer's disease (AD) dementia, and 146 cognitively normal subjects. All subjects underwent a three-dimensional volumetric brain magnetic resonance imaging (MRI) scan, and cortical thickness was measured using FreeSurfer. We applied the Laplace Beltrami operator to reduce noise in the cortical thickness data and to reduce the dimension of the feature vector. Classifiers were constructed by applying both principal component analysis and linear discriminant analysis to the cortical thickness data. For the hierarchical classification, we trained four classifiers using different pairs of groups: Step 1 - CN vs. FTD + AD, Step 2 - FTD vs. AD, Step 3 - bvFTD vs. PPA, Step 4 - svPPA vs. nfvPPA. To evaluate the classification performance for each step, we used a10-fold cross-validation approach, performed 1000 times for reliability. Results The classification accuracy of the entire hierarchical classification tree was 75.8%, which was higher than that of the non-hierarchical classifier (73.0%). The classification accuracies of steps 1–4 were 86.1%, 90.8%, 86.9%, and 92.1%, respectively. Changes in the right frontotemporal area were critical for discriminating behavioral variant FTD from PPA. The left frontal lobe discriminated nfvPPA from svPPA, while the bilateral anterior temporal regions were critical for identifying svPPA. Conclusions In the present study, our automated classifier successfully classified FTD clinical subtypes with good to excellent accuracy. Our classifier may help clinicians diagnose FTD subtypes with subtle cortical atrophy and facilitate appropriate specific interventions. We developed a machine learning-based automated classifier for differential diagnosis of FTD clinical syndromes and AD. Our classifier achieved good to excellent accuracy for each classification step. Discriminative regions are similar to previously known cortical atrophic patterns in each clinical syndrome.
Collapse
Affiliation(s)
- Jun Pyo Kim
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Jeonghun Kim
- Department of Bio-convergence Engineering, Korea University, Seoul, Republic of Korea
| | - Yu Hyun Park
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Seong Beom Park
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Jin San Lee
- Department of Neurology, Kyunghee University Medical Center, Seoul, Republic of Korea
| | - Sole Yoo
- Department of Cognitive Science, Yonsei University, Seoul, Republic of Korea
| | - Eun-Joo Kim
- Department of Neurology, Busan National University Hospital, Busan, Republic of Korea
| | - Hee Jin Kim
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Duk L Na
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea
| | - Jesse A Brown
- Department of Neurology, UCSF Weill Institute for Neurosciences, University of California, San Francisco, San Francisco, CA, USA
| | - Samuel N Lockhart
- Department of Internal Medicine, Section of Gerontology and Geriatric Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Sang Won Seo
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea; Neuroscience Center, Samsung Medical Center, Seoul, Republic of Korea; Samsung Alzheimer Research Center, Samsung Medical Center, Seoul, Republic of Korea; Center for Clinical Epidemiology, Samsung Medical Center, Seoul, Republic of Korea; Department of Clinical Research Design and Evaluation, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea.
| | - Joon-Kyung Seong
- Department of Bio-convergence Engineering, Korea University, Seoul, Republic of Korea; School of Biomedical Engineering, Korea University, Seoul, Republic of Korea.
| |
Collapse
|
33
|
Zhutovsky P, Vijverberg EGB, Bruin WB, Thomas RM, Wattjes MP, Pijnenburg YAL, van Wingen GA, Dols A. Individual Prediction of Behavioral Variant Frontotemporal Dementia Development Using Multivariate Pattern Analysis of Magnetic Resonance Imaging Data. J Alzheimers Dis 2019; 68:1229-1241. [PMID: 30909224 DOI: 10.3233/jad-181004] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
BACKGROUND Patients with behavioral variant of frontotemporal dementia (bvFTD) initially may only show behavioral and/or cognitive symptoms that overlap with other neurological and psychiatric disorders. The diagnostic accuracy is dependent on progressive symptoms worsening and frontotemporal abnormalities on neuroimaging findings. Predictive biomarkers could facilitate the early detection of bvFTD. OBJECTIVE To determine the prognostic accuracy of clinical and structural MRI data using a support vector machine (SVM) classification to predict the 2-year clinical follow-up diagnosis in a group of patients presenting late-onset behavioral changes. METHODS Data from 73 patients were included and divided into probable/definite bvFTD (n = 18), neurological (n = 28), and psychiatric (n = 27) groups based on 2-year follow-up diagnosis. Grey-matter volumes were extracted from baseline structural MRI scans. SVM classifiers were used to perform three binary classifications: bvFTD versus neurological and psychiatric, bvFTD versus neurological, and bvFTD versus psychiatric group(s), and one multi-class classification. Classification performance was determined for clinical and neuroimaging data separately and their combination using 5-fold cross-validation. RESULTS Accuracy of the binary classification tasks ranged from 72-82% (p < 0.001) with adequate sensitivity (67-79%), specificity (77-88%), and area-under-the-receiver-operator-curve (0.80-0.9). Multi-class accuracy ranged between 55-59% (p < 0.001). The combination of clinical and voxel-wise whole brain data showed the best performance overall. CONCLUSION These results show the potential for automated early confirmation of diagnosis for bvFTD using machine learning analysis of clinical and neuroimaging data in a diverse and clinically relevant sample of patients.
Collapse
Affiliation(s)
- Paul Zhutovsky
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Everard G B Vijverberg
- Amsterdam UMC, VU University Medical Center, Department of Neurology and Alzheimer Centre, Amsterdam Neuroscience, Amsterdam, The Netherlands.,Department of Neurology, HagaZiekenhuis, The Hague, The Netherlands
| | - Willem B Bruin
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Rajat M Thomas
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Mike P Wattjes
- Amsterdam UMC, VU University Medical Center, Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Amsterdam, The Netherlands.,Department of Diagnostic and Interventional Neuroradiology, Hannover Medical School, Hannover, Germany
| | - Yolande A L Pijnenburg
- Amsterdam UMC, VU University Medical Center, Department of Neurology and Alzheimer Centre, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Guido A van Wingen
- Amsterdam UMC, University of Amsterdam, Department of Psychiatry, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Annemiek Dols
- Amsterdam UMC, VU University Medical Center, Department of Neurology and Alzheimer Centre, Amsterdam Neuroscience, Amsterdam, The Netherlands.,Department of Old Age Psychiatry, GGZ InGeest, Amsterdam, The Netherlands
| |
Collapse
|
34
|
Bruun M, Koikkalainen J, Rhodius-Meester HFM, Baroni M, Gjerum L, van Gils M, Soininen H, Remes AM, Hartikainen P, Waldemar G, Mecocci P, Barkhof F, Pijnenburg Y, van der Flier WM, Hasselbalch SG, Lötjönen J, Frederiksen KS. Detecting frontotemporal dementia syndromes using MRI biomarkers. NEUROIMAGE-CLINICAL 2019; 22:101711. [PMID: 30743135 PMCID: PMC6369219 DOI: 10.1016/j.nicl.2019.101711] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2018] [Revised: 02/01/2019] [Accepted: 02/03/2019] [Indexed: 12/20/2022]
Abstract
Background Diagnosing frontotemporal dementia may be challenging. New methods for analysis of regional brain atrophy patterns on magnetic resonance imaging (MRI) could add to the diagnostic assessment. Therefore, we aimed to develop automated imaging biomarkers for differentiating frontotemporal dementia subtypes from other diagnostic groups, and from one another. Methods In this retrospective multicenter cohort study, we included 1213 patients (age 67 ± 9, 48% females) from two memory clinic cohorts: 116 frontotemporal dementia, 341 Alzheimer's disease, 66 Dementia with Lewy bodies, 40 vascular dementia, 104 other dementias, 229 mild cognitive impairment, and 317 subjective cognitive decline. Three MRI atrophy biomarkers were derived from the normalized volumes of automatically segmented cortical regions: 1) the anterior vs. posterior index, 2) the asymmetry index, and 3) the temporal pole left index. We used the following performance metrics: area under the receiver operating characteristic curve (AUC), sensitivity, and specificity. To account for the low prevalence of frontotemporal dementia we pursued a high specificity of 95%. Cross-validation was used in assessing the performance. The generalizability was assessed in an independent cohort (n = 200). Results The anterior vs. posterior index performed with an AUC of 83% for differentiation of frontotemporal dementia from all other diagnostic groups (Sensitivity = 59%, Specificity = 95%, positive likelihood ratio = 11.8, negative likelihood ratio = 0.4). The asymmetry index showed highest performance for separation of primary progressive aphasia and behavioral variant frontotemporal dementia (AUC = 85%, Sensitivity = 79%, Specificity = 92%, positive likelihood ratio = 9.9, negative likelihood ratio = 0.2), whereas the temporal pole left index was specific for detection of semantic variant primary progressive aphasia (AUC = 85%, Sensitivity = 82%, Specificity = 80%, positive likelihood ratio = 4.1, negative likelihood ratio = 0.2). The validation cohort provided corresponding results for the anterior vs. posterior index and temporal pole left index. Conclusion This study presents three quantitative MRI biomarkers, which could provide additional information to the diagnostic assessment and assist clinicians in diagnosing frontotemporal dementia. Quantitative MRI biomarkers (API, ASI, and TPL) for detection of FTD and its subtypes. API differentiated FTD from other diagnostic groups with AUC of 83%. ASI and TPL showed highest performance for PPA subtypes. A subcortical bvFTD subtype resembling AD atrophy pattern seems undetectable for MRI.
Collapse
Affiliation(s)
- Marie Bruun
- Danish Dementia Research Centre, Department of Neurology, Rigshospitalet, University of Copenhagen, Denmark.
| | | | - Hanneke F M Rhodius-Meester
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | - Marta Baroni
- Institute of Gerontology and Geriatrics, University of Perugia, Perugia, Italy
| | - Le Gjerum
- Danish Dementia Research Centre, Department of Neurology, Rigshospitalet, University of Copenhagen, Denmark
| | - Mark van Gils
- VTT Technical Research Center of Finland Ltd, Tampere, Finland
| | - Hilkka Soininen
- Institute of Clinical Medicine, Neurology, University of Eastern Finland, Kuopio, Finland; Neurocenter, neurology, Kuopio University Hospital, Kuopio, Finland
| | - Anne M Remes
- Unit of Clinical Neuroscience, Neurology, University of Oulu, Oulu, Finland; Medical Research Center, Oulu University Hospital, Oulu, Finland
| | | | - Gunhild Waldemar
- Danish Dementia Research Centre, Department of Neurology, Rigshospitalet, University of Copenhagen, Denmark
| | - Patrizia Mecocci
- Institute of Gerontology and Geriatrics, University of Perugia, Perugia, Italy
| | - Frederik Barkhof
- Department of Radiology and Nuclear Medicine, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands; UCL institutes of Neurology and Healthcare Engineering, London, UK
| | - Yolande Pijnenburg
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | - Wiesje M van der Flier
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | - Steen G Hasselbalch
- Danish Dementia Research Centre, Department of Neurology, Rigshospitalet, University of Copenhagen, Denmark
| | | | - Kristian S Frederiksen
- Danish Dementia Research Centre, Department of Neurology, Rigshospitalet, University of Copenhagen, Denmark
| |
Collapse
|
35
|
Cloud-Based Brain Magnetic Resonance Image Segmentation and Parcellation System for Individualized Prediction of Cognitive Worsening. JOURNAL OF HEALTHCARE ENGINEERING 2019; 2019:9507193. [PMID: 30838124 PMCID: PMC6374863 DOI: 10.1155/2019/9507193] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Revised: 10/24/2018] [Accepted: 11/05/2018] [Indexed: 01/13/2023]
Abstract
For patients with cognitive disorders and dementia, accurate prognosis of cognitive worsening is critical to their ability to prepare for the future, in collaboration with health-care providers. Despite multiple efforts to apply computational brain magnetic resonance image (MRI) analysis in predicting cognitive worsening, with several successes, brain MRI is not routinely quantified in clinical settings to guide prognosis and clinical decision-making. To encourage the clinical use of a cutting-edge image segmentation method, we developed a prediction model as part of an established web-based cloud platform, MRICloud. The model was built in a training dataset from Alzheimer's Disease Neuroimaging Initiative (ADNI) where baseline MRI scans were combined with clinical data over time. Each MRI was parcellated into 265 anatomical units based on the MRICloud fully automated image segmentation function, to measure the volume of each parcel. The Mini Mental State Examination (MMSE) was used as a measure of cognitive function. The normalized volume of 265 parcels, combined with baseline MMSE score, age, and sex were input variables for a Least Absolute Shrinkage and Selection Operator (LASSO) regression analysis, with MMSE change in the subsequent two years as the target for prediction. A leave-one-out analysis performed on the training dataset estimated a correlation coefficient of 0.64 between true and predicted MMSE change. A receiver operating characteristic (ROC) analysis estimated a sensitivity of 0.88 and a specificity of 0.76 in predicting substantial cognitive worsening after two years, defined as MMSE decline of ≥4 points. This MRICloud prediction model was then applied to a test dataset of clinically acquired MRIs from the Johns Hopkins Memory and Alzheimer's Treatment Center (MATC), a clinical care setting. In the latter setting, the model had both sensitivity and specificity of 1.0 in predicting substantial cognitive worsening. While the MRICloud prediction model demonstrated promise as a platform on which computational MRI findings can easily be extended to clinical use, further study with a larger number of patients is needed for validation.
Collapse
|
36
|
Zhang Y, Liu S. Analysis of structural brain MRI and multi-parameter classification for Alzheimer's disease. ACTA ACUST UNITED AC 2018. [PMID: 28622141 DOI: 10.1515/bmt-2016-0239] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Incorporating with machine learning technology, neuroimaging markers which extracted from structural Magnetic Resonance Images (sMRI), can help distinguish Alzheimer's Disease (AD) patients from Healthy Controls (HC). In the present study, we aim to investigate differences in atrophic regions between HC and AD and apply machine learning methods to classify these two groups. T1-weighted sMRI scans of 158 patients with AD and 145 age-matched HC were acquired from the ADNI database. Five kinds of parameters (i.e. cortical thickness, surface area, gray matter volume, curvature and sulcal depth) were obtained through the preprocessing steps. The recursive feature elimination (RFE) method for support vector machine (SVM) and leave-one-out cross validation (LOOCV) were applied to determine the optimal feature dimensions. Each kind of parameter was trained by SVM algorithm to acquire a classifier, which was used to classify HC and AD ultimately. Moreover, the ROC curves were depicted for testing the classifiers' performance and the SVM classifiers of two-dimensional spaces took the top two important features as classification features for separating HC and AD to the maximum extent. The results showed that the decreased cortical thickness and gray matter volume dramatically exhibited the trend of atrophy. The key differences between AD and HC existed in the cortical thickness and gray matter volume of the entorhinal cortex and medial orbitofrontal cortex. In terms of classification results, an optimal accuracy of 90.76% was obtained via multi-parameter combination (i.e. cortical thickness, gray matter volume and surface area). Meanwhile, the receiver operating characteristic (ROC) curves and area under the curve (AUC) were also verified multi-parameter combination could reach a better classification performance (AUC=0.94) after the SVM-RFE method. The results could be well prove that multi-parameter combination could provide more useful classified features from multivariate anatomical structure than single parameter. In addition, as cortical thickness and multi-parameter combination contained more important classified information with fewer feature dimensions after feature selection, it could be optimum to separate HC from AD to take the top two important features of them to construct SVM classifiers in two-dimensional space. The proposed work is a promising approach suggesting an important role for machine-learning based diagnostic image analysis for clinical practice.
Collapse
Affiliation(s)
- Yingteng Zhang
- School of Mathematics, South China University of Technology, Guangzhou 510640, China
| | - Shenquan Liu
- School of Mathematics, South China University of Technology, Guangzhou 510640, China
| |
Collapse
|
37
|
Voxel-wise deviations from healthy aging for the detection of region-specific atrophy. NEUROIMAGE-CLINICAL 2018; 20:851-860. [PMID: 30278372 PMCID: PMC6169102 DOI: 10.1016/j.nicl.2018.09.013] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2018] [Revised: 08/14/2018] [Accepted: 09/16/2018] [Indexed: 12/19/2022]
Abstract
The identification of pathological atrophy in MRI scans requires specialized training, which is scarce outside dedicated centers. We sought to investigate the clinical usefulness of computer-generated representations of local grey matter (GM) loss or increased volume of cerebral fluids (CSF) as normalized deviations (z-scores) from healthy aging to either aid human visual readings or directly detect pathological atrophy. Two experienced neuroradiologists rated atrophy in 30 patients with Alzheimer's disease (AD), 30 patients with frontotemporal dementia (FTD), 30 with dementia due to Lewy-body disease (LBD) and 30 healthy controls (HC) on a three-point scale in 10 anatomical regions as reference gold standard. Seven raters, varying in their experience with MRI diagnostics rated all cases on the same scale once with and once without computer-generated volume deviation maps that were overlaid on anatomical slices. In addition, we investigated the predictive value of the computer generated deviation maps on their own for the detection of atrophy as identified by the gold standard raters. Inter and intra-rater agreements of the two gold standard raters were substantial (Cohen's kappa κ > 0.62). The intra-rater agreement of the other raters ranged from fair (κ = 0.37) to substantial (κ = 0.72) and improved on average by 0.13 (0.57 < κ < 0.87) when volume deviation maps were displayed. The seven other raters showed good agreement with the gold standard in regions including the hippocampus but agreement was substantially lower in e.g. the parietal cortex and did not improve with the display of atrophy scores. Rating speed increased over the course of the study and irrespective of the presentation of voxel-wise deviations. Automatically detected large deviations of local volume were consistently associated with gold standard atrophy reading as shown by an area under the receiver operator characteristic of up to 0.95 for the hippocampus region. When applying these test characteristics to prevalences typically found in a memory clinic, we observed a positive or negative predictive value close to or above 0.9 in the hippocampus for almost all of the expected cases. The volume deviation maps derived from CSF volume increase were generally better in detecting atrophy. Our study demonstrates an agreement of visual ratings among non-experts not further increased by displaying, region-specific deviations of volume. The high predictive value of computer generated local deviations independent from human interaction and the consistent advantages of CSF-over GM-based estimations should be considered in the development of diagnostic tools and indicate clinical utility well beyond aiding visual assessments. The visual identification of atrophy is most accurate in the temporal lobe. Voxel-wise deviations of tissue volume from normal aging is easy to implement. Displaying voxel-wise deviations subjectively but not objectively aids readers. Voxel-wise deviations themselves show high agreement with expert readings. Information on tissue deviations should be provided with cerebral MRI scans.
Collapse
|
38
|
Sun Z, Qiao Y, Lelieveldt BPF, Staring M. Integrating spatial-anatomical regularization and structure sparsity into SVM: Improving interpretation of Alzheimer's disease classification. Neuroimage 2018; 178:445-460. [DOI: 10.1016/j.neuroimage.2018.05.051] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2018] [Revised: 04/10/2018] [Accepted: 05/21/2018] [Indexed: 12/21/2022] Open
Affiliation(s)
- Zhuo Sun
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, 2300, RC, Leiden, The Netherlands
| | - Yuchuan Qiao
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, 2300, RC, Leiden, The Netherlands
| | - Boudewijn P F Lelieveldt
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, 2300, RC, Leiden, The Netherlands; Intelligent System Group, Faculty of EEMCS, Delft University of Technology, 2600, GA, Delft, The Netherlands
| | - Marius Staring
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, 2300, RC, Leiden, The Netherlands; Intelligent System Group, Faculty of EEMCS, Delft University of Technology, 2600, GA, Delft, The Netherlands.
| | | |
Collapse
|
39
|
McCarthy J, Collins DL, Ducharme S. Morphometric MRI as a diagnostic biomarker of frontotemporal dementia: A systematic review to determine clinical applicability. Neuroimage Clin 2018; 20:685-696. [PMID: 30218900 PMCID: PMC6140291 DOI: 10.1016/j.nicl.2018.08.028] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Revised: 07/31/2018] [Accepted: 08/28/2018] [Indexed: 01/21/2023]
Abstract
Frontotemporal dementia (FTD) is difficult to diagnose, due to its heterogeneous nature and overlap in symptoms with primary psychiatric disorders. Brain MRI for atrophy is a key biomarker but lacks sensitivity in the early stage. Morphometric MRI-based measures and machine learning techniques are a promising tool to improve diagnostic accuracy. Our aim was to review the current state of the literature using morphometric MRI to classify FTD and assess its applicability for clinical practice. A search was completed using Pubmed and PsychInfo of studies which conducted a classification of subjects with FTD from non-FTD (controls or another disorder) using morphometric MRI metrics on an individual level, using single or combined approaches. 28 relevant articles were included and systematically reviewed following PRISMA guidelines. The studies were categorized based on the type of FTD subjects included and the group(s) against which they were classified. Studies varied considerably in subject selection, MRI methodology, and classification approach, and results are highly heterogeneous. Overall many studies indicate good diagnostic accuracy, with higher performance when differentiating FTD from controls (highest result was accuracy of 100%) than other dementias (highest result was AUC of 0.874). Very few machine learning algorithms have been tested in prospective replication. In conclusion, morphometric MRI with machine learning shows potential as an early diagnostic biomarker of FTD, however studies which use rigorous methodology and validate findings in an independent real-life cohort are necessary before this method can be recommended for use clinically.
Collapse
Affiliation(s)
- Jillian McCarthy
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - D Louis Collins
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - Simon Ducharme
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada.
| |
Collapse
|
40
|
[Big data and artificial intelligence for diagnostic decision support in atypical dementia]. DER NERVENARZT 2018; 89:875-884. [PMID: 30076451 DOI: 10.1007/s00115-018-0568-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
The differential diagnosis of atypical dementia remains difficult. The use of positron emission tomography (PET) still represents the gold standard for imaging diagnostics. According to the current evidence, however, magnetic resonance imaging (MRI) is almost equal to fluorodeoxyglucose (FDG)-PET, but only when using new big data and machine learning methods. In cases of atypical dementia, especially in younger patients and for follow-up, MRI is preferable to computed tomography (CT). In the clinical routine, promising MRI procedures are e. g. the automated volumetry of anatomical 3D images, as well as a non-contrast-enhanced MRI perfusion method, called arterial spin labeling (ASL). Because of the rapidly growing amount of biomarker data, there is a need for computer-aided big data analyses and artificial intelligence. Based on fast analyses of the diverse and rapidly increasing amount of clinical, imaging, epidemiological, molecular genetic and economic data, new knowledge on the pathogenesis, prevention and treatment can be generated. Technical availability, homogenization of the underlying data and the availability of large reference data are the basis for the widespread establishment of promising analytical methods.
Collapse
|
41
|
Klöppel S, Kotschi M, Peter J, Egger K, Hausner L, Frölich L, Förster A, Heimbach B, Normann C, Vach W, Urbach H, Abdulkadir A. Separating Symptomatic Alzheimer's Disease from Depression based on Structural MRI. J Alzheimers Dis 2018; 63:353-363. [PMID: 29614658 PMCID: PMC5900555 DOI: 10.3233/jad-170964] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Older patients with depression or Alzheimer’s disease (AD) at the stage of early dementia or mild cognitive impairment may present with objective cognitive impairment, although the pathology and thus therapy and prognosis differ substantially. In this study, we assessed the potential of an automated algorithm to categorize a test set of 65 T1-weighted structural magnetic resonance images (MRI). A convenience sample of elderly individuals fulfilling clinical criteria of either AD (n = 28) or moderate and severe depression (n = 37) was recruited from different settings to assess the potential of the pattern recognition method to assist in the differential diagnosis of AD versus depression. We found that our algorithm learned discriminative patterns in the subject’s grey matter distribution reflected by an area under the receiver operator characteristics curve of up to 0.83 (confidence interval ranged from 0.67 to 0.92) and a balanced accuracy of 0.79 for the separation of depression from AD, evaluated by leave-one-out cross validation. The algorithm also identified consistent structural differences in a clinically more relevant scenario where the data used during training were independent from the data used for evaluation and, critically, which included five possible diagnoses (specifically AD, frontotemporal dementia, Lewy body dementia, depression, and healthy aging). While the output was insufficiently accurate to use it directly as a means for classification when multiple classes are possible, the continuous output computed by the machine learning algorithm differed between the two groups that were investigated. The automated analysis thus could complement, but not replace clinical assessments.
Collapse
Affiliation(s)
- Stefan Klöppel
- Center of Geriatrics and Gerontology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,Freiburg Brain Imaging, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,Department of Psychiatry and Psychotherapy, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Switzerland
| | - Maria Kotschi
- Center of Geriatrics and Gerontology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,Freiburg Brain Imaging, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,Department of Psychiatry and Psychotherapy, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany
| | - Jessica Peter
- University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Switzerland
| | - Karl Egger
- Freiburg Brain Imaging, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,Department of Neuroradiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany
| | - Lucrezia Hausner
- Department of Geriatric Psychiatry, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Germany
| | - Lutz Frölich
- Department of Geriatric Psychiatry, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Germany
| | - Alex Förster
- Department of Neuroradiology, University Medical Center Mannheim, Medical Faculty Mannheim, University of Heidelberg, Germany
| | - Bernhard Heimbach
- Center of Geriatrics and Gerontology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany
| | - Claus Normann
- Department of Psychiatry and Psychotherapy, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany
| | - Werner Vach
- Institute of Medical Biometry and Statistics, Medical Faculty and Medical Center, University of Freiburg, Germany
| | - Horst Urbach
- Department of Neuroradiology, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany
| | - Ahmed Abdulkadir
- Freiburg Brain Imaging, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, Germany.,University Hospital of Old Age Psychiatry and Psychotherapy, University of Bern, Switzerland
| | | |
Collapse
|
42
|
Belathur Suresh M, Fischl B, Salat DH. Factors influencing accuracy of cortical thickness in the diagnosis of Alzheimer's disease. Hum Brain Mapp 2017; 39:1500-1515. [PMID: 29271096 DOI: 10.1002/hbm.23922] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2017] [Revised: 11/28/2017] [Accepted: 12/07/2017] [Indexed: 02/04/2023] Open
Abstract
There is great value to use of structural neuroimaging in the assessment of Alzheimer's disease (AD). However, to date, predictive value of structural imaging tend to range between 80% and 90% in accuracy and it is unclear why this is the case given that structural imaging should parallel the pathologic processes of AD. There is a possibility that clinical misdiagnosis relative to the gold standard pathologic diagnosis and/or additional brain pathologies are confounding factors contributing to reduced structural imaging classification accuracy. We examined potential factors contributing to misclassification of individuals with clinically diagnosed AD purely from cortical thickness measures. Correctly classified and incorrectly classified groups were compared across a range of demographic, biological, and neuropsychological data including cerebrospinal fluid biomarkers, amyloid imaging, white matter hyperintensity (WMH) volume, cognitive, and genetic factors. Individual subject analyses suggested that at least a portion of the control individuals misclassified as AD from structural imaging additionally harbor substantial AD biomarker pathology and risk, yet are relatively resistant to cognitive symptoms, likely due to "cognitive reserve," and therefore clinically unimpaired. In contrast, certain clinical control individuals misclassified as AD from cortical thickness had increased WMH volume relative to other controls in the sample, suggesting that vascular conditions may contribute to classification accuracy from cortical thickness measures. These results provide examples of factors that contribute to the accuracy of structural imaging in predicting a clinical diagnosis of AD, and provide important information about considerations for future work aimed at optimizing structural based diagnostic classifiers for AD.
Collapse
Affiliation(s)
- Mahanand Belathur Suresh
- MGH/MIT/HMS Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts.,Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.,Department of Information Science and Engineering, Sri Jayachamarajendra College of Engineering, Mysuru, Karnataka, India
| | - Bruce Fischl
- MGH/MIT/HMS Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts.,Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.,Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, Massachusetts
| | - David H Salat
- MGH/MIT/HMS Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Charlestown, Massachusetts.,Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts.,Neuroimaging Research for Veterans Center, VA Boston Healthcare System, Boston, Massachusetts
| | | |
Collapse
|
43
|
Machine learning and microsimulation techniques on the prognosis of dementia: A systematic literature review. PLoS One 2017; 12:e0179804. [PMID: 28662070 PMCID: PMC5491044 DOI: 10.1371/journal.pone.0179804] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2017] [Accepted: 06/05/2017] [Indexed: 11/19/2022] Open
Abstract
Background Dementia is a complex disorder characterized by poor outcomes for the patients and high costs of care. After decades of research little is known about its mechanisms. Having prognostic estimates about dementia can help researchers, patients and public entities in dealing with this disorder. Thus, health data, machine learning and microsimulation techniques could be employed in developing prognostic estimates for dementia. Objective The goal of this paper is to present evidence on the state of the art of studies investigating and the prognosis of dementia using machine learning and microsimulation techniques. Method To achieve our goal we carried out a systematic literature review, in which three large databases—Pubmed, Socups and Web of Science were searched to select studies that employed machine learning or microsimulation techniques for the prognosis of dementia. A single backward snowballing was done to identify further studies. A quality checklist was also employed to assess the quality of the evidence presented by the selected studies, and low quality studies were removed. Finally, data from the final set of studies were extracted in summary tables. Results In total 37 papers were included. The data summary results showed that the current research is focused on the investigation of the patients with mild cognitive impairment that will evolve to Alzheimer’s disease, using machine learning techniques. Microsimulation studies were concerned with cost estimation and had a populational focus. Neuroimaging was the most commonly used variable. Conclusions Prediction of conversion from MCI to AD is the dominant theme in the selected studies. Most studies used ML techniques on Neuroimaging data. Only a few data sources have been recruited by most studies and the ADNI database is the one most commonly used. Only two studies have investigated the prediction of epidemiological aspects of Dementia using either ML or MS techniques. Finally, care should be taken when interpreting the reported accuracy of ML techniques, given studies’ different contexts.
Collapse
|
44
|
Spinelli EG, Mandelli ML, Miller ZA, Santos-Santos MA, Wilson SM, Agosta F, Grinberg LT, Huang EJ, Trojanowski JQ, Meyer M, Henry ML, Comi G, Rabinovici G, Rosen HJ, Filippi M, Miller BL, Seeley WW, Gorno-Tempini ML. Typical and atypical pathology in primary progressive aphasia variants. Ann Neurol 2017; 81:430-443. [PMID: 28133816 DOI: 10.1002/ana.24885] [Citation(s) in RCA: 234] [Impact Index Per Article: 33.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2016] [Revised: 01/26/2017] [Accepted: 01/26/2017] [Indexed: 12/11/2022]
Abstract
OBJECTIVE To characterize in vivo signatures of pathological diagnosis in a large cohort of patients with primary progressive aphasia (PPA) variants defined by current diagnostic classification. METHODS Extensive clinical, cognitive, neuroimaging, and neuropathological data were collected from 69 patients with sporadic PPA, divided into 29 semantic (svPPA), 25 nonfluent (nfvPPA), 11 logopenic (lvPPA), and 4 mixed PPA. Patterns of gray matter (GM) and white matter (WM) atrophy at presentation were assessed and tested as predictors of pathological diagnosis using support vector machine (SVM) algorithms. RESULTS A clinical diagnosis of PPA was associated with frontotemporal lobar degeneration (FTLD) with transactive response DNA-binding protein (TDP) inclusions in 40.5%, FTLD-tau in 40.5%, and Alzheimer disease (AD) pathology in 19% of cases. Each variant was associated with 1 typical pathology; 24 of 29 (83%) svPPA showed FTLD-TDP type C, 22 of 25 (88%) nfvPPA showed FTLD-tau, and all 11 lvPPA had AD. Within FTLD-tau, 4R-tau pathology was commonly associated with nfvPPA, whereas Pick disease was observed in a minority of subjects across all variants except for lvPPA. Compared with pathologically typical cases, svPPA-tau showed significant extrapyramidal signs, greater executive impairment, and severe striatal and frontal GM and WM atrophy. nfvPPA-TDP patients lacked general motor symptoms or significant WM atrophy. Combining GM and WM volumes, SVM analysis showed 92.7% accuracy to distinguish FTLD-tau and FTLD-TDP pathologies across variants. INTERPRETATION Each PPA clinical variant is associated with a typical and most frequent cognitive, neuroimaging, and neuropathological profile. Specific clinical and early anatomical features may suggest rare and atypical pathological diagnosis in vivo. Ann Neurol 2017;81:430-443.
Collapse
Affiliation(s)
- Edoardo G Spinelli
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA.,Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Maria Luisa Mandelli
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - Zachary A Miller
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | | | - Stephen M Wilson
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA.,Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
| | - Federica Agosta
- Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Lea T Grinberg
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - Eric J Huang
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - John Q Trojanowski
- Department of Pathology and Laboratory Medicine, University of Pennsylvania, Philadelphia, PA
| | - Marita Meyer
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - Maya L Henry
- Department of Communication Sciences and Disorders, University of Texas, Austin, TX
| | - Giancarlo Comi
- Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Gil Rabinovici
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - Howard J Rosen
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - Massimo Filippi
- Neuroimaging Research Unit, Institute of Experimental Neurology, Division of Neuroscience, San Raffaele Scientific Institute, Vita-Salute San Raffaele University, Milan, Italy
| | - Bruce L Miller
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | - William W Seeley
- Memory and Aging Center, University of California, San Francisco, San Francisco, CA
| | | |
Collapse
|
45
|
Arbabshirani MR, Plis S, Sui J, Calhoun VD. Single subject prediction of brain disorders in neuroimaging: Promises and pitfalls. Neuroimage 2017; 145:137-165. [PMID: 27012503 PMCID: PMC5031516 DOI: 10.1016/j.neuroimage.2016.02.079] [Citation(s) in RCA: 529] [Impact Index Per Article: 75.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2015] [Revised: 02/03/2016] [Accepted: 02/25/2016] [Indexed: 01/18/2023] Open
Abstract
Neuroimaging-based single subject prediction of brain disorders has gained increasing attention in recent years. Using a variety of neuroimaging modalities such as structural, functional and diffusion MRI, along with machine learning techniques, hundreds of studies have been carried out for accurate classification of patients with heterogeneous mental and neurodegenerative disorders such as schizophrenia and Alzheimer's disease. More than 500 studies have been published during the past quarter century on single subject prediction focused on a multiple brain disorders. In the first part of this study, we provide a survey of more than 200 reports in this field with a focus on schizophrenia, mild cognitive impairment (MCI), Alzheimer's disease (AD), depressive disorders, autism spectrum disease (ASD) and attention-deficit hyperactivity disorder (ADHD). Detailed information about those studies such as sample size, type and number of extracted features and reported accuracy are summarized and discussed. To our knowledge, this is by far the most comprehensive review of neuroimaging-based single subject prediction of brain disorders. In the second part, we present our opinion on major pitfalls of those studies from a machine learning point of view. Common biases are discussed and suggestions are provided. Moreover, emerging trends such as decentralized data sharing, multimodal brain imaging, differential diagnosis, disease subtype classification and deep learning are also discussed. Based on this survey, there is extensive evidence showing the great potential of neuroimaging data for single subject prediction of various disorders. However, the main bottleneck of this exciting field is still the limited sample size, which could be potentially addressed by modern data sharing models such as the ones discussed in this paper. Emerging big data technologies and advanced data-intensive machine learning methodologies such as deep learning have coincided with an increasing need for accurate, robust and generalizable single subject prediction of brain disorders during an exciting time. In this report, we survey the past and offer some opinions regarding the road ahead.
Collapse
Affiliation(s)
- Mohammad R Arbabshirani
- The Mind Research Network, Albuquerque, NM 87106, USA; Geisinger Health System, Danville, PA 17822, USA
| | - Sergey Plis
- The Mind Research Network, Albuquerque, NM 87106, USA
| | - Jing Sui
- The Mind Research Network, Albuquerque, NM 87106, USA; Brainnetome Center and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China
| | - Vince D Calhoun
- The Mind Research Network, Albuquerque, NM 87106, USA; Department of ECE, University of New Mexico, Albuquerque, NM, USA
| |
Collapse
|
46
|
Dukart J, Sambataro F, Bertolino A. Accurate Prediction of Conversion to Alzheimer's Disease using Imaging, Genetic, and Neuropsychological Biomarkers. J Alzheimers Dis 2016; 49:1143-59. [PMID: 26599054 DOI: 10.3233/jad-150570] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
A variety of imaging, neuropsychological, and genetic biomarkers have been suggested as potential biomarkers for the identification of mild cognitive impairment (MCI) in patients who later develop Alzheimer's disease (AD). Here, we systematically evaluated the most promising combinations of these biomarkers regarding discrimination between stable and converter MCI and reflection of disease staging. Alzheimer's Disease Neuroimaging Initiative data of AD (n = 144), controls (n = 112), stable (n = 265) and converter (n = 177) MCI, for which apolipoprotein E status, neuropsychological evaluation, and structural, glucose, and amyloid imaging were available, were included in this study. Naïve Bayes classifiers were built on AD and controls data for all possible combinations of these biomarkers, with and without stratification by amyloid status. All classifiers were then applied to the MCI cohorts. We obtained an accuracy of 76% for discrimination between converter and stable MCI with glucose positron emission tomography as a single biomarker. This accuracy increased to about 87% when including further imaging modalities and genetic information. We also identified several biomarker combinations as strong predictors of time to conversion. Use of amyloid validated training data resulted in increased sensitivities and decreased specificities for differentiation between stable and converter MCI when amyloid was included as a biomarker but not for other classifier combinations. Our results indicate that fully independent classifiers built only on AD and controls data and combining imaging, genetic, and/or neuropsychological biomarkers can more reliably discriminate between stable and converter MCI than single modality classifiers. Several biomarker combinations are identified as strongly predictive for the time to conversion to AD.
Collapse
Affiliation(s)
- Juergen Dukart
- F. Hoffmann-La Roche, Roche Innovation Centre Basel, Basel, Switzerland.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Fabio Sambataro
- F. Hoffmann-La Roche, Roche Innovation Centre Basel, Basel, Switzerland
| | - Alessandro Bertolino
- F. Hoffmann-La Roche, Roche Innovation Centre Basel, Basel, Switzerland.,Department of Basic Medical Science, Neuroscience and Sense Organs, University of Bari, Bari, Italy
| |
Collapse
|
47
|
Moradi E, Khundrakpam B, Lewis JD, Evans AC, Tohka J. Predicting symptom severity in autism spectrum disorder based on cortical thickness measures in agglomerative data. Neuroimage 2016; 144:128-141. [PMID: 27664827 DOI: 10.1016/j.neuroimage.2016.09.049] [Citation(s) in RCA: 53] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2016] [Revised: 08/29/2016] [Accepted: 09/20/2016] [Indexed: 12/15/2022] Open
Abstract
Machine learning approaches have been widely used for the identification of neuropathology from neuroimaging data. However, these approaches require large samples and suffer from the challenges associated with multi-site, multi-protocol data. We propose a novel approach to address these challenges, and demonstrate its usefulness with the Autism Brain Imaging Data Exchange (ABIDE) database. We predict symptom severity based on cortical thickness measurements from 156 individuals with autism spectrum disorder (ASD) from four different sites. The proposed approach consists of two main stages: a domain adaptation stage using partial least squares regression to maximize the consistency of imaging data across sites; and a learning stage combining support vector regression for regional prediction of severity with elastic-net penalized linear regression for integrating regional predictions into a whole-brain severity prediction. The proposed method performed markedly better than simpler alternatives, better with multi-site than single-site data, and resulted in a considerably higher cross-validated correlation score than has previously been reported in the literature for multi-site data. This demonstration of the utility of the proposed approach for detecting structural brain abnormalities in ASD from the multi-site, multi-protocol ABIDE dataset indicates the potential of designing machine learning methods to meet the challenges of agglomerative data.
Collapse
Affiliation(s)
- Elaheh Moradi
- Department of Signal Processing, Tampere University of Technology, Tampere, Finland
| | - Budhachandra Khundrakpam
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - John D Lewis
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - Alan C Evans
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill University, Montreal, Canada
| | - Jussi Tohka
- Department of Bioengineering and Aerospace Engineering, Universidad Carlos III de Madrid, Avd. de la Universidad, 30, 28911, Leganes, Spain; Instituto de Investigacion Sanitaria Gregorio Marañon, Madrid, Spain.
| |
Collapse
|
48
|
Centered Kernel Alignment Enhancing Neural Network Pretraining for MRI-Based Dementia Diagnosis. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2016; 2016:9523849. [PMID: 27148392 PMCID: PMC4842359 DOI: 10.1155/2016/9523849] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/24/2015] [Accepted: 03/03/2016] [Indexed: 12/18/2022]
Abstract
Dementia is a growing problem that affects elderly people worldwide. More accurate evaluation of dementia diagnosis can help during the medical examination. Several methods for computer-aided dementia diagnosis have been proposed using resonance imaging scans to discriminate between patients with Alzheimer's disease (AD) or mild cognitive impairment (MCI) and healthy controls (NC). Nonetheless, the computer-aided diagnosis is especially challenging because of the heterogeneous and intermediate nature of MCI. We address the automated dementia diagnosis by introducing a novel supervised pretraining approach that takes advantage of the artificial neural network (ANN) for complex classification tasks. The proposal initializes an ANN based on linear projections to achieve more discriminating spaces. Such projections are estimated by maximizing the centered kernel alignment criterion that assesses the affinity between the resonance imaging data kernel matrix and the label target matrix. As a result, the performed linear embedding allows accounting for features that contribute the most to the MCI class discrimination. We compare the supervised pretraining approach to two unsupervised initialization methods (autoencoders and Principal Component Analysis) and against the best four performing classification methods of the 2014 CADDementia challenge. As a result, our proposal outperforms all the baselines (7% of classification accuracy and area under the receiver-operating-characteristic curve) at the time it reduces the class biasing.
Collapse
|
49
|
Kassubek J, Müller HP. Computer-based magnetic resonance imaging as a tool in clinical diagnosis in neurodegenerative diseases. Expert Rev Neurother 2016; 16:295-306. [PMID: 26807776 DOI: 10.1586/14737175.2016.1146590] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
Magnetic resonance imaging (MRI) is one of the core elements within the differential diagnostic work-up of patients with neurodegenerative diseases such as dementia syndromes, Parkinsonian syndromes, and motor neuron diseases. Currently, computerized MRI analyses are not routinely used for individual diagnosis; however, they have improved the anatomical understanding of pathomorphological alterations in various neurodegenerative diseases by quantitative comparisons between patients and controls at the group level. For multiparametric MRI protocols, including T1-weighted MRI, diffusion-weighted imaging, and intrinsic functional connectivity MRI, the potential as a surrogate marker is a subject of investigation. The additional value of MRI with respect to diagnosis at the individual level and for future disease-modifying multicentre trials remains to be defined. Here, we give an overview of recent applications of multiparametric MRI to patients with various neurodegenerative diseases. Starting from applications at the group level, continuous progress of a transfer to individual diagnostic classification is ongoing.
Collapse
Affiliation(s)
- Jan Kassubek
- a Department of Neurology , University of Ulm , Ulm , Germany
| | | |
Collapse
|
50
|
Comparison of Feature Selection Techniques in Machine Learning for Anatomical Brain MRI in Dementia. Neuroinformatics 2016; 14:279-96. [PMID: 26803769 DOI: 10.1007/s12021-015-9292-3] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
|