Reproducible evaluation of classification methods in Alzheimer's disease: Framework and application to MRI and PET data

AI for the prediction of early stages of Alzheimer's disease from neuroimaging biomarkers - A narrative review of a growing field

OBJECTIVES

The objectives of this narrative review are to summarize the current state of AI applications in neuroimaging for early Alzheimer's disease (AD) prediction and to highlight the potential of AI techniques in improving early AD diagnosis, prognosis, and management.

METHODS

We conducted a narrative review of studies using AI techniques applied to neuroimaging data for early AD prediction. We examined single-modality studies using structural MRI and PET imaging, as well as multi-modality studies integrating multiple neuroimaging techniques and biomarkers. Furthermore, they reviewed longitudinal studies that model AD progression and identify individuals at risk of rapid decline.

RESULTS

Single-modality studies using structural MRI and PET imaging have demonstrated high accuracy in classifying AD and predicting progression from mild cognitive impairment (MCI) to AD. Multi-modality studies, integrating multiple neuroimaging techniques and biomarkers, have shown improved performance and robustness compared to single-modality approaches. Longitudinal studies have highlighted the value of AI in modeling AD progression and identifying individuals at risk of rapid decline. However, challenges remain in data standardization, model interpretability, generalizability, clinical integration, and ethical considerations.

CONCLUSION

AI techniques applied to neuroimaging data have the potential to improve early AD diagnosis, prognosis, and management. Addressing challenges related to data standardization, model interpretability, generalizability, clinical integration, and ethical considerations is crucial for realizing the full potential of AI in AD research and clinical practice. Collaborative efforts among researchers, clinicians, and regulatory agencies are needed to develop reliable, robust, and ethical AI tools that can benefit AD patients and society.

A novel graph neural network method for Alzheimer's disease classification

Alzheimer's disease (AD) is a chronic neurodegenerative disease. Early diagnosis are very important to timely treatment and delay the progression of the disease. In the past decade, many computer-aided diagnostic (CAD) algorithms have been proposed for classification of AD. In this paper, we propose a novel graph neural network method, termed Brain Graph Attention Network (BGAN) for classification of AD. First, brain graph data are used to model classification of AD as a graph classification task. Second, a local attention layer is designed to capture and aggregate messages of interactions between node neighbors. And, a global attention layer is introduced to obtain the contribution of each node for graph representation. Finally, using the BGAN to implement AD classification. We train and test on two open public databases for AD classification task. Compared to classic models, the experimental results show that our model is superior to six classic models. We demonstrate that BGAN is a powerful classification model for AD. In addition, our model can provide an analysis of brain regions in order to judge which regions are related to AD disease and which regions are related to AD progression.

Delayed care-seeking in international migrant workers with imported malaria in China

BACKGROUND

Imported malaria cases continue to pose major challenges in China as well as in other countries that have achieved elimination. Early diagnosis and treatment of each imported malaria case is the key to successfully maintaining malaria elimination success. This study aimed to build an easy-to-use predictive nomogram to predict and intervene against delayed care-seeking among international migrant workers with imported malaria.

METHODS

A prediction model was built based on cases with imported malaria from 2012 to 2019, in Jiangsu Province, China. Routine surveillance information (e.g. sex, age, symptoms, origin country and length of stay abroad), data on the place of initial care-seeking and the gross domestic product (GDP) of the destination city were extracted. Multivariate logistic regression was performed to identify independent predictors and a nomogram was established to predict the risk of delayed care-seeking. The discrimination and calibration of the nomogram was performed using area under the curve and calibration plots. In addition, four machine learning models were used to make a comparison.

RESULTS

Of 2255 patients with imported malaria, 636 (28.2%) sought care within 24 h after symptom onset, and 577 (25.6%) sought care 3 days after symptom onset. Development of symptoms before entry into China, initial care-seeking from superior healthcare facilities and a higher GDP level of the destination city were significantly associated with delayed care-seeking among migrant workers with imported malaria. Based on these independent risk factors, an easy-to-use and intuitive nomogram was established. The calibration curves of the nomogram showed good consistency.

CONCLUSIONS

The tool provides public health practitioners with a method for the early detection of delayed care-seeking risk among international migrant workers with imported malaria, which may be of significance in improving post-travel healthcare for labour migrants, reducing the risk of severe malaria, preventing malaria reintroduction and sustaining achievements in malaria elimination.

The genetic architecture of multimodal human brain age

The complex biological mechanisms underlying human brain aging remain incompletely understood. This study investigated the genetic architecture of three brain age gaps (BAG) derived from gray matter volume (GM-BAG), white matter microstructure (WM-BAG), and functional connectivity (FC-BAG). We identified sixteen genomic loci that reached genome-wide significance (P-value < 5×10-8). A gene-drug-disease network highlighted genes linked to GM-BAG for treating neurodegenerative and neuropsychiatric disorders and WM-BAG genes for cancer therapy. GM-BAG displayed the most pronounced heritability enrichment in genetic variants within conserved regions. Oligodendrocytes and astrocytes, but not neurons, exhibited notable heritability enrichment in WM and FC-BAG, respectively. Mendelian randomization identified potential causal effects of several chronic diseases on brain aging, such as type 2 diabetes on GM-BAG and AD on WM-BAG. Our results provide insights into the genetics of human brain aging, with clinical implications for potential lifestyle and therapeutic interventions. All results are publicly available at https://labs.loni.usc.edu/medicine .

Contrast-enhanced to non-contrast-enhanced image translation to exploit a clinical data warehouse of T1-weighted brain MRI

BACKGROUND

Clinical data warehouses provide access to massive amounts of medical images, but these images are often heterogeneous. They can for instance include images acquired both with or without the injection of a gadolinium-based contrast agent. Harmonizing such data sets is thus fundamental to guarantee unbiased results, for example when performing differential diagnosis. Furthermore, classical neuroimaging software tools for feature extraction are typically applied only to images without gadolinium. The objective of this work is to evaluate how image translation can be useful to exploit a highly heterogeneous data set containing both contrast-enhanced and non-contrast-enhanced images from a clinical data warehouse.

METHODS

We propose and compare different 3D U-Net and conditional GAN models to convert contrast-enhanced T1-weighted (T1ce) into non-contrast-enhanced (T1nce) brain MRI. These models were trained using 230 image pairs and tested on 77 image pairs from the clinical data warehouse of the Greater Paris area.

RESULTS

Validation using standard image similarity measures demonstrated that the similarity between real and synthetic T1nce images was higher than between real T1nce and T1ce images for all the models compared. The best performing models were further validated on a segmentation task. We showed that tissue volumes extracted from synthetic T1nce images were closer to those of real T1nce images than volumes extracted from T1ce images.

CONCLUSION

We showed that deep learning models initially developed with research quality data could synthesize T1nce from T1ce images of clinical quality and that reliable features could be extracted from the synthetic images, thus demonstrating the ability of such methods to help exploit a data set coming from a clinical data warehouse.

Subtypes of brain change in aging and their associations with cognition and Alzheimer's disease biomarkers

Structural brain changes underly cognitive changes in older age and contribute to inter-individual variability in cognition. Here, we assessed how changes in cortical thickness, surface area, and subcortical volume, are related to cognitive change in cognitively unimpaired older adults using structural magnetic resonance imaging (MRI) data-driven clustering. Specifically, we tested (1) which brain structural changes over time predict cognitive change in older age (2) whether these are associated with core cerebrospinal fluid (CSF) Alzheimer's disease (AD) biomarkers phosphorylated tau (p-tau) and amyloid-β (Aβ42), and (3) the degree of overlap between clusters derived from different structural features. In total 1899 cognitively healthy older adults (50 - 93 years) were followed up to 16 years with neuropsychological and structural MRI assessments, a subsample of which (n = 612) had CSF p-tau and Aβ42 measurements. We applied Monte-Carlo Reference-based Consensus clustering to identify subgroups of older adults based on structural brain change patterns over time. Four clusters for each brain feature were identified, representing the degree of longitudinal brain decline. Each brain feature provided a unique contribution to brain aging as clusters were largely independent across modalities. Cognitive change and baseline cognition were best predicted by cortical area change, whereas higher levels of p-tau and Aβ42 were associated with changes in subcortical volume. These results provide insights into the link between changes in brain morphology and cognition, which may translate to a better understanding of different aging trajectories.

Genomic loci influence patterns of structural covariance in the human brain

Normal and pathologic neurobiological processes influence brain morphology in coordinated ways that give rise to patterns of structural covariance (PSC) across brain regions and individuals during brain aging and diseases. The genetic underpinnings of these patterns remain largely unknown. We apply a stochastic multivariate factorization method to a diverse population of 50,699 individuals (12 studies and 130 sites) and derive data-driven, multi-scale PSCs of regional brain size. PSCs were significantly correlated with 915 genomic loci in the discovery set, 617 of which are newly identified, and 72% were independently replicated. Key pathways influencing PSCs involve reelin signaling, apoptosis, neurogenesis, and appendage development, while pathways of breast cancer indicate potential interplays between brain metastasis and PSCs associated with neurodegeneration and dementia. Using support vector machines, multi-scale PSCs effectively derive imaging signatures of several brain diseases. Our results elucidate genetic and biological underpinnings that influence structural covariance patterns in the human brain.

Hippocampal metabolic subregions and networks: Behavioral, molecular, and pathological aging profiles

INTRODUCTION

Hippocampal local and network dysfunction is the hallmark of Alzheimer's disease (AD).

METHODS

We characterized the spatial patterns of hippocampus differentiation based on brain co-metabolism in healthy elderly participants and demonstrated their relevance to study local metabolic changes and associated dysfunction in pathological aging.

RESULTS

The hippocampus can be differentiated into anterior/posterior and dorsal cornu ammonis (CA)/ventral (subiculum) subregions. While anterior/posterior CA show co-metabolism with different regions of the subcortical limbic networks, the anterior/posterior subiculum are parts of cortical networks supporting object-centered memory and higher cognitive demands, respectively. Both networks show relationships with the spatial patterns of gene expression pertaining to cell energy metabolism and AD's process. Finally, while local metabolism is generally lower in posterior regions, the anterior-posterior imbalance is maximal in late mild cognitive impairment with the anterior subiculum being relatively preserved.

DISCUSSION

Future studies should consider bidimensional hippocampal differentiation and in particular the posterior subicular region to better understand pathological aging.

Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse

A variety of algorithms have been proposed for computer-aided diagnosis of dementia from anatomical brain MRI. These approaches achieve high accuracy when applied to research data sets but their performance on real-life clinical routine data has not been evaluated yet. The aim of this work was to study the performance of such approaches on clinical routine data, based on a hospital data warehouse, and to compare the results to those obtained on a research data set. The clinical data set was extracted from the hospital data warehouse of the Greater Paris area, which includes 39 different hospitals. The research set was composed of data from the Alzheimer's Disease Neuroimaging Initiative data set. In the clinical set, the population of interest was identified by exploiting the diagnostic codes from the 10th revision of the International Classification of Diseases that are assigned to each patient. We studied how the imbalance of the training sets, in terms of contrast agent injection and image quality, may bias the results. We demonstrated that computer-aided diagnosis performance was strongly biased upwards (over 17 percent points of balanced accuracy) by the confounders of image quality and contrast agent injection, a phenomenon known as the Clever Hans effect or shortcut learning. When these biases were removed, the performance was very poor. In any case, the performance was considerably lower than on the research data set. Our study highlights that there are still considerable challenges for translating dementia computer-aided diagnosis systems to clinical routine.

Associations of neuroinflammatory IL-6 and IL-8 with brain atrophy, memory decline, and core AD biomarkers - in cognitively unimpaired older adults

Concentrations of pro-inflammatory cytokines -interleukin-6 (IL-6) and interleukin-8 (IL-8) - are increased with age and in Alzheimer's disease (AD). It is not clear whether concentrations of IL-6 and IL-8 in the central nervous system predict later brain and cognitive changes over time nor whether this relationship is mediated by core AD biomarkers. Here, 219 cognitively healthy older adults (62-91 years), with baseline cerebrospinal fluid (CSF) measures of IL-6 and IL-8 were followed over time - up to 9 years - with assessments that included cognitive function, structural magnetic resonance imaging, and CSF measurements of phosphorylated tau (p-tau) and amyloid-β (Aβ-42) concentrations (for a subsample). Higher baseline CSF IL-8 was associated with better memory performance over time in the context of lower levels of CSF p-tau and p-tau/Aβ-42 ratio. Higher CSF IL-6 was related to less CSF p-tau changes over time. The results are in line with the hypothesis suggesting that an up-regulation of IL-6 and IL-8 in the brain may play a neuroprotective role in cognitively healthy older adults with lower load of AD pathology.

The Genetic Architecture of Multimodal Human Brain Age

The complex biological mechanisms underlying human brain aging remain incompletely understood, involving multiple body organs and chronic diseases. In this study, we used multimodal magnetic resonance imaging and artificial intelligence to examine the genetic architecture of the brain age gap (BAG) derived from gray matter volume (GM-BAG, N=31,557 European ancestry), white matter microstructure (WM-BAG, N=31,674), and functional connectivity (FC-BAG, N=32,017). We identified sixteen genomic loci that reached genome-wide significance (P-value<5×10-8). A gene-drug-disease network highlighted genes linked to GM-BAG for treating neurodegenerative and neuropsychiatric disorders and WM-BAG genes for cancer therapy. GM-BAG showed the highest heritability enrichment for genetic variants in conserved regions, whereas WM-BAG exhibited the highest heritability enrichment in the 5' untranslated regions; oligodendrocytes and astrocytes, but not neurons, showed significant heritability enrichment in WM and FC-BAG, respectively. Mendelian randomization identified potential causal effects of several exposure variables on brain aging, such as type 2 diabetes on GM-BAG (odds ratio=1.05 [1.01, 1.09], P-value=1.96×10-2) and AD on WM-BAG (odds ratio=1.04 [1.02, 1.05], P-value=7.18×10-5). Overall, our results provide valuable insights into the genetics of human brain aging, with clinical implications for potential lifestyle and therapeutic interventions. All results are publicly available at the MEDICINE knowledge portal: https://labs.loni.usc.edu/medicine.

Regional Glymphatic Abnormality in Behavioral Variant Frontotemporal Dementia

OBJECTIVES

Glymphatic function has not yet been explored in behavioral variant frontotemporal dementia (bvFTD). The spatial correlation between regional glymphatic function and bvFTD remains unknown.

METHOD

A total of 74 patients with bvFTD and 67 age- and sex-matched healthy controls (HCs) were selected from discovery dataset and replication dataset. All participants underwent neuropsychological assessment. Glymphatic measures including choroid plexus (CP) volume, diffusion tensor imaging along the perivascular (DTI-ALPS) index, and coupling between blood-oxygen-level-dependent signals and cerebrospinal fluid signals (BOLD-CSF coupling), were compared between the two groups. Regional glymphatic function was evaluated by dividing DTI-ALPS and BOLD-CSF coupling into anterior, middle, and posterior regions. The bvFTD-related metabolic pattern was identified using spatial covariance analysis based on l8 F-FDG-PET.

RESULTS

Patients with bvFTD showed higher CP volume (p < 0.001); anterior and middle DTI-ALPS (p < 0.001); and weaker anterior BOLD-CSF coupling (p < 0.05) than HCs after controlling for cortical gray matter volume in both datasets. In bvFTD from the discovery dataset, the anterior DTI-ALPS was negatively associated with the expression of the bvFTD-related metabolic pattern (r = -0.52, p = 0.034) and positively related with regional standardized uptake value ratios of l8 F-FDG-PET in bvFTD-related brain regions (r range: 0.49 to 0.62, p range: 0.017 to 0.047). Anterior and middle glymphatic functions were related to global cognition and disease severity.

INTERPRETATION

Our findings reveal abnormal glymphatic function, especially in the anterior and middle regions of brain in bvFTD. Regional glymphatic dysfunction may contribute to the pathogenesis of bvFTD. ANN NEUROL 2023;94:442-456.

Conv-Swinformer: Integration of CNN and shift window attention for Alzheimer's disease classification

Deep learning (DL) algorithms based on brain MRI images have achieved great success in the prediction of Alzheimer's disease (AD), with classification accuracy exceeding even that of the most experienced clinical experts. As a novel feature fusion method, Transformer has achieved excellent performance in many computer vision tasks, which also greatly promotes the application of Transformer in medical images. However, when Transformer is used for 3D MRI image feature fusion, existing DL models treat the input local features equally, which is inconsistent with the fact that adjacent voxels have stronger semantic connections than spatially distant voxels. In addition, due to the relatively small size of the dataset for medical images, it is difficult to capture local lesion features in limited iterative training by treating all input features equally. This paper proposes a deep learning model Conv-Swinformer that focuses on extracting and integrating local fine-grained features. Conv-Swinformer consists of a CNN module and a Transformer encoder module. The CNN module summarizes the planar features of the MRI slices, and the Transformer module establishes semantic connections in 3D space for these planar features. By introducing the shift window attention mechanism in the Transformer encoder, the attention is focused on a small spatial area of the MRI image, which effectively reduces unnecessary background semantic information and enables the model to capture local features more accurately. In addition, the layer-by-layer enlarged attention window can further integrate local fine-grained features, thus enhancing the model's attention ability. Compared with DL algorithms that indiscriminately fuse local features of MRI images, Conv-Swinformer can fine-grained extract local lesion features, thus achieving better classification results.

Noninvasive automatic detection of Alzheimer's disease from spontaneous speech: a review

Alzheimer's disease (AD) is considered as one of the leading causes of death among people over the age of 70 that is characterized by memory degradation and language impairment. Due to language dysfunction observed in individuals with AD patients, the speech-based methods offer non-invasive, convenient, and cost-effective solutions for the automatic detection of AD. This paper systematically reviews the technologies to detect the onset of AD from spontaneous speech, including data collection, feature extraction and classification. First the paper formulates the task of automatic detection of AD and describes the process of data collection. Then, feature extractors from speech data and transcripts are reviewed, which mainly contains acoustic features from speech and linguistic features from text. Especially, general handcrafted features and deep embedding features are organized from different modalities. Additionally, this paper summarizes optimization strategies for AD detection systems. Finally, the paper addresses challenges related to data size, model explainability, reliability and multimodality fusion, and discusses potential research directions based on these challenges.

PRedicting the EVolution of SubjectIvE Cognitive Decline to Alzheimer's Disease With machine learning: the PREVIEW study protocol

BACKGROUND

As disease-modifying therapies (DMTs) for Alzheimer's disease (AD) are becoming a reality, there is an urgent need to select cost-effective tools that can accurately identify patients in the earliest stages of the disease. Subjective Cognitive Decline (SCD) is a condition in which individuals complain of cognitive decline with normal performances on neuropsychological evaluation. Many studies demonstrated a higher prevalence of Alzheimer's pathology in patients diagnosed with SCD as compared to the general population. Consequently, SCD was suggested as an early symptomatic phase of AD. We will describe the study protocol of a prospective cohort study (PREVIEW) that aim to identify features derived from easily accessible, cost-effective and non-invasive assessment to accurately detect SCD patients who will progress to AD dementia.

METHODS

We will include patients who self-referred to our memory clinic and are diagnosed with SCD. Participants will undergo: clinical, neurologic and neuropsychological examination, estimation of cognitive reserve and depression, evaluation of personality traits, APOE and BDNF genotyping, electroencephalography and event-related potential recording, lumbar puncture for measurement of Aβ42, t-tau, and p-tau concentration and Aβ42/Aβ40 ratio. Recruited patients will have follow-up neuropsychological examinations every two years. Collected data will be used to train a machine learning algorithm to define the risk of being carriers of AD and progress to dementia in patients with SCD.

DISCUSSION

This is the first study to investigate the application of machine learning to predict AD in patients with SCD. Since all the features we will consider can be derived from non-invasive and easily accessible assessments, our expected results may provide evidence for defining cost-effective and globally scalable tools to estimate the risk of AD and address the needs of patients with memory complaints. In the era of DMTs, this will have crucial implications for the early identification of patients suitable for treatment in the initial stages of AD.

TRIAL REGISTRATION NUMBER (TRN)

NCT05569083.

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi-modality data

Alzheimer's disease (AD) is a neurodegenerative disorder, the most common cause of dementia, so the accurate diagnosis of AD and its prodromal stage mild cognitive impairment (MCI) is significant. Recent studies have demonstrated that multiple neuroimaging and biological measures contain complementary information for diagnosis. Many existing multi-modal models based on deep learning simply concatenate each modality's features despite substantial differences in representation spaces. In this paper, we propose a novel multi-modal cross-attention AD diagnosis (MCAD) framework to learn the interaction between modalities for better playing their complementary roles for AD diagnosis with multi-modal data including structural magnetic resonance imaging (sMRI), fluorodeoxyglucose-positron emission tomography (FDG-PET) and cerebrospinal fluid (CSF) biomarkers. Specifically, the imaging and non-imaging representations are learned by the image encoder based on cascaded dilated convolutions and CSF encoder, respectively. Then, a multi-modal interaction module is introduced, which takes advantage of cross-modal attention to integrate imaging and non-imaging information and reinforce relationships between these modalities. Moreover, an extensive objective function is designed to reduce the discrepancy between modalities for effectively fusing the features of multi-modal data, which could further improve the diagnosis performance. We evaluate the effectiveness of our proposed method on the ADNI dataset, and the extensive experiments demonstrate that our MCAD achieves superior performance for multiple AD-related classification tasks, compared to several competing methods. Also, we investigate the importance of cross-attention and the contribution of each modality to the diagnostics performance. The experimental results demonstrate that combining multi-modality data via cross-attention is helpful for accurate AD diagnosis.

Convergence of Artificial Intelligence and Neuroscience towards the Diagnosis of Neurological Disorders-A Scoping Review

Artificial intelligence (AI) is a field of computer science that deals with the simulation of human intelligence using machines so that such machines gain problem-solving and decision-making capabilities similar to that of the human brain. Neuroscience is the scientific study of the struczture and cognitive functions of the brain. Neuroscience and AI are mutually interrelated. These two fields help each other in their advancements. The theory of neuroscience has brought many distinct improvisations into the AI field. The biological neural network has led to the realization of complex deep neural network architectures that are used to develop versatile applications, such as text processing, speech recognition, object detection, etc. Additionally, neuroscience helps to validate the existing AI-based models. Reinforcement learning in humans and animals has inspired computer scientists to develop algorithms for reinforcement learning in artificial systems, which enables those systems to learn complex strategies without explicit instruction. Such learning helps in building complex applications, like robot-based surgery, autonomous vehicles, gaming applications, etc. In turn, with its ability to intelligently analyze complex data and extract hidden patterns, AI fits as a perfect choice for analyzing neuroscience data that are very complex. Large-scale AI-based simulations help neuroscientists test their hypotheses. Through an interface with the brain, an AI-based system can extract the brain signals and commands that are generated according to the signals. These commands are fed into devices, such as a robotic arm, which helps in the movement of paralyzed muscles or other human parts. AI has several use cases in analyzing neuroimaging data and reducing the workload of radiologists. The study of neuroscience helps in the early detection and diagnosis of neurological disorders. In the same way, AI can effectively be applied to the prediction and detection of neurological disorders. Thus, in this paper, a scoping review has been carried out on the mutual relationship between AI and neuroscience, emphasizing the convergence between AI and neuroscience in order to detect and predict various neurological disorders.

Biomarkers of diagnosis, prognosis, pathogenesis, response to therapy: Convergence or divergence? Lessons from Alzheimer's disease and synucleinopathies

Alzheimer's disease (AD) is the most common disorder associated with cognitive impairment. Recent observations emphasize the pathogenic role of multiple factors inside and outside the central nervous system, supporting the notion that AD is a syndrome of many etiologies rather than a "heterogeneous" but ultimately unifying disease entity. Moreover, the defining pathology of amyloid and tau coexists with many others, such as α-synuclein, TDP-43, and others, as a rule, not an exception. Thus, an effort to shift our AD paradigm as an amyloidopathy must be reconsidered. Along with amyloid accumulation in its insoluble state, β-amyloid is becoming depleted in its soluble, normal states, as a result of biological, toxic, and infectious triggers, requiring a shift from convergence to divergence in our approach to neurodegeneration. These aspects are reflected-in vivo-by biomarkers, which have become increasingly strategic in dementia. Similarly, synucleinopathies are primarily characterized by abnormal deposition of misfolded α-synuclein in neurons and glial cells and, in the process, depleting the levels of the normal, soluble α-synuclein that the brain needs for many physiological functions. The soluble to insoluble conversion also affects other normal brain proteins, such as TDP-43 and tau, accumulating in their insoluble states in both AD and dementia with Lewy bodies (DLB). The two diseases have been distinguished by the differential burden and distribution of insoluble proteins, with neocortical phosphorylated tau deposition more typical of AD and neocortical α-synuclein deposition peculiar to DLB. We propose a reappraisal of the diagnostic approach to cognitive impairment from convergence (based on clinicopathologic criteria) to divergence (based on what differs across individuals affected) as a necessary step for the launch of precision medicine.

VGG-TSwinformer: Transformer-based deep learning model for early Alzheimer's disease prediction

BACKGROUND AND OBJECTIVE

Mild cognitive impairment (MCI) is a transitional state between normal aging and Alzheimer's disease (AD), and accurately predicting the progression trend of MCI is critical to the early prevention and treatment of AD. Brain structural magnetic resonance imaging (sMRI), as one of the most important biomarkers for the diagnosis of AD, has been applied in various deep learning models. However, due to the inherent disadvantage of deep learning in dealing with longitudinal medical image data, few applications of deep learning for longitudinal analysis of MCI, and the majority of existing deep learning algorithms for MCI progress prediction rely on the analysis of the sMRI images collected at a single time-point, ignoring the progressive nature of the disorder.

METHODS

In this work, we propose a VGG-TSwinformer model based on convolutional neural network (CNN) and Transformer for short-term longitudinal study of MCI. In this model, VGG-16 based CNN is used to extract low-level spatial features of longitudinal sMRI images and map these low-level features to high-level feature representations, sliding-window attention is used for fine-grained fusion of spatially adjacent feature representations, and gradually fuses distant spatial feature representations through the superposition of attention windows of different sizes, temporal attention is used to measure the evolution of this feature representations as a result of disease progression.

RESULTS

We validated our model on the ADNI dataset. For the classification task of sMCI vs pMCI, accuracy, sensitivity, specificity and AUC reached 77.2%, 79.97%, 71.59% and 0.8153 respectively. Compared with other cross-sectional studies also applied to sMRI, the proposed model achieved better results in terms of accuracy, sensitivity, and AUC.

CONCLUSION

The proposed VGG-TSwinformer is a deep learning model for short-term longitudinal study of MCI, which can build brain atrophy progression model from longitudinal sMRI images, and improve diagnostic efficiency compared to algorithms using only cross-sectional sMRI images.

Episodic Memory-Related Imaging Features as Valuable Biomarkers for the Diagnosis of Alzheimer's Disease: A Multicenter Study Based on Machine Learning

BACKGROUND

Individualized and reliable biomarkers are crucial for diagnosing Alzheimer's disease (AD). However, lack of accessibility and neurobiological correlation are the main obstacles to their clinical application. Machine learning algorithms can effectively identify personalized biomarkers based on the prominent symptoms of AD.

METHODS

Episodic memory-related magnetic resonance imaging (MRI) features of 143 patients with amnesic mild cognitive impairment (MCI) were identified using a multivariate relevance vector regression algorithm. The support vector machine classification model was constructed using these MRI features and verified in 2 independent datasets (N = 994). The neurobiological basis was also investigated based on cognitive assessments, neuropathologic biomarkers of cerebrospinal fluid, and positron emission tomography images of amyloid-β plaques.

RESULTS

The combination of gray matter volume and amplitude of low-frequency fluctuation MRI features accurately predicted episodic memory impairment in individual patients with amnesic MCI (r = 0.638) when measured using an episodic memory assessment panel. The MRI features that contributed to episodic memory prediction were primarily distributed across the default mode network and limbic network. The classification model based on these features distinguished patients with AD from normal control subjects with more than 86% accuracy. Furthermore, most identified episodic memory-related regions showed significantly different amyloid-β positron emission tomography measurements among the AD, MCI, and normal control groups. Moreover, the classification outputs significantly correlated with cognitive assessment scores and cerebrospinal fluid pathological biomarkers' levels in the MCI and AD groups.

CONCLUSIONS

Neuroimaging features can reflect individual episodic memory function and serve as potential diagnostic biomarkers of AD.

Efficient Training on Alzheimer's Disease Diagnosis with Learnable Weighted Pooling for 3D PET Brain Image Classification

Three-dimensional convolutional neural networks (3D CNNs) have been widely applied to analyze Alzheimer's disease (AD) brain images for a better understanding of the disease progress or predicting the conversion from cognitively impaired (CU) or mild cognitive impairment status. It is well-known that training 3D-CNN is computationally expensive and with the potential of overfitting due to the small sample size available in the medical imaging field. Here we proposed a novel 3D-2D approach by converting a 3D brain image to a 2D fused image using a Learnable Weighted Pooling (LWP) method to improve efficient training and maintain comparable model performance. By the 3D-to-2D conversion, the proposed model can easily forward the fused 2D image through a pre-trained 2D model while achieving better performance over different 3D and 2D baselines. In the implementation, we chose to use ResNet34 for feature extraction as it outperformed other 2D CNN backbones. We further showed that the weights of the slices are location-dependent and the model performance relies on the 3D-to-2D fusion view, with the best outcomes from the coronal view. With the new approach, we were able to reduce 75% of the training time and increase the accuracy to 0.88, compared with conventional 3D CNNs, for classifying amyloid-beta PET imaging from the AD patients from the CU participants using the publicly available Alzheimer's Disease Neuroimaging Initiative dataset. The novel 3D-2D model may have profound implications for timely AD diagnosis in clinical settings in the future.

Investigating the temporal pattern of neuroimaging-based brain age estimation as a biomarker for Alzheimer's Disease related neurodegeneration

Neuroimaging-based brain-age estimation via machine learning has emerged as an important new approach for studying brain aging. The difference between one's estimated brain age and chronological age, the brain age gap (BAG), has been proposed as an Alzheimer's Disease (AD) biomarker. However, most past studies on the BAG have been cross-sectional. Quantifying longitudinal changes in an individual's BAG temporal pattern would likely improve prediction of AD progression and clinical outcome based on neurophysiological changes. To fill this gap, our study conducted predictive modeling using a large neuroimaging dataset with up to 8 years of follow-up to examine the temporal patterns of the BAG's trajectory and how it varies by subject-level characteristics (sex, APOEɛ4 carriership) and disease status. Specifically, we explored the pattern and rate of change in BAG over time in individuals who remain stable with normal cognition or mild cognitive impairment (MCI), as well as individuals who progress to clinical AD. Combining multimodal imaging data in a support vector regression model to estimate brain age yielded improved performance over single modality. Multilevel modeling results showed the BAG followed a linear increasing trajectory with a significantly faster rate in individuals with MCI who progressed to AD compared to cognitively normal or MCI individuals who did not progress. The dynamic changes in the BAG during AD progression were further moderated by sex and APOEɛ4 carriership. Our findings demonstrate the BAG as a potential biomarker for understanding individual specific temporal patterns related to AD progression.

Development of a deep learning network for Alzheimer’s disease classification with evaluation of imaging modality and longitudinal data

Objective. Neuroimaging uncovers important information about disease in the brain. Yet in Alzheimer’s disease (AD), there remains a clear clinical need for reliable tools to extract diagnoses from neuroimages. Significant work has been done to develop deep learning (DL) networks using neuroimaging for AD diagnosis. However, no particular model has emerged as optimal. Due to a lack of direct comparisons and evaluations on independent data, there is no consensus on which modality is best for diagnostic models or whether longitudinal information enhances performance. The purpose of this work was (1) to develop a generalizable DL model to distinguish neuroimaging scans of AD patients from controls and (2) to evaluate the influence of imaging modality and longitudinal data on performance. Approach. We trained a 2-class convolutional neural network (CNN) with and without a cascaded recurrent neural network (RNN). We used datasets of 772 (N AD = 364, N control = 408) 3D 18F-FDG PET scans and 780 (N AD = 280, N control = 500) T1-weighted volumetric-3D MR images (containing 131 and 144 patients with multiple timepoints) from the Alzheimer’s Disease Neuroimaging Initiative, plus an independent set of 104 (N AD = 63, N NC = 41) 18F-FDG PET scans (one per patient) for validation. Main Results. ROC analysis showed that PET-trained models outperformed MRI-trained, achieving maximum AUC with the CNN + RNN model of 0.93 ± 0.08, with accuracy 82.5 ± 8.9%. Adding longitudinal information offered significant improvement to performance on 18F-FDG PET, but not on T1-MRI. CNN model validation with an independent 18F-FDG PET dataset achieved AUC of 0.99. Layer-wise relevance propagation heatmaps added CNN interpretability. Significance. The development of a high-performing tool for AD diagnosis, with the direct evaluation of key influences, reveals the advantage of using 18F-FDG PET and longitudinal data over MRI and single timepoint analysis. This has significant implications for the potential of neuroimaging for future research on AD diagnosis and clinical management of suspected AD patients.

Discriminating Aging Cognitive Decline Spectrum Using PET and Magnetic Resonance Image Features

Background: The population aging increased the prevalence of brain diseases, like Alzheimer’s disease (AD), and early identification of individuals with higher odds of cognitive decline is essential to maintain quality of life. Imaging evaluation of individuals at risk of cognitive decline includes biomarkers extracted from brain positron emission tomography (PET) and structural magnetic resonance imaging (MRI). Objective: We propose investigating ensemble models to classify groups in the aging cognitive decline spectrum by combining features extracted from single imaging modalities and combinations of imaging modalities (FDG+AMY+MRI, and a PET ensemble). Methods: We group imaging data of 131 individuals into four classes related to the individuals’ cognitive assessment in baseline and follow-up: stable cognitive non-impaired; individuals converting to mild cognitive impairment (MCI) syndrome; stable MCI; and Alzheimer’s clinical syndrome. We assess the performance of four algorithms using leave-one-out cross-validation: decision tree classifier, random forest (RF), light gradient boosting machine (LGBM), and categorical boosting (CAT). The performance analysis of models is evaluated using balanced accuracy before and after using Shapley Additive exPlanations with recursive feature elimination (SHAP-RFECV) method. Results: Our results show that feature selection with CAT or RF algorithms have the best overall performance in discriminating early cognitive decline spectrum mainly using MRI imaging features. Conclusion: Use of CAT or RF algorithms with SHAP-RFECV shows good discrimination of early stages of aging cognitive decline, mainly using MRI image features. Further work is required to analyze the impact of selected brain regions and their correlation with cognitive decline spectrum.

A CAD System for Alzheimer's Disease Classification Using Neuroimaging MRI 2D Slices

Developments in medical care have inspired wide interest in the current decade, especially to their services to individuals living prolonged and healthier lives. Alzheimer's disease (AD) is the most chronic neurodegeneration and dementia-causing disorder. Economic expense of treating AD patients is expected to grow. The requirement of developing a computer-aided technique for early AD categorization becomes even more essential. Deep learning (DL) models offer numerous benefits against machine learning tools. Several latest experiments that exploited brain magnetic resonance imaging (MRI) scans and convolutional neural networks (CNN) for AD classification showed promising conclusions. CNN's receptive field aids in the extraction of main recognizable features from these MRI scans. In order to increase classification accuracy, a new adaptive model based on CNN and support vector machines (SVM) is presented in the research, combining both the CNN's capabilities in feature extraction and SVM in classification. The objective of this research is to build a hybrid CNN-SVM model for classifying AD using the MRI ADNI dataset. Experimental results reveal that the hybrid CNN-SVM model outperforms the CNN model alone, with relative improvements of 3.4%, 1.09%, 0.85%, and 2.82% on the testing dataset for AD vs. cognitive normal (CN), CN vs. mild cognitive impairment (MCI), AD vs. MCI, and CN vs. MCI vs. AD, respectively. Finally, the proposed approach has been further experimented on OASIS dataset leading to accuracy of 86.2%.

TR-GAN: Multi-Session Future MRI Prediction With Temporal Recurrent Generative Adversarial Network

Magnetic Resonance Imaging (MRI) has been proven to be an efficient way to diagnose Alzheimer's disease (AD). Recent dramatic progress on deep learning greatly promotes the MRI analysis based on data-driven CNN methods using a large-scale longitudinal MRI dataset. However, most of the existing MRI datasets are fragmented due to unexpected quits of volunteers. To tackle this problem, we propose a novel Temporal Recurrent Generative Adversarial Network (TR-GAN) to complete missing sessions of MRI datasets. Unlike existing GAN-based methods, which either fail to generate future sessions or only generate fixed-length sessions, TR-GAN takes all past sessions to recurrently and smoothly generate future ones with variant length. Specifically, TR-GAN adopts recurrent connection to deal with variant input sequence length and flexibly generate future variant sessions. Besides, we also design a multiple scale & location (MSL) module and a SWAP module to encourage the model to better focus on detailed information, which helps to generate high-quality MRI data. Compared with other popular GAN architectures, TR-GAN achieved the best performance in all evaluation metrics of two datasets. After expanding the Whole MRI dataset, the balanced accuracy of AD vs. cognitively normal (CN) vs. mild cognitive impairment (MCI) and stable MCI vs. progressive MCI classification can be increased by 3.61% and 4.00%, respectively.

Deep transfer learning-based fully automated detection and classification of Alzheimer's disease on brain MRI

OBJECTIVES

To employ different automated convolutional neural network (CNN)-based transfer learning (TL) methods for both binary and multiclass classification of Alzheimer's disease (AD) using brain MRI.

METHODS

Herein, we applied three popular pre-trained CNN models (ResNet101, Xception, and InceptionV3) using a fine-tuned approach of TL on 3D T1-weighted brain MRI from a subset of ADNI dataset (n = 305 subjects). To evaluate power of TL, the aforementioned networks were also trained from scratch for performance comparison. Initially, Unet network segmentedthe MRI scans into characteristic components of gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF). The proposed networks were trained and tested over the pre-processed and augmented segmented and whole images for both binary (NC/AD + progressive mild cognitive impairment (pMCI)+stable MCI (sMCI)) and 4-class (AD/pMCI/sMCI/NC) classification. Also, two independent test sets from the OASIS (n = 30) and AIBL (n = 60) datasets were used to externally assess the performance of the proposed algorithms.

RESULTS

The proposed TL-based CNN models achieved better performance compared to the training CNN models from scratch. On the ADNI test set, InceptionV3-TL achieved the highest accuracy of 93.75% and AUC of 92.0% for binary classification, as well as the highest accuracy of 93.75% and AUC of 96.0% for multiclass classification of AD on the whole images. On the OASIS test set, InceptionV3-TL outperformed two other models by achieving 93.33% accuracy with 93.0% AUC in binary classification of AD on the whole images. On the AIBL test set, InceptionV3-TL also outperformed two other models in both binary and multiclass classification tasks on the whole MR images and achieved accuracy/AUC of 93.33%/95.0% and 90.0%/93.0%, respectively. The GM segment as input provided the highest performance in both binary and multiclass classification of AD, as compared to the WM and CSF segments.

CONCLUSION

This study demonstrates the potential of applying deep TL approach for automated detection and classification of AD using brain MRI with high accuracy and robustness across internal and external test data, suggesting that these models can possibly be used as a supportive tool to assist clinicians in creating objective opinion and correct diagnosis.

ADVANCES IN KNOWLEDGE

We used CNN-based TL approaches and the augmentation techniques to overcome the insufficient data problem. Our study provides evidence that deep TL algorithms can be used for both binary and multiclass classification of AD with high accuracy.

Biomarkers for Alzheimer's Disease: Context of Use, Qualification, and Roadmap for Clinical Implementation

Background and Objectives: The US Food and Drug Administration (FDA) defines a biomarker as a characteristic that is measured as an indicator of normal biological processes, pathogenic processes, or responses to an exposure or intervention. Biomarkers may be used in clinical care or as drug development tools (DDTs) in clinical trials. The goal of this review and perspective is to provide insight into the regulatory guidance for the use of biomarkers in clinical trials and clinical care. Materials and Methods: We reviewed FDA guidances relevant to biomarker use in clinical trials and their transition to use in clinical care. We identified instructive examples of these biomarkers in Alzheimer's disease (AD) drug development and their application in clinical practice. Results: For use in clinical trials, biomarkers must have a defined context of use (COU) as a risk/susceptibility, diagnostic, monitoring, predictive, prognostic, pharmacodynamic, or safety biomarker. A four-stage process defines the pathway to establish the regulatory acceptance of the COU for a biomarker including submission of a letter of intent, description of the qualification plan, submission of a full qualification package, and acceptance through a qualification recommendation. Biomarkers used in clinical care may be companion biomarkers, in vitro diagnostic devices (IVDs), or laboratory developed tests (LDTs). A five-phase biomarker development process has been proposed to structure the biomarker development process. Conclusions: Biomarkers are increasingly important in drug development and clinical care. Adherence to regulatory guidance for biomarkers used in clinical trials and patient care is required to advance these important drug development and clinical tools.

Early-Stage Alzheimer's Disease Categorization Using PET Neuroimaging Modality and Convolutional Neural Networks in the 2D and 3D Domains

Alzheimer's Disease (AD) is a health apprehension of significant proportions that is negatively impacting the ageing population globally. It is characterized by neuronal loss and the formation of structures such as neurofibrillary tangles and amyloid plaques in the early as well as later stages of the disease. Neuroimaging modalities are routinely used in clinical practice to capture brain alterations associated with AD. On the other hand, deep learning methods are routinely used to recognize patterns in underlying data distributions effectively. This work uses Convolutional Neural Network (CNN) architectures in both 2D and 3D domains to classify the initial stages of AD into AD, Mild Cognitive Impairment (MCI) and Normal Control (NC) classes using the positron emission tomography neuroimaging modality deploying data augmentation in a random zoomed in/out scheme. We used novel concepts such as the blurring before subsampling principle and distant domain transfer learning to build 2D CNN architectures. We performed three binaries, that is, AD/NC, AD/MCI, MCI/NC and one multiclass classification task AD/NC/MCI. The statistical comparison revealed that 3D-CNN architecture performed the best achieving an accuracy of 89.21% on AD/NC, 71.70% on AD/MCI, 62.25% on NC/MCI and 59.73% on AD/NC/MCI classification tasks using a five-fold cross-validation hyperparameter selection approach. Data augmentation helps in achieving superior performance on the multiclass classification task. The obtained results support the application of deep learning models towards early recognition of AD.

An fMRI Sequence Representation Learning Framework for Attention Deficit Hyperactivity Disorder Classification

For attention deficit hyperactivity disorder (ADHD), a common neurological disease, accurate identification is the basis for treatment. In this paper, a novel end-to-end representation learning framework for ADHD classification of functional magnetic resonance imaging (fMRI) sequences is proposed. With such a framework, the complexity of the sequence representation learning neural network decreases, the overfitting problem of deep learning for small samples cases is solved effectively, and superior classification performance is achieved. Specifically, a data conversion module was designed to convert a two-dimensional sequence into a three-dimensional image, which expands the modeling area and greatly reduces the computational complexity. The transfer learning method was utilized to freeze or fine-tune the parameters of the pre-trained neural network to reduce the risk of overfitting in the cases with small samples. Hierarchical feature extraction can be performed automatically by combining the sequence representation learning modules with a weighted cross-entropy loss. Experiments were conducted both with individual imaging sites and combining them, and the results showed that the classification average accuracies with the proposed framework were 73.73% and 72.02%, respectively, which are much higher than those of the existing methods.

Probabilistic principal component analysis and long short-term memory classifier for automatic detection of Alzheimer’s disease using MRI brain images

The automatic recognition and classification of Alzheimer disease utilizing magnetic resonance imaging is a hard task, due to the complexity and variability of the size, location, texture and shape of the lesions. The objective of this study is to propose a proper feature dimensional reduction and classification approach to improve the performance of Alzheimer disease recognition and classification. At first, the input brain images were acquired from Open Access Series of Imaging Studies (OASIS) and National Institute of Mental Health and Neuro Sciences (NIMHANS) databases. Then, the image pre-processing and feature extraction were attained by applying Contrast Limited Adaptive Histogram Equalization (CLAHE) and Discrete Wavelet Transform (DWT) approach to denoise and extract the feature vectors from the images. In addition, Probabilistic Principal Component Analysis (PPCA) was used to diminish the extracted features dimension that effectively lessen the “curse of dimensionality” concern. At last, Long Short-Term Memory (LSTM) classifier was employed to classify the brain images as Alzheimer disease, normal, and Mild Cognitive Impairment (MCI). From the simulation outcome, the proposed system attained better performance compared to the existing systems and showed 3–11% improvement in recognition accuracy.

Using the Alzheimer's Disease Neuroimaging Initiative to improve early detection, diagnosis, and treatment of Alzheimer's disease

INTRODUCTION

The Alzheimer's Disease Neuroimaging Initiative (ADNI) has accumulated 15 years of clinical, neuroimaging, cognitive, biofluid biomarker and genetic data, and biofluid samples available to researchers, resulting in more than 3500 publications. This review covers studies from 2018 to 2020.

METHODS

We identified 1442 publications using ADNI data by conventional search methods and selected impactful studies for inclusion.

RESULTS

Disease progression studies supported pivotal roles for regional amyloid beta (Aβ) and tau deposition, and identified underlying genetic contributions to Alzheimer's disease (AD). Vascular disease, immune response, inflammation, resilience, and sex modulated disease course. Biologically coherent subgroups were identified at all clinical stages. Practical algorithms and methodological changes improved determination of Aβ status. Plasma Aβ, phosphorylated tau181, and neurofilament light were promising noninvasive biomarkers. Prognostic and diagnostic models were externally validated in ADNI but studies are limited by lack of ethnocultural cohort diversity.

DISCUSSION

ADNI has had a profound impact in improving clinical trials for AD.

Searching for optimal machine learning model to classify mild cognitive impairment (MCI) subtypes using multimodal MRI data

The intervention at the stage of mild cognitive impairment (MCI) is promising for preventing Alzheimer's disease (AD). This study aims to search for the optimal machine learning (ML) model to classify early and late MCI (EMCI and LMCI) subtypes using multimodal MRI data. First, the tract-based spatial statistics (TBSS) analyses showed LMCI-related white matter changes in the Corpus Callosum. The ROI-based tractography addressed the connected cortical areas by affected callosal fibers. We then prepared two feature subsets for ML by measuring resting-state functional connectivity (TBSS-RSFC method) and graph theory metrics (TBSS-Graph method) in these cortical areas, respectively. We also prepared feature subsets of diffusion parameters in the regions of LMCI-related white matter alterations detected by TBSS analyses. Using these feature subsets, we trained and tested multiple ML models for EMCI/LMCI classification with cross-validation. Our results showed the ensemble ML model (AdaBoost) with feature subset of diffusion parameters achieved better performance of mean accuracy 70%. The useful brain regions for classification were those, including frontal, parietal lobe, Corpus Callosum, cingulate regions, insula, and thalamus regions. Our findings indicated the optimal ML model using diffusion parameters might be effective to distinguish LMCI from EMCI subjects at the prodromal stage of AD.

Diagnosis of early mild cognitive impairment using a multiobjective optimization algorithm based on T1-MRI data

Alzheimer's disease (AD) is the most prevalent form of dementia. The accurate diagnosis of AD, especially in the early phases is very important for timely intervention. It has been suggested that brain atrophy, as measured with structural magnetic resonance imaging (sMRI), can be an efficacy marker of neurodegeneration. While classification methods have been successful in diagnosis of AD, the performance of such methods have been very poor in diagnosis of those in early stages of mild cognitive impairment (EMCI). Therefore, in this study we investigated whether optimisation based on evolutionary algorithms (EA) can be an effective tool in diagnosis of EMCI as compared to cognitively normal participants (CNs). Structural MRI data for patients with EMCI (n = 54) and CN participants (n = 56) was extracted from Alzheimer's disease Neuroimaging Initiative (ADNI). Using three automatic brain segmentation methods, we extracted volumetric parameters as input to the optimisation algorithms. Our method achieved classification accuracy of greater than 93%. This accuracy level is higher than the previously suggested methods of classification of CN and EMCI using a single- or multiple modalities of imaging data. Our results show that with an effective optimisation method, a single modality of biomarkers can be enough to achieve a high classification accuracy.

Individual prediction of hemispheric similarity of functional connectivity during normal aging

In the aging process of normal people, the functional activity pattern of brain is in constant change, and the change of brain runs through the whole life cycle, which plays a crucial role in the track of individual development. In recent years, some studies had been carried out on the brain functional activity pattern during individual aging process from different perspectives, which provided an opportunity for the problem we want to study. In this study, we used the resting-state functional magnetic resonance imaging (rs-fMRI) data from Cambridge Center for Aging and Neuroscience (Cam-CAN) database with large sample and long lifespan, and computed the functional connectivity (FC) values for each individual. Based on these values, the hemispheric similarity of functional connectivity (HSFC) obtained by Pearson correlation was used as the starting point of this study. We evaluated the ability of individual recognition of HSFC in the process of aging, as well as the variation trend with aging process. The results showed that HSFC could be used to identify individuals effectively, and it could reflect the change rule in the process of aging. In addition, we observed a series of results at the sub-module level and find that the recognition rate in the sub-module was different from each other, as well as the trend with age. Finally, as a validation, we repeated the main results by human brainnetome atlas (BNA) template and without global signal regression, found that had a good robustness. This also provides a new clue to hemispherical change patterns during normal aging.

Multi-scale semi-supervised clustering of brain images: Deriving disease subtypes

Disease heterogeneity is a significant obstacle to understanding pathological processes and delivering precision diagnostics and treatment. Clustering methods have gained popularity for stratifying patients into subpopulations (i.e., subtypes) of brain diseases using imaging data. However, unsupervised clustering approaches are often confounded by anatomical and functional variations not related to a disease or pathology of interest. Semi-supervised clustering techniques have been proposed to overcome this and, therefore, capture disease-specific patterns more effectively. An additional limitation of both unsupervised and semi-supervised conventional machine learning methods is that they typically model, learn and infer from data using a basis of feature sets pre-defined at a fixed anatomical or functional scale (e.g., atlas-based regions of interest). Herein we propose a novel method, "Multi-scAle heteroGeneity analysIs and Clustering" (MAGIC), to depict the multi-scale presentation of disease heterogeneity, which builds on a previously proposed semi-supervised clustering method, HYDRA. It derives multi-scale and clinically interpretable feature representations and exploits a double-cyclic optimization procedure to effectively drive identification of inter-scale-consistent disease subtypes. More importantly, to understand the conditions under which the clustering model can estimate true heterogeneity related to diseases, we conducted extensive and systematic semi-simulated experiments to evaluate the proposed method on a sizeable healthy control sample from the UK Biobank (N = 4403). We then applied MAGIC to imaging data from Alzheimer's disease (ADNI, N = 1728) and schizophrenia (PHENOM, N = 1166) patients to demonstrate its potential and challenges in dissecting the neuroanatomical heterogeneity of common brain diseases. Taken together, we aim to provide guidance regarding when such analyses can succeed or should be taken with caution. The code of the proposed method is publicly available at https://github.com/anbai106/MAGIC.

Early Diagnosis of Alzheimer’s Disease Using Cerebral Catheter Angiogram Neuroimaging: A Novel Model Based on Deep Learning Approaches

Neuroimaging refers to the techniques that provide efficient information about the neural structure of the human brain, which is utilized for diagnosis, treatment, and scientific research. The problem of classifying neuroimages is one of the most important steps that are needed by medical staff to diagnose their patients early by investigating the indicators of different neuroimaging types. Early diagnosis of Alzheimer’s disease is of great importance in preventing the deterioration of the patient’s situation. In this research, a novel approach was devised based on a digital subtracted angiogram scan that provides sufficient features of a new biomarker cerebral blood flow. The used dataset was acquired from the database of K.A.U.H hospital and contains digital subtracted angiograms of participants who were diagnosed with Alzheimer’s disease, besides samples of normal controls. Since each scan included multiple frames for the left and right ICA’s, pre-processing steps were applied to make the dataset prepared for the next stages of feature extraction and classification. The multiple frames of scans transformed from real space into DCT space and averaged to remove noises. Then, the averaged image was transformed back to the real space, and both sides filtered with Meijering and concatenated in a single image. The proposed model extracts the features using different pre-trained models: InceptionV3 and DenseNet201. Then, the PCA method was utilized to select the features with 0.99 explained variance ratio, where the combination of selected features from both pre-trained models is fed into machine learning classifiers. Overall, the obtained experimental results are at least as good as other state-of-the-art approaches in the literature and more efficient according to the recent medical standards with a 99.14% level of accuracy, considering the difference in dataset samples and the used cerebral blood flow biomarker.

Classification of Initial Stages of Alzheimer’s Disease through Pet Neuroimaging Modality and Deep Learning: Quantifying the Impact of Image Filtering Approaches

Alzheimer’s disease (AD) is a leading health concern affecting the elderly population worldwide. It is defined by amyloid plaques, neurofibrillary tangles, and neuronal loss. Neuroimaging modalities such as positron emission tomography (PET) and magnetic resonance imaging are routinely used in clinical settings to monitor the alterations in the brain during the course of progression of AD. Deep learning techniques such as convolutional neural networks (CNNs) have found numerous applications in healthcare and other technologies. Together with neuroimaging modalities, they can be deployed in clinical settings to learn effective representations of data for different tasks such as classification, segmentation, detection, etc. Image filtering methods are instrumental in making images viable for image processing operations and have found numerous applications in image-processing-related tasks. In this work, we deployed 3D-CNNs to learn effective representations of PET modality data to quantify the impact of different image filtering approaches. We used box filtering, median filtering, Gaussian filtering, and modified Gaussian filtering approaches to preprocess the images and use them for classification using 3D-CNN architecture. Our findings suggest that these approaches are nearly equivalent and have no distinct advantage over one another. For the multiclass classification task between normal control (NC), mild cognitive impairment (MCI), and AD classes, the 3D-CNN architecture trained using Gaussian-filtered data performed the best. For binary classification between NC and MCI classes, the 3D-CNN architecture trained using median-filtered data performed the best, while, for binary classification between AD and MCI classes, the 3D-CNN architecture trained using modified Gaussian-filtered data performed the best. Finally, for binary classification between AD and NC classes, the 3D-CNN architecture trained using box-filtered data performed the best.

Federated Learning via Conditional Mutual Learning for Alzheimer's Disease Classification on T1w MRI

Data-driven deep learning has been considered a promising method for building powerful models for medical data, which often requires a large amount of diverse data to be sufficiently effective. However, the expensive cost of collecting and the privacy constraints lead to the fact that existing medical datasets are small-scale and distributed. Federated learning via model distillation is a data-private collaborative learning where the model can leverage all available data without direct sharing. The data knowledge is shared by distillation through the multi-site average prediction scores on the public dataset. However, the average consensus is suboptimal to individual client due to data domain shift in MRI data caused by acquisition protocols, recruitment criteria, etc. In this work, we propose a federated conditional mutual learning (FedCM) to improve the performance by considering the clients' local performance and the similarity between clients. This work is the first federated learning on multi-dataset Alzheimer's disease classification by 3DCNN using T1w MRI. Our method achieves the best recognition rates comparing with FedMD and other frameworks. Further visualization and relevance ranking on the region of interests (ROI) in human brains implies that the left hemisphere may have greater relevance than the right hemisphere does. Several potential regions are listed for future investigation.

Transfer Learning for Alzheimer's Disease through Neuroimaging Biomarkers: A Systematic Review

Alzheimer's disease (AD) is a remarkable challenge for healthcare in the 21st century. Since 2017, deep learning models with transfer learning approaches have been gaining recognition in AD detection, and progression prediction by using neuroimaging biomarkers. This paper presents a systematic review of the current state of early AD detection by using deep learning models with transfer learning and neuroimaging biomarkers. Five databases were used and the results before screening report 215 studies published between 2010 and 2020. After screening, 13 studies met the inclusion criteria. We noted that the maximum accuracy achieved to date for AD classification is 98.20% by using the combination of 3D convolutional networks and local transfer learning, and that for the prognostic prediction of AD is 87.78% by using pre-trained 3D convolutional network-based architectures. The results show that transfer learning helps researchers in developing a more accurate system for the early diagnosis of AD. However, there is a need to consider some points in future research, such as improving the accuracy of the prognostic prediction of AD, exploring additional biomarkers such as tau-PET and amyloid-PET to understand highly discriminative feature representation to separate similar brain patterns, managing the size of the datasets due to the limited availability.

Data analysis with Shapley values for automatic subject selection in Alzheimer's disease data sets using interpretable machine learning

BACKGROUND

For the recruitment and monitoring of subjects for therapy studies, it is important to predict whether mild cognitive impaired (MCI) subjects will prospectively develop Alzheimer's disease (AD). Machine learning (ML) is suitable to improve early AD prediction. The etiology of AD is heterogeneous, which leads to high variability in disease patterns. Further variability originates from multicentric study designs, varying acquisition protocols, and errors in the preprocessing of magnetic resonance imaging (MRI) scans. The high variability makes the differentiation between signal and noise difficult and may lead to overfitting. This article examines whether an automatic and fair data valuation method based on Shapley values can identify the most informative subjects to improve ML classification.

METHODS

An ML workflow was developed and trained for a subset of the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort. The validation was executed for an independent ADNI test set and for the Australian Imaging, Biomarker and Lifestyle Flagship Study of Ageing (AIBL) cohort. The workflow included volumetric MRI feature extraction, feature selection, sample selection using Data Shapley, random forest (RF), and eXtreme Gradient Boosting (XGBoost) for model training as well as Kernel SHapley Additive exPlanations (SHAP) values for model interpretation.

RESULTS

The RF models, which excluded 134 of the 467 training subjects based on their RF Data Shapley values, outperformed the base models that reached a mean accuracy of 62.64% by 5.76% (3.61 percentage points) for the independent ADNI test set. The XGBoost base models reached a mean accuracy of 60.00% for the AIBL data set. The exclusion of those 133 subjects with the smallest RF Data Shapley values could improve the classification accuracy by 2.98% (1.79 percentage points). The cutoff values were calculated using an independent validation set.

CONCLUSION

The Data Shapley method was able to improve the mean accuracies for the test sets. The most informative subjects were associated with the number of ApolipoproteinE ε4 (ApoE ε4) alleles, cognitive test results, and volumetric MRI measurements.

Automatic quality control of brain T1-weighted magnetic resonance images for a clinical data warehouse

Many studies on machine learning (ML) for computer-aided diagnosis have so far been mostly restricted to high-quality research data. Clinical data warehouses, gathering routine examinations from hospitals, offer great promises for training and validation of ML models in a realistic setting. However, the use of such clinical data warehouses requires quality control (QC) tools. Visual QC by experts is time-consuming and does not scale to large datasets. In this paper, we propose a convolutional neural network (CNN) for the automatic QC of 3D T1-weighted brain MRI for a large heterogeneous clinical data warehouse. To that purpose, we used the data warehouse of the hospitals of the Greater Paris area (Assistance Publique-Hôpitaux de Paris [AP-HP]). Specifically, the objectives were: 1) to identify images which are not proper T1-weighted brain MRIs; 2) to identify acquisitions for which gadolinium was injected; 3) to rate the overall image quality. We used 5000 images for training and validation and a separate set of 500 images for testing. In order to train/validate the CNN, the data were annotated by two trained raters according to a visual QC protocol that we specifically designed for application in the setting of a data warehouse. For objectives 1 and 2, our approach achieved excellent accuracy (balanced accuracy and F1-score >90%), similar to the human raters. For objective 3, the performance was good but substantially lower than that of human raters. Nevertheless, the automatic approach accurately identified (balanced accuracy and F1-score >80%) low quality images, which would typically need to be excluded. Overall, our approach shall be useful for exploiting hospital data warehouses in medical image computing.

Clinica: An Open-Source Software Platform for Reproducible Clinical Neuroscience Studies

We present Clinica (www.clinica.run), an open-source software platform designed to make clinical neuroscience studies easier and more reproducible. Clinica aims for researchers to (i) spend less time on data management and processing, (ii) perform reproducible evaluations of their methods, and (iii) easily share data and results within their institution and with external collaborators. The core of Clinica is a set of automatic pipelines for processing and analysis of multimodal neuroimaging data (currently, T1-weighted MRI, diffusion MRI, and PET data), as well as tools for statistics, machine learning, and deep learning. It relies on the brain imaging data structure (BIDS) for the organization of raw neuroimaging datasets and on established tools written by the community to build its pipelines. It also provides converters of public neuroimaging datasets to BIDS (currently ADNI, AIBL, OASIS, and NIFD). Processed data include image-valued scalar fields (e.g., tissue probability maps), meshes, surface-based scalar fields (e.g., cortical thickness maps), or scalar outputs (e.g., regional averages). These data follow the ClinicA Processed Structure (CAPS) format which shares the same philosophy as BIDS. Consistent organization of raw and processed neuroimaging files facilitates the execution of single pipelines and of sequences of pipelines, as well as the integration of processed data into statistics or machine learning frameworks. The target audience of Clinica is neuroscientists or clinicians conducting clinical neuroscience studies involving multimodal imaging, and researchers developing advanced machine learning algorithms applied to neuroimaging data.

AD Course Map charts Alzheimer's disease progression

Alzheimer's disease (AD) is characterized by the progressive alterations seen in brain images which give rise to the onset of various sets of symptoms. The variability in the dynamics of changes in both brain images and cognitive impairments remains poorly understood. This paper introduces AD Course Map a spatiotemporal atlas of Alzheimer's disease progression. It summarizes the variability in the progression of a series of neuropsychological assessments, the propagation of hypometabolism and cortical thinning across brain regions and the deformation of the shape of the hippocampus. The analysis of these variations highlights strong genetic determinants for the progression, like possible compensatory mechanisms at play during disease progression. AD Course Map also predicts the patient's cognitive decline with a better accuracy than the 56 methods benchmarked in the open challenge TADPOLE. Finally, AD Course Map is used to simulate cohorts of virtual patients developing Alzheimer's disease. AD Course Map offers therefore new tools for exploring the progression of AD and personalizing patients care.

Reproducible Evaluation of Diffusion MRI Features for Automatic Classification of Patients with Alzheimer's Disease

Diffusion MRI is the modality of choice to study alterations of white matter. In past years, various works have used diffusion MRI for automatic classification of Alzheimer's disease. However, classification performance obtained with different approaches is difficult to compare because of variations in components such as input data, participant selection, image preprocessing, feature extraction, feature rescaling (FR), feature selection (FS) and cross-validation (CV) procedures. Moreover, these studies are also difficult to reproduce because these different components are not readily available. In a previous work (Samper-González et al. 2018), we propose an open-source framework for the reproducible evaluation of AD classification from T1-weighted (T1w) MRI and PET data. In the present paper, we first extend this framework to diffusion MRI data. Specifically, we add: conversion of diffusion MRI ADNI data into the BIDS standard and pipelines for diffusion MRI preprocessing and feature extraction. We then apply the framework to compare different components. First, FS has a positive impact on classification results: highest balanced accuracy (BA) improved from 0.76 to 0.82 for task CN vs AD. Secondly, voxel-wise features generally gives better performance than regional features. Fractional anisotropy (FA) and mean diffusivity (MD) provided comparable results for voxel-wise features. Moreover, we observe that the poor performance obtained in tasks involving MCI were potentially caused by the small data samples, rather than by the data imbalance. Furthermore, no extensive classification difference exists for different degree of smoothing and registration methods. Besides, we demonstrate that using non-nested validation of FS leads to unreliable and over-optimistic results: 5% up to 40% relative increase in BA. Lastly, with proper FR and FS, the performance of diffusion MRI features is comparable to that of T1w MRI. All the code of the framework and the experiments are publicly available: general-purpose tools have been integrated into the Clinica software package ( www.clinica.run ) and the paper-specific code is available at: https://github.com/aramis-lab/AD-ML .

Anomaly Analysis of Alzheimer’s Disease in PET Images Using an Unsupervised Adversarial Deep Learning Model

In this study, the anomaly analysis of Alzheimer’s disease using positron emission tomography (PET) images using an unsupervised proposed adversarial model is investigated. The model consists of three parts: a parallel-network encoder, which is comprised of a convolutional pipeline and a dilated convolutional pipeline that extracts global and local features and concatenates them, a decoder that reconstructs the input image from the obtained feature vector, and a discriminator that distinguishes if the input image image is real or fake. The hypothesis is that if the proposed model is trained with only normal brain images, the corresponding construction loss for normal images should be minimal. However, if the input image belongs to a class that is designated as an anomaly that which the model is not trained with, then the construction loss will be high. This will reflect during the anomaly score comparison between the normal and the anomalous image. A multi-case analysis is performed for three major classes using the Alzheimer’s Disease Neuroimaging Initiative dataset, Alzheimer’s disease, mild cognitive impairment, and normal control. The base parallel-encoder network shows better classification accuracy than the benchmark models, and the proposed model that is built on the parallel model outperforms the benchmark anomaly detection models. The proposed model gave out 96.03% and 75.21% in classification and area under the curve score, respectively. Additionally, a qualitative evaluation done by using Fréchet inception distance gave a better score than the state-of-the-art by three points.