Generalizable, Reproducible, and Neuroscientifically Interpretable Imaging Biomarkers for Alzheimer's Disease

Macroscale Gradient Dysfunction in Alzheimer's Disease: Patterns With Cognition Terms and Gene Expression Profiles

Macroscale functional gradient techniques provide a continuous coordinate system that extends from unimodal regions to transmodal higher-order networks. However, the alterations of these functional gradients in AD and their correlations with cognitive terms and gene expression profiles remain to be established. In the present study, we directly studied the functional gradients with functional MRI data from seven scanners. We adopted data-driven meta-analytic techniques to unveil AD-associated changes in the functional gradients. The principal primary-to-transmodal gradient was suppressed in AD. Compared to NCs, AD patients exhibited global connectome gradient alterations, including reduced gradient range and gradient variation, increased gradient scores in the somatomotor, ventral attention, and frontoparietal regions, and decreased in the default mode network. More importantly, the Gene Ontology terms of biological processes were significantly enriched in the potassium ion transport and protein-containing complex remodeling. Our compelling evidence provides a new perspective in understanding the connectome alterations in AD.

s2MRI-ADNet: an interpretable deep learning framework integrating Euclidean-graph representations of Alzheimer's disease solely from structural MRI

OBJECTIVE

To establish a multi-dimensional representation solely on structural MRI (sMRI) for early diagnosis of AD.

METHODS

A total of 3377 participants' sMRI from four independent databases were retrospectively identified to construct an interpretable deep learning model that integrated multi-dimensional representations of AD solely on sMRI (called s2MRI-ADNet) by a dual-channel learning strategy of gray matter volume (GMV) from Euclidean space and the regional radiomics similarity network (R2SN) from graph space. Specifically, the GMV feature map learning channel (called GMV-Channel) was to take into consideration spatial information of both long-range spatial relations and detailed localization information, while the node feature and connectivity strength learning channel (called NFCS-Channel) was to characterize the graph-structured R2SN network by a separable learning strategy.

RESULTS

The s2MRI-ADNet achieved a superior classification accuracy of 92.1% and 91.4% under intra-database and inter-database cross-validation. The GMV-Channel and NFCS-Channel captured complementary group-discriminative brain regions, revealing a complementary interpretation of the multi-dimensional representation of brain structure in Euclidean and graph spaces respectively. Besides, the generalizable and reproducible interpretation of the multi-dimensional representation in capturing complementary group-discriminative brain regions revealed a significant correlation between the four independent databases (p < 0.05). Significant associations (p < 0.05) between attention scores and brain abnormality, between classification scores and clinical measure of cognitive ability, CSF biomarker, metabolism, and genetic risk score also provided solid neurobiological interpretation.

CONCLUSION

The s2MRI-ADNet solely on sMRI could leverage the complementary multi-dimensional representations of AD in Euclidean and graph spaces, and achieved superior performance in the early diagnosis of AD, facilitating its potential in both clinical translation and popularization.

Frequency-specific dual-attention based adversarial network for blood oxygen level-dependent time series prediction

Functional magnetic resonance imaging (fMRI) is currently one of the most popular technologies for measuring brain activity in both research and clinical contexts. However, clinical constraints often result in short fMRI scan durations, limiting the diagnostic performance for brain disorders. To address this limitation, we developed an end-to-end frequency-specific dual-attention-based adversarial network (FDAA-Net) to extend the time series of existing blood oxygen level-dependent (BOLD) data, enhancing their diagnostic utility. Our approach leverages the frequency-dependent nature of fMRI signals using variational mode decomposition (VMD), which adaptively tracks brain activity across different frequency bands. We integrated the generative adversarial network (GAN) with a spatial-temporal attention mechanism to fully capture relationships among spatially distributed brain regions and temporally continuous time windows. We also introduced a novel loss function to estimate the upward and downward trends of each frequency component. We validated FDAA-Net on the Human Connectome Project (HCP) database by comparing the original and predicted time series of brain regions in the default mode network (DMN), a key network activated during rest. FDAA-Net effectively overcame linear frequency-specific challenges and outperformed other popular prediction models. Test-retest reliability experiments demonstrated high consistency between the functional connectivity of predicted outcomes and targets. Furthermore, we examined the clinical applicability of FDAA-Net using short-term fMRI data from individuals with autism spectrum disorder (ASD) and major depressive disorder (MDD). The model achieved a maximum predicted sequence length of 40% of the original scan durations. The prolonged time series improved diagnostic performance by 8.0% for ASD and 11.3% for MDD compared with the original sequences. These findings highlight the potential of fMRI time series prediction to enhance diagnostic power of brain disorders in short fMRI scans.

Federated learning via multi-attention guided UNet for thyroid nodule segmentation of ultrasound images

Accurate segmentation of thyroid nodules is essential for early screening and diagnosis, but it can be challenging due to the nodules' varying sizes and positions. To address this issue, we propose a multi-attention guided UNet (MAUNet) for thyroid nodule segmentation. We use a multi-scale cross attention (MSCA) module for initial image feature extraction. By integrating interactions between features at different scales, the impact of thyroid nodule shape and size on the segmentation results has been reduced. Additionally, we incorporate a dual attention (DA) module into the skip-connection step of the UNet network, which promotes information exchange and fusion between the encoder and decoder. To test the model's robustness and effectiveness, we conduct the extensive experiments on multi-center ultrasound images provided by 17 local hospitals. The model is trained using the federal learning mechanism to ensure privacy protection. The experimental results show that the Dice scores of the model on the data sets from the three centers are 0.908, 0.912 and 0.887, respectively. Compared to existing methods, our method demonstrates higher generalization ability on multi-center datasets and achieves better segmentation results.

3D Multimodal Fusion Network With Disease-Induced Joint Learning for Early Alzheimer's Disease Diagnosis

Multimodal neuroimaging provides complementary information critical for accurate early diagnosis of Alzheimer's disease (AD). However, the inherent variability between multimodal neuroimages hinders the effective fusion of multimodal features. Moreover, achieving reliable and interpretable diagnoses in the field of multimodal fusion remains challenging. To address them, we propose a novel multimodal diagnosis network based on multi-fusion and disease-induced learning (MDL-Net) to enhance early AD diagnosis by efficiently fusing multimodal data. Specifically, MDL-Net proposes a multi-fusion joint learning (MJL) module, which effectively fuses multimodal features and enhances the feature representation from global, local, and latent learning perspectives. MJL consists of three modules, global-aware learning (GAL), local-aware learning (LAL), and outer latent-space learning (LSL) modules. GAL via a self-adaptive Transformer (SAT) learns the global relationships among the modalities. LAL constructs local-aware convolution to learn the local associations. LSL module introduces latent information through outer product operation to further enhance feature representation. MDL-Net integrates the disease-induced region-aware learning (DRL) module via gradient weight to enhance interpretability, which iteratively learns weight matrices to identify AD-related brain regions. We conduct the extensive experiments on public datasets and the results confirm the superiority of our proposed method. Our code will be available at: https://github.com/qzf0320/MDL-Net.

Never-Ending Learning for Explainable Brain Computing

Exploring the nature of human intelligence and behavior is a longstanding pursuit in cognitive neuroscience, driven by the accumulation of knowledge, information, and data across various studies. However, achieving a unified and transparent interpretation of findings presents formidable challenges. In response, an explainable brain computing framework is proposed that employs the never-ending learning paradigm, integrating evidence combination and fusion computing within a Knowledge-Information-Data (KID) architecture. The framework supports continuous brain cognition investigation, utilizing joint knowledge-driven forward inference and data-driven reverse inference, bolstered by the pre-trained language modeling techniques and the human-in-the-loop mechanisms. In particular, it incorporates internal evidence learning through multi-task functional neuroimaging analyses and external evidence learning via topic modeling of published neuroimaging studies, all of which involve human interactions at different stages. Based on two case studies, the intricate uncertainty surrounding brain localization in human reasoning is revealed. The present study also highlights the potential of systematization to advance explainable brain computing, offering a finer-grained understanding of brain activity patterns related to human intelligence.

Machine learning with multimodal neuroimaging data to classify stages of Alzheimer's disease: a systematic review and meta-analysis

In recent years, Alzheimer's disease (AD) has been a serious threat to human health. Researchers and clinicians alike encounter a significant obstacle when trying to accurately identify and classify AD stages. Several studies have shown that multimodal neuroimaging input can assist in providing valuable insights into the structural and functional changes in the brain related to AD. Machine learning (ML) algorithms can accurately categorize AD phases by identifying patterns and linkages in multimodal neuroimaging data using powerful computational methods. This study aims to assess the contribution of ML methods to the accurate classification of the stages of AD using multimodal neuroimaging data. A systematic search is carried out in IEEE Xplore, Science Direct/Elsevier, ACM DigitalLibrary, and PubMed databases with forward snowballing performed on Google Scholar. The quantitative analysis used 47 studies. The explainable analysis was performed on the classification algorithm and fusion methods used in the selected studies. The pooled sensitivity and specificity, including diagnostic efficiency, were evaluated by conducting a meta-analysis based on a bivariate model with the hierarchical summary receiver operating characteristics (ROC) curve of multimodal neuroimaging data and ML methods in the classification of AD stages. Wilcoxon signed-rank test is further used to statistically compare the accuracy scores of the existing models. With a 95% confidence interval of 78.87-87.71%, the combined sensitivity for separating participants with mild cognitive impairment (MCI) from healthy control (NC) participants was 83.77%; for separating participants with AD from NC, it was 94.60% (90.76%, 96.89%); for separating participants with progressive MCI (pMCI) from stable MCI (sMCI), it was 80.41% (74.73%, 85.06%). With a 95% confidence interval (78.87%, 87.71%), the Pooled sensitivity for distinguishing mild cognitive impairment (MCI) from healthy control (NC) participants was 83.77%, with a 95% confidence interval (90.76%, 96.89%), the Pooled sensitivity for distinguishing AD from NC was 94.60%, likewise (MCI) from healthy control (NC) participants was 83.77% progressive MCI (pMCI) from stable MCI (sMCI) was 80.41% (74.73%, 85.06%), and early MCI (EMCI) from NC was 86.63% (82.43%, 89.95%). Pooled specificity for differentiating MCI from NC was 79.16% (70.97%, 87.71%), AD from NC was 93.49% (91.60%, 94.90%), pMCI from sMCI was 81.44% (76.32%, 85.66%), and EMCI from NC was 85.68% (81.62%, 88.96%). The Wilcoxon signed rank test showed a low P-value across all the classification tasks. Multimodal neuroimaging data with ML is a promising future in classifying the stages of AD but more research is required to increase the validity of its application in clinical practice.

A comprehensive segmentation of chest X-ray improves deep learning-based WHO radiologically confirmed pneumonia diagnosis in children

OBJECTIVES

To investigate a comprehensive segmentation of chest X-ray (CXR) in promoting deep learning-based World Health Organization's (WHO) radiologically confirmed pneumonia diagnosis in children.

METHODS

A total of 4400 participants between January 2016 and June 2021were identified for a cross-sectional study and divided into primary endpoint pneumonia (PEP), other infiltrates, and normal groups according to WHO's diagnostic criteria. The CXR was divided into six segments of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung by adopting the RA-UNet. To demonstrate the benefits of lung field segmentation in pneumonia diagnosis, the segmented images and images that were not segmented, which constituted seven segmentation combinations, were fed into the CBAM-ResNet under a three-category classification comparison. The interpretability of the CBAM-ResNet for pneumonia diagnosis was also performed by adopting a Grad-CAM module.

RESULTS

The RA-UNet achieved a high spatial overlap between manual and automatic segmentation (averaged DSC = 0.9639). The CBAM-ResNet when fed with the six segments achieved superior three-category diagnosis performance (accuracy = 0.8243) over other segmentation combinations and deep learning models under comparison, which was increased by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. The Grad-CAM could capture the pneumonia lesions more accurately, generating a more interpretable visualization and enhancing the superiority and reliability of our study in assisting pediatric pneumonia diagnosis.

CONCLUSIONS

The comprehensive segmentation of CXR could improve deep learning-based pneumonia diagnosis in childhood with a more reasonable WHO's radiological standardized pneumonia classification instead of conventional dichotomous bacterial pneumonia and viral pneumonia.

CLINICAL RELEVANCE STATEMENT

The comprehensive segmentation of chest X-ray improves deep learning-based WHO confirmed pneumonia diagnosis in children, laying a strong foundation for the potential inclusion of computer-aided pediatric CXR readings in precise classification of pneumonia and PCV vaccine trials efficacy in children.

KEY POINTS

• The chest X-ray was comprehensively segmented into six anatomical structures of left lung, right lung, mediastinum, diaphragm, ext-left lung, and ext-right lung. • The comprehensive segmentation improved the three-category classification of primary endpoint pneumonia, other infiltrates, and normal with an increase by around 6% in accuracy, precision, specificity, sensitivity, F1-score, and around 3% in AUC. • The comprehensive segmentation gave rise to a more accurate and interpretable visualization results in capturing the pneumonia lesions.

A novel spatiotemporal graph convolutional network framework for functional connectivity biomarkers identification of Alzheimer's disease

BACKGROUND

Functional connectivity (FC) biomarkers play a crucial role in the early diagnosis and mechanistic study of Alzheimer's disease (AD). However, the identification of effective FC biomarkers remains challenging. In this study, we introduce a novel approach, the spatiotemporal graph convolutional network (ST-GCN) combined with the gradient-based class activation mapping (Grad-CAM) model (STGC-GCAM), to effectively identify FC biomarkers for AD.

METHODS

This multi-center cross-racial retrospective study involved 2,272 participants, including 1,105 cognitively normal (CN) subjects, 790 mild cognitive impairment (MCI) individuals, and 377 AD patients. All participants underwent functional magnetic resonance imaging (fMRI) and T1-weighted MRI scans. In this study, firstly, we optimized the STGC-GCAM model to enhance classification accuracy. Secondly, we identified novel AD-associated biomarkers using the optimized model. Thirdly, we validated the imaging biomarkers using Kaplan-Meier analysis. Lastly, we performed correlation analysis and causal mediation analysis to confirm the physiological significance of the identified biomarkers.

RESULTS

The STGC-GCAM model demonstrated great classification performance (The average area under the curve (AUC) values for different categories were: CN vs MCI = 0.98, CN vs AD = 0.95, MCI vs AD = 0.96, stable MCI vs progressive MCI = 0.79). Notably, the model identified specific brain regions, including the sensorimotor network (SMN), visual network (VN), and default mode network (DMN), as key differentiators between patients and CN individuals. These brain regions exhibited significant associations with the severity of cognitive impairment (p < 0.05). Moreover, the topological features of important brain regions demonstrated excellent predictive capability for the conversion from MCI to AD (Hazard ratio = 3.885, p < 0.001). Additionally, our findings revealed that the topological features of these brain regions mediated the impact of amyloid beta (Aβ) deposition (bootstrapped average causal mediation effect: β = -0.01 [-0.025, 0.00], p < 0.001) and brain glucose metabolism (bootstrapped average causal mediation effect: β = -0.02 [-0.04, -0.001], p < 0.001) on cognitive status.

CONCLUSIONS

This study presents the STGC-GCAM framework, which identifies FC biomarkers using a large multi-site fMRI dataset.

A Deep Learning-Based Ensemble Method for Early Diagnosis of Alzheimer's Disease using MRI Images

Recently, the early diagnosis of Alzheimer's disease has gained major attention due to the growing prevalence of the disease and the resulting costs imposed on individuals and society. The main objective of this study was to propose an ensemble method based on deep learning for the early diagnosis of AD using MRI images. The methodology of this study consisted of collecting the dataset, preprocessing, creating the individual and ensemble models, evaluating the models based on ADNI data, and validating the trained model based on the local dataset. The proposed method was an ensemble approach selected through a comparative analysis of various ensemble scenarios. Finally, the six best individual CNN-based classifiers were selected to combine and constitute the ensemble model. The evaluation showed an accuracy rate of 98.57, 96.37, 94.22, 99.83, 93.88, and 93.92 for NC/AD, NC/EMCI, EMCI/LMCI, LMCI/AD, four-way and three-way classification groups, respectively. The validation results on the local dataset revealed an accuracy of 88.46 for three-way classification. Our performance results were higher than most reviewed studies and comparable with others. Although comparative analysis showed superior results of ensemble methods against individual architectures, there were no significant differences among various ensemble approaches. The validation results revealed the low performance of individual models in practice. In contrast, the ensemble method showed promising results. However, further studies on various and larger datasets are required to validate the generalizability of the model.

Diagnosis of Alzheimer's disease by joining dual attention CNN and MLP based on structural MRIs, clinical and genetic data

Alzheimer's disease (AD) is an irreversible central nervous degenerative disease, while mild cognitive impairment (MCI) is a precursor state of AD. Accurate early diagnosis of AD is conducive to the prevention and early intervention treatment of AD. Although some computational methods have been developed for AD diagnosis, most employ only neuroimaging, ignoring other data (e.g., genetic, clinical) that may have potential disease information. In addition, the results of some methods lack interpretability. In this work, we proposed a novel method (called DANMLP) of joining dual attention convolutional neural network (CNN) and multilayer perceptron (MLP) for computer-aided AD diagnosis by integrating multi-modality data of the structural magnetic resonance imaging (sMRI), clinical data (i.e., demographics, neuropsychology), and APOE genetic data. Our DANMLP consists of four primary components: (1) the Patch-CNN for extracting the image characteristics from each local patch, (2) the position self-attention block for capturing the dependencies between features within a patch, (3) the channel self-attention block for capturing dependencies of inter-patch features, (4) two MLP networks for extracting the clinical features and outputting the AD classification results, respectively. Compared with other state-of-the-art methods in the 5CV test, DANMLP achieves 93% and 82.4% classification accuracy for the AD vs. MCI and MCI vs. NC tasks on the ADNI database, which is 0.2%∼15.2% and 3.4%∼26.8% higher than that of other five methods, respectively. The individualized visualization of focal areas can also help clinicians in the early diagnosis of AD. These results indicate that DANMLP can be effectively used for diagnosing AD and MCI patients.

A neuroimaging biomarker for Individual Brain-Related Abnormalities In Neurodegeneration (IBRAIN): a cross-sectional study

Background

Alzheimer's disease (AD) is a prevalent neurodegenerative disorder that poses a worldwide public health challenge. A neuroimaging biomarker would significantly improve early diagnosis and intervention, ultimately enhancing the quality of life for affected individuals and reducing the burden on healthcare systems.

Methods

Cross-sectional and longitudinal data (10,099 participants with 13,380 scans) from 12 independent datasets were used in the present study (this study was performed between September 1, 2021 and February 15, 2023). The Individual Brain-Related Abnormalities In Neurodegeneration (IBRAIN) score was developed via integrated regional- and network-based measures under an ensemble machine learning model based on structural MRI data. We systematically assessed whether IBRAIN could be a neuroimaging biomarker for AD.

Findings

IBRAIN accurately differentiated individuals with AD from NCs (AUC = 0.92) and other neurodegenerative diseases, including Frontotemporal dementia (FTD), Parkinson's disease (PD), Vascular dementia (VaD) and Amyotrophic Lateral Sclerosis (ALS) (AUC = 0.92). IBRAIN was significantly correlated to clinical measures and gene expression, enriched in immune process and protein metabolism. The IBRAIN score exhibited a significant ability to reveal the distinct progression of prodromal AD (i.e., Mild cognitive impairment, MCI) (Hazard Ratio (HR) = 6.52 [95% CI: 4.42∼9.62], p < 1 × 10-16), which offers similar powerful performance with Cerebrospinal Fluid (CSF) Aβ (HR = 3.78 [95% CI: 2.63∼5.43], p = 2.13 × 10-14) and CSF Tau (HR = 3.77 [95% CI: 2.64∼5.39], p = 9.53 × 10-15) based on the COX and Log-rank test. Notably, the IBRAIN shows comparable sensitivity (beta = -0.70, p < 1 × 10-16) in capturing longitudinal changes in individuals with conversion to AD than CSF Aβ (beta = -0.26, p = 4.40 × 10-9) and CSF Tau (beta = 0.12, p = 1.02 × 10-5).

Interpretation

Our findings suggested that IBRAIN is a biologically relevant, specific, and sensitive neuroimaging biomarker that can serve as a clinical measure to uncover prodromal AD progression. It has strong potential for application in future clinical practice and treatment trials.

Funding

Science and Technology Innovation 2030 Major Projects, the National Natural Science Foundation of China, Beijing Natural Science Funds, the Fundamental Research Funds for the CentralUniversity, and the Startup Funds for Talents at Beijing Normal University.

MRAβ: A multimodal MRI-derived amyloid-β biomarker for Alzheimer's disease

Florbetapir 18 F (AV45), a highly sensitive and specific positron emission tomographic (PET) molecular biomarker binding to the amyloid-β of Alzheimer's disease (AD), is constrained by radiation and cost. We sought to combat it by combining multimodal magnetic resonance imaging (MRI) images and a collaborative generative adversarial networks model (CollaGAN) to develop a multimodal MRI-derived Amyloid-β (MRAβ) biomarker. We collected multimodal MRI and PET AV45 data of 380 qualified participants from the ADNI dataset and 64 subjects from OASIS3 dataset. A five-fold cross-validation CollaGAN were applied to generate MRAβ. In the ADNI dataset, we found MRAβ could characterize the subject-level AV45 spatial variations in both AD and mild cognitive impairment (MCI). Voxel-wise two-sample t-tests demonstrated amyloid-β depositions identified by MRAβ in AD and MCI were significantly higher than healthy controls (HCs) in widespread cortices (p < .05, corrected) and were much similar to those by AV45 (r > .92, p < .001). Moreover, a 3D ResNet classifier demonstrated that MRAβ was comparable to AV45 in discriminating AD from HC in both the ADNI and OASIS3 datasets, and in discriminate MCI from HC in ADNI. Finally, we found MRAβ could mimic cortical hyper-AV45 in HCs who later converted to MCI (r = .79, p < .001) and was comparable to AV45 in discriminating them from stable HC (p > .05). In summary, our work illustrates that MRAβ synthesized by multimodal MRI could mimic the cerebral amyloid-β depositions like AV45 and lends credence to the feasibility of advancing MRI toward molecular-explainable biomarkers.

Reproducible Abnormalities and Diagnostic Generalizability of White Matter in Alzheimer's Disease

Alzheimer's disease (AD) is associated with the impairment of white matter (WM) tracts. The current study aimed to verify the utility of WM as the neuroimaging marker of AD with multisite diffusion tensor imaging datasets [321 patients with AD, 265 patients with mild cognitive impairment (MCI), 279 normal controls (NC)], a unified pipeline, and independent site cross-validation. Automated fiber quantification was used to extract diffusion profiles along tracts. Random-effects meta-analyses showed a reproducible degeneration pattern in which fractional anisotropy significantly decreased in the AD and MCI groups compared with NC. Machine learning models using tract-based features showed good generalizability among independent site cross-validation. The diffusion metrics of the altered regions and the AD probability predicted by the models were highly correlated with cognitive ability in the AD and MCI groups. We highlighted the reproducibility and generalizability of the degeneration pattern of WM tracts in AD.

A comprehensive characterization of hippocampal feature ensemble serves as individualized brain signature for Alzheimer's disease: deep learning analysis in 3238 participants worldwide

OBJECTIVES

Hippocampal characterization is one of the most significant hallmarks of Alzheimer's disease (AD); rather, the single-level feature is insufficient. A comprehensive hippocampal characterization is pivotal for developing a well-performing biomarker for AD. To verify whether a comprehensive characterization of hippocampal features of gray matter volume, segmentation probability, and radiomics features could better distinguish AD from normal control (NC), and to investigate whether the classification decision score could serve as a robust and individualized brain signature.

METHODS

A total of 3238 participants' structural MRI from four independent databases were employed to conduct a 3D residual attention network (3DRA-Net) to classify NC, mild cognitive impairment (MCI), and AD. The generalization was validated under inter-database cross-validation. The neurobiological basis of the classification decision score as a neuroimaging biomarker was systematically investigated by association with clinical profiles, as well as longitudinal trajectory analysis to reveal AD progression. All image analyses were performed only upon the single modality of T1-weighted MRI.

RESULTS

Our study exhibited an outstanding performance (ACC = 91.6%, AUC = 0.95) of the comprehensive characterization of hippocampal features in distinguishing AD (n = 282) from NC (n = 603) in Alzheimer's Disease Neuroimaging Initiative cohort, and ACC = 89.2% and AUC = 0.93 under external validation. More importantly, the constructed score was significantly correlated with clinical profiles (p < 0.05), and dynamically altered over the AD longitudinal progression, provided compelling evidence of a solid neurobiological basis.

CONCLUSIONS

This systemic study highlights the potential of the comprehensive characterization of hippocampal features to provide an individualized, generalizable, and biologically plausible neuroimaging biomarker for early detection of AD.

KEY POINTS

• The comprehensive characterization of hippocampal features exhibited ACC = 91.6% (AUC = 0.95) in classifying AD from NC under intra-database cross-validation, and ACC = 89.2% (AUC = 0.93) in external validation. • The constructed classification score was significantly associated with clinical profiles, and dynamically altered over the AD longitudinal progression, which highlighted its potential of being an individualized, generalizable, and biologically plausible neuroimaging biomarker for early detection of AD.

Deep joint learning of pathological region localization and Alzheimer's disease diagnosis

The identification of Alzheimer's disease (AD) using structural magnetic resonance imaging (sMRI) has been studied based on the subtle morphological changes in the brain. One of the typical approaches is a deep learning-based patch-level feature representation. For this approach, however, the predetermined patches before learning the diagnostic model can limit classification performance. To mitigate this problem, we propose the BrainBagNet with a position-based gate (PG), which applies position information of brain images represented through the 3D coordinates. Our proposed method represents the patch-level class evidence based on both MR scan and position information for image-level prediction. To validate the effectiveness of our proposed framework, we conducted comprehensive experiments comparing it with state-of-the-art methods, utilizing two publicly available datasets: the Alzheimer's Disease Neuroimaging Initiative (ADNI) and the Australian Imaging, Biomarkers and Lifestyle (AIBL) dataset. Furthermore, our experimental results demonstrate that our proposed method outperforms the existing competing methods in terms of classification performance for both AD diagnosis and mild cognitive impairment conversion prediction tasks. In addition, we performed various analyses of the results from diverse perspectives to obtain further insights into the underlying mechanisms and strengths of our proposed framework. Based on the results of our experiments, we demonstrate that our proposed framework has the potential to advance deep-learning-based patch-level feature representation studies for AD diagnosis and MCI conversion prediction. In addition, our method provides valuable insights, such as interpretability, and the ability to capture subtle changes, into the underlying pathological processes of AD and MCI, benefiting both researchers and clinicians.

Altered large-scale dynamic connectivity patterns in Alzheimer's disease and mild cognitive impairment patients: A machine learning study

Alzheimer's disease (AD) is a common neurodegeneration disease associated with substantial disruptions in the brain network. However, most studies investigated static resting-state functional connections, while the alteration of dynamic functional connectivity in AD remains largely unknown. This study used group independent component analysis and the sliding-window method to estimate the subject-specific dynamic connectivity states in 1704 individuals from three data sets. Informative inherent states were identified by the multivariate pattern classification method, and classifiers were built to distinguish ADs from normal controls (NCs) and to classify mild cognitive impairment (MCI) patients with informative inherent states similar to ADs or not. In addition, MCI subgroups with heterogeneous functional states were examined in the context of different cognition decline trajectories. Five informative states were identified by feature selection, mainly involving functional connectivity belonging to the default mode network and working memory network. The classifiers discriminating AD and NC achieved the mean area under the receiver operating characteristic curve of 0.87 with leave-one-site-out cross-validation. Alterations in connectivity strength, fluctuation, and inter-synchronization were found in AD and MCIs. Moreover, individuals with MCI were clustered into two subgroups, which had different degrees of atrophy and different trajectories of cognition decline progression. The present study uncovered the alteration of dynamic functional connectivity in AD and highlighted that the dynamic states could be powerful features to discriminate patients from NCs. Furthermore, it demonstrated that these states help to identify MCIs with faster cognition decline and might contribute to the early prevention of AD.

Explainable artificial intelligence (XAI) in radiology and nuclear medicine: a literature review

Rational

Deep learning (DL) has demonstrated a remarkable performance in diagnostic imaging for various diseases and modalities and therefore has a high potential to be used as a clinical tool. However, current practice shows low deployment of these algorithms in clinical practice, because DL algorithms lack transparency and trust due to their underlying black-box mechanism. For successful employment, explainable artificial intelligence (XAI) could be introduced to close the gap between the medical professionals and the DL algorithms. In this literature review, XAI methods available for magnetic resonance (MR), computed tomography (CT), and positron emission tomography (PET) imaging are discussed and future suggestions are made.

Methods

PubMed, Embase.com and Clarivate Analytics/Web of Science Core Collection were screened. Articles were considered eligible for inclusion if XAI was used (and well described) to describe the behavior of a DL model used in MR, CT and PET imaging.

Results

A total of 75 articles were included of which 54 and 17 articles described post and ad hoc XAI methods, respectively, and 4 articles described both XAI methods. Major variations in performance is seen between the methods. Overall, post hoc XAI lacks the ability to provide class-discriminative and target-specific explanation. Ad hoc XAI seems to tackle this because of its intrinsic ability to explain. However, quality control of the XAI methods is rarely applied and therefore systematic comparison between the methods is difficult.

Conclusion

There is currently no clear consensus on how XAI should be deployed in order to close the gap between medical professionals and DL algorithms for clinical implementation. We advocate for systematic technical and clinical quality assessment of XAI methods. Also, to ensure end-to-end unbiased and safe integration of XAI in clinical workflow, (anatomical) data minimization and quality control methods should be included.

Interpretable machine learning for dementia: A systematic review

INTRODUCTION

Machine learning research into automated dementia diagnosis is becoming increasingly popular but so far has had limited clinical impact. A key challenge is building robust and generalizable models that generate decisions that can be reliably explained. Some models are designed to be inherently "interpretable," whereas post hoc "explainability" methods can be used for other models.

METHODS

Here we sought to summarize the state-of-the-art of interpretable machine learning for dementia.

RESULTS

We identified 92 studies using PubMed, Web of Science, and Scopus. Studies demonstrate promising classification performance but vary in their validation procedures and reporting standards and rely heavily on popular data sets.

DISCUSSION

Future work should incorporate clinicians to validate explanation methods and make conclusive inferences about dementia-related disease pathology. Critically analyzing model explanations also requires an understanding of the interpretability methods itself. Patient-specific explanations are also required to demonstrate the benefit of interpretable machine learning in clinical practice.

Regional Deep Atrophy: a Self-Supervised Learning Method to Automatically Identify Regions Associated With Alzheimer's Disease Progression From Longitudinal MRI

Longitudinal assessment of brain atrophy, particularly in the hippocampus, is a well-studied biomarker for neurodegenerative diseases, such as Alzheimer's disease (AD). In clinical trials, estimation of brain progressive rates can be applied to track therapeutic efficacy of disease modifying treatments. However, most state-of-the-art measurements calculate changes directly by segmentation and/or deformable registration of MRI images, and may misreport head motion or MRI artifacts as neurodegeneration, impacting their accuracy. In our previous study, we developed a deep learning method DeepAtrophy that uses a convolutional neural network to quantify differences between longitudinal MRI scan pairs that are associated with time. DeepAtrophy has high accuracy in inferring temporal information from longitudinal MRI scans, such as temporal order or relative inter-scan interval. DeepAtrophy also provides an overall atrophy score that was shown to perform well as a potential biomarker of disease progression and treatment efficacy. However, DeepAtrophy is not interpretable, and it is unclear what changes in the MRI contribute to progression measurements. In this paper, we propose Regional Deep Atrophy (RDA), which combines the temporal inference approach from DeepAtrophy with a deformable registration neural network and attention mechanism that highlights regions in the MRI image where longitudinal changes are contributing to temporal inference. RDA has similar prediction accuracy as DeepAtrophy, but its additional interpretability makes it more acceptable for use in clinical settings, and may lead to more sensitive biomarkers for disease monitoring in clinical trials of early AD.

HGM-cNet: Integrating hippocampal gray matter probability map into a cascaded deep learning framework improves hippocampus segmentation

A robust cascaded deep learning framework with integrated hippocampal gray matter (HGM) probability map was developed to improve the hippocampus segmentation (called HGM-cNet) due to its significance in various neuropsychiatric disorders such as Alzheimer's disease (AD). Particularly, the HGM-cNet cascaded two identical convolutional neural networks (CNN), where each CNN was devised by incorporating Attention Block, Residual Block, and DropBlock into the typical encoder-decoder architecture. The two CNNs were skip-connected between encoder components at each scale. The adoption of the cascaded deep learning framework was to conveniently incorporate the HGM probability map with the feature map generated by the first CNN. Experiments on 135T1-weighted MRI scans and manual hippocampal labels from publicly available ADNI-HarP dataset demonstrated that the proposed HGM-cNet outperformed seven multi-atlas-based hippocampus segmentation methods and six deep learning methods under comparison in most evaluation metrics. The Dice (average > 0.89 for both left and right hippocampus) was increased by around or more than 1% over other methods. The HGM-cNet also achieved a superior hippocampus segmentation performance in each group of cognitive normal, mild cognitive impairment, and AD. The stability, conveniences and generalizability of the cascaded deep learning framework with integrated HGM probability map in improving hippocampus segmentation was validated by replacing the proposed CNN with 3D-UNet, Atten-UNet, HippoDeep, QuickNet, DeepHarp, and TransBTS models. The integration of the HGM probability map in the cascaded deep learning framework was also demonstrated to facilitate capturing hippocampal atrophy more accurately than alternative methods in AD analysis. The codes are publicly available at https://github.com/Liu1436510768/HGM-cNet.git.

Individualized functional connectome identified generalizable biomarkers for psychiatric symptoms in transdiagnostic patients

Substantial clinical heterogeneity and comorbidity inherent amongst mental disorders limit the identification of neuroimaging biomarkers that can reliably track clinical symptoms. Strategies that enable generation of meaningful and replicable neurobiological markers at the individual level will push the field of neuropsychiatry forward in developing efficacious personalized treatment. The current study included 142 adult patients with a primary diagnosis of schizophrenia (SCZ), bipolar (BP), or attention deficit/hyperactivity disorder (ADHD), and 67 patient ratings across four behavioral measures. Using functional connectivity derived from a personalized fMRI approach, we identified several candidate imaging markers related to dimensional phenotypes across disorders, assessed the internal and external generalizability of these markers, and compared the probability of replicating findings across datasets using individual and group-averaged defined functional regions. We identified subject-specific connections related to three different clinical domains (attention deficit, appetite-energy, psychosis-positive) in a discovery dataset. Importantly, these connectivity biomarkers were robust and were reproduced in an independent validation dataset. For markers related to neurovegetative symptoms (attention deficit, appetite-energy symptoms), the brain connections involved showed similar connectivity patterns across the different diagnoses. However, psychosis-positive symptoms were associated with connections of varying strength across disorders. Finally, we found that markers for symptom domains were replicable for individually-specified connections, but not for group template-derived connections. Our personalized strategies allowed us to identify meaningful and generalizable imaging markers for symptom domains in patients who exhibit high levels of heterogeneity. These biomarkers may shed new light on the connectivity underpinnings of psychiatric symptoms and lead to personalized interventions.

Diagnostic performance of magnetic resonance imaging-based machine learning in Alzheimer's disease detection: a meta-analysis

PURPOSE

Advanced machine learning (ML) algorithms can assist rapid medical image recognition and realize automatic, efficient, noninvasive, and convenient diagnosis. We aim to further evaluate the diagnostic performance of ML to distinguish patients with probable Alzheimer's disease (AD) from normal older adults based on structural magnetic resonance imaging (MRI).

METHODS

The Medline, Embase, and Cochrane Library databases were searched for relevant literature published up until July 2021. We used the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool and Checklist for Artificial Intelligence in Medical Imaging (CLAIM) to evaluate all included studies' quality and potential bias. Random-effects models were used to calculate pooled sensitivity and specificity, and the Deeks' test was used to assess publication bias.

RESULTS

We included 24 models based on different brain features extracted by ML algorithms in 19 papers. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, and area under the summary receiver operating characteristic curve for ML in detecting AD were 0.85 (95%CI 0.81-0.89), 0.88 (95%CI 0.84-0.91), 7.15 (95%CI 5.40-9.47), 0.17 (95%CI 0.12-0.22), 43.34 (95%CI 26.89-69.84), and 0.93 (95%CI 0.91-0.95).

CONCLUSION

ML using structural MRI data performed well in diagnosing probable AD patients and normal elderly. However, more high-quality, large-scale prospective studies are needed to further enhance the reliability and generalizability of ML for clinical applications before it can be introduced into clinical practice.

Monte Carlo Ensemble Neural Network for the diagnosis of Alzheimer's disease

Convolutional neural networks (CNNs) have been increasingly used in the computer-aided diagnosis of Alzheimer's Disease (AD). This study takes the advantage of the 2D-slice CNN fast computation and ensemble approaches to develop a Monte Carlo Ensemble Neural Network (MCENN) by introducing Monte Carlo sampling and an ensemble neural network in the integration with ResNet50. Our goals are to improve the 2D-slice CNN performance and to design the MCENN model insensitive to image resolution. Unlike traditional ensemble approaches with multiple base learners, our MCENN model incorporates one neural network learner and generates a large number of possible classification decisions via Monte Carlo sampling of feature importance within the combined slices. This can overcome the main weakness of the lack of 3D brain anatomical information in 2D-slice CNNs and develop a neural network to learn the 3D relevance of the features across multiple slices. Brain images from Alzheimer's Disease Neuroimaging Initiative (ADNI, 7199 scans), the Open Access Series of Imaging Studies-3 (OASIS-3, 1992 scans), and a clinical sample (239 scans) are used to evaluate the performance of the MCENN model for the classification of cognitively normal (CN), patients with mild cognitive impairment (MCI) and AD. Our MCENN with a small number of slices and minimal image processing (rigid transformation, intensity normalization, skull stripping) achieves the AD classification accuracy of 90%, better than existing 2D-slice CNNs (accuracy: 63%∼84%) and 3D CNNs (accuracy: 74%∼88%). Furthermore, the MCENN is robust to be trained in the ADNI dataset and applied to the OASIS-3 dataset and the clinical sample. Our experiments show that the AD classification accuracy of the MCENN model is comparable when using high- and low-resolution brain images, suggesting the insensitivity of the MCENN to image resolution. Hence, the MCENN does not require high-resolution 3D brain structural images and comprehensive image processing, which supports its potential use in a clinical setting.

Episodic Memory-Related Imaging Features as Valuable Biomarkers for the Diagnosis of Alzheimer's Disease: A Multicenter Study Based on Machine Learning

BACKGROUND

Individualized and reliable biomarkers are crucial for diagnosing Alzheimer's disease (AD). However, lack of accessibility and neurobiological correlation are the main obstacles to their clinical application. Machine learning algorithms can effectively identify personalized biomarkers based on the prominent symptoms of AD.

METHODS

Episodic memory-related magnetic resonance imaging (MRI) features of 143 patients with amnesic mild cognitive impairment (MCI) were identified using a multivariate relevance vector regression algorithm. The support vector machine classification model was constructed using these MRI features and verified in 2 independent datasets (N = 994). The neurobiological basis was also investigated based on cognitive assessments, neuropathologic biomarkers of cerebrospinal fluid, and positron emission tomography images of amyloid-β plaques.

RESULTS

The combination of gray matter volume and amplitude of low-frequency fluctuation MRI features accurately predicted episodic memory impairment in individual patients with amnesic MCI (r = 0.638) when measured using an episodic memory assessment panel. The MRI features that contributed to episodic memory prediction were primarily distributed across the default mode network and limbic network. The classification model based on these features distinguished patients with AD from normal control subjects with more than 86% accuracy. Furthermore, most identified episodic memory-related regions showed significantly different amyloid-β positron emission tomography measurements among the AD, MCI, and normal control groups. Moreover, the classification outputs significantly correlated with cognitive assessment scores and cerebrospinal fluid pathological biomarkers' levels in the MCI and AD groups.

CONCLUSIONS

Neuroimaging features can reflect individual episodic memory function and serve as potential diagnostic biomarkers of AD.

Magnetic Resonance Imaging Studies of Neurodegenerative Disease: From Methods to Translational Research

Neurodegenerative diseases (NDs) have become a significant threat to an aging human society. Numerous studies have been conducted in the past decades to clarify their pathologic mechanisms and search for reliable biomarkers. Magnetic resonance imaging (MRI) is a powerful tool for investigating structural and functional brain alterations in NDs. With the advantages of being non-invasive and non-radioactive, it has been frequently used in both animal research and large-scale clinical investigations. MRI may serve as a bridge connecting micro- and macro-level analysis and promoting bench-to-bed translational research. Nevertheless, due to the abundance and complexity of MRI techniques, exploiting their potential is not always straightforward. This review aims to briefly introduce research progress in clinical imaging studies and discuss possible strategies for applying MRI in translational ND research.

Deep learning magnetic resonance imaging predicts platinum sensitivity in patients with epithelial ovarian cancer

Objective

The aim of the study is to develop and validate a deep learning model to predict the platinum sensitivity of patients with epithelial ovarian cancer (EOC) based on contrast-enhanced magnetic resonance imaging (MRI).

Methods

In this retrospective study, 93 patients with EOC who received platinum-based chemotherapy (≥4 cycles) and debulking surgery at the Sun Yat-sen Memorial Hospital from January 2011 to January 2020 were enrolled and randomly assigned to the training and validation cohorts (2:1). Two different models were built based on either the primary tumor or whole volume of the abdomen as the volume of interest (VOI) within the same cohorts, and then a pre-trained convolutional neural network Med3D (Resnet 10 version) was transferred to automatically extract 1,024 features from two MRI sequences (CE-T1WI and T2WI) of each patient to predict platinum sensitivity. The performance of the two models was compared.

Results

A total of 93 women (mean age, 50.5 years ± 10.5 [standard deviation]) were evaluated (62 in the training cohort and 31 in the validation cohort). The AUCs of the whole abdomen model were 0.97 and 0.98 for the training and validation cohorts, respectively, which was better than the primary tumor model (AUCs of 0.88 and 0.81 in the training and validation cohorts, respectively). In k-fold cross-validation and stratified analysis, the whole abdomen model maintained a stable performance, and the decision function value generated by the model was a prognostic indicator that successfully discriminates high- and low-risk recurrence patients.

Conclusion

The non-manually segmented whole-abdomen deep learning model based on MRI exhibited satisfactory predictive performance for platinum sensitivity and may assist gynecologists in making optimal treatment decisions.

How segmentation methods affect hippocampal radiomic feature accuracy in Alzheimer's disease analysis?

OBJECTIVES

Hippocampal radiomic features (HRFs) can serve as biomarkers in Alzheimer's disease (AD). However, how different hippocampal segmentation methods affect HRFs in AD is still unknown. The aim of the study was to investigate how different segmentation methods affect HRF accuracy in AD analysis.

METHODS

A total of 1650 subjects were identified from the Alzheimer's Disease Neuroimaging Initiative database (ADNI). The mini-mental state examination (MMSE) and Alzheimer's disease assessment scale (ADAS-cog13) were also adopted. After calculating the HRFs of intensity, shape, and textural features from each side of the hippocampus in structural magnetic resonance imaging (sMRI), the consistency of HRFs calculated from 7 different hippocampal segmentation methods was validated, and the performance of machine learning-based classification of AD vs. normal control (NC) adopting the different HRFs was also examined. Additional 571 subjects from the European DTI Study on Dementia database (EDSD) were to validate the consistency of results.

RESULTS

Between different segmentations, HRFs showed a high measurement consistency (R > 0.7), a high significant consistency between NC, mild cognitive impairment (MCI), and AD (T-value plot, R > 0.8), and consistent significant correlations between HRFs and MMSE/ADAS-cog13 (p < 0.05). The best NC vs. AD classification was obtained when the hippocampus was sufficiently segmented by primitive majority voting (threshold = 0.2). High consistent results were reproduced from independent EDSD cohort.

CONCLUSIONS

HRFs exhibited high consistency across different hippocampal segmentation methods, and the best performance in AD classification was obtained when HRFs were extracted by the naïve majority voting method with a more sufficient segmentation and relatively low hippocampus segmentation accuracy.

KEY POINTS

• The hippocampal radiomic features exhibited high measurement/statistical/clinical consistency across different hippocampal segmentation methods. • The best performance in AD classification was obtained when hippocampal radiomics were extracted by the naïve majority voting method with a more sufficient segmentation and relatively low hippocampus segmentation accuracy.

Convolutional Neural Networks for Classification of T2DM Cognitive Impairment Based on Whole Brain Structural Features

Purpose

Cognitive impairment is generally found in individuals with type 2 diabetes mellitus (T2DM). Although they may not have visible symptoms of cognitive impairment in the early stages of the disorder, they are considered to be at high risk. Therefore, the classification of these patients is important for preventing the progression of cognitive impairment.

Methods

In this study, a convolutional neural network was used to construct a model for classifying 107 T2DM patients with and without cognitive impairment based on T1-weighted structural MRI. The Montreal cognitive assessment score served as an index of the cognitive status of the patients.

Results

The classifier could identify T2DM-related cognitive decline with a classification accuracy of 84.85% and achieved an area under the curve of 92.65%.

Conclusions

The model can help clinicians analyze and predict cognitive impairment in patients and enable early treatment.

Impaired time-distance reconfiguration patterns in Alzheimer's disease: a dynamic functional connectivity study with 809 individuals from 7 sites

BACKGROUND

The dynamic functional connectivity (dFC) has been used successfully to investigate the dysfunction of Alzheimer's disease (AD) patients. The reconfiguration intensity of nodal dFC, which means the degree of alteration between FCs at different time scales, could provide additional information for understanding the reconfiguration of brain connectivity.

RESULTS

In this paper, we introduced a feature named time distance nodal connectivity diversity (tdNCD), and then evaluated the network reconfiguration intensity in every specific brain region in AD using a large multicenter dataset (N = 809 from 7 independent sites). Our results showed that the dysfunction involved in three subnetworks in AD, including the default mode network (DMN), the subcortical network (SCN), and the cerebellum network (CBN). The nodal tdNCD inside the DMN increased in AD compared to normal controls, and the nodal dynamic FC of the SCN and the CBN decreased in AD. Additionally, the classification analysis showed that the classification performance was better when combined tdNCD and FC to classify AD from normal control (ACC = 81%, SEN = 83.4%, SPE = 80.6%, and F1-score = 79.4%) than that only using FC (ACC = 78.2%, SEN = 76.2%, SPE = 76.5%, and F1-score = 77.5%) with a leave-one-site-out cross-validation. Besides, the performance of the three classes classification was improved from 50% (only using FC) to 53.3% (combined FC and tdNCD) (macro F1-score accuracy from 46.8 to 48.9%). More importantly, the classification model showed significant clinically predictive correlations (two classes classification: R = -0.38, P < 0.001; three classes classification: R = -0.404, P < 0.001). More importantly, several commonly used machine learning models confirmed that the tdNCD would provide additional information for classifying AD from normal controls.

CONCLUSIONS

The present study demonstrated dynamic reconfiguration of nodal FC abnormities in AD. The tdNCD highlights the potential for further understanding core mechanisms of brain dysfunction in AD. Evaluating the tdNCD FC provides a promising way to understand AD processes better and investigate novel diagnostic brain imaging biomarkers for AD.

Structural and functional connectivity abnormalities of the default mode network in patients with Alzheimer's disease and mild cognitive impairment within two independent datasets

Alzheimer's disease (AD) is a chronic neurodegenerative disease characterized by progressive dementia, and amnestic mild cognitive impairment (aMCI) has been defined as a transitional stage between normal aging and AD. Accumulating evidence has shown that altered functional connectivity (FC) and structural connectivity (SC) in the default mode network (DMN) is the prominent hallmarks of AD. However, the relationship between the changes in SC and FC of the DMN is not yet clear. In the present study, we derived the FC and SC matrices of the DMN with functional magnetic resonance imaging (fMRI) and diffusion-weighted imaging (DWI) data and further assessed FC and SC abnormalities within a discovery dataset of 120 participants (39 normal controls, 34 patients with aMCI and 47 patients with AD), as well as a replication dataset of 122 participants (43 normal controls, 37 patients with aMCI and 42 patients with AD). Disrupted SC and FC were found among DMN components (e.g., the posterior cingulate cortex (PCC), medial prefrontal cortex (mPFC), and hippocampus) in patients in the aMCI and AD groups in the discovery dataset; most of the disrupted connections were also identified in the replication dataset. More importantly, some SC and FC elements were significantly correlated with the cognitive ability of patients with aMCI and AD. In addition, we found structural-functional decoupling between the PCC and the right hippocampus in patients in the aMCI and AD groups. These findings of the alteration of DMN connectivity in neurodegenerative cohorts deepen our understanding of the pathophysiological mechanisms of AD.

An attention-based hybrid deep learning framework integrating brain connectivity and activity of resting-state functional MRI data

Functional magnetic resonance imaging (fMRI) as a promising tool to investigate psychotic disorders can be decomposed into useful imaging features such as time courses (TCs) of independent components (ICs) and functional network connectivity (FNC) calculated by TC cross-correlation. TCs reflect the temporal dynamics of brain activity and the FNC characterizes temporal coherence across intrinsic brain networks. Both features have been used as input to deep learning approaches with decent results. However, few studies have tried to leverage their complementary information to learn optimal representations at multiple facets. Motivated by this, we proposed a Hybrid Deep Learning Framework integrating brain Connectivity and Activity (HDLFCA) together by combining convolutional recurrent neural network (C-RNN) and deep neural network (DNN), aiming to improve classification accuracy and interpretability simultaneously. Specifically, C-RNNAM was proposed to extract temporal dynamic dependencies with an attention module (AM) to automatically learn discriminative knowledge from TC nodes, while DNN was applied to identify the most group-discriminative FNC patterns with layer-wise relevance propagation (LRP). Then, both prediction outputs were concatenated to build a new feature matrix, generating the final decision by logistic regression. The effectiveness of HDLFCA was validated on both multi-site schizophrenia (SZ, n ∼ 1100) and public autism datasets (ABIDE, n ∼ 1522) by outperforming 12 alternative models at 2.8-8.9% accuracy, including 8 models using either static FNC or TCs and 4 models using dynamic FNC. Appreciable classification accuracy was achieved for HC vs. SZ (85.3%) and HC vs. Autism (72.4%) respectively. More importantly, the most group-discriminative brain regions can be easily attributed and visualized, providing meaningful biological interpretability and highlighting the great potential of the proposed HDLFCA model in the identification of valid neuroimaging biomarkers.

Alzheimer's Disease Diagnosis With Brain Structural MRI Using Multiview-Slice Attention and 3D Convolution Neural Network

Numerous artificial intelligence (AI) based approaches have been proposed for automatic Alzheimer's disease (AD) prediction with brain structural magnetic resonance imaging (sMRI). Previous studies extract features from the whole brain or individual slices separately, ignoring the properties of multi-view slices and feature complementarity. For this reason, we present a novel AD diagnosis model based on the multiview-slice attention and 3D convolution neural network (3D-CNN). Specifically, we begin by extracting the local slice-level characteristic in various dimensions using multiple sub-networks. Then we proposed a slice-level attention mechanism to emphasize specific 2D-slices to exclude the redundancy features. After that, a 3D-CNN was employed to capture the global subject-level structural changes. Finally, all these 2D and 3D features were fused to obtain more discriminative representations. We conduct the experiments on 1,451 subjects from ADNI-1 and ADNI-2 datasets. Experimental results showed the superiority of our model over the state-of-the-art approaches regarding dementia classification. Specifically, our model achieves accuracy values of 91.1 and 80.1% on ADNI-1 for AD diagnosis and mild cognitive impairment (MCI) convention prediction, respectively.

Regional Radiomics Similarity Networks Reveal Distinct Subtypes and Abnormality Patterns in Mild Cognitive Impairment

Individuals with mild cognitive impairment (MCI) of different subtypes show distinct alterations in network patterns. The first aim of this study is to identify the subtypes of MCI by employing a regional radiomics similarity network (R2SN). The second aim is to characterize the abnormality patterns associated with the clinical manifestations of each subtype. An individual-level R2SN is constructed for N = 605 normal controls (NCs), N = 766 MCI patients, and N = 283 Alzheimer's disease (AD) patients. MCI patients' R2SN profiles are clustered into two subtypes using nonnegative matrix factorization. The patterns of brain alterations, gene expression, and the risk of cognitive decline in each subtype are evaluated. MCI patients are clustered into "similar to the pattern of NCs" (N-CI, N = 252) and "similar to the pattern of AD" (A-CI, N = 514) subgroups. Significant differences are observed between the subtypes with respect to the following: 1) clinical measures; 2) multimodal neuroimaging; 3) the proportion of progression to dementia (61.54% for A-CI and 21.77% for N-CI) within three years; 4) enriched genes for potassium-ion transport and synaptic transmission. Stratification into the two subtypes provides new insight for risk assessment and precise early intervention for MCI patients.

Predicting diagnosis 4 years prior to Alzheimer's disease incident

This study employed a deep learning longitudinal model, graph convolutional and recurrent neural network (graph-CNN-RNN), on a series of brain structural MRI scans for AD prognosis. It characterized whole-brain morphology via incorporating longitudinal cortical and subcortical morphology and defined a probabilistic risk for the prediction of AD as a function of age prior to clinical diagnosis. The graph-CNN-RNN model was trained on half of the Alzheimer's Disease Neuroimaging Initiative dataset (ADNI, n = 1559) and validated on the other half of the ADNI dataset and the Open Access Series of Imaging Studies-3 (OASIS-3, n = 930). Our findings demonstrated that the graph-CNN-RNN can reliably and robustly diagnose AD at the accuracy rate of 85% and above across all the time points for both datasets. The graph-CNN-RNN predicted the AD conversion from 0 to 4 years before the AD onset at ∼80% of accuracy. The AD probabilistic risk was associated with clinical traits, cognition, and amyloid burden assessed using [18F]-Florbetapir (AV45) positron emission tomography (PET) across all the time points. The graph-CNN-RNN provided the quantitative trajectory of brain morphology from prognosis to overt stages of AD. Such a deep learning tool and the AD probabilistic risk have great potential in clinical applications for AD prognosis.

A systematic analysis of diagnostic performance for Alzheimer's disease using structural MRI

Background

Alzheimer's disease (AD) is one of the most common neurodegenerative disorders in the elderly. Although numerous structural magnetic resonance imaging (sMRI) studies have reported diagnostic models that could distinguish AD from normal controls (NCs) with 80-95% accuracy, limited efforts have been made regarding the clinically practical computer-aided diagnosis (CAD) system for AD.

Objective

To explore the potential factors that hinder the clinical translation of the AD-related diagnostic models based on sMRI.

Methods

To systematically review the diagnostic models for AD based on sMRI, we identified relevant studies published in the past 15 years on PubMed, Web of Science, Scopus, and Ovid. To evaluate the heterogeneity and publication bias among those studies, we performed subgroup analysis, meta-regression, Begg's test, and Egger's test.

Results

According to our screening criterion, 101 studies were included. Our results demonstrated that high diagnostic accuracy for distinguishing AD from NC was obtained in recently published studies, accompanied by significant heterogeneity. Meta-analysis showed that many factors contributed to the heterogeneity of high diagnostic accuracy of AD using sMRI, which included but was not limited to the following aspects: (i) different datasets; (ii) different machine learning models, e.g. traditional machine learning or deep learning model; (iii) different cross-validation methods, e.g. k-fold cross-validation leads to higher accuracies than leave-one-out cross-validation, but both overestimate the accuracy when compared to validation in independent samples; (iv) different sample sizes; and (v) the publication times. We speculate that these complicated variables might be the adverse factor for developing a clinically applicable system for the early diagnosis of AD.

Conclusions

Our findings proved that previous studies reported promising results for classifying AD from NC with different models using sMRI. However, considering the many factors hindering clinical radiology practice, there would still be a long way to go to improve.

Ranking convolutional neural network for Alzheimer's disease mini-mental state examination prediction at multiple time-points

BACKGROUND AND OBJECTIVE

Alzheimer's disease (AD) is a fatal neurodegenerative disease. Predicting Mini-mental state examination (MMSE) based on magnetic resonance imaging (MRI) plays an important role in monitoring the progress of AD. Existing machine learning based methods cast MMSE prediction as a single metric regression problem simply and ignore the relationship between subjects with various scores.

METHODS

In this study, we proposed a ranking convolutional neural network (rankCNN) to address the prediction of MMSE through muti-classification. Specifically, we use a 3D convolutional neural network with sharing weights to extract the feature from MRI, followed by multiple sub-networks which transform the cognitive regression into a series of simpler binary classification. In addition, we further use a ranking layer to measure the ranking information between samples to strengthen the ability of the classification by extracting more discriminative features.

RESULTS

We evaluated the proposed model on ADNI-1 and ADNI-2 datasets with a total of 1,569 subjects. The Root Mean Squared Error (RMSE) of our proposed model at baseline is 2.238 and 2.434 on ADNI-1 and ADNI-2, respectively. Extensive experimental results on ADNI-1 and ADNI-2 datasets demonstrate that our proposed model is superior to several state-of-the-art methods at both baseline and future MMSE prediction of subjects.

CONCLUSION

This paper provides a new method that can effectively predict the MMSE at baseline and future time points using baseline MRI, making it possible to use MRI for accurate early diagnosis of AD. The source code is freely available at https://github.com/fengduqianhe/ADrankCNN-master.

Altered Connection and Diagnosis Utility of White Matter in Alzheimer's Disease: A Multi-site Automated Fiber Quantification Study

Alzheimer's disease (AD) is a typical neurodegenerative disease that is associated with cognitive decline, memory loss, and functional disconnection. Diffusion tensor imaging (DTI) has been widely used to investigate the integrity and degeneration of white matter in AD. In this study, with one of the world's largest DTI biobanks (865 individuals), we aim to explore the diagnosis utility and stability of tractbased features (extracted by automated fiber quantification (AFQ) pipeline) in AD. First, we studied the clinical association of tract-based features by detecting AD-associated alterations of diffusion properties along fiber bundles. Then, a binary classification experiment between AD and normal controls was performed using tract-based diffusion properties as features and support vector machine (SVM) as a classifier with an independent site cross-validation strategy. The average accuracy of 77.90% (the highest was 88.89%) showed that white matter properties as biomarkers had a relatively stable role in the clinical diagnosis of AD.Clinical Relevance- White matter characteristics are valid and robust biomarkers of AD, which have high accuracy and generalizability in the AD diagnosis in a large multi-site dataset.

Preventing dataset shift from breaking machine-learning biomarkers

Machine learning brings the hope of finding new biomarkers extracted from cohorts with rich biomedical measurements. A good biomarker is one that gives reliable detection of the corresponding condition. However, biomarkers are often extracted from a cohort that differs from the target population. Such a mismatch, known as a dataset shift, can undermine the application of the biomarker to new individuals. Dataset shifts are frequent in biomedical research, e.g.,  because of recruitment biases. When a dataset shift occurs, standard machine-learning techniques do not suffice to extract and validate biomarkers. This article provides an overview of when and how dataset shifts break machine-learning-extracted biomarkers, as well as detection and correction strategies.

Regional radiomics similarity networks (R2SNs) in the human brain: Reproducibility, small-world properties and a biological basis

A structural covariance network (SCN) has been used successfully in structural magnetic resonance imaging (sMRI) studies. However, most SCNs have been constructed by a unitary marker that is insensitive for discriminating different disease phases. The aim of this study was to devise a novel regional radiomics similarity network (R2SN) that could provide more comprehensive information in morphological network analysis. R2SNs were constructed by computing the Pearson correlations between the radiomics features extracted from any pair of regions for each subject (AAL atlas). We further assessed the small-world property of R2SNs, and we evaluated the reproducibility in different datasets and through test-retest analysis. The relationships between the R2SNs and general intelligence/interregional coexpression of genes were also explored. R2SNs could be replicated in different datasets, regardless of the use of different feature subsets. R2SNs showed high reproducibility in the test-retest analysis (intraclass correlation coefficient > 0.7). In addition, the small-word property (σ > 2) and the high correlation between gene expression (R = 0.29, p < 0.001) and general intelligence were determined for R2SNs. Furthermore, the results have also been repeated in the Brainnetome atlas. R2SNs provide a novel, reliable, and biologically plausible method to understand human morphological covariance based on sMRI.

Cortical and Subcortical Grey Matter Abnormalities in White Matter Hyperintensities and Subsequent Cognitive Impairment

Grey matter (GM) alterations may contribute to cognitive decline in individuals with white matter hyperintensities (WMH) but no consensus has yet emerged. Here, we investigated cortical thickness and grey matter volume in 23 WMH patients with mild cognitive impairment (WMH-MCI), 43 WMH patients without cognitive impairment, and 55 healthy controls. Both WMH groups showed GM atrophy in the bilateral thalamus, fronto-insular cortices, and several parietal-temporal regions, and the WMH-MCI group showed more extensive and severe GM atrophy. The GM atrophy in the thalamus and fronto-insular cortices was associated with cognitive decline in the WMH-MCI patients and may mediate the relationship between WMH and cognition in WMH patients. Furthermore, the main results were well replicated in an independent dataset from the Alzheimer's Disease Neuroimaging Initiative database and in other control analyses. These comprehensive results provide robust evidence of specific GM alterations underlying WMH and subsequent cognitive impairment.

Quantitative Radiomic Features as New Biomarkers for Alzheimer's Disease: An Amyloid PET Study

Growing evidence indicates that amyloid-beta (Aβ) accumulation is one of the most common neurobiological biomarkers in Alzheimer's disease (AD). The primary aim of this study was to explore whether the radiomic features of Aβ positron emission tomography (PET) images are used as predictors and provide a neurobiological foundation for AD. The radiomics features of Aβ PET imaging of each brain region of the Brainnetome Atlas were computed for classification and prediction using a support vector machine model. The results showed that the area under the receiver operating characteristic curve (AUC) was 0.93 for distinguishing AD (N = 291) from normal control (NC; N = 334). Additionally, the AUC was 0.83 for the prediction of mild cognitive impairment (MCI) converting (N = 88) (vs. no conversion, N = 100) to AD. In the MCI and AD groups, the systemic analysis demonstrated that the classification outputs were significantly associated with clinical measures (apolipoprotein E genotype, polygenic risk scores, polygenic hazard scores, cerebrospinal fluid Aβ, and Tau, cognitive ability score, the conversion time for progressive MCI subjects and cognitive changes). These findings provide evidence that the radiomic features of Aβ PET images can serve as new biomarkers for clinical applications in AD/MCI, further providing evidence for predicting whether MCI subjects will convert to AD.

Application of Structural and Functional Connectome Mismatch for Classification and Individualized Therapy in Alzheimer Disease

While machine learning approaches to analyzing Alzheimer disease connectome neuroimaging data have been studied, many have limited ability to provide insight in individual patterns of disease and lack the ability to provide actionable information about where in the brain a specific patient's disease is located. We studied a cohort of patients with Alzheimer disease who underwent resting state functional magnetic resonance imaging and diffusion tractography imaging. These images were processed, and a structural and functional connectivity matrix was generated using the HCP cortical and subcortical atlas. By generating a machine learning model, individual-level structural and functional anomalies detection and characterization were explored in this study. Our study found that structural disease burden in Alzheimer's patients is mainly focused in the subcortical structures and the Default mode network (DMN). Interestingly, functional anomalies were less consistent between individuals and less common in general in these patients. More intriguing was that some structural anomalies were noted in all patients in the study, namely a reduction in fibers involving parcellations in the right anterior cingulate. Alternately, the functional consequences of connectivity loss were cortical and variable. Integrated structural/functional connectomics might provide a useful tool for assessing AD progression, while few concerns have been made for analyzing the mismatch between these two. We performed a preliminary exploration into a set of Alzheimer disease data, intending to improve a personalized approach to understanding individual connectomes in an actionable manner. Specifically, we found that there were consistent patterns of white matter fiber loss, mainly focused around the DMN and deep subcortical structures, which were present in nearly all patients with clinical AD. Functional magnetic resonance imaging shows abnormal functional connectivity different within the patients, which may be used as the individual target for further therapeutic strategies making, like non-invasive stimulation technology.