Using deep learning to investigate the neuroimaging correlates of psychiatric and neurological disorders: Methods and applications

Nonlinear latent representations of high-dimensional task-fMRI data: Unveiling cognitive and behavioral insights in heterogeneous spatial maps

Finding an interpretable and compact representation of complex neuroimaging data is extremely useful for understanding brain behavioral mapping and hence for explaining the biological underpinnings of mental disorders. However, hand-crafted representations, as well as linear transformations, may inadequately capture the considerable variability across individuals. Here, we implemented a data-driven approach using a three-dimensional autoencoder on two large-scale datasets. This approach provides a latent representation of high-dimensional task-fMRI data which can account for demographic characteristics whilst also being readily interpretable both in the latent space learned by the autoencoder and in the original voxel space. This was achieved by addressing a joint optimization problem that simultaneously reconstructs the data and predicts clinical or demographic variables. We then applied normative modeling to the latent variables to define summary statistics ('latent indices') and establish a multivariate mapping to non-imaging measures. Our model, trained with multi-task fMRI data from the Human Connectome Project (HCP) and UK biobank task-fMRI data, demonstrated high performance in age and sex predictions and successfully captured complex behavioral characteristics while preserving individual variability through a latent representation. Our model also performed competitively with respect to various baseline models including several variants of principal components analysis, independent components analysis and classical regions of interest, both in terms of reconstruction accuracy and strength of association with behavioral variables.

Assessment of Sports Concussion in Female Athletes: A Role for Neuroinformatics?

Over the past decade, the intricacies of sports-related concussions among female athletes have become readily apparent. Traditional clinical methods for diagnosing concussions suffer limitations when applied to female athletes, often failing to capture subtle changes in brain structure and function. Advanced neuroinformatics techniques and machine learning models have become invaluable assets in this endeavor. While these technologies have been extensively employed in understanding concussion in male athletes, there remains a significant gap in our comprehension of their effectiveness for female athletes. With its remarkable data analysis capacity, machine learning offers a promising avenue to bridge this deficit. By harnessing the power of machine learning, researchers can link observed phenotypic neuroimaging data to sex-specific biological mechanisms, unraveling the mysteries of concussions in female athletes. Furthermore, embedding methods within machine learning enable examining brain architecture and its alterations beyond the conventional anatomical reference frame. In turn, allows researchers to gain deeper insights into the dynamics of concussions, treatment responses, and recovery processes. This paper endeavors to address the crucial issue of sex differences in multimodal neuroimaging experimental design and machine learning approaches within female athlete populations, ultimately ensuring that they receive the tailored care they require when facing the challenges of concussions. Through better data integration, feature identification, knowledge representation, validation, etc., neuroinformaticists, are ideally suited to bring clarity, context, and explainabilty to the study of sports-related head injuries in males and in females, and helping to define recovery.

Ensemble approach of transfer learning and vision transformer leveraging explainable AI for disease diagnosis: An advancement towards smart healthcare 5.0

Smart healthcare has advanced the medical industry with the integration of data-driven approaches. Artificial intelligence and machine learning provided remarkable progress, but there is a lack of transparency and interpretability in such applications. To overcome such limitations, explainable AI (EXAI) provided a promising result. This paper applied the EXAI for disease diagnosis in the advancement of smart healthcare. The paper combined the approach of transfer learning, vision transformer, and explainable AI and designed an ensemble approach for prediction of disease and its severity. The result is evaluated on a dataset of Alzheimer's disease. The result analysis compared the performance of transfer learning models with the ensemble model of transfer learning and vision transformer. For training, InceptionV3, VGG19, Resnet50, and Densenet121 transfer learning models were selected for ensembling with vision transformer. The result compares the performance of two models: a transfer learning (TL) model and an ensemble transfer learning (Ensemble TL) model combined with vision transformer (ViT) on ADNI dataset. For the TL model, the accuracy is 58 %, precision is 52 %, recall is 42 %, and the F1-score is 44 %. Whereas, the Ensemble TL model with ViT shows significantly improved performance i.e., 96 % of accuracy, 94 % of precision, 90 % of recall and 92 % of F1-score on ADNI dataset. This shows the efficacy of the ensemble model over transfer learning models.

Investigating the discrimination ability of 3D convolutional neural networks applied to altered brain MRI parametric maps

Convolutional neural networks (CNNs) are gradually being recognized in the neuroimaging community as a powerful tool for image analysis. Despite their outstanding performances, some aspects of CNN functioning are still not fully understood by human operators. We postulated that the interpretability of CNNs applied to neuroimaging data could be improved by investigating their behavior when they are fed data with known characteristics. We analyzed the ability of 3D CNNs to discriminate between original and altered whole-brain parametric maps derived from diffusion-weighted magnetic resonance imaging. The alteration consisted in linearly changing the voxel intensity of either one (monoregion) or two (biregion) anatomical regions in each brain volume, but without mimicking any neuropathology. Performing ten-fold cross-validation and using a hold-out set for testing, we assessed the CNNs' discrimination ability according to the intensity of the altered regions, comparing the latter's size and relative position. Monoregion CNNs showed that the larger the modified region, the smaller the intensity increase needed to achieve good performances. Biregion CNNs systematically outperformed monoregion CNNs, but could only detect one of the two target regions when tested on the corresponding monoregion images. Exploiting prior information on training data allowed for a better understanding of CNN behavior, especially when altered regions were combined. This can inform about the complexity of CNN pattern retrieval and elucidate misclassified examples, particularly relevant for pathological data. The proposed analytical approach may serve to gain insights into CNN behavior and guide the design of enhanced detection systems exploiting our prior knowledge.

The effect of head motion on brain age prediction using deep convolutional neural networks

Deep learning can be used effectively to predict participants' age from brain magnetic resonance imaging (MRI) data, and a growing body of evidence suggests that the difference between predicted and chronological age-referred to as brain-predicted age difference (brain-PAD)-is related to various neurological and neuropsychiatric disease states. A crucial aspect of the applicability of brain-PAD as a biomarker of individual brain health is whether and how brain-predicted age is affected by MR image artifacts commonly encountered in clinical settings. To investigate this issue, we trained and validated two different 3D convolutional neural network architectures (CNNs) from scratch and tested the models on a separate dataset consisting of motion-free and motion-corrupted T1-weighted MRI scans from the same participants, the quality of which were rated by neuroradiologists from a clinical diagnostic point of view. Our results revealed a systematic increase in brain-PAD with worsening image quality for both models. This effect was also observed for images that were deemed usable from a clinical perspective, with brains appearing older in medium than in good quality images. These findings were also supported by significant associations found between the brain-PAD and standard image quality metrics indicating larger brain-PAD for lower-quality images. Our results demonstrate a spurious effect of advanced brain aging as a result of head motion and underline the importance of controlling for image quality when using brain-predicted age based on structural neuroimaging data as a proxy measure for brain health.

Diagnosing schizophrenia using deep learning: Novel interpretation approaches and multi-site validation

Schizophrenia is a profound and enduring mental disorder that imposes significant negative impacts on individuals, their families, and society at large. The development of more accurate and objective diagnostic tools for schizophrenia can be expedited through the employment of deep learning (DL), that excels at deciphering complex hierarchical non-linear patterns. However, the limited interpretability of deep learning has eroded confidence in the model and restricted its clinical utility. At the same time, if the data source is only derived from a single center, the model's generalizability is difficult to test. To enhance the model's reliability and applicability, leave-one-center-out validation with a large and diverse sample from multiple centers is crucial. In this study, we utilized Nine different global centers to train and test the 3D Resnet model's generalizability, resulting in an 82% classification performance (area under the curve) on all datasets sourced from different countries, employing a leave-one-center-out-validation approach. Per our approximation of the feature significance of each region on the atlas, we identified marked differences in the thalamus, pallidum, and inferior frontal gyrus between individuals with schizophrenia and healthy controls, lending credence to prior research findings. At the same time, in order to translate the model's output into clinically applicable insights, the SHapley Additive exPlanations (SHAP) permutation explainer method with an anatomical atlas have been refined, thereby offering precise neuroanatomical and functional interpretations of different brain regions.

Autism spectrum disorders detection based on multi-task transformer neural network

Autism Spectrum Disorders (ASD) are neurodevelopmental disorders that cause people difficulties in social interaction and communication. Identifying ASD patients based on resting-state functional magnetic resonance imaging (rs-fMRI) data is a promising diagnostic tool, but challenging due to the complex and unclear etiology of autism. And it is difficult to effectively identify ASD patients with a single data source (single task). Therefore, to address this challenge, we propose a novel multi-task learning framework for ASD identification based on rs-fMRI data, which can leverage useful information from multiple related tasks to improve the generalization performance of the model. Meanwhile, we adopt an attention mechanism to extract ASD-related features from each rs-fMRI dataset, which can enhance the feature representation and interpretability of the model. The results show that our method outperforms state-of-the-art methods in terms of accuracy, sensitivity and specificity. This work provides a new perspective and solution for ASD identification based on rs-fMRI data using multi-task learning. It also demonstrates the potential and value of machine learning for advancing neuroscience research and clinical practice.

Multivariate brain-behaviour associations in psychiatric disorders

Mapping brain-behaviour associations is paramount to understand and treat psychiatric disorders. Standard approaches involve investigating the association between one brain and one behavioural variable (univariate) or multiple variables against one brain/behaviour feature ('single' multivariate). Recently, large multimodal datasets have propelled a new wave of studies that leverage on 'doubly' multivariate approaches capable of parsing the multifaceted nature of both brain and behaviour simultaneously. Within this movement, canonical correlation analysis (CCA) and partial least squares (PLS) emerge as the most popular techniques. Both seek to capture shared information between brain and behaviour in the form of latent variables. We provide an overview of these methods, review the literature in psychiatric disorders, and discuss the main challenges from a predictive modelling perspective. We identified 39 studies across four diagnostic groups: attention deficit and hyperactive disorder (ADHD, k = 4, N = 569), autism spectrum disorders (ASD, k = 6, N = 1731), major depressive disorder (MDD, k = 5, N = 938), psychosis spectrum disorders (PSD, k = 13, N = 1150) and one transdiagnostic group (TD, k = 11, N = 5731). Most studies (67%) used CCA and focused on the association between either brain morphology, resting-state functional connectivity or fractional anisotropy against symptoms and/or cognition. There were three main findings. First, most diagnoses shared a link between clinical/cognitive symptoms and two brain measures, namely frontal morphology/brain activity and white matter association fibres (tracts between cortical areas in the same hemisphere). Second, typically less investigated behavioural variables in multivariate models such as physical health (e.g., BMI, drug use) and clinical history (e.g., childhood trauma) were identified as important features. Finally, most studies were at risk of bias due to low sample size/feature ratio and/or in-sample testing only. We highlight the importance of carefully mitigating these sources of bias with an exemplar application of CCA.

Progress and trends in neurological disorders research based on deep learning

In recent years, deep learning (DL) has emerged as a powerful tool in clinical imaging, offering unprecedented opportunities for the diagnosis and treatment of neurological disorders (NDs). This comprehensive review explores the multifaceted role of DL techniques in leveraging vast datasets to advance our understanding of NDs and improve clinical outcomes. Beginning with a systematic literature review, we delve into the utilization of DL, particularly focusing on multimodal neuroimaging data analysis-a domain that has witnessed rapid progress and garnered significant scientific interest. Our study categorizes and critically analyses numerous DL models, including Convolutional Neural Networks (CNNs), LSTM-CNN, GAN, and VGG, to understand their performance across different types of Neurology Diseases. Through particular analysis, we identify key benchmarks and datasets utilized in training and testing DL models, shedding light on the challenges and opportunities in clinical neuroimaging research. Moreover, we discuss the effectiveness of DL in real-world clinical scenarios, emphasizing its potential to revolutionize ND diagnosis and therapy. By synthesizing existing literature and describing future directions, this review not only provides insights into the current state of DL applications in ND analysis but also covers the way for the development of more efficient and accessible DL techniques. Finally, our findings underscore the transformative impact of DL in reshaping the landscape of clinical neuroimaging, offering hope for enhanced patient care and groundbreaking discoveries in the field of neurology. This review paper is beneficial for neuropathologists and new researchers in this field.

Aberrant concordance among dynamics of spontaneous brain activity in patients with migraine without aura: A multivariate pattern analysis study

Background

Alterations in the static and dynamic characteristics of spontaneous brain activity have been extensively studied to investigate functional brain changes in migraine without aura (MwoA). However, alterations in concordance among the dynamics of spontaneous brain activity in MwoA remain largely unknown. This study aimed to determine the possibilities of diagnosis based on the concordance indices.

Methods

Resting-state functional MRI scans were performed on 32 patients with MwoA and 33 matched healthy controls (HCs) in the first cohort, as well as 36 patients with MwoA and 32 HCs in the validation cohort. The dynamic indices including fractional amplitude of low-frequency fluctuation, regional homogeneity, voxel-mirrored homotopic connectivity, degree centrality and global signal connectivity were analyzed. We calculated the concordance of grey matter volume-wise (across voxels) and voxel-wise (across time windows) to quantify the degree of integration among different functional levels represented by these dynamic indices. Subsequently, the voxel-wise concordance alterations were analyzed as features for multi-voxel pattern analysis (MVPA) utilizing the support vector machine.

Results

Compared with that of HCs, patients with MwoA had lower whole-grey matter volume-wise concordance, and the mean value of volume-wise concordance was negatively correlated with the frequency of migraine attacks. The MVPA results revealed that the most discriminative brain regions were the right thalamus, right cerebellar Crus II, left insula, left precentral gyrus, right cuneus, and left inferior occipital gyrus.

Conclusions

Concordance alterations in the dynamics of spontaneous brain activity in brain regions could be an important feature in the identification of patients with MwoA.

The Role of AI in Hospitals and Clinics: Transforming Healthcare in the 21st Century

As healthcare systems around the world face challenges such as escalating costs, limited access, and growing demand for personalized care, artificial intelligence (AI) is emerging as a key force for transformation. This review is motivated by the urgent need to harness AI's potential to mitigate these issues and aims to critically assess AI's integration in different healthcare domains. We explore how AI empowers clinical decision-making, optimizes hospital operation and management, refines medical image analysis, and revolutionizes patient care and monitoring through AI-powered wearables. Through several case studies, we review how AI has transformed specific healthcare domains and discuss the remaining challenges and possible solutions. Additionally, we will discuss methodologies for assessing AI healthcare solutions, ethical challenges of AI deployment, and the importance of data privacy and bias mitigation for responsible technology use. By presenting a critical assessment of AI's transformative potential, this review equips researchers with a deeper understanding of AI's current and future impact on healthcare. It encourages an interdisciplinary dialogue between researchers, clinicians, and technologists to navigate the complexities of AI implementation, fostering the development of AI-driven solutions that prioritize ethical standards, equity, and a patient-centered approach.

Classification of Mild Cognitive Impairment Using Functional Near-Infrared Spectroscopy-Derived Biomarkers With Convolutional Neural Networks

OBJECTIVE

To date, early detection of mild cognitive impairment (MCI) has mainly depended on paper-based neuropsychological assessments. Recently, biomarkers for MCI detection have gained a lot of attention because of the low sensitivity of neuropsychological assessments. This study proposed the functional near-infrared spectroscopy (fNIRS)-derived data with convolutional neural networks (CNNs) to identify MCI.

METHODS

Eighty-two subjects with MCI and 148 healthy controls (HC) performed the 2-back task, and their oxygenated hemoglobin (HbO2) changes in the prefrontal cortex (PFC) were recorded during the task. The CNN model based on fNIRS-derived spatial features with HbO2 slope within time windows was trained to classify MCI. Thereafter, the 5-fold cross-validation approach was used to evaluate the performance of the CNN model.

RESULTS

Significant differences in averaged HbO2 values between MCI and HC groups were found, and the CNN model could better discriminate MCI with over 89.57% accuracy than the Korean version of the Montreal Cognitive Assessment (MoCA) (89.57%). Specifically, the CNN model based on HbO2 slope within the time window of 20-60 seconds from the left PFC (96.09%) achieved the highest accuracy.

CONCLUSION

These findings suggest that the fNIRS-derived spatial features with CNNs could be a promising way for early detection of MCI as a surrogate for a conventional screening tool and demonstrate the superiority of the fNIRS-derived spatial features with CNNs to the MoCA.

Imaging-based deep learning in kidney diseases: recent progress and future prospects

Kidney diseases result from various causes, which can generally be divided into neoplastic and non-neoplastic diseases. Deep learning based on medical imaging is an established methodology for further data mining and an evolving field of expertise, which provides the possibility for precise management of kidney diseases. Recently, imaging-based deep learning has been widely applied to many clinical scenarios of kidney diseases including organ segmentation, lesion detection, differential diagnosis, surgical planning, and prognosis prediction, which can provide support for disease diagnosis and management. In this review, we will introduce the basic methodology of imaging-based deep learning and its recent clinical applications in neoplastic and non-neoplastic kidney diseases. Additionally, we further discuss its current challenges and future prospects and conclude that achieving data balance, addressing heterogeneity, and managing data size remain challenges for imaging-based deep learning. Meanwhile, the interpretability of algorithms, ethical risks, and barriers of bias assessment are also issues that require consideration in future development. We hope to provide urologists, nephrologists, and radiologists with clear ideas about imaging-based deep learning and reveal its great potential in clinical practice.Critical relevance statement The wide clinical applications of imaging-based deep learning in kidney diseases can help doctors to diagnose, treat, and manage patients with neoplastic or non-neoplastic renal diseases.Key points• Imaging-based deep learning is widely applied to neoplastic and non-neoplastic renal diseases.• Imaging-based deep learning improves the accuracy of the delineation, diagnosis, and evaluation of kidney diseases.• The small dataset, various lesion sizes, and so on are still challenges for deep learning.

The application of machine learning on brain imaging features of different narcolepsy subtypes

STUDY OBJECTIVES

Narcolepsy is a central hypersomnia disorder, and differential diagnoses between its subtypes can be difficult. Hence, we applied machine learning to analyze the positron emission tomography (PET) data of patients with type 1 or type 2 narcolepsy, and patients with type 1 narcolepsy and comorbid schizophrenia, to construct predictive models to facilitate the diagnosis.

METHODS

This is a retrospective and prospective case-control study of adolescent and young adult patients with type 1 or type 2 narcolepsy, and type 1 narcolepsy and comorbid schizophrenia. All participants received 18-F-fluorodeoxy glucose PET, sleep studies, neurocognitive tests, sleep questionnaires, and human leukocyte antigen typing. The collected PET data were analyzed by feature selections and classification methods in machine learning to construct predictive models.

RESULTS

A total of 314 participants with narcolepsy were enrolled; 204 had type 1 narcolepsy, 90 had type 2 narcolepsy, and 20 had type 1 narcolepsy and comorbid schizophrenia. We used three filter methods for feature selection followed by a comparative analysis of classification methods. To apply a small number of regions of interest (ROI) and high classification accuracy, the Naïve Bayes classifier with the Term Variance as feature selection achieved the goal with only three ROIs (left basal ganglia, left Heschl, and left striatum) and produced an accuracy of higher than 99%.

CONCLUSIONS

The accuracy of our predictive model of PET data are promising and can aid clinicians in the diagnosis of narcolepsy subtypes. Future research with a larger sample size could further refine the predictive model of narcolepsy.

A primer on the use of machine learning to distil knowledge from data in biological psychiatry

Applications of machine learning in the biomedical sciences are growing rapidly. This growth has been spurred by diverse cross-institutional and interdisciplinary collaborations, public availability of large datasets, an increase in the accessibility of analytic routines, and the availability of powerful computing resources. With this increased access and exposure to machine learning comes a responsibility for education and a deeper understanding of its bases and bounds, borne equally by data scientists seeking to ply their analytic wares in medical research and by biomedical scientists seeking to harness such methods to glean knowledge from data. This article provides an accessible and critical review of machine learning for a biomedically informed audience, as well as its applications in psychiatry. The review covers definitions and expositions of commonly used machine learning methods, and historical trends of their use in psychiatry. We also provide a set of standards, namely Guidelines for REporting Machine Learning Investigations in Neuropsychiatry (GREMLIN), for designing and reporting studies that use machine learning as a primary data-analysis approach. Lastly, we propose the establishment of the Machine Learning in Psychiatry (MLPsych) Consortium, enumerate its objectives, and identify areas of opportunity for future applications of machine learning in biological psychiatry. This review serves as a cautiously optimistic primer on machine learning for those on the precipice as they prepare to dive into the field, either as methodological practitioners or well-informed consumers.

Performance reserves in brain-imaging-based phenotype prediction

This study examines the impact of sample size on predicting cognitive and mental health phenotypes from brain imaging via machine learning. Our analysis shows a 3- to 9-fold improvement in prediction performance when sample size increases from 1,000 to 1 M participants. However, despite this increase, the data suggest that prediction accuracy remains worryingly low and far from fully exploiting the predictive potential of brain imaging data. Additionally, we find that integrating multiple imaging modalities boosts prediction accuracy, often equivalent to doubling the sample size. Interestingly, the most informative imaging modality often varied with increasing sample size, emphasizing the need to consider multiple modalities. Despite significant performance reserves for phenotype prediction, achieving substantial improvements may necessitate prohibitively large sample sizes, thus casting doubt on the practical or clinical utility of machine learning in some areas of neuroimaging.

Deep learning-based multimodality classification of chronic mild traumatic brain injury using resting-state functional MRI and PET imaging

Mild traumatic brain injury (mTBI) is a public health concern. The present study aimed to develop an automatic classifier to distinguish between patients with chronic mTBI (n = 83) and healthy controls (HCs) (n = 40). Resting-state functional MRI (rs-fMRI) and positron emission tomography (PET) imaging were acquired from the subjects. We proposed a novel deep-learning-based framework, including an autoencoder (AE), to extract high-level latent and rectified linear unit (ReLU) and sigmoid activation functions. Single and multimodality algorithms integrating multiple rs-fMRI metrics and PET data were developed. We hypothesized that combining different imaging modalities provides complementary information and improves classification performance. Additionally, a novel data interpretation approach was utilized to identify top-performing features learned by the AEs. Our method delivered a classification accuracy within the range of 79-91.67% for single neuroimaging modalities. However, the performance of classification improved to 95.83%, thereby employing the multimodality model. The models have identified several brain regions located in the default mode network, sensorimotor network, visual cortex, cerebellum, and limbic system as the most discriminative features. We suggest that this approach could be extended to the objective biomarkers predicting mTBI in clinical settings.

A lightweight mixup-based short texts clustering for contrastive learning

Traditional text clustering based on distance struggles to distinguish between overlapping representations in medical data. By incorporating contrastive learning, the feature space can be optimized and applies mixup implicitly during the data augmentation phase to reduce computational burden. Medical case text is prevalent in everyday life, and clustering is a fundamental method of identifying major categories of conditions within vast amounts of unlabeled text. Learning meaningful clustering scores in data relating to rare diseases is difficult due to their unique sparsity. To address this issue, we propose a contrastive clustering method based on mixup, which involves selecting a small batch of data to simulate the experimental environment of rare diseases. The contrastive learning module optimizes the feature space based on the fact that positive pairs share negative samples, and clustering is employed to group data with comparable semantic features. The module mitigates the issue of overlap in data, whilst mixup generates cost-effective virtual features, resulting in superior experiment scores even when using small batch data and reducing resource usage and time overhead. Our suggested technique has acquired cutting-edge outcomes and embodies a favorable strategy for unmonitored text clustering.

Unveiling New Strategies Facilitating the Implementation of Artificial Intelligence in Neuroimaging for the Early Detection of Alzheimer's Disease

Alzheimer's disease (AD) is a chronic neurodegenerative disorder with a global impact. The past few decades have witnessed significant strides in comprehending the underlying pathophysiological mechanisms and developing diagnostic methodologies for AD, such as neuroimaging approaches. Neuroimaging techniques, including positron emission tomography and magnetic resonance imaging, have revolutionized the field by providing valuable insights into the structural and functional alterations in the brains of individuals with AD. These imaging modalities enable the detection of early biomarkers such as amyloid-β plaques and tau protein tangles, facilitating early and precise diagnosis. Furthermore, the emerging technologies encompassing blood-based biomarkers and neurochemical profiling exhibit promising results in the identification of specific molecular signatures for AD. The integration of machine learning algorithms and artificial intelligence has enhanced the predictive capacity of these diagnostic tools when analyzing complex datasets. In this review article, we will highlight not only some of the most used diagnostic imaging approaches in neurodegeneration research but focus much more on new tools like artificial intelligence, emphasizing their application in the realm of AD. These advancements hold immense potential for early detection and intervention, thereby paving the way for personalized therapeutic strategies and ultimately augmenting the quality of life for individuals affected by AD.

Decoding fMRI data with support vector machines and deep neural networks

BACKGROUND

Multivoxel pattern analysis (MVPA) examines fMRI activation patterns associated with different cognitive conditions. Support vector machines (SVMs) are the predominant method in MVPA. While SVM is intuitive and easy to apply, it is mainly suitable for analyzing data that are linearly separable. Convolutional neural networks (CNNs) are known to have the ability to approximate nonlinear relationships. Applications of CNN to fMRI data are beginning to appear with increasing frequency, but our understanding of the similarities and differences between CNN models and SVM models is limited.

NEW METHOD

We compared the two methods when they are applied to the same datasets. Two datasets were considered: (1) fMRI data collected from participants during a cued visual spatial attention task and (2) fMRI data collected from participants viewing natural images containing varying degrees of affective content.

RESULTS

We found that (1) both SVM and CNN are able to achieve above-chance decoding accuracies for attention control and emotion processing in both the primary visual cortex and the whole brain, (2) the CNN decoding accuracies are consistently higher than that of the SVM, (3) the SVM and CNN decoding accuracies are generally not correlated, and (4) the heatmaps derived from SVM and CNN are not significantly overlapping.

COMPARISON WITH EXISTING METHODS

By comparing SVM and CNN we pointed out the similarities and differences between the two methods.

CONCLUSIONS

SVM and CNN rely on different neural features for classification. Applying both to the same data may yield a more comprehensive understanding of neuroimaging data.

Predicting suicidality in late-life depression by 3D convolutional neural network and cross-sample entropy analysis of resting-state fMRI

BACKGROUND

Predicting suicide is a pressing issue among older adults; however, predicting its risk is difficult. Capitalizing on the recent development of machine learning, considerable progress has been made in predicting complex behavior such as suicide. As depression remained the strongest risk for suicide, we aimed to apply deep learning algorithms to identify suicidality in a group with late-life depression (LLD).

METHODS

We enrolled 83 patients with LLD, 35 of which were non-suicidal and 48 were suicidal, including 26 with only suicidal ideation and 22 with past suicide attempts, for resting-state functional magnetic resonance imaging (MRI). Cross-sample entropy (CSE) analysis was conducted to examine the complexity of MRI signals among brain regions. Three-dimensional (3D) convolutional neural networks (CNNs) were used, and the classification accuracy in each brain region was averaged to predict suicidality after sixfold cross-validation.

RESULTS

We found brain regions with a mean accuracy above 75% to predict suicidality located mostly in default mode, fronto-parietal, and cingulo-opercular resting-state networks. The models with right amygdala and left caudate provided the most reliable accuracy in all cross-validation folds, indicating their neurobiological importance in late-life suicide.

CONCLUSION

Combining CSE analysis and the 3D CNN, several brain regions were found to be associated with suicidality.

A hybrid spatiotemporal deep belief network and sparse representation-based framework reveals multilevel core functional components in decoding multitask fMRI signals

Decoding human brain activity on various task-based functional brain imaging data is of great significance for uncovering the functioning mechanism of the human mind. Currently, most feature extraction model-based methods for brain state decoding are shallow machine learning models, which may struggle to capture complex and precise spatiotemporal patterns of brain activity from the highly noisy fMRI raw data. Moreover, although decoding models based on deep learning methods benefit from their multilayer structure that could extract spatiotemporal features at multiscale, the relatively large populations of fMRI datasets are indispensable, and the explainability of their results is elusive. To address the above problems, we proposed a computational framework based on hybrid spatiotemporal deep belief network and sparse representations to differentiate multitask fMRI (tfMRI) signals. Using a relatively small cohort of tfMRI data as a test bed, our framework can achieve an average classification accuracy of 97.86% and define the multilevel temporal and spatial patterns of multiple cognitive tasks. Intriguingly, our model can characterize the key components for differentiating the multitask fMRI signals. Overall, the proposed framework can identify the interpretable and discriminative fMRI composition patterns at multiple scales, offering an effective methodology for basic neuroscience and clinical research with relatively small cohorts.

Automatic diagnosis of schizophrenia and attention deficit hyperactivity disorder in rs-fMRI modality using convolutional autoencoder model and interval type-2 fuzzy regression

Nowadays, many people worldwide suffer from brain disorders, and their health is in danger. So far, numerous methods have been proposed for the diagnosis of Schizophrenia (SZ) and attention deficit hyperactivity disorder (ADHD), among which functional magnetic resonance imaging (fMRI) modalities are known as a popular method among physicians. This paper presents an SZ and ADHD intelligent detection method of resting-state fMRI (rs-fMRI) modality using a new deep learning method. The University of California Los Angeles dataset, which contains the rs-fMRI modalities of SZ and ADHD patients, has been used for experiments. The FMRIB software library toolbox first performed preprocessing on rs-fMRI data. Then, a convolutional Autoencoder model with the proposed number of layers is used to extract features from rs-fMRI data. In the classification step, a new fuzzy method called interval type-2 fuzzy regression (IT2FR) is introduced and then optimized by genetic algorithm, particle swarm optimization, and gray wolf optimization (GWO) techniques. Also, the results of IT2FR methods are compared with multilayer perceptron, k-nearest neighbors, support vector machine, random forest, and decision tree, and adaptive neuro-fuzzy inference system methods. The experiment results show that the IT2FR method with the GWO optimization algorithm has achieved satisfactory results compared to other classifier methods. Finally, the proposed classification technique was able to provide 72.71% accuracy.

A systematic review on automated clinical depression diagnosis

Assessing mental health disorders and determining treatment can be difficult for a number of reasons, including access to healthcare providers. Assessments and treatments may not be continuous and can be limited by the unpredictable nature of psychiatric symptoms. Machine-learning models using data collected in a clinical setting can improve diagnosis and treatment. Studies have used speech, text, and facial expression analysis to identify depression. Still, more research is needed to address challenges such as the need for multimodality machine-learning models for clinical use. We conducted a review of studies from the past decade that utilized speech, text, and facial expression analysis to detect depression, as defined by the Diagnostic and Statistical Manual of Mental Disorders (DSM-5), using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guideline. We provide information on the number of participants, techniques used to assess clinical outcomes, speech-eliciting tasks, machine-learning algorithms, metrics, and other important discoveries for each study. A total of 544 studies were examined, 264 of which satisfied the inclusion criteria. A database has been created containing the query results and a summary of how different features are used to detect depression. While machine learning shows its potential to enhance mental health disorder evaluations, some obstacles must be overcome, especially the requirement for more transparent machine-learning models for clinical purposes. Considering the variety of datasets, feature extraction techniques, and metrics used in this field, guidelines have been provided to collect data and train machine-learning models to guarantee reproducibility and generalizability across different contexts.

Applications of machine learning and deep learning in SPECT and PET imaging: General overview, challenges and future prospects

The integration of positron emission tomography (PET) and single-photon emission computed tomography (SPECT) imaging techniques with machine learning (ML) algorithms, including deep learning (DL) models, is a promising approach. This integration enhances the precision and efficiency of current diagnostic and treatment strategies while offering invaluable insights into disease mechanisms. In this comprehensive review, we delve into the transformative impact of ML and DL in this domain. Firstly, a brief analysis is provided of how these algorithms have evolved and which are the most widely applied in this domain. Their different potential applications in nuclear imaging are then discussed, such as optimization of image adquisition or reconstruction, biomarkers identification, multimodal fusion and the development of diagnostic, prognostic, and disease progression evaluation systems. This is because they are able to analyse complex patterns and relationships within imaging data, as well as extracting quantitative and objective measures. Furthermore, we discuss the challenges in implementation, such as data standardization and limited sample sizes, and explore the clinical opportunities and future horizons, including data augmentation and explainable AI. Together, these factors are propelling the continuous advancement of more robust, transparent, and reliable systems.

Altered effective connectivity from cerebellum to motor cortex in chronic low back pain: A multivariate pattern analysis and spectral dynamic causal modeling study

To explore the central processing mechanism of pain perception in chronic low back pain (cLBP) using multi-voxel pattern analysis (MVPA) based on the static and dynamic fractional amplitude of low-frequency fluctuations (fALFF) analysis, and spectral dynamic causal modeling (spDCM). Thirty-two patients with cLBP and 29 matched healthy controls (HCs) for the first cohort and 24 patients with cLBP and 22 HCs for the validation cohort underwent resting-state fMRI scan. The alterations in static and dynamic fALFF were as classification features to distinguish patients with cLBP from HCs. The brain regions gotten from the MVPA results were used for further spDCM analysis. We found that the most discriminative brain regions that contributed to the classification were the right supplementary motor area (SMA.R), left paracentral lobule (PCL.L), and bilateral cerebellar Crus II. The spDCM results displayed decreased excitatory influence from the bilateral cerebellar Crus II to PCL.L in patients with cLBP compared with HCs. Moreover, the conversion of effective connectivity from the bilateral cerebellar Crus II to SMA.R from excitatory influence to inhibitive influence, and the effective connectivity strength exhibited partially mediated effects on Chinese Short Form Oswestry Disability Index Questionnaire (C-SFODI) scores. Our findings suggest that the cerebellum and its weakened or inhibited connections to the motor cortex may be one of the underlying feedback pathways for pain perception in cLBP, and partially mediate the degree of dysfunction.

Interpretable speech features vs. DNN embeddings: What to use in the automatic assessment of Parkinson's disease in multi-lingual scenarios

Speech-based approaches for assessing Parkinson's Disease (PD) often rely on feature extraction for automatic classification or detection. While many studies prioritize accuracy by using non-interpretable embeddings from Deep Neural Networks, this work aims to explore the predictive capabilities and language robustness of both feature types in a systematic fashion. As interpretable features, prosodic, linguistic, and cognitive descriptors were adopted, while x-vectors, Wav2Vec 2.0, HuBERT, and TRILLsson representations were used as non-interpretable features. Mono-lingual, multi-lingual, and cross-lingual machine learning experiments were conducted leveraging six data sets comprising speech recordings from various languages: American English, Castilian Spanish, Colombian Spanish, Italian, German, and Czech. For interpretable feature-based models, the mean of the best F1-scores obtained from each language was 81% in mono-lingual, 81% in multi-lingual, and 71% in cross-lingual experiments. For non-interpretable feature-based models, instead, they were 85% in mono-lingual, 88% in multi-lingual, and 79% in cross-lingual experiments. Firstly, models based on non-interpretable features outperformed interpretable ones, especially in cross-lingual experiments. Specifically, TRILLsson provided the most stable and accurate results across tasks and data sets. Conversely, the two types of features adopted showed some level of language robustness in multi-lingual and cross-lingual experiments. Overall, these results suggest that interpretable feature-based models can be used by clinicians to evaluate the deterioration of the speech of patients with PD, while non-interpretable feature-based models can be leveraged to achieve higher detection accuracy.

Artificial Intelligence in Neuroradiology: A Review of Current Topics and Competition Challenges

There is an expanding body of literature that describes the application of deep learning and other machine learning and artificial intelligence methods with potential relevance to neuroradiology practice. In this article, we performed a literature review to identify recent developments on the topics of artificial intelligence in neuroradiology, with particular emphasis on large datasets and large-scale algorithm assessments, such as those used in imaging AI competition challenges. Numerous applications relevant to ischemic stroke, intracranial hemorrhage, brain tumors, demyelinating disease, and neurodegenerative/neurocognitive disorders were discussed. The potential applications of these methods to spinal fractures, scoliosis grading, head and neck oncology, and vascular imaging were also reviewed. The AI applications examined perform a variety of tasks, including localization, segmentation, longitudinal monitoring, diagnostic classification, and prognostication. While research on this topic is ongoing, several applications have been cleared for clinical use and have the potential to augment the accuracy or efficiency of neuroradiologists.

A meta-analysis and systematic review of single vs. multimodal neuroimaging techniques in the classification of psychosis

BACKGROUND

Psychotic disorders are characterized by structural and functional abnormalities in brain networks. Neuroimaging techniques map and characterize such abnormalities using unique features (e.g., structural integrity, coactivation). However, it is unclear if a specific method, or a combination of modalities, is particularly effective in identifying differences in brain networks of someone with a psychotic disorder.

METHODS

A systematic meta-analysis evaluated machine learning classification of schizophrenia spectrum disorders in comparison to healthy control participants using various neuroimaging modalities (i.e., T1-weighted imaging (T1), diffusion tensor imaging (DTI), resting state functional connectivity (rs-FC), or some combination (multimodal)). Criteria for manuscript inclusion included whole-brain analyses and cross-validation to provide a complete picture regarding the predictive ability of large-scale brain systems in psychosis. For this meta-analysis, we searched Ovid MEDLINE, PubMed, PsychInfo, Google Scholar, and Web of Science published between inception and March 13th 2023. Prediction results were averaged for studies using the same dataset, but parallel analyses were run that included studies with pooled sample across many datasets. We assessed bias through funnel plot asymmetry. A bivariate regression model determined whether differences in imaging modality, demographics, and preprocessing methods moderated classification. Separate models were run for studies with internal prediction (via cross-validation) and external prediction.

RESULTS

93 studies were identified for quantitative review (30 T1, 9 DTI, 40 rs-FC, and 14 multimodal). As a whole, all modalities reliably differentiated those with schizophrenia spectrum disorders from controls (OR = 2.64 (95%CI = 2.33 to 2.95)). However, classification was relatively similar across modalities: no differences were seen across modalities in the classification of independent internal data, and a small advantage was seen for rs-FC studies relative to T1 studies in classification in external datasets. We found large amounts of heterogeneity across results resulting in significant signs of bias in funnel plots and Egger's tests. Results remained similar, however, when studies were restricted to those with less heterogeneity, with continued small advantages for rs-FC relative to structural measures. Notably, in all cases, no significant differences were seen between multimodal and unimodal approaches, with rs-FC and unimodal studies reporting largely overlapping classification performance. Differences in demographics and analysis or denoising were not associated with changes in classification scores.

CONCLUSIONS

The results of this study suggest that neuroimaging approaches have promise in the classification of psychosis. Interestingly, at present most modalities perform similarly in the classification of psychosis, with slight advantages for rs-FC relative to structural modalities in some specific cases. Notably, results differed substantially across studies, with suggestions of biased effect sizes, particularly highlighting the need for more studies using external prediction and large sample sizes. Adopting more rigorous and systematized standards will add significant value toward understanding and treating this critical population.

Automatic brain MRI motion artifact detection based on end-to-end deep learning is similarly effective as traditional machine learning trained on image quality metrics

Head motion artifacts in magnetic resonance imaging (MRI) are an important confounding factor concerning brain research as well as clinical practice. For this reason, several machine learning-based methods have been developed for the automatic quality control of structural MRI scans. Deep learning offers a promising solution to this problem, however, given its data-hungry nature and the scarcity of expert-annotated datasets, its advantage over traditional machine learning methods in identifying motion-corrupted brain scans is yet to be determined. In the present study, we investigated the relative advantage of the two methods in structural MRI quality control. To this end, we collected publicly available T1-weighted images and scanned subjects in our own lab under conventional and active head motion conditions. The quality of the images was rated by a team of radiologists from the point of view of clinical diagnostic use. We present a relatively simple, lightweight 3D convolutional neural network trained in an end-to-end manner that achieved a test set (N = 411) balanced accuracy of 94.41% in classifying brain scans into clinically usable or unusable categories. A support vector machine trained on image quality metrics achieved a balanced accuracy of 88.44% on the same test set. Statistical comparison of the two models yielded no significant difference in terms of confusion matrices, error rates, or receiver operating characteristic curves. Our results suggest that these machine learning methods are similarly effective in identifying severe motion artifacts in brain MRI scans, and underline the efficacy of end-to-end deep learning-based systems in brain MRI quality control, allowing the rapid evaluation of diagnostic utility without the need for elaborate image pre-processing.

Advancing Patient Care: How Artificial Intelligence Is Transforming Healthcare

Artificial Intelligence (AI) has emerged as a transformative technology with immense potential in the field of medicine. By leveraging machine learning and deep learning, AI can assist in diagnosis, treatment selection, and patient monitoring, enabling more accurate and efficient healthcare delivery. The widespread implementation of AI in healthcare has the role to revolutionize patients' outcomes and transform the way healthcare is practiced, leading to improved accessibility, affordability, and quality of care. This article explores the diverse applications and reviews the current state of AI adoption in healthcare. It concludes by emphasizing the need for collaboration between physicians and technology experts to harness the full potential of AI.

Brain morphometric features predict medication response in youth with bipolar disorder: a prospective randomized clinical trial

BACKGROUND

Identification of treatment-specific predictors of drug therapies for bipolar disorder (BD) is important because only about half of individuals respond to any specific medication. However, medication response in pediatric BD is variable and not well predicted by clinical characteristics.

METHODS

A total of 121 youth with early course BD (acute manic/mixed episode) were prospectively recruited and randomized to 6 weeks of double-blind treatment with quetiapine (n = 71) or lithium (n = 50). Participants completed structural magnetic resonance imaging (MRI) at baseline before treatment and 1 week after treatment initiation, and brain morphometric features were extracted for each individual based on MRI scans. Positive antimanic treatment response at week 6 was defined as an over 50% reduction of Young Mania Rating Scale scores from baseline. Two-stage deep learning prediction model was established to distinguish responders and non-responders based on different feature sets.

RESULTS

Pre-treatment morphometry and morphometric changes occurring during the first week can both independently predict treatment outcome of quetiapine and lithium with balanced accuracy over 75% (all p < 0.05). Combining brain morphometry at baseline and week 1 allows prediction with the highest balanced accuracy (quetiapine: 83.2% and lithium: 83.5%). Predictions in the quetiapine and lithium group were found to be driven by different morphometric patterns.

CONCLUSIONS

These findings demonstrate that pre-treatment morphometric measures and acute brain morphometric changes can serve as medication response predictors in pediatric BD. Brain morphometric features may provide promising biomarkers for developing biologically-informed treatment outcome prediction and patient stratification tools for BD treatment development.

Decoding fMRI Data: A Comparison Between Support Vector Machines and Deep Neural Networks

Multivoxel pattern analysis (MVPA) examines the differences in fMRI activation patterns associated with different cognitive conditions and provides information not possible with the conventional univariate analysis. Support vector machines (SVMs) are the predominant machine learning method in MVPA. SVMs are intuitive and easy to apply. The limitation is that it is a linear method and mainly suitable for analyzing data that are linearly separable. Convolutional neural networks (CNNs), a class of AI models originally developed for object recognition, are known to have the ability to approximate nonlinear relationships. CNNs are rapidly becoming an alternative to SVMs. The purpose of this study is to compare the two methods when they are applied to the same datasets. Two datasets were considered: (1) fMRI data collected from participants during a cued visual spatial attention task (the attention dataset) and (2) fMRI data collected from participants viewing natural images containing varying degrees of affective content (the emotion dataset). We found that (1) both SVM and CNN are able to achieve above chance level decoding accuracies for attention control and emotion processing in both the primary visual cortex and the whole brain with, (2) the CNN decoding accuracies are consistently higher than that of the SVM, (3) the SVM and CNN decoding accuracies are generally not correlated with each other, and (4) the heatmaps derived from SVM and CNN are not significantly overlapping. These results suggest that (1) there are both linearly separable features and nonlinearly separable features in fMRI data that distinguish cognitive conditions and (2) applying both SVM and CNN to the same data may yield a more comprehensive understanding of neuroimaging data.

Key points

We compared the performance and characteristics of SVM and CNN, two major methods in MVPA analysis of neuroimaging data, by applying them to the same two fMRI datasets.Both SVM and CNN achieved decoding accuracies above chance level for both datasets in the chosen ROIs and the CNN decoding accuracies were consistently higher than those of SVM.The heatmaps derived from SVM and CNN, which assess the contribution of voxels or brain regions to MVPA decoding performance, showed no significant overlap, providing evidence that the two methods depend on distinct brain activity patterns for decoding cognitive conditions.

Automated Medical Diagnosis of Alzheimer´s Disease Using an Efficient Net Convolutional Neural Network

Alzheimer's disease (AD) poses an enormous challenge to modern healthcare. Since 2017, researchers have been using deep learning (DL) models for the early detection of AD using neuroimaging biomarkers. In this paper, we implement the EfficietNet-b0 convolutional neural network (CNN) with a novel approach-"fusion of end-to-end and transfer learning"-to classify different stages of AD. 245 T1W MRI scans of cognitively normal (CN) subjects, 229 scans of AD subjects, and 229 scans of subjects with stable mild cognitive impairment (sMCI) were employed. Each scan was preprocessed using a standard pipeline. The proposed models were trained and evaluated using preprocessed scans. For the sMCI vs. AD classification task we obtained 95.29% accuracy and 95.35% area under the curve (AUC) for model training and 93.10% accuracy and 93.00% AUC for model testing. For the multiclass AD vs. CN vs. sMCI classification task we obtained 85.66% accuracy and 86% AUC for model training and 87.38% accuracy and 88.00% AUC for model testing. Based on our experimental results, we conclude that CNN-based DL models can be used to analyze complicated MRI scan features in clinical settings.

Prediction of suicidality in bipolar disorder using variability of intrinsic brain activity and machine learning

Bipolar disorder (BD) is associated with marked suicidal susceptibility, particularly during a major depressive episode. However, the evaluation of suicidal risk remains challenging since it relies mainly on self-reported information from patients. Hence, it is necessary to complement neuroimaging features with advanced machine learning techniques in order to predict suicidal behavior in BD patients. In this study, a total of 288 participants, including 75 BD suicide attempters, 101 BD nonattempters and 112 healthy controls, underwent a resting-state functional magnetic resonance imaging (rs-fMRI). Intrinsic brain activity was measured by amplitude of low-frequency fluctuation (ALFF). We trained and tested a two-level k-nearest neighbors (k-NN) model based on resting-state variability of ALFF with fivefold cross-validation. BD suicide attempters had increased dynamic ALFF values in the right anterior cingulate cortex, left thalamus and right precuneus. Compared to other machine learning methods, our proposed framework had a promising performance with 83.52% accuracy, 78.75% sensitivity and 87.50% specificity. The trained models could also replicate and validate the results in an independent cohort with 72.72% accuracy. These findings based on a relatively large data set, provide a promising way of combining fMRI data with machine learning technique to reliably predict suicide attempt at an individual level in bipolar depression. Overall, this work might enhance our understanding of the neurobiology of suicidal behavior by detecting clinically defined disruptions in the dynamics of instinct brain activity.

Neural network algorithms predict new diffusion MRI data for multi-compartmental analysis of brain microstructure in a clinical setting

High angular resolution diffusion imaging (HARDI) is a promising method for advanced analysis of brain microstructure. However, comprehensive HARDI analysis requires multiple acquisitions of diffusion images (multi-shell HARDI), which is time consuming and often impractical in clinical settings. This study aimed to establish neural network models that can predict new diffusion datasets from clinically feasible brain diffusion MRI for multi-shell HARDI. The development included 2 algorithms: multi-layer perceptron (MLP) and convolutional neural network (CNN). Both followed a voxel-based approach for model training (70%), validation (15%), and testing (15%). The investigations involved 2 multi-shell HARDI datasets: 1) 11 healthy subjects from the Human Connectome Project (HCP); and 2) 10 local subjects with multiple sclerosis (MS). To assess outcomes, we conducted neurite orientation dispersion and density imaging using both predicted and original data and compared their orientation dispersion index (ODI) and neurite density index (NDI) in different brain tissues with 2 measures: peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM). Results showed that both models achieved robust predictions, which provided competitive ODI and NDI, especially in brain white matter. The CNN outperformed MLP with the HCP data on both PSNR (p < 0.001) and SSIM (p < 0.01). With the MS data, the models performed similarly. Overall, the optimized neural networks can help generate non-acquired brain diffusion MRI, which will make advanced HARDI analysis possible in clinical practice following further validation. Enabling detailed characterization of brain microstructure will allow enhanced understanding of brain function in both health and disease.

Predicting sex, age, general cognition and mental health with machine learning on brain structural connectomes

There is an increasing expectation that advanced, computationally expensive machine learning (ML) techniques, when applied to large population-wide neuroimaging datasets, will help to uncover key differences in the human brain in health and disease. We take a comprehensive approach to explore how multiple aspects of brain structural connectivity can predict sex, age, general cognitive function and general psychopathology, testing different ML algorithms from deep learning (DL) model (BrainNetCNN) to classical ML methods. We modelled N = 8183 structural connectomes from UK Biobank using six different structural network weightings obtained from diffusion MRI. Streamline count generally provided the highest prediction accuracies in all prediction tasks. DL did not improve on prediction accuracies from simpler linear models. Further, high correlations between gradient attribution coefficients from DL and model coefficients from linear models suggested the models ranked the importance of features in similar ways, which indirectly suggested the similarity in models' strategies for making predictive decision to some extent. This highlights that model complexity is unlikely to improve detection of associations between structural connectomes and complex phenotypes with the current sample size.

Impacts of Daily Travel by Distances on the Spread of COVID-19: An Artificial Neural Network Model

The continued spread of COVID-19 poses significant threats to the safety of the community. Since it is still uncertain when the pandemic will end, it is vital to understand the factors contributing to new cases of COVID-19, especially from the transportation perspective. This paper examines the effect of the United States residents’ daily trips by distances on the spread of COVID-19 in the community. The artificial neural network method is used to construct and test the predictive model using data collected from two sources: Bureau of Transportation Statistics and the COVID-19 Tracking Project. The dataset uses ten daily travel variables by distances and new tests from March to September 2020, with a sample size of 10,914. The results indicate the importance of daily trips at different distances in predicting the spread of COVID-19. More specifically, trips shorter than 3 mi and trips between 250 and 500 mi contribute most to predicting daily new cases of COVID-19. Additionally, daily new tests and trips between 10 and 25 mi are among the variables with the lowest effects. This study’s findings can help governmental authorities evaluate the risk of COVID-19 infection based on residents’ daily travel behaviors and form necessary strategies to mitigate the risks. The developed neural network can be used to predict the infection rate and construct various scenarios for risk assessment and control.

Visual deep learning of unprocessed neuroimaging characterises dementia subtypes and generalises across non-stereotypic samples

BACKGROUND

Dementia's diagnostic protocols are mostly based on standardised neuroimaging data collected in the Global North from homogeneous samples. In other non-stereotypical samples (participants with diverse admixture, genetics, demographics, MRI signals, or cultural origins), classifications of disease are difficult due to demographic and region-specific sample heterogeneities, lower quality scanners, and non-harmonised pipelines.

METHODS

We implemented a fully automatic computer-vision classifier using deep learning neural networks. A DenseNet was applied on raw (unpreprocessed) data from 3000 participants (behavioural variant frontotemporal dementia-bvFTD, Alzheimer's disease-AD, and healthy controls; both male and female as self-reported by participants). We tested our results in demographically matched and unmatched samples to discard possible biases and performed multiple out-of-sample validations.

FINDINGS

Robust classification results across all groups were achieved from standardised 3T neuroimaging data from the Global North, which also generalised to standardised 3T neuroimaging data from Latin America. Moreover, DenseNet also generalised to non-standardised, routine 1.5T clinical images from Latin America. These generalisations were robust in samples with heterogenous MRI recordings and were not confounded by demographics (i.e., were robust in both matched and unmatched samples, and when incorporating demographic variables in a multifeatured model). Model interpretability analysis using occlusion sensitivity evidenced core pathophysiological regions for each disease (mainly the hippocampus in AD, and the insula in bvFTD) demonstrating biological specificity and plausibility.

INTERPRETATION

The generalisable approach outlined here could be used in the future to aid clinician decision-making in diverse samples.

FUNDING

The specific funding of this article is provided in the acknowledgements section.

A scoping review of neurodegenerative manifestations in explainable digital phenotyping

Neurologists nowadays no longer view neurodegenerative diseases, like Parkinson's and Alzheimer's disease, as single entities, but rather as a spectrum of multifaceted symptoms with heterogeneous progression courses and treatment responses. The definition of the naturalistic behavioral repertoire of early neurodegenerative manifestations is still elusive, impeding early diagnosis and intervention. Central to this view is the role of artificial intelligence (AI) in reinforcing the depth of phenotypic information, thereby supporting the paradigm shift to precision medicine and personalized healthcare. This suggestion advocates the definition of disease subtypes in a new biomarker-supported nosology framework, yet without empirical consensus on standardization, reliability and interpretability. Although the well-defined neurodegenerative processes, linked to a triad of motor and non-motor preclinical symptoms, are detected by clinical intuition, we undertake an unbiased data-driven approach to identify different patterns of neuropathology distribution based on the naturalistic behavior data inherent to populations in-the-wild. We appraise the role of remote technologies in the definition of digital phenotyping specific to brain-, body- and social-level neurodegenerative subtle symptoms, emphasizing inter- and intra-patient variability powered by deep learning. As such, the present review endeavors to exploit digital technologies and AI to create disease-specific phenotypic explanations, facilitating the understanding of neurodegenerative diseases as "bio-psycho-social" conditions. Not only does this translational effort within explainable digital phenotyping foster the understanding of disease-induced traits, but it also enhances diagnostic and, eventually, treatment personalization.

Machine learning approach for obstructive sleep apnea screening using brain diffusion tensor imaging

Patients with obstructive sleep apnea (OSA) show autonomic, mood, cognitive, and breathing dysfunctions that are linked to increased morbidity and mortality, which can be improved with early screening and intervention. The gold standard and other available methods for OSA diagnosis are complex, require whole-night data, and have significant wait periods that potentially delay intervention. Our aim was to examine whether using faster and less complicated machine learning models, including support vector machine (SVM) and random forest (RF), with brain diffusion tensor imaging (DTI) data can classify OSA from healthy controls. We collected two DTI series from 59 patients with OSA [age: 50.2 ± 9.9 years; body mass index (BMI): 31.5 ± 5.6 kg/m2 ; apnea-hypopnea index (AHI): 34.1 ± 21.2 events/h 23 female] and 96 controls (age: 51.8 ± 9.7 years; BMI: 26.2 ± 4.1 kg/m2 ; 51 female) using a 3.0-T magnetic resonance imaging scanner. Using DTI data, mean diffusivity maps were calculated from each series, realigned and averaged, normalised to a common space, and used to conduct cross-validation for model training and selection and to predict OSA. The RF model showed 0.73 OSA and controls classification accuracy and 0.85 area under the curve (AUC) value on the receiver-operator curve. Cross-validation showed the RF model with comparable fitting over SVM for OSA and control data (SVM; accuracy, 0.77; AUC, 0.84). The RF ML model performs similar to SVM, indicating the comparable statistical fitness to DTI data. The findings indicate that RF model has similar AUC and accuracy over SVM, and either model can be used as a faster OSA screening tool for subjects having brain DTI data.

Can Artificial Intelligence Diagnose Transient Global Amnesia Using Electroencephalography Data?

BACKGROUND AND PURPOSE

This study aimed to determine the ability of deep learning using convolutional neural networks (CNNs) to diagnose transient global amnesia (TGA) based on electroencephalography (EEG) data, and to differentiate between patients with recurrent TGA events and those with a single TGA event.

METHODS

We retrospectively enrolled newly diagnosed patients with TGA and healthy controls. All patients with TGA and the healthy controls underwent EEG. The EEG signals were converted into images using time-frequency analysis with short-time Fourier transforms. We employed two CNN models (AlexNet and VGG19) to classify the patients with TGA and the healthy controls, and for further classification of patients with recurrent TGA events and those with a single TGA event.

RESULTS

We enrolled 171 patients with TGA and 68 healthy controls. The accuracy and area under the curve (AUC) of the AlexNet and VGG19 models in classifying patients with TGA and healthy controls were 70.4% and 71.8%, and 0.718 and 0.743, respectively. In addition, the accuracy and AUC of the AlexNet and VGG19 models in classifying patients with recurrent TGA events and those with a single TGA event were 71.1% and 88.4%, and 0.773 and 0.873, respectively.

CONCLUSIONS

We have successfully demonstrated the feasibility of deep learning in diagnosing TGA based on EEG data, and used two different CNN models to distinguish between patients with recurrent TGA events and those with a single TGA event.

Discriminative patterns of white matter changes in Alzheimer's

Changes in structural connectivity of the Alzheimer's brain have not been widely studied utilizing cutting-edge methodologies. This study develops an efficient structural connectome-based convolutional neural network (CNN) to classify the AD and uses explanations of CNNs' choices in classification to pinpoint the discriminative changes in white matter connectivity in AD. A CNN architecture has been developed to classify normal control (NC) and AD subjects from the weighted structural connectome. Then, the CNN classification decision is visually analyzed using gradient-based localization techniques to identify the discriminative changes in white matter connectivity in Alzheimer's. The cortical regions involved in the identified discriminative structural connectivity changes in AD are highly covered in the temporal/subcortical regions. A specific pattern is identified in the discriminative changes in structural connectivity of AD, where the white matter changes are revealed within the temporal/subcortical regions and from the temporal/subcortical regions to the frontal and parietal regions in both left and right hemispheres.  The proposed approach has the potential to comprehensively analyze the discriminative structural connectivity differences in AD, change the way of detecting biomarkers, and help clinicians better understand the structural changes in AD and provide them with more confidence in automated diagnostic systems.

Towards greater neuroimaging classification transparency via the integration of explainability methods and confidence estimation approaches

The field of neuroimaging has increasingly sought to develop artificial intelligence-based models for neurological and neuropsychiatric disorder automated diagnosis and clinical decision support. However, if these models are to be implemented in a clinical setting, transparency will be vital. Two aspects of transparency are (1) confidence estimation and (2) explainability. Confidence estimation approaches indicate confidence in individual predictions. Explainability methods give insight into the importance of features to model predictions. In this study, we integrate confidence estimation and explainability approaches for the first time. We demonstrate their viability for schizophrenia diagnosis using resting state functional magnetic resonance imaging (rs-fMRI) dynamic functional network connectivity (dFNC) data. We compare two confidence estimation approaches: Monte Carlo dropout (MCD) and MC batch normalization (MCBN). We combine them with two gradient-based explainability approaches, saliency and layer-wise relevance propagation (LRP), and examine their effects upon explanations. We find that MCD often adversely affects model gradients, making it ill-suited for integration with gradient-based explainability methods. In contrast, MCBN does not affect model gradients. Additionally, we find many participant-level differences between regular explanations and the distributions of explanations for combined explainability and confidence estimation approaches. This suggests that a similar confidence estimation approach used in a clinical context with explanations only output for the regular model would likely not yield adequate explanations. We hope that our findings will provide a starting point for the integration of the two fields, provide useful guidance for future studies, and accelerate the development of transparent neuroimaging clinical decision support systems.

Framework for Accurate Classification of Self-Reported Stress From Multisession Functional MRI Data of Veterans With Posttraumatic Stress

Background: Posttraumatic stress disorder (PTSD) is a significant burden among combat Veterans returning from the wars in Iraq and Afghanistan. While empirically supported treatments have demonstrated reductions in PTSD symptomatology, there remains a need to improve treatment effectiveness. Functional magnetic resonance imaging (fMRI) neurofeedback has emerged as a possible treatment to ameliorate PTSD symptom severity. Virtual reality (VR) approaches have also shown promise in increasing treatment compliance and outcomes. To facilitate fMRI neurofeedback-associated therapies, it would be advantageous to accurately classify internal brain stress levels while Veterans are exposed to trauma-associated VR imagery. Methods: Across 2 sessions, we used fMRI to collect neural responses to trauma-associated VR-like stimuli among male combat Veterans with PTSD symptoms (N = 8). Veterans reported their self-perceived stress level on a scale from 1 to 8 every 15 s throughout the fMRI sessions. In our proposed framework, we precisely sample the fMRI data on cortical gray matter, blurring the data along the gray-matter manifold to reduce noise and dimensionality while preserving maximum neural information. Then, we independently applied 3 machine learning (ML) algorithms to this fMRI data collected across 2 sessions, separately for each Veteran, to build individualized ML models that predicted their internal brain states (self-reported stress responses). Results: We accurately classified the 8-class self-reported stress responses with a mean (± standard error) root mean square error of 0.6 (± 0.1) across all Veterans using the best ML approach. Conclusions: The findings demonstrate the predictive ability of ML algorithms applied to whole-brain cortical fMRI data collected during individual Veteran sessions. The framework we have developed to preprocess whole-brain cortical fMRI data and train ML models across sessions would provide a valuable tool to enable individualized real-time fMRI neurofeedback during VR-like exposure therapy for PTSD.

Normative model detects abnormal functional connectivity in psychiatric disorders

INTRODUCTION

The diagnosis of psychiatric disorders is mostly based on the clinical evaluation of the patient's signs and symptoms. Deep learning binary-based classification models have been developed to improve the diagnosis but have not yet reached clinical practice, in part due to the heterogeneity of such disorders. Here, we propose a normative model based on autoencoders.

METHODS

We trained our autoencoder on resting-state functional magnetic resonance imaging (rs-fMRI) data from healthy controls. The model was then tested on schizophrenia (SCZ), bipolar disorder (BD), and attention-deficit hyperactivity disorder (ADHD) patients to estimate how each patient deviated from the norm and associate it with abnormal functional brain networks' (FBNs) connectivity. Rs-fMRI data processing was conducted within the FMRIB Software Library (FSL), which included independent component analysis and dual regression. Pearson's correlation coefficients between the extracted blood oxygen level-dependent (BOLD) time series of all FBNs were calculated, and a correlation matrix was generated for each subject.

RESULTS AND DISCUSSION

We found that the functional connectivity related to the basal ganglia network seems to play an important role in the neuropathology of BD and SCZ, whereas in ADHD, its role is less evident. Moreover, the abnormal connectivity between the basal ganglia network and the language network is more specific to BD. The connectivity between the higher visual network and the right executive control and the connectivity between the anterior salience network and the precuneus networks are the most relevant in SCZ and ADHD, respectively. The results demonstrate that the proposed model could identify functional connectivity patterns that characterize different psychiatric disorders, in agreement with the literature. The abnormal connectivity patterns from the two independent SCZ groups of patients were similar, demonstrating that the presented normative model was also generalizable. However, the group-level differences did not withstand individual-level analysis implying that psychiatric disorders are highly heterogeneous. These findings suggest that a precision-based medical approach, focusing on each patient's specific functional network changes may be more beneficial than the traditional group-based diagnostic classification.

Recent advances in psychoradiology

Psychiatry, as a field, lacks objective markers for diagnosis, progression, treatment planning, and prognosis, in part due to difficulties studying the brain in vivo, and diagnoses are based on self-reported symptoms and observation of patient behavior and cognition. Rapid advances in brain imaging techniques allow clinical investigators to noninvasively quantify brain features at the structural, functional, and molecular levels. Psychoradiology is an emerging discipline at the intersection of psychiatry and radiology. Psychoradiology applies medical imaging technologies to psychiatry and promises not only to improve insight into structural and functional brain abnormalities in patients with psychiatric disorders but also to have potential clinical utility. We searched for representative studies related to recent advances in psychoradiology through May 1, 2022, and conducted a selective review of 165 references, including 75 research articles. We summarize the novel dynamic imaging processing methods to model brain networks and present imaging genetics studies that reveal the relationship between various neuroimaging endophenotypes and genetic markers in psychiatric disorders. Furthermore, we survey recent advances in psychoradiology, with a focus on future psychiatric diagnostic approaches with dimensional analysis and a shift from group-level to individualized analysis. Finally, we examine the application of machine learning in psychoradiology studies and the potential of a novel option for brain stimulation treatment based on psychoradiological findings in precision medicine. Here, we provide a summary of recent advances in psychoradiology research, and we hope this review will help guide the practice of psychoradiology in the scientific and clinical fields.

Predicting age from resting-state scalp EEG signals with deep convolutional neural networks on TD-brain dataset

Introduction

Brain age prediction has been shown to be clinically relevant, with errors in its prediction associated with various psychiatric and neurological conditions. While the prediction from structural and functional magnetic resonance imaging data has been feasible with high accuracy, whether the same results can be achieved with electroencephalography is unclear.

Methods

The current study aimed to create a new deep learning solution for brain age prediction using raw resting-state scalp EEG. To this end, we utilized the TD-BRAIN dataset, including 1,274 subjects (both healthy controls and individuals with various psychiatric disorders, with a total of 1,335 recording sessions). To achieve the best age prediction, we used data augmentation techniques to increase the diversity of the training set and developed a deep convolutional neural network model.

Results

The model's training was done with 10-fold cross-subject cross-validation, with the EEG recordings of the subjects used for training not considered to test the model. In training, using the relative rather than the absolute loss function led to a better mean absolute error of 5.96 years in cross-validation. We found that the best performance could be achieved when both eyes-open and eyes-closed states are used simultaneously. The frontocentral electrodes played the most important role in age prediction.

Discussion

The architecture and training method of the proposed deep convolutional neural networks (DCNN) improve state-of-the-art metrics in the age prediction task using raw resting-state EEG data by 13%. Given that brain age prediction might be a potential biomarker of numerous brain diseases, inexpensive and precise EEG-based estimation of brain age will be in demand for clinical practice.

Predicting the severity of internet gaming disorder with resting-state brain features: A multi-voxel pattern analysis

BACKGROUND

Internet gaming disorder (IGD) has become a worldwide mental health concern; however, the neural mechanism underlying this disorder remains unclear. Multivoxel pattern analysis (MVPA), a newly developed data-driven approach, can be used to investigate the neural features of IGD based on massive neural data.

METHODS

Resting-state fMRI data from four hundred and two participants with varying levels of IGD severity were recruited. Regional homogeneity (ReHo) and the amplitude of low-frequency fluctuation (ALFF) were calculated and subsequently decoded by applying MVPA. The highly weighted regions in both predictive models were selected as regions of interest for further graph theory and Granger causality analysis (GCA) to explore how they affect IGD severity.

RESULTS

The results revealed that the neural patterns of ReHo and ALFF can independently and significantly predict IGD severity. The highly weighted regions that contributed to both predictive models were the right precentral gyrus and left postcentral gyrus. Moreover, topological properties of the right precentral gyrus were significantly correlated with IGD severity; further GCA revealed effective connectivity from the right precentral gyrus to left precentral gyrus and dorsal anterior cingulate cortex, both of which were significantly associated with IGD severity.

CONCLUSIONS

The present study demonstrated that IGD has distinctive neural patterns, and this pattern could be found by machine learning. In addition, the neural features in the right precentral gyrus play a key role in predicting IGD severity. The current study revealed the neural features of IGD and provided a potential target for IGD interventions using brain modulation.