Sex classification from functional brain connectivity: Generalization to multiple datasets

Machine learning (ML) approaches are increasingly being applied to neuroimaging data. Studies in neuroscience typically have to rely on a limited set of training data which may impair the generalizability of ML models. However, it is still unclear which kind of training sample is best suited to optimize generalization performance. In the present study, we systematically investigated the generalization performance of sex classification models trained on the parcelwise connectivity profile of either single samples or compound samples of two different sizes. Generalization performance was quantified in terms of mean across-sample classification accuracy and spatial consistency of accurately classifying parcels. Our results indicate that the generalization performance of parcelwise classifiers (pwCs) trained on single dataset samples is dependent on the specific test samples. Certain datasets seem to "match" in the sense that classifiers trained on a sample from one dataset achieved a high accuracy when tested on the respected other one and vice versa. The pwCs trained on the compound samples demonstrated overall highest generalization performance for all test samples, including one derived from a dataset not included in building the training samples. Thus, our results indicate that both a large sample size and a heterogeneous data composition of a training sample have a central role in achieving generalizable results.

Enhancing Cognitive Performance Prediction through White Matter Hyperintensity Connectivity Assessment: A Multicenter Lesion Network Mapping Analysis of 3,485 Memory Clinic Patients

Introduction

White matter hyperintensities of presumed vascular origin (WMH) are associated with cognitive impairment and are a key imaging marker in evaluating cognitive health. However, WMH volume alone does not fully account for the extent of cognitive deficits and the mechanisms linking WMH to these deficits remain unclear. We propose that lesion network mapping (LNM), enables to infer if brain networks are connected to lesions, and could be a promising technique for enhancing our understanding of the role of WMH in cognitive disorders. Our study employed this approach to test the following hypotheses: (1) LNM-informed markers surpass WMH volumes in predicting cognitive performance, and (2) WMH contributing to cognitive impairment map to specific brain networks.

Methods & results

We analyzed cross-sectional data of 3,485 patients from 10 memory clinic cohorts within the Meta VCI Map Consortium, using harmonized test results in 4 cognitive domains and WMH segmentations. WMH segmentations were registered to a standard space and mapped onto existing normative structural and functional brain connectome data. We employed LNM to quantify WMH connectivity across 480 atlas-based gray and white matter regions of interest (ROI), resulting in ROI-level structural and functional LNM scores. The capacity of total and regional WMH volumes and LNM scores in predicting cognitive function was compared using ridge regression models in a nested cross-validation. LNM scores predicted performance in three cognitive domains (attention and executive function, information processing speed, and verbal memory) significantly better than WMH volumes. LNM scores did not improve prediction for language functions. ROI-level analysis revealed that higher LNM scores, representing greater disruptive effects of WMH on regional connectivity, in gray and white matter regions of the dorsal and ventral attention networks were associated with lower cognitive performance.

Conclusion

Measures of WMH-related brain network connectivity significantly improve the prediction of current cognitive performance in memory clinic patients compared to WMH volume as a traditional imaging marker of cerebrovascular disease. This highlights the crucial role of network effects, particularly in attentionrelated brain regions, improving our understanding of vascular contributions to cognitive impairment. Moving forward, refining WMH information with connectivity data could contribute to patient-tailored therapeutic interventions and facilitate the identification of subgroups at risk of cognitive disorders.

A latent clinical-anatomical dimension relating metabolic syndrome to brain structure and cognition

The link between metabolic syndrome (MetS) and neurodegenerative as well as cerebrovascular conditions holds substantial implications for brain health in at-risk populations. This study elucidates the complex relationship between MetS and brain health by conducting a comprehensive examination of cardiometabolic risk factors, brain morphology, and cognitive function in 40,087 individuals. Multivariate, data-driven statistics identified a latent dimension linking more severe MetS to widespread brain morphological abnormalities, accounting for up to 71% of shared variance in the data. This dimension was replicable across sub-samples. In a mediation analysis, we could demonstrate that MetS-related brain morphological abnormalities mediated the link between MetS severity and cognitive performance in multiple domains. Employing imaging transcriptomics and connectomics, our results also suggest that MetS-related morphological abnormalities are linked to the regional cellular composition and macroscopic brain network organization. By leveraging extensive, multi-domain data combined with a dimensional stratification approach, our analysis provides profound insights into the association of MetS and brain health. These findings can inform effective therapeutic and risk mitigation strategies aimed at maintaining brain integrity.

Sex classification from functional brain connectivity: Generalization to multiple datasets Generalizability of sex classifiers

Machine learning (ML) approaches are increasingly being applied to neuroimaging data. Studies in neuroscience typically have to rely on a limited set of training data which may impair the generalizability of ML models. However, it is still unclear which kind of training sample is best suited to optimize generalization performance. In the present study, we systematically investigated the generalization performance of sex classification models trained on the parcelwise connectivity profile of either single samples or a compound sample containing data from four different datasets. Generalization performance was quantified in terms of mean across-sample classification accuracy and spatial consistency of accurately classifying parcels. Our results indicate that generalization performance of pwCs trained on single dataset samples is dependent on the specific test samples. Certain datasets seem to "match" in the sense that classifiers trained on a sample from one dataset achieved a high accuracy when tested on the respected other one and vice versa. The pwC trained on the compound sample demonstrated overall highest generalization performance for all test samples, including one derived from a dataset not included in building the training samples. Thus, our results indicate that a big and heterogenous training sample comprising data of multiple datasets is best suited to achieve generalizable results.

Julearn: an easy-to-use library for leakage-free evaluation and inspection of ML models

The fast-paced development of machine learning (ML) and its increasing adoption in research challenge researchers without extensive training in ML. In neuroscience, ML can help understand brain-behavior relationships, diagnose diseases and develop biomarkers using data from sources like magnetic resonance imaging and electroencephalography. Primarily, ML builds models to make accurate predictions on unseen data. Researchers evaluate models' performance and generalizability using techniques such as cross-validation (CV). However, choosing a CV scheme and evaluating an ML pipeline is challenging and, if done improperly, can lead to overestimated results and incorrect interpretations. Here, we created julearn, an open-source Python library allowing researchers to design and evaluate complex ML pipelines without encountering common pitfalls. We present the rationale behind julearn's design, its core features, and showcase three examples of previously-published research projects. Julearn simplifies the access to ML providing an easy-to-use environment. With its design, unique features, simple interface, and practical documentation, it poses as a useful Python-based library for research projects.

Lifetime Exposure to Depression and Neuroimaging Measures of Brain Structure and Function

Importance

Despite decades of neuroimaging studies reporting brain structural and functional alterations in depression, discrepancies in findings across studies and limited convergence across meta-analyses have raised questions about the consistency and robustness of the observed brain phenotypes.

Objective

To investigate the associations between 6 operational criteria of lifetime exposure to depression and functional and structural neuroimaging measures.

Design, Setting, and Participants

This cross-sectional study analyzed data from a UK Biobank cohort of individuals aged 45 to 80 years who were enrolled between January 1, 2014, and December 31, 2018. Participants included individuals with a lifetime exposure to depression and matched healthy controls without indications of psychosis, mental illness, behavior disorder, and disease of the nervous system. Six operational criteria of lifetime exposure to depression were evaluated: help seeking for depression; self-reported depression; antidepressant use; depression definition by Smith et al; hospital International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10) diagnosis codes F32 and F33; and Composite International Diagnostic Interview Short Form score. Six increasingly restrictive depression definitions and groups were defined based on the 6 depression criteria, ranging from meeting only 1 criterion to meeting all 6 criteria. Data were analyzed between January and October 2022.

Main Outcomes and Measures

Functional measures were calculated using voxel-wise fractional amplitude of low-frequency fluctuation (fALFF), global correlation (GCOR), and local correlation (LCOR). Structural measures were calculated using gray matter volume (GMV).

Results

The study included 20 484 individuals with lifetime depression (12 645 females [61.7%]; mean [SD] age, 63.91 [7.60] years) and 25 462 healthy controls (14 078 males [55.3%]; mean [SD] age, 65.05 [7.8] years). Across all depression criteria, individuals with lifetime depression displayed regionally consistent decreases in fALFF, LCOR, and GCOR (Cohen d range, -0.53 [95% CI, -0.88 to -0.15] to -0.04 [95% CI, -0.07 to -0.01]) but not in GMV (Cohen d range, -0.47 [95 % CI, -0.75 to -0.12] to 0.26 [95% CI, 0.15-0.37]). Hospital ICD-10 diagnosis codes F32 and F33 (median [IQR] difference in effect sizes, -0.14 [-0.17 to -0.11]) and antidepressant use (median [IQR] difference in effect sizes, -0.12 [-0.16 to -0.10]) were criteria associated with the most pronounced alterations.

Conclusions and Relevance

Results of this cross-sectional study indicate that lifetime exposure to depression was associated with robust functional changes, with a more restrictive depression definition revealing more pronounced alterations. Different inclusion criteria for depression may be associated with the substantial variation in imaging findings reported in the literature.

A latent clinical-anatomical dimension relating metabolic syndrome to brain structure and cognition

The link between metabolic syndrome (MetS) and neurodegenerative as well cerebrovascular conditions holds substantial implications for brain health in at-risk populations. This study elucidates the complex relationship between MetS and brain health by conducting a comprehensive examination of cardiometabolic risk factors, cortical morphology, and cognitive function in 40,087 individuals. Multivariate, data-driven statistics identified a latent dimension linking more severe MetS to widespread brain morphological abnormalities, accounting for up to 71% of shared variance in the data. This dimension was replicable across sub-samples. In a mediation analysis we could demonstrate that MetS-related brain morphological abnormalities mediated the link between MetS severity and cognitive performance in multiple domains. Employing imaging transcriptomics and connectomics, our results also suggest that MetS-related morphological abnormalities are linked to the regional cellular composition and macroscopic brain network organization. By leveraging extensive, multi-domain data combined with a dimensional stratification approach, our analysis provides profound insights into the association of MetS and brain health. These findings can inform effective therapeutic and risk mitigation strategies aimed at maintaining brain integrity.

Network and State Specificity in Connectivity-Based Predictions of Individual Behavior

Predicting individual behavior from brain functional connectivity (FC) patterns can contribute to our understanding of human brain functioning. This may apply in particular if predictions are based on features derived from circumscribed, a priori defined functional networks, which improves interpretability. Furthermore, some evidence suggests that task-based FC data may yield more successful predictions of behavior than resting-state FC data. Here, we comprehensively examined to what extent the correspondence of functional network priors and task states with behavioral target domains influences the predictability of individual performance in cognitive, social, and affective tasks. To this end, we used data from the Human Connectome Project for large-scale out-of-sample predictions of individual abilities in working memory (WM), theory-of-mind cognition (SOCIAL), and emotion processing (EMO) from FC of corresponding and non-corresponding states (WM/SOCIAL/EMO/resting-state) and networks (WM/SOCIAL/EMO/whole-brain connectome). Using root mean squared error and coefficient of determination to evaluate model fit revealed that predictive performance was rather poor overall. Predictions from whole-brain FC were slightly better than those from FC in task-specific networks, and a slight benefit of predictions based on FC from task versus resting state was observed for performance in the WM domain. Beyond that, we did not find any significant effects of a correspondence of network, task state, and performance domains. Together, these results suggest that multivariate FC patterns during both task and resting states contain rather little information on individual performance levels, calling for a reconsideration of how the brain mediates individual differences in mental abilities.

Predicting executive functioning from brain networks: modality specificity and age effects

Healthy aging is associated with structural and functional network changes in the brain, which have been linked to deterioration in executive functioning (EF), while their neural implementation at the individual level remains unclear. As the biomarker potential of individual resting-state functional connectivity (RSFC) patterns has been questioned, we investigated to what degree individual EF abilities can be predicted from the gray-matter volume (GMV), regional homogeneity, fractional amplitude of low-frequency fluctuations (fALFF), and RSFC within EF-related, perceptuo-motor, and whole-brain networks in young and old adults. We examined whether the differences in out-of-sample prediction accuracy were modality-specific and depended on age or task-demand levels. Both uni- and multivariate analysis frameworks revealed overall low prediction accuracies and moderate-to-weak brain-behavior associations (R2 < 0.07, r < 0.28), further challenging the idea of finding meaningful markers for individual EF performance with the metrics used. Regional GMV, well linked to overall atrophy, carried the strongest information about individual EF differences in older adults, whereas fALFF, measuring functional variability, did so for younger adults. Our study calls for future research analyzing more global properties of the brain, different task-states and applying adaptive behavioral testing to result in sensitive predictors for young and older adults, respectively.

A systematic comparison of VBM pipelines and their application to age prediction

Voxel-based morphometry (VBM) analysis is commonly used for localized quantification of gray matter volume (GMV). Several alternatives exist to implement a VBM pipeline. However, how these alternatives compare and their utility in applications, such as the estimation of aging effects, remain largely unclear. This leaves researchers wondering which VBM pipeline they should use for their project. In this study, we took a user-centric perspective and systematically compared five VBM pipelines, together with registration to either a general or a study-specific template, utilizing three large datasets (n>500 each). Considering the known effect of aging on GMV, we first compared the pipelines in their ability of individual-level age prediction and found markedly varied results. To examine whether these results arise from systematic differences between the pipelines, we classified them based on their GMVs, resulting in near-perfect accuracy. To gain deeper insights, we examined the impact of different VBM steps using the region-wise similarity between pipelines. The results revealed marked differences, largely driven by segmentation and registration steps. We observed large variability in subject-identification accuracies, highlighting the interpipeline differences in individual-level quantification of GMV. As a biologically meaningful criterion we correlated regional GMV with age. The results were in line with the age-prediction analysis, and two pipelines, CAT and the combination of fMRIPrep for tissue characterization with FSL for registration, reflected age information better.

Lack of structural brain alterations associated with insomnia: findings from the ENIGMA-Sleep Working Group

Existing neuroimaging studies have reported divergent structural alterations in insomnia disorder (ID). In the present study, we performed a large-scale coordinated meta-analysis by pooling structural brain measures from 1085 subjects (mean [SD] age 50.5 [13.9] years, 50.2% female, 17.4% with insomnia) across three international Enhancing NeuroImaging Genetics through Meta-Analysis (ENIGMA)-Sleep cohorts. Two sites recruited patients with ID/controls: Freiburg (University of Freiburg Medical Center, Freiburg, Germany) 42/43 and KUMS (Kermanshah University of Medical Sciences, Kermanshah, Iran) 42/49, while the Study of Health in Pomerania (SHIP-Trend, University Medicine Greifswald, Greifswald, Germany) recruited population-based individuals with/without insomnia symptoms 75/662. The influence of insomnia on magnetic resonance imaging-based brain morphometry using an insomnia brain score was then assessed. Within each cohort, we used an ordinary least-squares linear regression to investigate the link between the individual regional cortical and subcortical volumes and the presence of insomnia symptoms. Then, we performed a fixed-effects meta-analysis across cohorts based on the first-level results. For the insomnia brain score, weighted logistic ridge regression was performed on one sample (Freiburg), which separated patients with ID from controls to train a model based on the segmentation measurements. Afterward, the insomnia brain scores were validated using the other two samples. The model was used to predict the log-odds of the subjects with insomnia given individual insomnia-related brain atrophy. After adjusting for multiple comparisons, we did not detect any significant associations between insomnia symptoms and cortical or subcortical volumes, nor could we identify a global insomnia-related brain atrophy pattern. Thus, we observed inconsistent brain morphology differences between individuals with and without insomnia across three independent cohorts. Further large-scale cross-sectional/longitudinal studies using both structural and functional neuroimaging are warranted to decipher the neurobiology of insomnia.

Accurate sex prediction of cisgender and transgender individuals without brain size bias

The increasing use of machine learning approaches on neuroimaging data comes with the important concern of confounding variables which might lead to biased predictions and in turn spurious conclusions about the relationship between the features and the target. A prominent example is the brain size difference between women and men. This difference in total intracranial volume (TIV) can cause bias when employing machine learning approaches for the investigation of sex differences in brain morphology. A TIV-biased model will not capture qualitative sex differences in brain organization but rather learn to classify an individual's sex based on brain size differences, thus leading to spurious and misleading conclusions, for example when comparing brain morphology between cisgender- and transgender individuals. In this study, TIV bias in sex classification models applied to cis- and transgender individuals was systematically investigated by controlling for TIV either through featurewise confound removal or by matching the training samples for TIV. Our results provide strong evidence that models not biased by TIV can classify the sex of both cis- and transgender individuals with high accuracy, highlighting the importance of appropriate modeling to avoid bias in automated decision making.

Intermediately synchronised brain states optimise trade-off between subject specificity and predictive capacity

Functional connectivity (FC) refers to the statistical dependencies between activity of distinct brain areas. To study temporal fluctuations in FC within the duration of a functional magnetic resonance imaging (fMRI) scanning session, researchers have proposed the computation of an edge time series (ETS) and their derivatives. Evidence suggests that FC is driven by a few time points of high-amplitude co-fluctuation (HACF) in the ETS, which may also contribute disproportionately to interindividual differences. However, it remains unclear to what degree different time points actually contribute to brain-behaviour associations. Here, we systematically evaluate this question by assessing the predictive utility of FC estimates at different levels of co-fluctuation using machine learning (ML) approaches. We demonstrate that time points of lower and intermediate co-fluctuation levels provide overall highest subject specificity as well as highest predictive capacity of individual-level phenotypes.

Predicting Executive Functioning from Brain Networks: Modality Specificity and Age Effects

Healthy aging is associated with structural and functional network changes in the brain, which have been linked to deterioration in executive functioning (EF), while their neural implementation at the individual level remains unclear. As the biomarker potential of individual resting-state functional connectivity (RSFC) patterns has been questioned, we investigated to what degree individual EF abilities can be predicted from gray-matter volume (GMV), regional homogeneity, fractional amplitude of low-frequency fluctuations (fALFF), and RSFC within EF-related, perceptuo-motor, and whole-brain networks in young and old adults. We examined whether differences in out-of-sample prediction accuracy were modality-specific and depended on age or task-demand levels. Both uni- and multivariate analysis frameworks revealed overall low prediction accuracies and moderate to weak brain-behavior associations (R2 < .07, r < .28), further challenging the idea of finding meaningful markers for individual EF performance with the metrics used. Regional GMV, well linked to overall atrophy, carried the strongest information about individual EF differences in older adults, whereas fALFF, measuring functional variability, did so for younger adults. Our study calls for future research analyzing more global properties of the brain, different task-states and applying adaptive behavioral testing to result in sensitive predictors for young and older adults, respectively.

A topography-based predictive framework for naturalistic viewing fMRI

Functional magnetic resonance imaging (fMRI) during naturalistic viewing (NV) provides exciting opportunities for studying brain functions in more ecologically valid settings. Understanding individual differences in brain functions during NV and their behavioural relevance has recently become an important goal. However, methods specifically designed for this purpose remain limited. Here, we propose a topography-based predictive framework (TOPF) to fill this methodological gap. TOPF identifies individual-specific evoked activity topographies in a data-driven manner and examines their behavioural relevance using a machine learning-based predictive framework. We validate TOPF on both NV and task-based fMRI data from multiple conditions. Our results show that TOPF effectively and stably captures individual differences in evoked brain activity and successfully predicts phenotypes across cognition, emotion and personality on unseen subjects from their activity topographies. Moreover, TOPF compares favourably with functional connectivity-based approaches in prediction performance, with the identified predictive brain regions being neurobiologically interpretable. Crucially, we highlight the importance of examining individual evoked brain activity topographies in advancing our understanding of the brain-behaviour relationship. We believe that the TOPF approach provides a simple but powerful tool for understanding brain-behaviour relationships on an individual level with a strong potential for clinical applications.

Predicting executive functioning from functional brain connectivity: network specificity and age effects

Healthy aging is associated with altered executive functioning (EF). Earlier studies found age-related differences in EF performance to be partially accounted for by changes in resting-state functional connectivity (RSFC) within brain networks associated with EF. However, it remains unclear which role RSFC in EF-associated networks plays as a marker for individual differences in EF performance. Here, we investigated to what degree individual abilities across 3 different EF tasks can be predicted from RSFC within EF-related, perceptuo-motor, whole-brain, and random networks separately in young and old adults. Specifically, we were interested if (i) young and old adults differ in predictability depending on network or EF demand level (high vs. low), (ii) an EF-related network outperforms EF-unspecific networks when predicting EF abilities, and (iii) this pattern changes with demand level. Both our uni- and multivariate analysis frameworks analyzing interactions between age × demand level × networks revealed overall low prediction accuracies and a general lack of specificity regarding neurobiological networks for predicting EF abilities. This questions the idea of finding markers for individual EF performance in RSFC patterns and calls for future research replicating the current approach in different task states, brain modalities, different, larger samples, and with more comprehensive behavioral measures.

Brain-age prediction: A systematic comparison of machine learning workflows

The difference between age predicted using anatomical brain scans and chronological age, i.e., the brain-age delta, provides a proxy for atypical aging. Various data representations and machine learning (ML) algorithms have been used for brain-age estimation. However, how these choices compare on performance criteria important for real-world applications, such as; (1) within-dataset accuracy, (2) cross-dataset generalization, (3) test-retest reliability, and (4) longitudinal consistency, remains uncharacterized. We evaluated 128 workflows consisting of 16 feature representations derived from gray matter (GM) images and eight ML algorithms with diverse inductive biases. Using four large neuroimaging databases covering the adult lifespan (total N = 2953, 18-88 years), we followed a systematic model selection procedure by sequentially applying stringent criteria. The 128 workflows showed a within-dataset mean absolute error (MAE) between 4.73-8.38 years, from which 32 broadly sampled workflows showed a cross-dataset MAE between 5.23-8.98 years. The test-retest reliability and longitudinal consistency of the top 10 workflows were comparable. The choice of feature representation and the ML algorithm both affected the performance. Specifically, voxel-wise feature spaces (smoothed and resampled), with and without principal components analysis, with non-linear and kernel-based ML algorithms performed well. Strikingly, the correlation of brain-age delta with behavioral measures disagreed between within-dataset and cross-dataset predictions. Application of the best-performing workflow on the ADNI sample showed a significantly higher brain-age delta in Alzheimer's and mild cognitive impairment patients compared to healthy controls. However, in the presence of age bias, the delta estimates in the patients varied depending on the sample used for bias correction. Taken together, brain-age shows promise, but further evaluation and improvements are needed for its real-world application.

Naturalistic viewing increases individual identifiability based on connectivity within functional brain networks

Naturalistic viewing (NV) is currently considered a promising paradigm for studying individual differences in functional brain organization. While whole brain functional connectivity (FC) under NV has been relatively well characterized, so far little work has been done on a network level. Here, we extend current knowledge by characterizing the influence of NV on FC in fourteen meta-analytically derived brain networks considering three different movie stimuli in comparison to resting-state (RS). We show that NV increases identifiability of individuals over RS based on functional connectivity in certain, but not all networks. Furthermore, movie stimuli including a narrative appear more distinct from RS. In addition, we assess individual variability in network FC by comparing within- and between-subject similarity during NV and RS. We show that NV can evoke individually distinct NFC patterns by increasing inter-subject variability while retaining within-subject similarity. Crucially, our results highlight that this effect is not observable across all networks, but rather dependent on the network-stimulus combination. Our results confirm that NV can improve the detection of individual differences over RS and underline the importance of selecting the appropriate combination of movie and cognitive network for the research question at hand.

Machine learning based identification of structural brain alterations underlying suicide risk in adolescents

Suicide is the third leading cause of death for individuals between 15 and 19 years of age. The high suicide mortality rate and limited prior success in identifying neuroimaging biomarkers indicate that it is crucial to improve the accuracy of clinical neural signatures underlying suicide risk. The current study implements machine-learning (ML) algorithms to examine structural brain alterations in adolescents that can discriminate individuals with suicide risk from typically developing (TD) adolescents at the individual level. Structural MRI data were collected from 79 adolescents who demonstrated clinical levels of suicide risk and 79 demographically matched TD adolescents. Region-specific cortical/subcortical volume (CV/SCV) was evaluated following whole-brain parcellation into 1000 cortical and 12 subcortical regions. CV/SCV parameters were used as inputs for feature selection and three ML algorithms (i.e., support vector machine [SVM], K-nearest neighbors, and ensemble) to classify adolescents at suicide risk from TD adolescents. The highest classification accuracy of 74.79% (with sensitivity = 75.90%, specificity = 74.07%, and area under the receiver operating characteristic curve = 87.18%) was obtained for CV/SCV data using the SVM classifier. Identified bilateral regions that contributed to the classification mainly included reduced CV within the frontal and temporal cortices but increased volume within the cuneus/precuneus for adolescents at suicide risk relative to TD adolescents. The current data demonstrate an unbiased region-specific ML framework to effectively assess the structural biomarkers of suicide risk. Future studies with larger sample sizes and the inclusion of clinical controls and independent validation data sets are needed to confirm our findings.

A too-good-to-be-true prior to reduce shortcut reliance

Despite their impressive performance in object recognition and other tasks under standard testing conditions, deep networks often fail to generalize to out-of-distribution (o.o.d.) samples. One cause for this shortcoming is that modern architectures tend to rely on ǣshortcutsǥ superficial features that correlate with categories without capturing deeper invariants that hold across contexts. Real-world concepts often possess a complex structure that can vary superficially across contexts, which can make the most intuitive and promising solutions in one context not generalize to others. One potential way to improve o.o.d. generalization is to assume simple solutions are unlikely to be valid across contexts and avoid them, which we refer to as the too-good-to-be-true prior. A low-capacity network (LCN) with a shallow architecture should only be able to learn surface relationships, including shortcuts. We find that LCNs can serve as shortcut detectors. Furthermore, an LCN's predictions can be used in a two-stage approach to encourage a high-capacity network (HCN) to rely on deeper invariant features that should generalize broadly. In particular, items that the LCN can master are downweighted when training the HCN. Using a modified version of the CIFAR-10 dataset in which we introduced shortcuts, we found that the two-stage LCN-HCN approach reduced reliance on shortcuts and facilitated o.o.d. generalization.

Leveraging Machine Learning for Gaining Neurobiological and Nosological Insights in Psychiatric Research

Much attention is currently devoted to developing diagnostic classifiers for mental disorders. Complementing these efforts, we highlight the potential of machine learning to gain biological insights into the psychopathology and nosology of mental disorders. Studies to this end have mainly used brain imaging data, which can be obtained noninvasively from large cohorts and have repeatedly been argued to reveal potentially intermediate phenotypes. This may become particularly relevant in light of recent efforts to identify magnetic resonance imaging-derived biomarkers that yield insight into pathophysiological processes as well as to refine the taxonomy of mental illness. In particular, the accuracy of machine learning models may be used as dependent variables to identify features relevant to pathophysiology. Moreover, such approaches may help disentangle the dimensional (within diagnosis) and often overlapping (across diagnoses) symptomatology of psychiatric illness. We also point out a multiview perspective that combines data from different sources, bridging molecular and system-level information. Finally, we summarize recent efforts toward a data-driven definition of subtypes or disease entities through unsupervised and semisupervised approaches. The latter, blending unsupervised and supervised concepts, may represent a particularly promising avenue toward dissecting heterogeneous categories. Finally, we raise several technical and conceptual aspects related to the reviewed approaches. In particular, we discuss common pitfalls pertaining to flawed input data or analytic procedures that would likely lead to unreliable outputs.

Confound-leakage: confound removal in machine learning leads to leakage

BACKGROUND

Machine learning (ML) approaches are a crucial component of modern data analysis in many fields, including epidemiology and medicine. Nonlinear ML methods often achieve accurate predictions, for instance, in personalized medicine, as they are capable of modeling complex relationships between features and the target. Problematically, ML models and their predictions can be biased by confounding information present in the features. To remove this spurious signal, researchers often employ featurewise linear confound regression (CR). While this is considered a standard approach for dealing with confounding, possible pitfalls of using CR in ML pipelines are not fully understood.

RESULTS

We provide new evidence that, contrary to general expectations, linear confound regression can increase the risk of confounding when combined with nonlinear ML approaches. Using a simple framework that uses the target as a confound, we show that information leaked via CR can increase null or moderate effects to near-perfect prediction. By shuffling the features, we provide evidence that this increase is indeed due to confound-leakage and not due to revealing of information. We then demonstrate the danger of confound-leakage in a real-world clinical application where the accuracy of predicting attention-deficit/hyperactivity disorder is overestimated using speech-derived features when using depression as a confound.

CONCLUSIONS

Mishandling or even amplifying confounding effects when building ML models due to confound-leakage, as shown, can lead to untrustworthy, biased, and unfair predictions. Our expose of the confound-leakage pitfall and provided guidelines for dealing with it can help create more robust and trustworthy ML models.

Mapping the deficit dimension structure of the National Institutes of Health Stroke Scale

BACKGROUND

The National Institutes of Health Stroke Scale (NIHSS) is the most frequently applied clinical rating scale for standardized assessment of neurological deficits in acute stroke in both clinical and research settings. Notwithstanding this prominent role, important questions regarding its validity remain insufficiently addressed: Investigations of the underlying dimensional structure of the NIHSS yielded inconsistent results that are largely not generalizable across studies. Neurobiological validations by linking measured deficit dimensions to brain anatomy and function are missing.

METHODS

We, therefore, employ advanced machine learning to identify an optimal representation of the dimensional structure of the NIHSS across two independent and heterogeneous stroke datasets (N = 503 and N = 690). Associated lesion locations are identified by multivariate lesion-deficit mapping (LDM) and their functional relevance is profiled based on a-priori task activation meta-data analysis, to provide an independent link to the behavioural level.

FINDINGS

A five-factor structure of the NIHSS was identified as the most robust and generalizable representation of stroke deficit dimensions across study populations, settings, and clinical phenotypes. Specifically, the identified dimensions comprised NIHSS items for (F1) left motor deficits, (F2) right motor deficits, (F3) dysarthria and facial palsy, (F4) language, and (F5) deficits in spatial attention and gaze. LDM linked four of these factors to differentially localized, eloquent neuroanatomical areas. Functional characterization of LDM results aligned with detected deficit dimensions, revealing associations with motor functions, language processing, and various functions in the perception domain.

INTERPRETATION

By cross-validating machine learning in heterogeneous multi-site stroke cohorts, we report evidence on the validity of the NIHSS: We identified an overarching structure of the NISHS containing a five-dimensional representation of stroke deficits. We provide an anatomical map of the NIHSS that is of value for future applications of individualized stroke treatment and rehabilitation.

FUNDING

This research was supported by the National Key R&D Program of China (Grant No. 2021YFC2502200), the National Human Brain Project of China (Grant No. 2022ZD0214000)", the German Research Foundation (Deutsche Forschungsgemeinschaft), Project 178316478 (A1, C1, C2), and Project 454012190 of the SPP 2041, the Helmholtz Portfolio Theme "Supercomputing and Modelling for the Human Brain" and Helmholtz Imaging Platform grant NimRLS (ZT-I-PF-4-010).

Whole-brain dynamical modelling for classification of Parkinson's disease

Simulated whole-brain connectomes demonstrate enhanced inter-individual variability depending on the data processing and modelling approach. By considering the human brain connectome as an individualized attribute, we investigate how empirical and simulated whole-brain connectome-derived features can be utilized to classify patients with Parkinson's disease against healthy controls in light of varying data processing and model validation. To this end, we applied simulated blood oxygenation level-dependent signals derived by a whole-brain dynamical model simulating electrical signals of neuronal populations to reveal differences between patients and controls. In addition to the widely used model validation via fitting the dynamical model to empirical neuroimaging data, we invented a model validation against behavioural data, such as subject classes, which we refer to as behavioural model fitting and show that it can be beneficial for Parkinsonian patient classification. Furthermore, the results of machine learning reported in this study also demonstrated that the performance of the patient classification can be improved when the empirical data are complemented by the simulation results. We also showed that the temporal filtering of blood oxygenation level-dependent signals influences the prediction results, where filtering in the low-frequency band is advisable for Parkinsonian patient classification. In addition, composing the feature space of empirical and simulated data from multiple brain parcellation schemes provided complementary features that improved prediction performance. Based on our findings, we suggest that combining the simulation results with empirical data is effective for inter-individual research and its clinical application.

Quantifying the heritability of belief formation

Individual differences in behaviour, traits and mental-health are partially heritable. Traditionally, studies have focused on quantifying the heritability of high-order characteristics, such as happiness or education attainment. Here, we quantify the degree of heritability of lower-level mental processes that likely contribute to complex traits and behaviour. In particular, we quantify the degree of heritability of cognitive and affective factors that contribute to the generation of beliefs about risk, which drive behavior in domains ranging from finance to health. Monozygotic and dizygotic twin pairs completed a belief formation task. We first show that beliefs about risk are associated with vividness of imagination, affective evaluation and learning abilities. We then demonstrate that the genetic contribution to individual differences in these processes range between 13.5 and 39%, with affect evaluation showing a particular robust heritability component. These results provide clues to which mental factors may be driving the heritability component of beliefs formation, which in turn contribute to the heritability of complex traits.

Cross-ethnicity/race generalization failure of behavioral prediction from resting-state functional connectivity

Algorithmic biases that favor majority populations pose a key challenge to the application of machine learning for precision medicine. Here, we assessed such bias in prediction models of behavioral phenotypes from brain functional magnetic resonance imaging. We examined the prediction bias using two independent datasets (preadolescent versus adult) of mixed ethnic/racial composition. When predictive models were trained on data dominated by white Americans (WA), out-of-sample prediction errors were generally higher for African Americans (AA) than for WA. This bias toward WA corresponds to more WA-like brain-behavior association patterns learned by the models. When models were trained on AA only, compared to training only on WA or an equal number of AA and WA participants, AA prediction accuracy improved but stayed below that for WA. Overall, the results point to the need for caution and further research regarding the application of current brain-behavior prediction models in minority populations.

Is it left or is it right? A classification approach for investigating hemispheric differences in low and high dimensionality

Hemispheric asymmetries, i.e., differences between the two halves of the brain, have extensively been studied with respect to both structure and function. Commonly employed pairwise comparisons between left and right are suitable for finding differences between the hemispheres, but they come with several caveats when assessing multiple asymmetries. What is more, they are not designed for identifying the characterizing features of each hemisphere. Here, we present a novel data-driven framework—based on machine learning-based classification—for identifying the characterizing features that underlie hemispheric differences. Using voxel-based morphometry data from two different samples (n = 226, n = 216), we separated the hemispheres along the midline and used two different pipelines: First, for investigating global differences, we embedded the hemispheres into a two-dimensional space and applied a classifier to assess if the hemispheres are distinguishable in their low-dimensional representation. Second, to investigate which voxels show systematic hemispheric differences, we employed two classification approaches promoting feature selection in high dimensions. The two hemispheres were accurately classifiable in both their low-dimensional (accuracies: dataset 1 = 0.838; dataset 2 = 0.850) and high-dimensional (accuracies: dataset 1 = 0.966; dataset 2 = 0.959) representations. In low dimensions, classification of the right hemisphere showed higher precision (dataset 1 = 0.862; dataset 2 = 0.894) compared to the left hemisphere (dataset 1 = 0.818; dataset 2 = 0.816). A feature selection algorithm in the high-dimensional analysis identified voxels that most contribute to accurate classification. In addition, the map of contributing voxels showed a better overlap with moderate to highly lateralized voxels, whereas conventional t test with threshold-free cluster enhancement best resembled the LQ map at lower thresholds. Both the low- and high-dimensional classifiers were capable of identifying the hemispheres in subsamples of the datasets, such as males, females, right-handed, or non-right-handed participants. Our study indicates that hemisphere classification is capable of identifying the hemisphere in their low- and high-dimensional representation as well as delineating brain asymmetries. The concept of hemisphere classifiability thus allows a change in perspective, from asking what differs between the hemispheres towards focusing on the features needed to identify the left and right hemispheres. Taking this perspective on hemispheric differences may contribute to our understanding of what makes each hemisphere special.

Functional parcellation of human and macaque striatum reveals human-specific connectivity in the dorsal caudate

A wide homology between human and macaque striatum is often assumed as in both the striatum is involved in cognition, emotion and executive functions. However, differences in functional and structural organization between human and macaque striatum may reveal evolutionary divergence and shed light on human vulnerability to neuropsychiatric diseases. For instance, dopaminergic dysfunction of the human striatum is considered to be a pathophysiological underpinning of different disorders, such as Parkinson's disease (PD) and schizophrenia (SCZ). Previous investigations have found a wide similarity in structural connectivity of the striatum between human and macaque, leaving the cross-species comparison of its functional organization unknown. In this study, resting-state functional connectivity (RSFC) derived striatal parcels were compared based on their homologous cortico-striatal connectivity. The goal here was to identify striatal parcels whose connectivity is human-specific compared to macaque parcels. Functional parcellation revealed that the human striatum was split into dorsal, dorsomedial, and rostral caudate and ventral, central, and caudal putamen, while the macaque striatum was divided into dorsal, and rostral caudate and rostral, and caudal putamen. Cross-species comparison indicated dissimilar cortico-striatal RSFC of the topographically similar dorsal caudate. We probed clinical relevance of the striatal clusters by examining differences in their cortico-striatal RSFC and gray matter (GM) volume between patients (with PD and SCZ) and healthy controls. We found abnormal RSFC not only between dorsal caudate, but also between rostral caudate, ventral, central and caudal putamen and widespread cortical regions for both PD and SCZ patients. Also, we observed significant structural atrophy in rostral caudate, ventral and central putamen for both PD and SCZ while atrophy in the dorsal caudate was specific to PD. Taken together, our cross-species comparative results revealed shared and human-specific RSFC of different striatal clusters reinforcing the complex organization and function of the striatum. In addition, we provided a testable hypothesis that abnormalities in a region with human-specific connectivity, i.e., dorsal caudate, might be associated with neuropsychiatric disorders.

Neurobiological substrates of the positive formal thought disorder in schizophrenia revealed by seed connectome-based predictive modeling

•

Formal thought disorder (FTD) is a core symptom of schizophrenia, but its neurobiological substrates remain elusive.

•

Resting-state functional connectivity (rsFC) of three meta-analytically defined seeds were correlated to positive and negative symptom dimensions of FTD.

•

RsFC patterns allowed individual prediction of positive FTD symptom severity.

•

These findings generalized to an independent data set.

•

Our study has identified robust neurobiological correlates of positive FTD in schizophrenia.

Formal thought disorder (FTD) is a core symptom cluster of schizophrenia, but its neurobiological substrates remain poorly understood. Here we collected resting-state fMRI data from 276 subjects at seven sites and employed machine-learning to investigate the neurobiological correlates of FTD along positive and negative symptom dimensions in schizophrenia. Three a priori, meta-analytically defined FTD-related brain regions were used as seeds to generate whole-brain resting-state functional connectivity (rsFC) maps, which were then compared between schizophrenia patients and controls. A repeated cross-validation procedure was realized within the patient group to identify clusters whose rsFC patterns to the seeds were repeatedly observed as significantly associated with specific FTD dimensions. These repeatedly identified clusters (i.e., robust clusters) were functionally characterized and the rsFC patterns were used for predictive modeling to investigate predictive capacities for individual FTD dimensional-scores. Compared with controls, differential rsFC was found in patients in fronto-temporo-thalamic regions. Our cross-validation procedure revealed significant clusters only when assessing the seed-to-whole-brain rsFC patterns associated with positive-FTD. RsFC patterns of three fronto-temporal clusters, associated with higher-order cognitive processes (e.g., executive functions), specifically predicted individual positive-FTD scores (p = 0.005), but not other positive symptoms, and the PANSS general psychopathology subscale (p > 0.05). The prediction of positive-FTD was moreover generalized to an independent dataset (p = 0.013). Our study has identified neurobiological correlates of positive FTD in schizophrenia in a network associated with higher-order cognitive functions, suggesting a dysexecutive contribution to FTD in schizophrenia. We regard our findings as robust, as they allow a prediction of individual-level symptom severity.

A Connectivity-Based Psychometric Prediction Framework for Brain-Behavior Relationship Studies

The recent availability of population-based studies with neuroimaging and behavioral measurements opens promising perspectives to investigate the relationships between interindividual variability in brain regions' connectivity and behavioral phenotypes. However, the multivariate nature of connectivity-based prediction model severely limits the insight into brain-behavior patterns for neuroscience. To address this issue, we propose a connectivity-based psychometric prediction framework based on individual regions' connectivity profiles. We first illustrate two main applications: 1) single brain region's predictive power for a range of psychometric variables and 2) single psychometric variable's predictive power variation across brain region. We compare the patterns of brain-behavior provided by these approaches to the brain-behavior relationships from activation approaches. Then, capitalizing on the increased transparency of our approach, we demonstrate how the influence of various data processing and analyses can directly influence the patterns of brain-behavior relationships, as well as the unique insight into brain-behavior relationships offered by this approach.

Comprehensive verbal fluency features predict executive function performance

Semantic verbal fluency (sVF) tasks are commonly used in clinical diagnostic batteries as well as in a research context. When performing sVF tasks to assess executive functions (EFs) the sum of correctly produced words is the main measure. Although previous research indicates potentially better insights into EF performance by the use of finer grained sVF information, this has not yet been objectively evaluated. To investigate the potential of employing a finer grained sVF feature set to predict EF performance, healthy monolingual German speaking participants (n = 230) were tested with a comprehensive EF test battery and sVF tasks, from which features including sum scores, error types, speech breaks and semantic relatedness were extracted. A machine learning method was applied to predict EF scores from sVF features in previously unseen subjects. To investigate the predictive power of the advanced sVF feature set, we compared it to the commonly used sum score analysis. Results revealed that 8 / 14 EF tests were predicted significantly using the comprehensive sVF feature set, which outperformed sum scores particularly in predicting cognitive flexibility and inhibitory processes. These findings highlight the predictive potential of a comprehensive evaluation of sVF tasks which might be used as diagnostic screening of EFs.

Imaging evolution of the primate brain: the next frontier?

Evolution, as we currently understand it, strikes a delicate balance between animals' ancestral history and adaptations to their current niche. Similarities between species are generally considered inherited from a common ancestor whereas observed differences are considered as more recent evolution. Hence comparing species can provide insights into the evolutionary history. Comparative neuroimaging has recently emerged as a novel subdiscipline, which uses magnetic resonance imaging (MRI) to identify similarities and differences in brain structure and function across species. Whereas invasive histological and molecular techniques are superior in spatial resolution, they are laborious, post-mortem, and oftentimes limited to specific species. Neuroimaging, by comparison, has the advantages of being applicable across species and allows for fast, whole-brain, repeatable, and multi-modal measurements of the structure and function in living brains and post-mortem tissue. In this review, we summarise the current state of the art in comparative anatomy and function of the brain and gather together the main scientific questions to be explored in the future of the fascinating new field of brain evolution derived from comparative neuroimaging.

Intrinsic Connectivity Patterns of Task-Defined Brain Networks Allow Individual Prediction of Cognitive Symptom Dimension of Schizophrenia and Are Linked to Molecular Architecture

BACKGROUND

Despite the marked interindividual variability in the clinical presentation of schizophrenia, the extent to which individual dimensions of psychopathology relate to the functional variability in brain networks among patients remains unclear. Here, we address this question using network-based predictive modeling of individual psychopathology along 4 data-driven symptom dimensions. Follow-up analyses assess the molecular underpinnings of predictive networks by relating them to neurotransmitter-receptor distribution patterns.

METHODS

We investigated resting-state functional magnetic resonance imaging data from 147 patients with schizophrenia recruited at 7 sites. Individual expression along negative, positive, affective, and cognitive symptom dimensions was predicted using a relevance vector machine based on functional connectivity within 17 meta-analytic task networks following repeated 10-fold cross-validation and leave-one-site-out analyses. Results were validated in an independent sample. Networks robustly predicting individual symptom dimensions were spatially correlated with density maps of 9 receptors/transporters from prior molecular imaging in healthy populations.

RESULTS

Tenfold and leave-one-site-out analyses revealed 5 predictive network-symptom associations. Connectivity within theory of mind, cognitive reappraisal, and mirror neuron networks predicted negative, positive, and affective symptom dimensions, respectively. Cognitive dimension was predicted by theory of mind and socioaffective default networks. Importantly, these predictions generalized to the independent sample. Intriguingly, these two networks were positively associated with D₁ receptor and serotonin reuptake transporter densities as well as dopamine synthesis capacity.

CONCLUSIONS

We revealed a robust association between intrinsic functional connectivity within networks for socioaffective processes and the cognitive dimension of psychopathology. By investigating the molecular architecture, this work links dopaminergic and serotonergic systems with the functional topography of brain networks underlying cognitive symptoms in schizophrenia.

Polarization of microbial communities between competitive and cooperative metabolism

Resource competition and metabolic cross-feeding are among the main drivers of microbial community assembly. Yet the degree to which these two conflicting forces are reflected in the composition of natural communities has not been systematically investigated. Here, we use genome-scale metabolic modelling to assess the potential for resource competition and metabolic cooperation in large co-occurring groups (up to 40 members) across thousands of habitats. Our analysis reveals two distinct community types, which are clustered at opposite ends of a spectrum in a trade-off between competition and cooperation. At one end are highly cooperative communities, characterized by smaller genomes and multiple auxotrophies. At the other end are highly competitive communities, which feature larger genomes and overlapping nutritional requirements, and harbour more genes related to antimicrobial activity. The latter are mainly present in soils, whereas the former are found in both free-living and host-associated habitats. Community-scale flux simulations show that, whereas competitive communities can better resist species invasion but not nutrient shift, cooperative communities are susceptible to species invasion but resilient to nutrient change. We also show, by analysing an additional data set, that colonization by probiotic species is positively associated with the presence of cooperative species in the recipient microbiome. Together, our results highlight the bifurcation between competitive and cooperative metabolism in the assembly of natural communities and its implications for community modulation.

Age differences in predicting working memory performance from network-based functional connectivity

Deterioration in working memory capacity (WMC) has been associated with normal aging, but it remains unknown how age affects the relationship between WMC and connectivity within functional brain networks. We therefore examined the predictability of WMC from fMRI-based resting-state functional connectivity (RSFC) within eight meta-analytically defined functional brain networks and the connectome in young and old adults using relevance vector machine in a robust cross-validation scheme. Particular brain networks have been associated with mental functions linked to WMC to a varying degree and are associated with age-related differences in performance. Comparing prediction performance between the young and old sample revealed age-specific effects: In young adults, we found a general unpredictability of WMC from RSFC in networks subserving WM, cognitive action control, vigilant attention, theory-of-mind cognition, and semantic memory, whereas in older adults each network significantly predicted WMC. Moreover, both WM-related and WM-unrelated networks were differently predictive in older adults with low versus high WMC. These results indicate that the within-network functional coupling during task-free states is specifically related to individual task performance in advanced age, suggesting neural-level reorganization. In particular, our findings support the notion of a decreased segregation of functional brain networks, deterioration of network integrity within different networks and/or compensation by reorganization as factors driving associations between individual WMC and within-network RSFC in older adults. Thus, using multivariate pattern regression provided novel insights into age-related brain reorganization by linking cognitive capacity to brain network integrity.

Joint Multi-modal Parcellation of the Human Striatum: Functions and Clinical Relevance

The human striatum is essential for both low- and high-level functions and has been implicated in the pathophysiology of various prevalent disorders, including Parkinson's disease (PD) and schizophrenia (SCZ). It is known to consist of structurally and functionally divergent subdivisions. However, previous parcellations are based on a single neuroimaging modality, leaving the extent of the multi-modal organization of the striatum unknown. Here, we investigated the organization of the striatum across three modalities-resting-state functional connectivity, probabilistic diffusion tractography, and structural covariance-to provide a holistic convergent view of its structure and function. We found convergent clusters in the dorsal, dorsolateral, rostral, ventral, and caudal striatum. Functional characterization revealed the anterior striatum to be mainly associated with cognitive and emotional functions, while the caudal striatum was related to action execution. Interestingly, significant structural atrophy in the rostral and ventral striatum was common to both PD and SCZ, but atrophy in the dorsolateral striatum was specifically attributable to PD. Our study revealed a cross-modal convergent organization of the striatum, representing a fundamental topographical model that can be useful for investigating structural and functional variability in aging and in clinical conditions.

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses1. The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset2-5. Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed.

Sex Classification by Resting State Brain Connectivity

A large amount of brain imaging research has focused on group studies delineating differences between males and females with respect to both cognitive performance as well as structural and functional brain organization. To supplement existing findings, the present study employed a machine learning approach to assess how accurately participants' sex can be classified based on spatially specific resting state (RS) brain connectivity, using 2 samples from the Human Connectome Project (n1 = 434, n2 = 310) and 1 fully independent sample from the 1000BRAINS study (n = 941). The classifier, which was trained on 1 sample and tested on the other 2, was able to reliably classify sex, both within sample and across independent samples, differing both with respect to imaging parameters and sample characteristics. Brain regions displaying highest sex classification accuracies were mainly located along the cingulate cortex, medial and lateral frontal cortex, temporoparietal regions, insula, and precuneus. These areas were stable across samples and match well with previously described sex differences in functional brain organization. While our data show a clear link between sex and regionally specific brain connectivity, they do not support a clear-cut dimorphism in functional brain organization that is driven by sex alone.

CBPtools: a Python package for regional connectivity-based parcellation

Regional connectivity-based parcellation (rCBP) is a widely used procedure for investigating the structural and functional differentiation within a region of interest (ROI) based on its long-range connectivity. No standardized software or guidelines currently exist for applying rCBP, making the method only accessible to those who develop their own tools. As such, there exists a discrepancy between the laboratories applying the procedure each with their own software solutions, making it difficult to compare and interpret the results. Here, we outline an rCBP procedure accompanied by an open source software package called CBPtools. CBPtools is a Python (version 3.5+) package that allows users to run an extensively evaluated rCBP analysis workflow on a given ROI. It currently supports two modalities: resting-state functional connectivity and structural connectivity based on diffusion-weighted imaging, along with support for custom connectivity matrices. Analysis parameters are customizable and the workflow can be scaled to a large number of subjects using a parallel processing environment. Parcellation results with corresponding validity metrics are provided as textual and graphical output. Thus, CBPtools provides a simple plug-and-play, yet customizable way to conduct rCBP analyses. By providing an open-source software we hope to promote reproducible and comparable rCBP analyses and, importantly, make the rCBP procedure readily available. Here, we demonstrate the utility of CBPtools using a voluminous data set on an average compute-cluster infrastructure by performing rCBP on three ROIs prominently featured in parcellation literature.

Neurobiological Divergence of the Positive and Negative Schizophrenia Subtypes Identified on a New Factor Structure of Psychopathology Using Non-negative Factorization: An International Machine Learning Study

BACKGROUND

Disentangling psychopathological heterogeneity in schizophrenia is challenging, and previous results remain inconclusive. We employed advanced machine learning to identify a stable and generalizable factorization of the Positive and Negative Syndrome Scale and used it to identify psychopathological subtypes as well as their neurobiological differentiations.

METHODS

Positive and Negative Syndrome Scale data from the Pharmacotherapy Monitoring and Outcome Survey cohort (1545 patients; 586 followed up after 1.35 ± 0.70 years) were used for learning the factor structure by an orthonormal projective non-negative factorization. An international sample, pooled from 9 medical centers across Europe, the United States, and Asia (490 patients), was used for validation. Patients were clustered into psychopathological subtypes based on the identified factor structure, and the neurobiological divergence between the subtypes was assessed by classification analysis on functional magnetic resonance imaging connectivity patterns.

RESULTS

A 4-factor structure representing negative, positive, affective, and cognitive symptoms was identified as the most stable and generalizable representation of psychopathology. It showed higher internal consistency than the original Positive and Negative Syndrome Scale subscales and previously proposed factor models. Based on this representation, the positive-negative dichotomy was confirmed as the (only) robust psychopathological subtypes, and these subtypes were longitudinally stable in about 80% of the repeatedly assessed patients. Finally, the individual subtype could be predicted with good accuracy from functional connectivity profiles of the ventromedial frontal cortex, temporoparietal junction, and precuneus.

CONCLUSIONS

Machine learning applied to multisite data with cross-validation yielded a factorization generalizable across populations and medical systems. Together with subtyping and the demonstrated ability to predict subtype membership from neuroimaging data, this work further disentangles the heterogeneity in schizophrenia.

Multimodal Parcellations and Extensive Behavioral Profiling Tackling the Hippocampus Gradient

The hippocampus displays a complex organization and function that is perturbed in many neuropathologies. Histological work revealed a complex arrangement of subfields along the medial-lateral and the ventral-dorsal dimension, which contrasts with the anterior-posterior functional differentiation. The variety of maps has raised the need for an integrative multimodal view. We applied connectivity-based parcellation to 1) intrinsic connectivity 2) task-based connectivity, and 3) structural covariance, as complementary windows into structural and functional differentiation of the hippocampus. Strikingly, while functional properties (i.e., intrinsic and task-based) revealed similar partitions dominated by an anterior-posterior organization, structural covariance exhibited a hybrid pattern reflecting both functional and cytoarchitectonic subdivision. Capitalizing on the consistency of functional parcellations, we defined robust functional maps at different levels of partitions, which are openly available for the scientific community. Our functional maps demonstrated a head-body and tail partition, subdivided along the anterior-posterior and medial-lateral axis. Behavioral profiling of these fine partitions based on activation data indicated an emotion-cognition gradient along the anterior-posterior axis and additionally suggested a self-world-centric gradient supporting the role of the hippocampus in the construction of abstract representations for spatial navigation and episodic memory.

Integration and Segregation of Default Mode Network Resting-State Functional Connectivity in Transition-Age Males with High-Functioning Autism Spectrum Disorder: A Proof-of-Concept Study

The aim of this study is to assess the resting-state functional connectivity (RsFc) profile of the default mode network (DMN) in transition-age males with autism spectrum disorder (ASD). Resting-state blood oxygen level-dependent functional magnetic resonance imaging data were acquired from adolescent and young adult males with high-functioning ASD (n = 15) and from age-, sex-, and intelligence quotient-matched healthy controls (HCs; n = 16). The DMN was examined by assessing the positive and negative RsFc correlations of an average of the literature-based conceptualized major DMN nodes (medial prefrontal cortex [mPFC], posterior cingulate cortex, bilateral angular, and inferior temporal gyrus regions). RsFc data analysis was performed using a seed-driven approach. ASD was characterized by an altered pattern of RsFc in the DMN. The ASD group exhibited a weaker pattern of intra- and extra-DMN-positive and -negative RsFc correlations, respectively. In ASD, the strength of intra-DMN coupling was significantly reduced with the mPFC and the bilateral angular gyrus regions. In addition, the polarity of the extra-DMN correlation with the right hemispheric task-positive regions of fusiform gyrus and supramarginal gyrus was reversed from typically negative to positive in the ASD group. A wide variability was observed in the presentation of the RsFc profile of the DMN in both HC and ASD groups that revealed a distinct pattern of subgrouping using pattern recognition analyses. These findings imply that the functional architecture profile of the DMN is altered in ASD with weaker than expected integration and segregation of DMN RsFc. Future studies with larger sample sizes are warranted.

Prediction of outcome after aneurysmal subarachnoid haemorrhage using data from patient admission

OBJECTIVES

The pathogenesis leading to poor functional outcome after aneurysmal subarachnoid haemorrhage (aSAH) is multifactorial and not fully understood. We evaluated a machine learning approach based on easily determinable clinical and CT perfusion (CTP) features in the course of patient admission to predict the functional outcome 6 months after ictus.

METHODS

Out of 630 consecutive subarachnoid haemorrhage patients (2008-2015), 147 (mean age 54.3, 66.7% women) were retrospectively included (Inclusion: aSAH, admission within 24 h of ictus, CTP within 24 h of admission, documented modified Rankin scale (mRS) grades after 6 months. Exclusion: occlusive therapy before first CTP, previous aSAH, CTP not evaluable). A random forests model with conditional inference trees was optimised and trained on sex, age, World Federation of Neurosurgical Societies (WFNS) and modified Fisher grades, aneurysm in anterior vs. posterior circulation, early external ventricular drainage (EVD), as well as MTT and T_max maximum, mean, standard deviation (SD), range, 75th quartile and interquartile range to predict dichotomised mRS (≤ 2; > 2). Performance was assessed using the balanced accuracy over the training and validation folds using 20 repeats of 10-fold cross-validation.

RESULTS

In the final model, using 200 trees and the synthetic minority oversampling technique, median balanced accuracy was 84.4% (SD 0.7) over the training folds and 70.9% (SD 1.2) over the validation folds. The five most important features were the modified Fisher grade, age, MTT range, WFNS and early EVD.

CONCLUSIONS

A random forests model trained on easily determinable features in the course of patient admission can predict the functional outcome 6 months after aSAH with considerable accuracy.

KEY POINTS

• Features determinable in the course of admission of a patient with aneurysmal subarachnoid haemorrhage (aSAH) can predict the functional outcome 6 months after the occurrence of aSAH. • The top five predictive features were the modified Fisher grade, age, the mean transit time (MTT) range from computed tomography perfusion (CTP), the WFNS grade and the early necessity for an external ventricular drainage (EVD). • The range between the minimum and the maximum MTT may prove to be a valuable biomarker for detrimental functional outcome.

Predicting personality from network-based resting-state functional connectivity

Personality is associated with variation in all kinds of mental faculties, including affective, social, executive, and memory functioning. The intrinsic dynamics of neural networks underlying these mental functions are reflected in their functional connectivity at rest (RSFC). We, therefore, aimed to probe whether connectivity in functional networks allows predicting individual scores of the five-factor personality model and potential gender differences thereof. We assessed nine meta-analytically derived functional networks, representing social, affective, executive, and mnemonic systems. RSFC of all networks was computed in a sample of 210 males and 210 well-matched females and in a replication sample of 155 males and 155 females. Personality scores were predicted using relevance vector machine in both samples. Cross-validation prediction accuracy was defined as the correlation between true and predicted scores. RSFC within networks representing social, affective, mnemonic, and executive systems significantly predicted self-reported levels of Extraversion, Neuroticism, Agreeableness, and Openness. RSFC patterns of most networks, however, predicted personality traits only either in males or in females. Personality traits can be predicted by patterns of RSFC in specific functional brain networks, providing new insights into the neurobiology of personality. However, as most associations were gender-specific, RSFC-personality relations should not be considered independently of gender.

A simple plug-in bagging ensemble based on threshold-moving for classifying binary and multiclass imbalanced data

Class imbalance presents a major hurdle in the application of classification methods. A commonly taken approach is to learn ensembles of classifiers using rebalanced data. Examples include bootstrap averaging (bagging) combined with either undersampling or oversampling of the minority class examples. However, rebalancing methods entail asymmetric changes to the examples of different classes, which in turn can introduce their own biases. Furthermore, these methods often require specifying the performance measure of interest a priori, i.e., before learning. An alternative is to employ the threshold moving technique, which applies a threshold to the continuous output of a model, offering the possibility to adapt to a performance measure a posteriori, i.e., a plug-in method. Surprisingly, little attention has been paid to this combination of a bagging ensemble and threshold-moving. In this paper, we study this combination and demonstrate its competitiveness. Contrary to the other resampling methods, we preserve the natural class distribution of the data resulting in well-calibrated posterior probabilities. Additionally, we extend the proposed method to handle multiclass data. We validated our method on binary and multiclass benchmark data sets by using both, decision trees and neural networks as base classifiers. We perform analyses that provide insights into the proposed method.

Phytocannabinoids for Cancer Therapeutics: Recent Updates and Future Prospects

Phytocannabinoids (pCBs) are lipid-soluble phytochemicals present in the plant, Cannabis sativa L. and non-cannabis plants which have a long history in recreation and traditional medicine. The plant and the constituents isolated were central in the discovery of the endocannabinoid system (ECS), the most new target for drug discovery. The ECS includes two G-protein-coupled receptors; the cannabinoid receptors-1 and -2 (CB1 and CB2) for marijuana's psychoactive principle Δ(9)-tetrahydrocannabinol (Δ(9)-THC), their endogenous small lipid ligands; namely anandamide (AEA) and 2-arachidonoylglycerol (2-AG), also known as endocannabinoids and the enzymes for endocannabinoid biosynthesis and degradation such as fatty acid amide hydrolase (FAAH) and monoacylglycerol lipase (MAGL). The ECS has been suggested as a pro-homeostatic and pleiotropic signaling system activated in a time- and tissue-specific way during pathological conditions including cancer. Targeting the CB1 receptors becomes a concern because of adverse psychotropic reactions. Hence, targeting the CB2 receptors or the endocannabinoid metabolizing enzymes by pCBs obtained from plants lacking psychotropic adverse reactions has garnered interest in drug discovery. These pCBs derived from plants appear safe and effective with a wider access and availability. In the recent years, several pCBs derived other than non-cannabinoid plants have been reported to bind to and functionally interact with cannabinoid receptors and appear promising candidate for drug development including cancer therapeutics. Several of them also targets the endocannabinoid metabolizing enzymes that control endocannabinoid levels. In this article, we summarize and critically discuss the updates and future prospects of the pCBs as novel and promising candidates for cancer therapeutics.

Alignment-free genome tree inference by learning group-specific distance metrics

Understanding the evolutionary relationships between organisms is vital for their in-depth study. Gene-based methods are often used to infer such relationships, which are not without drawbacks. One can now attempt to use genome-scale information, because of the ever increasing number of genomes available. This opportunity also presents a challenge in terms of computational efficiency. Two fundamentally different methods are often employed for sequence comparisons, namely alignment-based and alignment-free methods. Alignment-free methods rely on the genome signature concept and provide a computationally efficient way that is also applicable to nonhomologous sequences. The genome signature contains evolutionary signal as it is more similar for closely related organisms than for distantly related ones. We used genome-scale sequence information to infer taxonomic distances between organisms without additional information such as gene annotations. We propose a method to improve genome tree inference by learning specific distance metrics over the genome signature for groups of organisms with similar phylogenetic, genomic, or ecological properties. Specifically, our method learns a Mahalanobis metric for a set of genomes and a reference taxonomy to guide the learning process. By applying this method to more than a thousand prokaryotic genomes, we showed that, indeed, better distance metrics could be learned for most of the 18 groups of organisms tested here. Once a group-specific metric is available, it can be used to estimate the taxonomic distances for other sequenced organisms from the group. This study also presents a large scale comparison between 10 methods--9 alignment-free and 1 alignment-based.

Copper phthalocyanine films deposited by liquid–liquid interface recrystallization technique (LLIRCT)

The simple recrystallization process is innovatively used to obtain the nanoparticles of copper phthalocyanine by a simple method. Liquid-liquid interface recrystallization technique (LLIRCT) has been employed successfully to produce small sized copper phthalocyanine nanoparticles with diameter between 3-5 nm. The TEM-SAED studies revealed the formation of 3-5 nm sized with beta-phase dominated mixture of alpha and beta copper phthalocyanine nanoparticles. The XRD, SEM, and the UV-vis studies were further carried out to confirm the formation of copper phthalocyanine thin films. The cyclic voltametry (CV) studies conclude that redox reaction is totally reversible one electron transfer process. The process is attributed to Cu(II)/Cu(I) redox reaction.

A simple visualization technique to understand the system dynamics in bioreactors

In this article, we present a graph theoretic method to visualize and analyze the system behavior under different operating conditions. The system attributes (or variables) are the nodes in the graphs, and partial correlation between a pair of attributes defines the distance between corresponding nodes, resulting in a fully connected graph. Then, the redundant links are reduced using Pathfinder Network Scaling technique to uncover the latent network structure. We use a simulated biological reactor dataset in normal and faulty operation to validate our method. The method is general and can be used to analyze several different systems.