Meta-matching as a simple framework to translate phenotypic predictive models from big to small data

Distinct cognitive and functional connectivity features from healthy cohorts can identify clinical obsessive-compulsive disorder

Improving diagnostic accuracy of obsessive-compulsive disorder (OCD) using models of brain imaging data is a key goal of the field, but this objective is challenging due to the limited size and phenotypic depth of clinical datasets. Leveraging the phenotypic diversity in large non-clinical datasets such as the UK Biobank (UKBB), offers a potential solution to this problem. Nevertheless, it remains unclear whether classification models trained on non-clinical populations will generalise to individuals with clinical OCD. This question is also relevant for the conceptualisation of OCD; specifically, whether the symptomology of OCD exists on a continuum from normal to pathological. Here, we examined a recently published "meta-matching" model trained on functional connectivity data from five large normative datasets (N=45,507) to predict cognitive, health and demographic variables. Specifically, we tested whether this model could classify OCD status in three independent clinical datasets (N=345). We found that the model could identify out-of-sample OCD individuals. Notably, the most predictive functional connectivity features mapped onto known cortico-striatal abnormalities in OCD and correlated with genetic brain expression maps previously implicated in the disorder. Further, the meta-matching model relied upon estimates of cognitive functions, such as cognitive flexibility and inhibition, to successfully predict OCD. These findings suggest that variability in non-clinical brain and behavioural features can discriminate clinical OCD status. These results support a dimensional and transdiagnostic conceptualisation of the brain and behavioural basis of OCD, with implications for research approaches and treatment targets.

Unveiling the core functional networks of cognition: An ontology-guided machine learning approach

Deciphering the functional architecture that underpins diverse cognitive functions is fundamental quest in neuroscience. In this study, we employed an innovative machine learning framework that integrated cognitive ontology with functional connectivity analysis to identify brain networks essential for cognition. We identified a core assembly of functional connectomes, primarily located within the association cortex, which showed superior predictive performance compared to two conventional methods widely employed in previous research across various cognitive domains. Our approach achieved a mean prediction accuracy of 0.13 across 16 cognitive tasks, including working memory, reading comprehension, and sustained attention, outperforming the traditional methods' accuracy of 0.08. In contrast, our method showed limited predictive power for sensory, motor, and emotional functions, with a mean prediction accuracy of 0.03 across 9 relevant tasks, slightly lower than the traditional methods' accuracy of 0.04. These cognitive connectomes were further characterized by distinctive patterns of resting-state functional connectivity, structural connectivity via white matter tracts, and gene expression, highlighting their neurogenetic underpinnings. Our findings reveal a domain-general functional network fingerprint that pivotal to cognition, offering a novel computational approach to explore the neural foundations of cognitive abilities.

A cortical surface template for human neuroscience

Neuroimaging data analysis relies on normalization to standard anatomical templates to resolve macroanatomical differences across brains. Existing human cortical surface templates sample locations unevenly because of distortions introduced by inflation of the folded cortex into a standard shape. Here we present the onavg template, which affords uniform sampling of the cortex. We created the onavg template based on openly available high-quality structural scans of 1,031 brains-25 times more than existing cortical templates. We optimized the vertex locations based on cortical anatomy, achieving an even distribution. We observed consistently higher multivariate pattern classification accuracies and representational geometry inter-participant correlations based on onavg than on other templates, and onavg only needs three-quarters as much data to achieve the same performance compared with other templates. The optimized sampling also reduces CPU time across algorithms by 1.3-22.4% due to less variation in the number of vertices in each searchlight.

Psychiatric neuroimaging designs for individualised, cohort, and population studies

Psychiatric neuroimaging faces challenges to rigour and reproducibility that prompt reconsideration of the relative strengths and limitations of study designs. Owing to high resource demands and varying inferential goals, current designs differentially emphasise sample size, measurement breadth, and longitudinal assessments. In this overview and perspective, we provide a guide to the current landscape of psychiatric neuroimaging study designs with respect to this balance of scientific goals and resource constraints. Through a heuristic data cube contrasting key design features, we discuss a resulting trade-off among small sample, precision longitudinal studies (e.g., individualised studies and cohorts) and large sample, minimally longitudinal, population studies. Precision studies support tests of within-person mechanisms, via intervention and tracking of longitudinal course. Population studies support tests of generalisation across multifaceted individual differences. A proposed reciprocal validation model (RVM) aims to recursively leverage these complementary designs in sequence to accumulate evidence, optimise relative strengths, and build towards improved long-term clinical utility.

Functional brain networks are associated with both sex and gender in children

Sex and gender are associated with human behavior throughout the life span and across health and disease, but whether they are associated with similar or distinct neural phenotypes is unknown. Here, we demonstrate that, in children, sex and gender are uniquely reflected in the intrinsic functional connectivity of the brain. Somatomotor, visual, control, and limbic networks are preferentially associated with sex, while network correlates of gender are more distributed throughout the cortex. These results suggest that sex and gender are irreducible to one another not only in society but also in biology.

Individual characteristics outperform resting-state fMRI for the prediction of behavioral phenotypes

In this study, we aimed to compare imaging-based features of brain function, measured by resting-state fMRI (rsfMRI), with individual characteristics such as age, gender, and total intracranial volume to predict behavioral measures. We developed a machine learning framework based on rsfMRI features in a dataset of 20,000 healthy individuals from the UK Biobank, focusing on temporal complexity and functional connectivity measures. Our analysis across four behavioral phenotypes revealed that both temporal complexity and functional connectivity measures provide comparable predictive performance. However, individual characteristics consistently outperformed rsfMRI features in predictive accuracy, particularly in analyses involving smaller sample sizes. Integrating rsfMRI features with demographic data sometimes enhanced predictive outcomes. The efficacy of different predictive modeling techniques and the choice of brain parcellation atlas were also examined, showing no significant influence on the results. To summarize, while individual characteristics are superior to rsfMRI in predicting behavioral phenotypes, rsfMRI still conveys additional predictive value in the context of machine learning, such as investigating the role of specific brain regions in behavioral phenotypes.

Quality over quantity: powering neuroimaging samples in psychiatry

Neuroimaging has been widely adopted in psychiatric research, with hopes that these non-invasive methods will provide important clues to the underpinnings and prediction of various mental health symptoms and outcomes. However, the translational impact of neuroimaging has not yet reached its promise, despite the plethora of computational methods, tools, and datasets at our disposal. Some have lamented that too many psychiatric neuroimaging studies have been underpowered with respect to sample size. In this review, we encourage this discourse to shift from a focus on sheer increases in sample size to more thoughtful choices surrounding experimental study designs. We propose considerations at multiple decision points throughout the study design, data modeling and analysis process that may help researchers working in psychiatric neuroimaging boost power for their research questions of interest without necessarily increasing sample size. We also provide suggestions for leveraging multiple datasets to inform each other and strengthen our confidence in the generalization of findings to both population-level and clinical samples. Through a greater emphasis on improving the quality of brain-based and clinical measures rather than merely quantity, meaningful and potentially translational clinical associations with neuroimaging measures can be achieved with more modest sample sizes in psychiatry.

Never-Ending Learning for Explainable Brain Computing

Exploring the nature of human intelligence and behavior is a longstanding pursuit in cognitive neuroscience, driven by the accumulation of knowledge, information, and data across various studies. However, achieving a unified and transparent interpretation of findings presents formidable challenges. In response, an explainable brain computing framework is proposed that employs the never-ending learning paradigm, integrating evidence combination and fusion computing within a Knowledge-Information-Data (KID) architecture. The framework supports continuous brain cognition investigation, utilizing joint knowledge-driven forward inference and data-driven reverse inference, bolstered by the pre-trained language modeling techniques and the human-in-the-loop mechanisms. In particular, it incorporates internal evidence learning through multi-task functional neuroimaging analyses and external evidence learning via topic modeling of published neuroimaging studies, all of which involve human interactions at different stages. Based on two case studies, the intricate uncertainty surrounding brain localization in human reasoning is revealed. The present study also highlights the potential of systematization to advance explainable brain computing, offering a finer-grained understanding of brain activity patterns related to human intelligence.

The Prediction of Brain Activity from Connectivity: Advances and Applications

The human brain is composed of multiple, discrete, functionally specialized regions that are interconnected to form large-scale distributed networks. Using advanced brain-imaging methods and machine-learning analytical approaches, recent studies have demonstrated that regional brain activity during the performance of various cognitive tasks can be accurately predicted from patterns of task-independent brain connectivity. In this review article, we first present evidence for the predictability of brain activity from structural connectivity (i.e., white matter connections) and functional connectivity (i.e., temporally synchronized task-free activations). We then discuss the implications of such predictions to clinical populations, such as patients diagnosed with psychiatric disorders or neurologic diseases, and to the study of brain-behavior associations. We conclude that connectivity may serve as an infrastructure that dictates brain activity, and we pinpoint several open questions and directions for future research.

Reliability and predictability of phenotype information from functional connectivity in large imaging datasets

One of the central objectives of contemporary neuroimaging research is to create predictive models that can disentangle the connection between patterns of functional connectivity across the entire brain and various behavioral traits. Previous studies have shown that models trained to predict behavioral features from the individual's functional connectivity have modest to poor performance. In this study, we trained models that predict observable individual traits (phenotypes) and their corresponding singular value decomposition (SVD) representations - herein referred to as latent phenotypes from resting state functional connectivity. For this task, we predicted phenotypes in two large neuroimaging datasets: the Human Connectome Project (HCP) and the Philadelphia Neurodevelopmental Cohort (PNC). We illustrate the importance of regressing out confounds, which could significantly influence phenotype prediction. Our findings reveal that both phenotypes and their corresponding latent phenotypes yield similar predictive performance. Interestingly, only the first five latent phenotypes were reliably identified, and using just these reliable phenotypes for predicting phenotypes yielded a similar performance to using all latent phenotypes. This suggests that the predictable information is present in the first latent phenotypes, allowing the remainder to be filtered out without any harm in performance. This study sheds light on the intricate relationship between functional connectivity and the predictability and reliability of phenotypic information, with potential implications for enhancing predictive modeling in the realm of neuroimaging research.

Pre-acquired Functional Connectivity Predicts Choice Inconsistency

Economic choice theories usually assume that humans maximize utility in their choices. However, studies have shown that humans make inconsistent choices, leading to suboptimal behavior, even without context-dependent manipulations. Previous studies showed that activation in value and motor networks are associated with inconsistent choices at the moment of choice. Here, we investigated if the neural predispositions, measured before a choice task, can predict choice inconsistency in a later risky choice task. Using functional connectivity (FC) measures from resting-state functional magnetic resonance imaging (rsfMRI), derived before any choice was made, we aimed to predict subjects' inconsistency levels in a later-performed choice task. We hypothesized that rsfMRI FC measures extracted from value and motor brain areas would predict inconsistency. Forty subjects (21 females) completed a rsfMRI scan before performing a risky choice task. We compared models that were trained on FC that included only hypothesized value and motor regions with models trained on whole-brain FC. We found that both model types significantly predicted inconsistency levels. Moreover, even the whole-brain models relied mostly on FC between value and motor areas. For external validation, we used a neural network pretrained on FC matrices of 37,000 subjects and fine-tuned it on our data and again showed significant predictions. Together, this shows that the tendency for choice inconsistency is predicted by predispositions of the nervous system and that synchrony between the motor and value networks plays a crucial role in this tendency.

Unveiling the Core Functional Networks of Cognition: An Ontology-Guided Machine Learning Approach

Deciphering the functional architecture that underpins diverse cognitive functions is fundamental quest in neuroscience. In this study, we employed an innovative machine learning framework that integrated cognitive ontology with functional connectivity analysis to identify brain networks essential for cognition. We identified a core assembly of functional connectomes, primarily located within the association cortex, which showed superior predictive performance compared to two conventional methods widely employed in previous research across various cognitive domains. Our approach achieved a mean prediction accuracy of 0.13 across 16 cognitive tasks, including working memory, reading comprehension, and sustained attention, outperforming the traditional methods' accuracy of 0.08. In contrast, our method showed limited predictive power for sensory, motor, and emotional functions, with a mean prediction accuracy of 0.03 across 9 relevant tasks, slightly lower than the traditional methods' accuracy of 0.04. These cognitive connectomes were further characterized by distinctive patterns of resting-state functional connectivity, structural connectivity via white matter tracts, and gene expression, highlighting their neurogenetic underpinnings. Our findings reveal a domain-general functional network fingerprint that pivotal to cognition, offering a novel computational approach to explore the neural foundations of cognitive abilities.

Translating phenotypic prediction models from big to small anatomical MRI data using meta-matching

Individualized phenotypic prediction based on structural MRI is an important goal in neuroscience. Prediction performance increases with larger samples, but small-scale datasets with fewer than 200 participants are often unavoidable. We have previously proposed a "meta-matching" framework to translate models trained from large datasets to improve the prediction of new unseen phenotypes in small collection efforts. Meta-matching exploits correlations between phenotypes, yielding large improvement over classical machine learning when applied to prediction models using resting-state functional connectivity as input features. Here, we adapt the two best performing meta-matching variants ("meta-matching finetune" and "meta-matching stacking") from our previous study to work with T1-weighted MRI data by changing the base neural network architecture to a 3D convolution neural network. We compare the two meta-matching variants with elastic net and classical transfer learning using the UK Biobank (N = 36,461), Human Connectome Project Young Adults (HCP-YA) dataset (N = 1,017) and HCP-Aging dataset (N = 656). We find that meta-matching outperforms elastic net and classical transfer learning by a large margin, both when translating models within the same dataset, as well as translating models across datasets with different MRI scanners, acquisition protocols and demographics. For example, when translating a UK Biobank model to 100 HCP-YA participants, meta-matching finetune yielded a 136% improvement in variance explained over transfer learning, with an average absolute gain of 2.6% (minimum = -0.9%, maximum = 17.6%) across 35 phenotypes. Overall, our results highlight the versatility of the meta-matching framework.

Multilayer meta-matching: translating phenotypic prediction models from multiple datasets to small data

Resting-state functional connectivity (RSFC) is widely used to predict phenotypic traits in individuals. Large sample sizes can significantly improve prediction accuracies. However, for studies of certain clinical populations or focused neuroscience inquiries, small-scale datasets often remain a necessity. We have previously proposed a "meta-matching" approach to translate prediction models from large datasets to predict new phenotypes in small datasets. We demonstrated large improvement of meta-matching over classical kernel ridge regression (KRR) when translating models from a single source dataset (UK Biobank) to the Human Connectome Project Young Adults (HCP-YA) dataset. In the current study, we propose two meta-matching variants ("meta-matching with dataset stacking" and "multilayer meta-matching") to translate models from multiple source datasets across disparate sample sizes to predict new phenotypes in small target datasets. We evaluate both approaches by translating models trained from five source datasets (with sample sizes ranging from 862 participants to 36,834 participants) to predict phenotypes in the HCP-YA and HCP-Aging datasets. We find that multilayer meta-matching modestly outperforms meta-matching with dataset stacking. Both meta-matching variants perform better than the original "meta-matching with stacking" approach trained only on the UK Biobank. All meta-matching variants outperform classical KRR and transfer learning by a large margin. In fact, KRR is better than classical transfer learning when less than 50 participants are available for finetuning, suggesting the difficulty of classical transfer learning in the very small sample regime. The multilayer meta-matching model is publicly available at GITHUB_LINK.

A common spectrum underlying brain disorders across lifespan revealed by deep learning on brain networks

Brain disorders in the early and late life of humans potentially share pathological alterations in brain functions. However, the key neuroimaging evidence remains unrevealed for elucidating such commonness and the relationships among these disorders. To explore this puzzle, we build a restricted single-branch deep learning model, using multi-site functional magnetic resonance imaging data (N = 4,410, 6 sites), for classifying 5 different early- and late-life brain disorders from healthy controls (cognitively unimpaired). Our model achieves 62.6 ± 1.9% overall classification accuracy and thus supports us in detecting a set of commonly affected functional subnetworks, including default mode, executive control, visual, and limbic networks. In the deep-layer representation of data, we observe young and aging patients with disorders are continuously distributed, which is in line with the clinical concept of the "spectrum of disorders." The relationships among brain disorders from the revealed spectrum promote the understanding of disorder comorbidities and time associations in the lifespan.

An atlas of trait associations with resting-state and task-evoked human brain functional organizations in the UK Biobank

Functional magnetic resonance imaging (fMRI) has been widely used to identify brain regions linked to critical functions, such as language and vision, and to detect tumors, strokes, brain injuries, and diseases. It is now known that large sample sizes are necessary for fMRI studies to detect small effect sizes and produce reproducible results. Here we report a systematic association analysis of 647 traits with imaging features extracted from resting-state and task-evoked fMRI data of more than 40,000 UK Biobank participants. We used a parcellation-based approach to generate 64,620 functional connectivity measures to reveal fine-grained details about cerebral cortex functional organizations. The difference between functional organizations at rest and during task was examined, and we have prioritized important brain regions and networks associated with a variety of human traits and clinical outcomes. For example, depression was most strongly associated with decreased connectivity in the somatomotor network. We have made our results publicly available and developed a browser framework to facilitate the exploration of brain function-trait association results (http://fmriatlas.org/).

The challenges and prospects of brain-based prediction of behaviour

Relating individual brain patterns to behaviour is fundamental in system neuroscience. Recently, the predictive modelling approach has become increasingly popular, largely due to the recent availability of large open datasets and access to computational resources. This means that we can use machine learning models and interindividual differences at the brain level represented by neuroimaging features to predict interindividual differences in behavioural measures. By doing so, we could identify biomarkers and neural correlates in a data-driven fashion. Nevertheless, this budding field of neuroimaging-based predictive modelling is facing issues that may limit its potential applications. Here we review these existing challenges, as well as those that we anticipate as the field develops. We focus on the impacts of these challenges on brain-based predictions. We suggest potential solutions to address the resolvable challenges, while keeping in mind that some general and conceptual limitations may also underlie the predictive modelling approach.

Prediction of cognitive scores by joint use of movie-watching fMRI connectivity and eye tracking via Attention-CensNet

Background

Brain functional connectivity under the naturalistic paradigm has been shown to be better at predicting individual behaviors than other brain states, such as rest and doing tasks. Nevertheless, the state-of-the-art methods have found it difficult to achieve desirable results from movie-watching paradigm functional magnetic resonance imaging (mfMRI) -induced brain functional connectivity, especially when there are fewer datasets. Incorporating other physical measurements into the prediction method may enhance accuracy. Eye tracking, becoming popular due to its portability and lower expense, can provide abundant behavioral features related to the output of human's cognition, and thus might supplement the mfMRI in observing participants' subconscious behaviors. However, there are very few studies on how to effectively integrate the multimodal information to strengthen the performance by a unified framework.

Objective

A fusion approach with mfMRI and eye tracking, based on convolution with edge-node switching in graph neural networks (CensNet), is proposed in this article.

Methods

In this graph model, participants are designated as nodes, mfMRI derived functional connectivity as node features, and different eye-tracking features are used to compute similarity between participants to construct heterogeneous graph edges. By taking multiple graphs as different channels, we introduce squeeze-and-excitation attention module to CensNet (A-CensNet) to integrate graph embeddings from multiple channels into one.

Results

The proposed model outperforms those using a single modality and single channel, and state-of-the-art methods.

Conclusions

The results indicate that brain functional activities and eye behaviors might complement each other in interpreting trait-like phenotypes.

Bias in machine learning models can be significantly mitigated by careful training: Evidence from neuroimaging studies

Despite the great promise that machine learning has offered in many fields of medicine, it has also raised concerns about potential biases and poor generalization across genders, age distributions, races and ethnicities, hospitals, and data acquisition equipment and protocols. In the current study, and in the context of three brain diseases, we provide evidence which suggests that when properly trained, machine learning models can generalize well across diverse conditions and do not necessarily suffer from bias. Specifically, by using multistudy magnetic resonance imaging consortia for diagnosing Alzheimer's disease, schizophrenia, and autism spectrum disorder, we find that well-trained models have a high area-under-the-curve (AUC) on subjects across different subgroups pertaining to attributes such as gender, age, racial groups and different clinical studies and are unbiased under multiple fairness metrics such as demographic parity difference, equalized odds difference, equal opportunity difference, etc. We find that models that incorporate multisource data from demographic, clinical, genetic factors, and cognitive scores are also unbiased. These models have a better predictive AUC across subgroups than those trained only with imaging features, but there are also situations when these additional features do not help.

Machine Learning for Precision Epilepsy Surgery

Brain surgery offers the best chance of seizure-freedom for patients with focal drug-resistant epilepsy, but only 50% achieve sustained seizure-freedom. With the explosion of data collected during routine presurgical evaluations and recent advances in computational science, we now have a tremendous potential to achieve precision epilepsy surgery: a data-driven tailoring of surgical planning. This review highlights the clinical need, the relevant computational science focusing on machine learning, and discusses some specific applications in epilepsy surgery.

Exploring the latent structure of behavior using the Human Connectome Project's data

How behavior arises from brain physiology has been one central topic of investigation in neuroscience. Considering the recent interest in predicting behavior from brain imaging using open datasets, there is the need for a principled approach to the categorization of behavioral variables. However, this is not trivial, as the definitions of psychological constructs and their relationships-their ontology-are not always clear. Here, we propose to use exploratory factor analysis (EFA) as a data-driven approach to find robust and interpretable domains of behavior in the Human Connectome Project (HCP) dataset. Additionally, we explore the clustering of behavioral variables using consensus clustering. We find that four and five factors offer the best description of the data, a result corroborated by the consensus clustering. In the four-factor solution, factors for Mental Health, Cognition, Processing Speed, and Substance Use arise. With five factors, Mental Health splits into Well-Being and Internalizing. Clustering results show a similar pattern, with clusters for Cognition, Processing Speed, Positive Affect, Negative Affect, and Substance Use. The factor structure is replicated in an independent dataset using confirmatory factor analysis (CFA). We discuss how the content of the factors fits with previous conceptualizations of general behavioral domains.

Leveraging Machine Learning for Gaining Neurobiological and Nosological Insights in Psychiatric Research

Much attention is currently devoted to developing diagnostic classifiers for mental disorders. Complementing these efforts, we highlight the potential of machine learning to gain biological insights into the psychopathology and nosology of mental disorders. Studies to this end have mainly used brain imaging data, which can be obtained noninvasively from large cohorts and have repeatedly been argued to reveal potentially intermediate phenotypes. This may become particularly relevant in light of recent efforts to identify magnetic resonance imaging-derived biomarkers that yield insight into pathophysiological processes as well as to refine the taxonomy of mental illness. In particular, the accuracy of machine learning models may be used as dependent variables to identify features relevant to pathophysiology. Moreover, such approaches may help disentangle the dimensional (within diagnosis) and often overlapping (across diagnoses) symptomatology of psychiatric illness. We also point out a multiview perspective that combines data from different sources, bridging molecular and system-level information. Finally, we summarize recent efforts toward a data-driven definition of subtypes or disease entities through unsupervised and semisupervised approaches. The latter, blending unsupervised and supervised concepts, may represent a particularly promising avenue toward dissecting heterogeneous categories. Finally, we raise several technical and conceptual aspects related to the reviewed approaches. In particular, we discuss common pitfalls pertaining to flawed input data or analytic procedures that would likely lead to unreliable outputs.

Interpreting mental state decoding with deep learning models

In mental state decoding, researchers aim to identify the set of mental states (e.g., experiencing happiness or fear) that can be reliably identified from the activity patterns of a brain region (or network). Deep learning (DL) models are highly promising for mental state decoding because of their unmatched ability to learn versatile representations of complex data. However, their widespread application in mental state decoding is hindered by their lack of interpretability, difficulties in applying them to small datasets, and in ensuring their reproducibility and robustness. We recommend approaching these challenges by leveraging recent advances in explainable artificial intelligence (XAI) and transfer learning, and also provide recommendations on how to improve the reproducibility and robustness of DL models in mental state decoding.