Probabilistic atlas for the language network based on precision fMRI data from >800 individuals

Soundless voices, silenced selves: are auditory verbal hallucinations in schizophrenia truly perceptual?

In much contemporary psychiatric training and practice, there is a strong emphasis on the audible or perceptual quality and externality of auditory verbal hallucinations in clinical assessments. A typical question during clinical assessment is asking whether the voices that a person hears sound identical to the way the clinician's voice is heard. In this Personal View, we argue that the most important factor in auditory verbal hallucinations in schizophrenia spectrum psychoses is a loss of first-person authority, and that a perceptual quality is not required for it to be this kind of hallucination. We draw on evidence from cognitive neuroscience showing that the activation of brain networks retrieved during capture of auditory verbal hallucinations that were experienced when a patient was in a functional MRI scanner does not match activation of networks retrieved during auditory perception. We propose that, despite early writings by Esquirol and Schneider that defined auditory verbal hallucinations as beliefs in perception rather than true perception, cognitive neuroscience, psychiatric training and practice, and patients adopting clinical vocabulary have been strongly influenced by the progression of the diagnostic criteria for schizophrenia, which increasingly place emphasis on language, such as the "full force" of a true perception. We hold that this change has resulted in an unhelpful top-down influence on the field, imposing perceptual qualities on auditory verbal hallucinations, and leading to misunderstandings and inaccuracies in clinical practice and patients' self-reports, and misinterpretations in cognitive neuroscience. We encourage a revision of the definition of auditory verbal hallucinations to move away from the necessity for auditory perception, and towards beliefs in perception due to the loss of first-person authority.

Spectral-switching analysis reveals real-time neuronal network representations of concurrent spontaneous naturalistic behaviors in human brain

Despite abundant evidence of functional networks in the human brain, their neuronal underpinnings, and relationships to real-time behavior have been challenging to resolve. Analyzing brain-wide intracranial-EEG recordings with video monitoring, acquired in awake subjects during clinical epilepsy evaluation, we discovered the tendency of each brain region to switch back and forth between 2 distinct power spectral densities (PSDs 2-55Hz). We further recognized that this 'spectral switching' occurs synchronously between distant sites, even between regions with differing baseline PSDs, revealing long-range functional networks that would be obscured in analysis of individual frequency bands. Moreover, the real-time PSD-switching dynamics of specific networks exhibited striking alignment with activities such as conversation and hand movements, revealing a multi-threaded functional network representation of concurrent naturalistic behaviors. Network structures and their relationships to behaviors were stable across days, but were altered during N3 sleep. Our results provide a new framework for understanding real-time, brain-wide neural-network dynamics.

Hypoactivation of the language network during auditory imagery contributes to hallucinations in Schizophrenia

Auditory verbal hallucinations (AVHs) involve perceptions, often voices, in the absence of external stimuli, and rank among the most common symptoms of schizophrenia. Metrical stress evaluation requires determination of the stronger syllable in words, and therefore requires auditory imagery, of interest for investigation of hallucinations in schizophrenia. The current functional magnetic resonance imaging study provides an updated whole-brain network analysis of a previously published study on metrical stress, which showed reduced directed connections between Broca's and Wernicke's regions of interest (ROIs) for hallucinations. Three functional brain networks were extracted, with the language network (LN) showing an earlier and shallower blood-oxygen-level dependent (BOLD) response for hallucinating patients, in the auditory imagery condition only (the reduced activation for hallucinations observed in the original ROI-based results were not specific to the imagery condition). This suggests that hypoactivation of the LN during internal auditory imagery may contribute to the propensity to hallucinate. This accords with cognitive accounts holding that an impaired balance between internal and external linguistic processes (underactivity in networks involved in internal auditory imagery and overactivity in networks involved in speech perception) contributes to our understanding of the biological underpinnings of hallucinations.

Resting-state functional connectivity correlates of brain structural aging in schizophrenia

A large body of research has shown that schizophrenia patients demonstrate increased brain structural aging. Although this process may be coupled with aberrant changes in intrinsic functional architecture of the brain, they remain understudied. We hypothesized that there are brain regions whose whole-brain functional connectivity at rest is differently associated with brain structural aging in schizophrenia patients compared to healthy controls. Eighty-four male schizophrenia patients and eighty-six male healthy controls underwent structural MRI and resting-state fMRI. The brain-predicted age difference (b-PAD) was a measure of brain structural aging. Resting-state fMRI was applied to obtain global correlation (GCOR) maps comprising voxelwise values of the strength and sign of functional connectivity of a given voxel with the rest of the brain. Schizophrenia patients had higher b-PAD compared to controls (mean between-group difference + 2.9 years). Greater b-PAD in schizophrenia patients, compared to controls, was associated with lower whole-brain functional connectivity of a region in frontal orbital cortex, inferior frontal gyrus, Heschl's Gyrus, plana temporale and polare, insula, and opercular cortices of the right hemisphere (rFTI). According to post hoc seed-based correlation analysis, decrease of functional connectivity with the posterior cingulate gyrus, left superior temporal cortices, as well as right angular gyrus/superior lateral occipital cortex has mainly driven the results. Lower functional connectivity of the rFTI was related to worse verbal working memory and language production. Our findings demonstrate that well-established frontotemporal functional abnormalities in schizophrenia are related to increased brain structural aging.

Functional dissociation of the language network and other cognition in early childhood

Is language distinct from other cognition during development? Does neural machinery for language emerge from general-purpose neural mechanisms, becoming tuned for language after years of experience and maturation? Answering these questions will shed light on the origins of domain-specificity in the brain. We address these questions using precision fMRI, scanning young children (35 months to 9 years of age) on an auditory language localizer, spatial working memory localizer (engaging the domain-general multiple demand [MD] network), and a resting-state scan. We create subject-specific functional regions of interest for each network and examine their selectivity, specificity, and functional connectivity. We find young children show domain-specific, left-lateralized language activation, and that the language network is not responsive to domain-general cognitive load. Additionally, the cortically adjacent MD network is selective to cognitive load, but not to language. These networks show higher within versus between-network functional connectivity. This connectivity is stable across ages (examined cross-sectionally and longitudinally), whereas language responses increase with age and across time within subject, reflecting a domain-specific developmental change. Overall, we provide evidence for a double dissociation of the language and MD network throughout development, in both their function and connectivity. These findings suggest that domain-specificity, even for uniquely human cognition like language, develops early and distinctly from mechanisms that presumably support other human cognition.

Precision fMRI reveals that the language network exhibits adult-like left-hemispheric lateralization by 4 years of age

Left hemisphere damage in adulthood often leads to linguistic deficits, but many cases of early damage leave linguistic processing preserved, and a functional language system can develop in the right hemisphere. To explain this early apparent equipotentiality of the two hemispheres for language, some have proposed that the language system is bilateral during early development and only becomes left-lateralized with age. We examined language lateralization using functional magnetic resonance imaging with two large pediatric cohorts (total n=273 children ages 4-16; n=107 adults). Strong, adult-level left-hemispheric lateralization (in activation volume and response magnitude) was evident by age 4. Thus, although the right hemisphere can take over language function in some cases of early brain damage, and although some features of the language system do show protracted development (magnitude of language response and strength of inter-regional correlations in the language network), the left-hemisphere bias for language is robustly present by 4 years of age. These results call for alternative accounts of early equipotentiality of the two hemispheres for language.

Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills

Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.

Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills

Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.

The Language Network Reliably "Tracks" Naturalistic Meaningful Nonverbal Stimuli

The language network, comprised of brain regions in the left frontal and temporal cortex, responds robustly and reliably during language comprehension but shows little or no response during many nonlinguistic cognitive tasks (e.g., Fedorenko & Blank, 2020). However, one domain whose relationship with language remains debated is semantics-our conceptual knowledge of the world. Given that the language network responds strongly to meaningful linguistic stimuli, could some of this response be driven by the presence of rich conceptual representations encoded in linguistic inputs? In this study, we used a naturalistic cognition paradigm to test whether the cognitive and neural resources that are responsible for language processing are also recruited for processing semantically rich nonverbal stimuli. To do so, we measured BOLD responses to a set of ∼5-minute-long video and audio clips that consisted of meaningful event sequences but did not contain any linguistic content. We then used the intersubject correlation (ISC) approach (Hasson et al., 2004) to examine the extent to which the language network "tracks" these stimuli, that is, exhibits stimulus-related variation. Across all the regions of the language network, meaningful nonverbal stimuli elicited reliable ISCs. These ISCs were higher than the ISCs elicited by semantically impoverished nonverbal stimuli (e.g., a music clip), but substantially lower than the ISCs elicited by linguistic stimuli. Our results complement earlier findings from controlled experiments (e.g., Ivanova et al., 2021) in providing further evidence that the language network shows some sensitivity to semantic content in nonverbal stimuli.

Comparative analysis of brain language templates with primary language areas detected from presurgical fMRI of brain tumor patients

INTRODUCTION

Functional brain templates are often used in the analysis of clinical functional MRI (fMRI) studies. However, these templates are mostly built based on anatomy or fMRI of healthy subjects, which have not been fully vetted in clinical cohorts. Our aim was to evaluate language templates by comparing with primary language areas (PLAs) detected from presurgical fMRI of brain tumor patients.

METHODS

Four language templates (A-D) based on anatomy, task-based fMRI, resting-state fMRI, and meta-analysis, respectively, were compared with PLAs detected by fMRI with word generation and sentence completion paradigms. For each template, the fraction of PLA activations enclosed by the template (positive inclusion fraction, [PIF]), the fraction of activations within the template but that did not belong to PLAs (false inclusion fraction, [FIF]), and their Dice similarity coefficient (DSC) with PLA activations were calculated.

RESULTS

For anterior PLAs, Template A had the greatest PIF (median, 0.95), whereas Template D had both the lowest FIF (median, 0.074), and the highest DSC (median, 0.30), which were all significant compared to other templates. For posterior PLAs, Templates B and D had similar PIF (median, 0.91 and 0.90, respectively) and DSC (both medians, 0.059), which were all significantly higher than that of Template C. Templates B and C had significantly lower FIF (median, 0.061 and 0.054, respectively) compared to Template D.

CONCLUSION

This study demonstrated significant differences between language templates in their inclusiveness of and spatial agreement with the PLAs detected in the presurgical fMRI of the patient cohort. These findings may help guide the selection of language templates tailored to their applications in clinical fMRI studies.

Distributed Sensitivity to Syntax and Semantics throughout the Language Network

Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.

Subthalamic nucleus-language network connectivity predicts dopaminergic modulation of speech function in Parkinson's disease

Speech impediments are a prominent yet understudied symptom of Parkinson's disease (PD). While the subthalamic nucleus (STN) is an established clinical target for treating motor symptoms, these interventions can lead to further worsening of speech. The interplay between dopaminergic medication, STN circuitry, and their downstream effects on speech in PD is not yet fully understood. Here, we investigate the effect of dopaminergic medication on STN circuitry and probe its association with speech and cognitive functions in PD patients. We found that changes in intrinsic functional connectivity of the STN were associated with alterations in speech functions in PD. Interestingly, this relationship was characterized by altered functional connectivity of the dorsolateral and ventromedial subdivisions of the STN with the language network. Crucially, medication-induced changes in functional connectivity between the STN's dorsolateral subdivision and key regions in the language network, including the left inferior frontal cortex and the left superior temporal gyrus, correlated with alterations on a standardized neuropsychological test requiring oral responses. This relation was not observed in the written version of the same test. Furthermore, changes in functional connectivity between STN and language regions predicted the medication's downstream effects on speech-related cognitive performance. These findings reveal a previously unidentified brain mechanism through which dopaminergic medication influences speech function in PD. Our study sheds light into the subcortical-cortical circuit mechanisms underlying impaired speech control in PD. The insights gained here could inform treatment strategies aimed at mitigating speech deficits in PD and enhancing the quality of life for affected individuals.

The language network as a natural kind within the broader landscape of the human brain

Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.

Bayesian modelling disentangles language versus executive control disruption in stroke

Stroke is the leading cause of long-term disability worldwide. Incurred brain damage can disrupt cognition, often with persisting deficits in language and executive capacities. Yet, despite their clinical relevance, the commonalities and differences between language versus executive control impairments remain under-specified. To fill this gap, we tailored a Bayesian hierarchical modelling solution in a largest-of-its-kind cohort (1080 patients with stroke) to deconvolve language and executive control with respect to the stroke topology. Cognitive function was assessed with a rich neuropsychological test battery including global cognitive function (tested with the Mini-Mental State Exam), language (assessed with a picture naming task), executive speech function (tested with verbal fluency tasks), executive control functions (Trail Making Test and Digit Symbol Coding Task), visuospatial functioning (Rey Complex Figure), as well as verbal learning and memory function (Soul Verbal Learning). Bayesian modelling predicted interindividual differences in eight cognitive outcome scores three months after stroke based on specific tissue lesion topologies. A multivariate factor analysis extracted four distinct cognitive factors that distinguish left- and right-hemispheric contributions to ischaemic tissue lesions. These factors were labelled according to the neuropsychological tests that had the strongest factor loadings: One factor delineated language and general cognitive performance and was mainly associated with damage to left-hemispheric brain regions in the frontal and temporal cortex. A factor for executive control summarized mental flexibility, task switching and visual-constructional abilities. This factor was strongly related to right-hemispheric brain damage of posterior regions in the occipital cortex. The interplay of language and executive control was reflected in two distinct factors that were labelled as executive speech functions and verbal memory. Impairments on both factors were mainly linked to left-hemispheric lesions. These findings shed light onto the causal implications of hemispheric specialization for cognition; and make steps towards subgroup-specific treatment protocols after stroke.

Artificial Neural Network Language Models Predict Human Brain Responses to Language Even After a Developmentally Realistic Amount of Training

Artificial neural networks have emerged as computationally plausible models of human language processing. A major criticism of these models is that the amount of training data they receive far exceeds that of humans during language learning. Here, we use two complementary approaches to ask how the models' ability to capture human fMRI responses to sentences is affected by the amount of training data. First, we evaluate GPT-2 models trained on 1 million, 10 million, 100 million, or 1 billion words against an fMRI benchmark. We consider the 100-million-word model to be developmentally plausible in terms of the amount of training data given that this amount is similar to what children are estimated to be exposed to during the first 10 years of life. Second, we test the performance of a GPT-2 model trained on a 9-billion-token dataset to reach state-of-the-art next-word prediction performance on the human benchmark at different stages during training. Across both approaches, we find that (i) the models trained on a developmentally plausible amount of data already achieve near-maximal performance in capturing fMRI responses to sentences. Further, (ii) lower perplexity-a measure of next-word prediction performance-is associated with stronger alignment with human data, suggesting that models that have received enough training to achieve sufficiently high next-word prediction performance also acquire representations of sentences that are predictive of human fMRI responses. In tandem, these findings establish that although some training is necessary for the models' predictive ability, a developmentally realistic amount of training (∼100 million words) may suffice.

Neural correlates of semantic-driven syntactic parsing in sentence comprehension

For sentence comprehension, information carried by semantic relations between constituents must be combined with other information to decode the constituent structure of a sentence, due to atypical and noisy situations of language use. Neural correlates of decoding sentence structure by semantic information have remained largely unexplored. In this functional MRI study, we examine the neural basis of semantic-driven syntactic parsing during sentence reading and compare it with that of other types of syntactic parsing driven by word order and case marking. Chinese transitive sentences of various structures were investigated, differing in word order, case making, and agent-patient semantic relations (i.e., same vs. different in animacy). For the non-canonical unmarked sentences without usable case marking, a semantic-driven effect triggered by agent-patient ambiguity was found in the left inferior frontal gyrus opercularis (IFGoper) and left inferior parietal lobule, with the activity not being modulated by naturalness factors of the sentences. The comparison between each type of non-canonical sentences with canonical sentences revealed that the non-canonicity effect engaged the left posterior frontal and temporal regions, in line with previous studies. No extra neural activity was found responsive to case marking within the non-canonical sentences. A word order effect across all types of sentences was also found in the left IFGoper, suggesting a common neural substrate between different types of parsing. The semantic-driven effect was also observed for the non-canonical marked sentences but not for the canonical sentences, suggesting that semantic information is used in decoding sentence structure in addition to case marking. The current findings illustrate the neural correlates of syntactic parsing with semantics, and provide neural evidence of how semantics facilitates syntax together with other information.

Lexical-Semantic Content, Not Syntactic Structure, Is the Main Contributor to ANN-Brain Similarity of fMRI Responses in the Language Network

Representations from artificial neural network (ANN) language models have been shown to predict human brain activity in the language network. To understand what aspects of linguistic stimuli contribute to ANN-to-brain similarity, we used an fMRI data set of responses to n = 627 naturalistic English sentences (Pereira et al., 2018) and systematically manipulated the stimuli for which ANN representations were extracted. In particular, we (i) perturbed sentences' word order, (ii) removed different subsets of words, or (iii) replaced sentences with other sentences of varying semantic similarity. We found that the lexical-semantic content of the sentence (largely carried by content words) rather than the sentence's syntactic form (conveyed via word order or function words) is primarily responsible for the ANN-to-brain similarity. In follow-up analyses, we found that perturbation manipulations that adversely affect brain predictivity also lead to more divergent representations in the ANN's embedding space and decrease the ANN's ability to predict upcoming tokens in those stimuli. Further, results are robust as to whether the mapping model is trained on intact or perturbed stimuli and whether the ANN sentence representations are conditioned on the same linguistic context that humans saw. The critical result-that lexical-semantic content is the main contributor to the similarity between ANN representations and neural ones-aligns with the idea that the goal of the human language system is to extract meaning from linguistic strings. Finally, this work highlights the strength of systematic experimental manipulations for evaluating how close we are to accurate and generalizable models of the human language network.

Disentangling neuroplasticity mechanisms in post-stroke language recovery

A major objective in post-stroke aphasia research is to gain a deeper understanding of neuroplastic mechanisms that drive language recovery, with the ultimate goal of enhancing treatment outcomes. Subsequent to recent advances in neuroimaging techniques, we now have the ability to examine more closely how neural activity patterns change after a stroke. However, the way these neural activity changes relate to language impairments and language recovery is still debated. The aim of this review is to provide a theoretical framework to better investigate and interpret neuroplasticity mechanisms underlying language recovery in post-stroke aphasia. We detail two sets of neuroplasticity mechanisms observed at the synaptic level that may explain functional neuroimaging findings in post-stroke aphasia recovery at the network level: feedback-based homeostatic plasticity and associative Hebbian plasticity. In conjunction with these plasticity mechanisms, higher-order cognitive control processes dynamically modulate neural activity in other regions to meet communication demands, despite reduced neural resources. This work provides a network-level neurobiological framework for understanding neural changes observed in post-stroke aphasia and can be used to define guidelines for personalized treatment development.

Mapping of facial and vocal processing in common marmosets with ultra-high field fMRI

Primate communication relies on multimodal cues, such as vision and audition, to facilitate the exchange of intentions, enable social interactions, avoid predators, and foster group cohesion during daily activities. Understanding the integration of facial and vocal signals is pivotal to comprehend social interaction. In this study, we acquire whole-brain ultra-high field (9.4 T) fMRI data from awake marmosets (Callithrix jacchus) to explore brain responses to unimodal and combined facial and vocal stimuli. Our findings reveal that the multisensory condition not only intensifies activations in the occipito-temporal face patches and auditory voice patches but also engages a more extensive network that includes additional parietal, prefrontal and cingulate areas, compared to the summed responses of the unimodal conditions. By uncovering the neural network underlying multisensory audiovisual integration in marmosets, this study highlights the efficiency and adaptability of the marmoset brain in processing facial and vocal social signals, providing significant insights into primate social communication.

Driving and suppressing the human language network using large language models

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of the brain response associated with each sentence. We then use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress the activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also non-invasively control neural activity in higher-level cortical areas, such as the language network.

Inter-individual, hemispheric and sex variability of brain activations during numerosity processing

Numerosity perception is a fundamental and innate cognitive function shared by both humans and many animal species. Previous research has primarily focused on exploring the spatial and functional consistency of neural activations that were associated with the processing of numerosity information. However, the inter-individual variability of brain activations of numerosity perception remains unclear. In the present study, with a large-sample functional magnetic resonance imaging (fMRI) dataset (n = 460), we aimed to localize the functional regions related to numerosity perceptions and explore the inter-individual, hemispheric, and sex differences within these brain regions. Fifteen subject-specific activated regions, including the anterior intraparietal sulcus (aIPS), posterior intraparietal sulcus (pIPS), insula, inferior frontal gyrus (IFG), inferior temporal gyrus (ITG), premotor area (PM), middle occipital gyrus (MOG) and anterior cingulate cortex (ACC), were delineated in each individual and then used to create a functional probabilistic atlas to quantify individual variability in brain activations of numerosity processing. Though the activation percentages of most regions were higher than 60%, the intersections of most regions across individuals were considerably lower, falling below 50%, indicating substantial variations in brain activations related to numerosity processing among individuals. Furthermore, significant hemispheric and sex differences in activation location, extent, and magnitude were also found in these regions. Most activated regions in the right hemisphere had larger activation volumes and activation magnitudes, and were located more lateral and anterior than their counterparts in the left hemisphere. In addition, in most of these regions, males displayed stronger activations than females. Our findings demonstrate large inter-individual, hemispheric, and sex differences in brain activations related to numerosity processing, and our probabilistic atlas can serve as a robust functional and spatial reference for mapping the numerosity-related neural networks.

Mapping individual aspects of bilingual experience to adaptations in brain structure

Individual differences in using multiple languages are thought to differentially affect brain structure and function. The present study assessed the neuroanatomical predictions of an emerging theory, the Unifying the Bilingual Experience Trajectories framework, which provides the most comprehensive set of predictions of how individual differences in bilingual experiences lead to specific neural and cognitive adaptations. A total of 140 young adults with variable language experiences were scanned using magnetic resonance imaging and completed demographic questionnaires. Brain structure measures implicated in predictions of the Unifying the Bilingual Experience Trajectories model were extracted and regressed against the model's experiential factors. Consistent with the model's predictions, greater intensity and diversity of bilingual language use resulted in changes in gray matter volume in cortical regions involved in executive control (including inferior frontal gyrus, middle temporal gyrus, angular gyrus, and medial frontal gyrus), indicating adaptations toward handling increased executive control demands. Conversely, duration of bilingual engagement resulted in changes within white matter microstructure (bilateral superior longitudinal fasciculus) and increases in subcortical gray matter (left caudate), indicative of adaptations toward increased efficiency of control. Overall, this research enhances our understanding of how bilingual experiences influence brain structure and provides the first direct empirical evidence for the predictions made by the Unifying the Bilingual Experience Trajectories framework.

Fractionating difficulty during sentence comprehension using functional neuroimaging

Sentence comprehension is highly practiced and largely automatic, but this belies the complexity of the underlying processes. We used functional neuroimaging to investigate garden-path sentences that cause difficulty during comprehension, in order to unpack the different processes used to support sentence interpretation. By investigating garden-path and other types of sentences within the same individuals, we functionally profiled different regions within the temporal and frontal cortices in the left hemisphere. The results revealed that different aspects of comprehension difficulty are handled by left posterior temporal, left anterior temporal, ventral left frontal, and dorsal left frontal cortices. The functional profiles of these regions likely lie along a spectrum of specificity to generality, including language-specific processing of linguistic representations, more general conflict resolution processes operating over linguistic representations, and processes for handling difficulty in general. These findings suggest that difficulty is not unitary and that there is a role for a variety of linguistic and non-linguistic processes in supporting comprehension.

Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI

How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher-proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g., related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages co-exist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.

Efficient functional localization of language regions in the brain

Important recent advances in the cognitive neuroscience of language have been made using functional localizers to demarcate language-selective regions in individual brains. Although single-subject localizers offer insights that are unavailable in classic group analyses, they require additional scan time that imposes costs on investigators and participants. In particular, the unique practical challenges of scanning children and other special populations has led to less adoption of localizers for neuroimaging research with these theoretically and clinically important groups. Here, we examined how measurements of the spatial extent and functional response profiles of language regions are affected by the duration of an auditory language localizer. We compared how parametrically smaller amounts of data collected from one scanning session affected (i) consistency of group-level whole-brain parcellations, (ii) functional selectivity of subject-level activation in individually defined functional regions of interest (fROIs), (iii) sensitivity and specificity of subject-level whole-brain and fROI activation, and (iv) test-retest reliability of subject-level whole-brain and fROI activation. For many of these metrics, the localizer duration could be reduced by 50-75% while preserving the stability and reliability of both the spatial extent and functional response profiles of language areas. These results indicate that, for most measures relevant to cognitive neuroimaging studies, the brain's language network can be localized just as effectively with 3.5 min of scan time as it can with 12 min. Minimizing the time required to reliably localize the brain's language network allows more effective localizer use in situations where each minute of scan time is particularly precious.

When the Brain Cares: Personal interests amplify engagement of language, self-reference, and reward regions in the brains of children with and without autism

Human language is shaped by individual experiences and interests. However, to study language in the brain, researchers use generic stimuli, avoiding the variable personal interests that typically animate language. Thus, it is unknown how personal interests affect language function in the brain. We conducted personalized functional magnetic resonance imaging (fMRI) in 20 typically-developing children as they listened to personalized narratives about their specific interest and non-personalized, generic narratives. Personally-interesting narratives amplified engagement of language regions, producing more consistent activation patterns across individuals - even though each narrative was unique - than the generic narratives. The personalized narratives also engaged self-reference and reward areas of the brain associated with motivation. Amplification of brain responses to personally-interesting narratives was also observed in 15 autistic children, a condition characterized by both intense specific interests and difficulties with communication. Here we show that personal interests significantly affect language processing in the human brain.

Driving and suppressing the human language network using large language models

Transformer models such as GPT generate human-like language and are highly predictive of human brain responses to language. Here, using fMRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of brain response associated with each sentence. Then, we use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also noninvasively control neural activity in higher-level cortical areas, like the language network.

Joint cortical registration of geometry and function using semi-supervised learning

Brain surface-based image registration, an important component of brain image analysis, establishes spatial correspondence between cortical surfaces. Existing iterative and learning-based approaches focus on accurate registration of folding patterns of the cerebral cortex, and assume that geometry predicts function and thus functional areas will also be well aligned. However, structure/functional variability of anatomically corresponding areas across subjects has been widely reported. In this work, we introduce a learning-based cortical registration framework, JOSA, which jointly aligns folding patterns and functional maps while simultaneously learning an optimal atlas. We demonstrate that JOSA can substantially improve registration performance in both anatomical and functional domains over existing methods. By employing a semi-supervised training strategy, the proposed framework obviates the need for functional data during inference, enabling its use in broad neuroscientific domains where functional data may not be observed. The source code of JOSA will be released to the public at https://voxelmorph.net.

Bayesian modeling disentangles language versus executive control disruption in stroke

Stroke is the leading cause of long-term disability worldwide. Incurred brain damage disrupts cognition, often with persisting deficits in language and executive capacities. Despite their clinical relevance, the commonalities, and differences of language versus executive control impairments remain under-specified. We tailored a Bayesian hierarchical modeling solution in a largest-of-its-kind cohort (1080 stroke patients) to deconvolve language and executive control in the brain substrates of stroke insults. Four cognitive factors distinguished left- and right-hemispheric contributions to ischemic tissue lesion. One factor delineated language and general cognitive performance and was mainly associated with damage to left-hemispheric brain regions in the frontal and temporal cortex. A factor for executive control summarized control and visual-constructional abilities. This factor was strongly related to right-hemispheric brain damage of posterior regions in the occipital cortex. The interplay of language and executive control was reflected in two factors: executive speech functions and verbal memory. Impairments on both were mainly linked to left-hemispheric lesions. These findings shed light onto the causal implications of hemispheric specialization for cognition; and make steps towards subgroup-specific treatment protocols after stroke.

Constructed languages are processed by the same brain mechanisms as natural languages

What constitutes a language? Natural languages share some features with other domains: from math, to music, to gesture. However, the brain mechanisms that process linguistic input are highly specialized, showing little or no response to diverse non-linguistic tasks. Here, we examine constructed languages (conlangs) to ask whether they draw on the same neural mechanisms as natural languages, or whether they instead pattern with domains like math and logic. Using individual-subject fMRI analyses, we show that understanding conlangs recruits the same brain areas as natural language comprehension. This result holds for Esperanto (n=19 speakers)- created to resemble natural languages-and fictional conlangs (Klingon (n=10), Na'vi (n=9), High Valyrian (n=3), and Dothraki (n=3)), created to differ from natural languages, and suggests that conlangs and natural languages share critical features and that the notable differences between conlangs and natural language are not consequential for the cognitive and neural mechanisms that they engage.

An open dataset for intelligent recognition and classification of abnormal condition in longwall mining

The underground coal mine production of the fully mechanized mining face exists many problems, such as poor operating environment, high accident rate and so on. Recently, the intelligent autonomous coal mining is gradually replacing the traditional mining process. The artificial intelligence technology is an active research area and is expect to identify and warn the underground abnormal conditions for intelligent longwall mining. It is inseparable from the construction of datasets, but the downhole dataset is still blank at present. This work develops an image dataset of underground longwall mining face (DsLMF+), which consists of 138004 images with annotation 6 categories of mine personnel, hydraulic support guard plate, large coal, towline, miners' behaviour and mine safety helmet. All the labels of dataset are publicly available in YOLO format and COCO format. The availability and accuracy of the datasets were reviewed by experts in coal mine field. The dataset is open access and aims to support further research and advancement of the intelligent identification and classification of abnormal conditions for underground mining.

The human language system, including its inferior frontal component in "Broca's area," does not support music perception

Language and music are two human-unique capacities whose relationship remains debated. Some have argued for overlap in processing mechanisms, especially for structure processing. Such claims often concern the inferior frontal component of the language system located within "Broca's area." However, others have failed to find overlap. Using a robust individual-subject fMRI approach, we examined the responses of language brain regions to music stimuli, and probed the musical abilities of individuals with severe aphasia. Across 4 experiments, we obtained a clear answer: music perception does not engage the language system, and judgments about music structure are possible even in the presence of severe damage to the language network. In particular, the language regions' responses to music are generally low, often below the fixation baseline, and never exceed responses elicited by nonmusic auditory conditions, like animal sounds. Furthermore, the language regions are not sensitive to music structure: they show low responses to both intact and structure-scrambled music, and to melodies with vs. without structural violations. Finally, in line with past patient investigations, individuals with aphasia, who cannot judge sentence grammaticality, perform well on melody well-formedness judgments. Thus, the mechanisms that process structure in language do not appear to process music, including music syntax.

A vocalization-processing network in marmosets

Vocalizations play an important role in the daily life of primates and likely form the basis of human language. Functional imaging studies have demonstrated that listening to voices activates a fronto-temporal voice perception network in human participants. Here, we acquired whole-brain ultrahigh-field (9.4 T) fMRI in awake marmosets (Callithrix jacchus) and demonstrate that these small, highly vocal New World primates possess a similar fronto-temporal network, including subcortical regions, that is activated by the presentation of conspecific vocalizations. The findings suggest that the human voice perception network has evolved from an ancestral vocalization-processing network that predates the separation of New and Old World primates.

Non-literal language processing is jointly supported by the language and theory of mind networks: Evidence from a novel meta-analytic fMRI approach

Going beyond the literal meaning of language is key to communicative success. However, the mechanisms that support non-literal inferences remain debated. Using a novel meta-analytic approach, we evaluate the contribution of linguistic, social-cognitive, and executive mechanisms to non-literal interpretation. We identified 74 fMRI experiments (n = 1,430 participants) from 2001 to 2021 that contrasted non-literal language comprehension with a literal control condition, spanning ten phenomena (e.g., metaphor, irony, indirect speech). Applying the activation likelihood estimation approach to the 825 activation peaks yielded six left-lateralized clusters. We then evaluated the locations of both the individual-study peaks and the clusters against probabilistic functional atlases (cf. anatomical locations, as is typically done) for three candidate brain networks-the language-selective network (Fedorenko, Behr, & Kanwisher, 2011), which supports language processing, the Theory of Mind (ToM) network (Saxe & Kanwisher, 2003), which supports social inferences, and the domain-general Multiple-Demand (MD) network (Duncan, 2010), which supports executive control. These atlases were created by overlaying individual activation maps of participants who performed robust and extensively validated 'localizer' tasks that selectively target each network in question (n = 806 for language; n = 198 for ToM; n = 691 for MD). We found that both the individual-study peaks and the ALE clusters fell primarily within the language network and the ToM network. These results suggest that non-literal processing is supported by both i) mechanisms that process literal linguistic meaning, and ii) mechanisms that support general social inference. They thus undermine a strong divide between literal and non-literal aspects of language and challenge the claim that non-literal processing requires additional executive resources.

The domain-separation language network dynamics in resting state support its flexible functional segregation and integration during language and speech processing

Modern linguistic theories and network science propose that language and speech processing are organized into hierarchical, segregated large-scale subnetworks, with a core of dorsal (phonological) stream and ventral (semantic) stream. The two streams are asymmetrically recruited in receptive and expressive language or speech tasks, which showed flexible functional segregation and integration. We hypothesized that the functional segregation of the two streams was supported by the underlying network segregation. A dynamic conditional correlation approach was employed to construct framewise time-varying language networks and k-means clustering was employed to investigate the temporal-reoccurring patterns. We found that the framewise language network dynamics in resting state were robustly clustered into four states, which dynamically reconfigured following a domain-separation manner. Spatially, the hub distributions of the first three states highly resembled the neurobiology of speech perception and lexical-phonological processing, speech production, and semantic processing, respectively. The fourth state was characterized by the weakest functional connectivity and was regarded as a baseline state. Temporally, the first three states appeared exclusively in limited time bins (∼15%), and most of the time (> 55%), state 4 was dominant. Machine learning-based dFC-linguistics prediction analyses showed that dFCs of the four states significantly predicted individual linguistic performance. These findings suggest a domain-separation manner of language network dynamics in resting state, which forms a dynamic "meta-network" framework to support flexible functional segregation and integration during language and speech processing.

Functional identification of language-responsive channels in individual participants in MEG investigations

Making meaningful inferences about the functional architecture of the language system requires the ability to refer to the same neural units across individuals and studies. Traditional brain imaging approaches align and average brains together in a common space. However, lateral frontal and temporal cortex, where the language system resides, is characterized by high structural and functional inter-individual variability. This variability reduces the sensitivity and functional resolution of group-averaging analyses. This problem is compounded by the fact that language areas often lay in close proximity to regions of other large-scale networks with different functional profiles. A solution inspired by other fields of cognitive neuroscience (e.g., vision) is to identify language areas functionally in each individual brain using a 'localizer' task (e.g., a language comprehension task). This approach has proven productive in fMRI, yielding a number of discoveries about the language system, and has been successfully extended to intracranial recording investigations. Here, we apply this approach to MEG. Across two experiments (one in Dutch speakers, n=19; one in English speakers, n=23), we examined neural responses to the processing of sentences and a control condition (nonword sequences). We demonstrated that the neural response to language is spatially consistent at the individual level. The language-responsive sensors of interest were, as expected, less responsive to the nonwords condition. Clear inter-individual differences were present in the topography of the neural response to language, leading to greater sensitivity when the data were analyzed at the individual level compared to the group level. Thus, as in fMRI, functional localization yields benefits in MEG and thus opens the door to probing fine-grained distinctions in space and time in future MEG investigations of language processing.

The elusive metric of lesion load

One of the widely used metrics in lesion-symptom mapping is lesion load that codes the amount of damage to a given brain region of interest. Lesion load aims to reduce the complex 3D lesion information into a feature that can reflect both site of damage, defined by the location of the region of interest, and size of damage within that region of interest. Basically, the process of estimation of lesion load converts a voxel-based lesion map into a region-based lesion map, with regions defined as atlas-based or data-driven spatial patterns. Here, after examining current definitions of lesion load, four methodological issues are discussed: (1) lesion load is agnostic to the location of damage within the region of interest, and it disregards damage outside the region of interest, (2) lesion load estimates are prone to errors introduced by the uncertainty in lesion delineation, spatial warping of the lesion/region, and binarization of the lesion/region, (3) lesion load calculation depends on brain parcellation selection, and (4) lesion load does not necessarily reflect a white matter disconnection. Overall, lesion load, when calculated in a robust way, can serve as a clinically-useful feature for explaining and predicting post-stroke outcome and recovery.

Hemispheric Asymmetries of Individual Differences in Functional Connectivity

Resting-state fMRI studies have revealed that individuals exhibit stable, functionally meaningful divergences in large-scale network organization. The locations with strongest deviations (called network "variants") have a characteristic spatial distribution, with qualitative evidence from prior reports suggesting that this distribution differs across hemispheres. Hemispheric asymmetries can inform us on constraints guiding the development of these idiosyncratic regions. Here, we used data from the Human Connectome Project to systematically investigate hemispheric differences in network variants. Variants were significantly larger in the right hemisphere, particularly along the frontal operculum and medial frontal cortex. Variants in the left hemisphere appeared most commonly around the TPJ. We investigated how variant asymmetries vary by functional network and how they compare with typical network distributions. For some networks, variants seemingly increase group-average network asymmetries (e.g., the group-average language network is slightly bigger in the left hemisphere and variants also appeared more frequently in that hemisphere). For other networks, variants counter the group-average network asymmetries (e.g., the default mode network is slightly bigger in the left hemisphere, but variants were more frequent in the right hemisphere). Intriguingly, left- and right-handers differed in their network variant asymmetries for the cingulo-opercular and frontoparietal networks, suggesting that variant asymmetries are connected to lateralized traits. These findings demonstrate that idiosyncratic aspects of brain organization differ systematically across the hemispheres. We discuss how these asymmetries in brain organization may inform us on developmental constraints of network variants and how they may relate to functions differentially linked to the two hemispheres.

A Neurosurgical Functional Dissection of the Middle Precentral Gyrus during Speech Production

Classical models have traditionally focused on the left posterior inferior frontal gyrus (Broca's area) as a key region for motor planning of speech production. However, converging evidence suggests that it is not critical for either speech motor planning or execution. Alternative cortical areas supporting high-level speech motor planning have yet to be defined. In this review, we focus on the precentral gyrus, whose role in speech production is often thought to be limited to lower-level articulatory muscle control. In particular, we highlight neurosurgical investigations that have shed light on a cortical region anatomically located near the midpoint of the precentral gyrus, hence called the middle precentral gyrus (midPrCG). The midPrCG is functionally located between dorsal hand and ventral orofacial cortical representations and exhibits unique sensorimotor and multisensory functions relevant for speech processing. This includes motor control of the larynx, auditory processing, as well as a role in reading and writing. Furthermore, direct electrical stimulation of midPrCG can evoke complex movements, such as vocalization, and selective injury can cause deficits in verbal fluency, such as pure apraxia of speech. Based on these findings, we propose that midPrCG is essential to phonological-motoric aspects of speech production, especially syllabic-level speech sequencing, a role traditionally ascribed to Broca's area. The midPrCG is a cortical brain area that should be included in contemporary models of speech production with a unique role in speech motor planning and execution.