Functional specificity for high-level linguistic processing in the human brain

Probing the link between vision and language in material perception using psychophysics and unsupervised learning

We can visually discriminate and recognize a wide range of materials. Meanwhile, we use language to describe what we see and communicate relevant information about the materials. Here, we investigate the relationship between visual judgment and language expression to understand how visual features relate to semantic representations in human cognition. We use deep generative models to generate images of realistic materials. Interpolating between the generative models enables us to systematically create material appearances in both well-defined and ambiguous categories. Using these stimuli, we compared the representations of materials from two behavioral tasks: visual material similarity judgments and free-form verbal descriptions. Our findings reveal a moderate but significant correlation between vision and language on a categorical level. However, analyzing the representations with an unsupervised alignment method, we discover structural differences that arise at the image-to-image level, especially among ambiguous materials morphed between known categories. Moreover, visual judgments exhibit more individual differences compared to verbal descriptions. Our results show that while verbal descriptions capture material qualities on the coarse level, they may not fully convey the visual nuances of material appearances. Analyzing the image representation of materials obtained from various pre-trained deep neural networks, we find that similarity structures in human visual judgments align more closely with those of the vision-language models than purely vision-based models. Our work illustrates the need to consider the vision-language relationship in building a comprehensive model for material perception. Moreover, we propose a novel framework for evaluating the alignment and misalignment between representations from different modalities, leveraging information from human behaviors and computational models.

Linguistic network in early deaf individuals: A neuroimaging meta-analysis

This meta-analysis summarizes evidence from 44 neuroimaging experiments and characterizes the general linguistic network in early deaf individuals. Meta-analytic comparisons with hearing individuals found that a specific set of regions (in particular the left inferior frontal gyrus and posterior middle temporal gyrus) participates in supramodal language processing. In addition to previously described modality-specific differences, the present study showed that the left calcarine gyrus and the right caudate were additionally recruited in deaf compared with hearing individuals. In addition, this study showed that the bilateral posterior superior temporal gyrus is shaped by cross-modal plasticity, whereas the left frontotemporal areas are shaped by early language experience. Although an overall left-lateralized pattern for language processing was observed in the early deaf individuals, regional lateralization was altered in the inferior frontal gyrus and anterior temporal lobe. These findings indicate that the core language network functions in a modality-independent manner, and provide a foundation for determining the contributions of sensory and linguistic experiences in shaping the neural bases of language processing.

Pronouns reactivate conceptual representations in human hippocampal neurons

During discourse comprehension, every new word adds to an evolving representation of meaning that accumulates over consecutive sentences and constrains the next words. To minimize repetition and utterance length, languages use pronouns, like the word "she," to refer to nouns and phrases that were previously introduced. It has been suggested that language comprehension requires that pronouns activate the same neuronal representations as the nouns themselves. We recorded from individual neurons in the human hippocampus during a reading task. Cells that were selective to a particular noun were later reactivated by pronouns that refer to the cells' preferred noun. These results imply that concept cells contribute to a rapid and dynamic semantic memory network that is recruited during language comprehension.

Auditory areas are recruited for naturalistic visual meaning in early deaf people

Congenital deafness enhances responses of auditory cortices to non-auditory tasks, yet the nature of the reorganization is not well understood. Here, naturalistic stimuli are used to induce neural synchrony across early deaf and hearing individuals. Participants watch a silent animated film in an intact version and three versions with gradually distorted meaning. Differences between groups are observed in higher-order auditory cortices in all stimuli, with no statistically significant effects in the primary auditory cortex. Comparison between levels of scrambling revealed a heterogeneity of function in secondary auditory areas. Both hemispheres show greater synchrony in the deaf than in the hearing participants for the intact movie and high-level variants. However, only the right hemisphere shows an increased inter-subject synchrony in the deaf people for the low-level movie variants. An event segmentation validates these results: the dynamics of the right secondary auditory cortex in the deaf people consist of shorter-length events with more transitions than the left. Our results reveal how deaf individuals use their auditory cortex to process visual meaning.

The role of variation in phonological and semantic working memory capacities in sentence comprehension: neural evidence from healthy and brain-damaged individuals

Research on the role of working memory (WM) in language processing has typically focused on WM for phonological information. However, considerable behavioral evidence supports the existence of a separate semantic WM system that plays a greater role in language processing. We review the neural evidence that supports the distinction between phonological and semantic WM capacities and discuss how individual differences in these capacities relate to sentence processing. In terms of neural substrates, findings from multivariate functional MRI for healthy participants and voxel-based lesion-symptom mapping for brain-damaged participants imply that the left supramarginal gyrus supports phonological WM, whereas the left inferior frontal gyrus (LIFG) and angular gyrus support semantic WM. In sentence comprehension, individual variation in semantic but not phonological WM related to performance in resolving semantic information and the LIFG region implicated in semantic WM showed fMRI activation during the resolution of semantic interference. Moreover, variation for brain-damaged participants in the integrity of a fiber tract supporting semantic WM had a greater relation to the processing of complex sentences than did the integrity of fiber tracts supporting phonological WM. Overall, the neural findings provide converging evidence regarding the distinction of these two capacities and the greater contribution of individual differences in semantic than phonological WM capacity to sentence processing.

Distinct neural pathway and its information flow for blind individual's Braille reading

Natural Braille reading presents significant challenges to the brain networks of late blind individuals, yet its underlying neural mechanisms remain largely unexplored. Using natural Braille texts in behavioral assessments and functional MRI, we sought to pinpoint the neural pathway and information flow crucial for Braille reading performance in late blind individuals. In the resting state, we discovered a unique neural connection between the higher-order 'visual' cortex, the lateral occipital cortex (LOC), and the inferior frontal cortex (IFC) in late blind individuals, but not in sighted controls. The left-lateralized LOC-IFC connectivity was correlated with individual Braille reading proficiency. Prolonged Braille reading practice led to increased strength of this connectivity. During a natural Braille reading task, bidirectional information flow between the LOC and the IFC was positively modulated, with a predominantly stronger top-down modulation from the IFC to the LOC. This stronger top-down modulation contributed to higher Braille reading proficiency. We thus proposed a two-predictor multiple regression model to predict individual Braille reading proficiency, incorporating both static connectivity and dynamic top-down communication between the LOC-IFC link. This work highlights the dual contributions of the occipito-frontal neural pathway and top-down cognitive strategy to superior natural Braille reading performance, offering guidance for training late blind individuals.

iTBS reveals the roles of domain-general cognitive control and language-specific brain regions during word formation rule learning

Repeated exposure to word forms and meanings improves lexical knowledge acquisition. However, the roles of domain-general and language-specific brain regions during this process remain unclear. To investigate this, we applied intermittent theta burst stimulation over the domain-general (group left dorsolateral prefrontal cortex) and domain-specific (Group L IFG) brain regions, with a control group receiving sham intermittent theta burst stimulation. Intermittent theta burst stimulation effects were subsequently assessed in functional magnetic resonance imaging using an artificial word learning task which consisted of 3 learning phases. A generalized psychophysiological interaction analysis explored the whole brain functional connectivity, while dynamic causal modeling estimated causal interactions in specific brain regions modulated by intermittent theta burst stimulation during repeated exposure. Compared to sham stimulation, active intermittent theta burst stimulation improved word learning performance and reduced activation of the left insula in learning phase 2. Active intermittent theta burst stimulation over the domain-general region increased whole-brain functional connectivity and modulated effective connectivity between brain regions during repeated exposure. This effect was not observed when active intermittent theta burst stimulation was applied to the language-specific region. These findings suggest that the domain-general region plays a crucial role in word formation rule learning, with intermittent theta burst stimulation enhancing whole-brain connectivity and facilitating efficient information exchange between key brain regions during new word learning.

Neural populations in the language network differ in the size of their temporal receptive windows

Despite long knowing what brain areas support language comprehension, our knowledge of the neural computations that these frontal and temporal regions implement remains limited. One important unresolved question concerns functional differences among the neural populations that comprise the language network. Here we leveraged the high spatiotemporal resolution of human intracranial recordings (n = 22) to examine responses to sentences and linguistically degraded conditions. We discovered three response profiles that differ in their temporal dynamics. These profiles appear to reflect different temporal receptive windows, with average windows of about 1, 4 and 6 words, respectively. Neural populations exhibiting these profiles are interleaved across the language network, which suggests that all language regions have direct access to distinct, multiscale representations of linguistic input-a property that may be critical for the efficiency and robustness of language processing.

Cortical cognitive processing during reading captured using functional-near infrared spectroscopy

Neuroimaging studies using functional magnetic resonance imaging (fMRI) have provided unparalleled insights into the fundamental neural mechanisms underlying human cognitive processing, such as high-level linguistic processes during reading. Here, we build upon this prior work to capture sentence reading comprehension outside the MRI scanner using functional near infra-red spectroscopy (fNIRS) in a large sample of participants (n = 82). We observed increased task-related hemodynamic responses in prefrontal and temporal cortical regions during sentence-level reading relative to the control condition (a list of non-words), replicating prior fMRI work on cortical recruitment associated with high-level linguistic processing during reading comprehension. These results lay the groundwork towards developing adaptive systems to support novice readers and language learners by targeting the underlying cognitive processes. This work also contributes to bridging the gap between laboratory findings and more real-world applications in the realm of cognitive neuroscience.

Language in Brains, Minds, and Machines

It has long been argued that only humans could produce and understand language. But now, for the first time, artificial language models (LMs) achieve this feat. Here we survey the new purchase LMs are providing on the question of how language is implemented in the brain. We discuss why, a priori, LMs might be expected to share similarities with the human language system. We then summarize evidence that LMs represent linguistic information similarly enough to humans to enable relatively accurate brain encoding and decoding during language processing. Finally, we examine which LM properties-their architecture, task performance, or training-are critical for capturing human neural responses to language and review studies using LMs as in silico model organisms for testing hypotheses about language. These ongoing investigations bring us closer to understanding the representations and processes that underlie our ability to comprehend sentences and express thoughts in language.

Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills

Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.

Macroscale brain states support the control of semantic cognition

A crucial aim in neuroscience is to understand how the human brain adapts to varying cognitive demands. This study investigates network reconfiguration during controlled semantic retrieval in differing contexts. We analyze brain responses to two semantic tasks of varying difficulty - global association and feature matching judgments - which are contrasted with non-semantic tasks on the cortical surface and within a whole-brain state space. Demanding semantic association tasks elicit activation in anterior prefrontal and temporal regions, while challenging semantic feature matching and non-semantic tasks predominantly activate posterior regions. Task difficulty also modulates activation along different dimensions of functional organization, suggesting different mechanisms of cognitive control. More demanding semantic association judgments engage cognitive control and default mode networks together, while feature matching and non-semantic tasks are skewed towards cognitive control networks. These findings highlight the brain's dynamic ability to tailor its networks to support diverse neurocognitive states, enriching our understanding of controlled cognition.

Speech and music recruit frequency-specific distributed and overlapping cortical networks

To what extent does speech and music processing rely on domain-specific and domain-general neural networks? Using whole-brain intracranial EEG recordings in 18 epilepsy patients listening to natural, continuous speech or music, we investigated the presence of frequency-specific and network-level brain activity. We combined it with a statistical approach in which a clear operational distinction is made between shared, preferred, and domain-selective neural responses. We show that the majority of focal and network-level neural activity is shared between speech and music processing. Our data also reveal an absence of anatomical regional selectivity. Instead, domain-selective neural responses are restricted to distributed and frequency-specific coherent oscillations, typical of spectral fingerprints. Our work highlights the importance of considering natural stimuli and brain dynamics in their full complexity to map cognitive and brain functions.

Connectivity Reveals the Relationships between Human Brain Areas Associated with High-Level Linguistic Processing and Macaque Brain Areas

Cross-species research has advanced human understanding of brain regions, with cross-species comparisons using magnetic resonance imaging technology becoming increasingly common. Currently, cross-species research on human language regions has primarily focused on traditional brain areas such as the Broca region. While some studies have indicated that human language function also involves other language regions, the corresponding relationships between these brain regions in humans and macaques remain unclear. This study calculated the strength of the connections between the high-level language processing regions in human and macaque brains, identified homologous target areas based on the structural connections of white-matter fiber bundles, and compared the connectivity profiles of both species. The results of the experiment demonstrated that macaques possess brain regions which exhibit connectivity patterns resembling those found in human high-level language processing regions. This discovery suggests that while the function of a human brain region is specialized, it still maintains a structural connectivity similar to that seen in macaques.

Semantic encoding during language comprehension at single-cell resolution

From sequences of speech sounds1,2 or letters3, humans can extract rich and nuanced meaning through language. This capacity is essential for human communication. Yet, despite a growing understanding of the brain areas that support linguistic and semantic processing4-12, the derivation of linguistic meaning in neural tissue at the cellular level and over the timescale of action potentials remains largely unknown. Here we recorded from single cells in the left language-dominant prefrontal cortex as participants listened to semantically diverse sentences and naturalistic stories. By tracking their activities during natural speech processing, we discover a fine-scale cortical representation of semantic information by individual neurons. These neurons responded selectively to specific word meanings and reliably distinguished words from nonwords. Moreover, rather than responding to the words as fixed memory representations, their activities were highly dynamic, reflecting the words' meanings based on their specific sentence contexts and independent of their phonetic form. Collectively, we show how these cell ensembles accurately predicted the broad semantic categories of the words as they were heard in real time during speech and how they tracked the sentences in which they appeared. We also show how they encoded the hierarchical structure of these meaning representations and how these representations mapped onto the cell population. Together, these findings reveal a finely detailed cortical organization of semantic representations at the neuron scale in humans and begin to illuminate the cellular-level processing of meaning during language comprehension.

Shared functional specialization in transformer-based language models and the human brain

When processing language, the brain is thought to deploy specialized computations to construct meaning from complex linguistic structures. Recently, artificial neural networks based on the Transformer architecture have revolutionized the field of natural language processing. Transformers integrate contextual information across words via structured circuit computations. Prior work has focused on the internal representations ("embeddings") generated by these circuits. In this paper, we instead analyze the circuit computations directly: we deconstruct these computations into the functionally-specialized "transformations" that integrate contextual information across words. Using functional MRI data acquired while participants listened to naturalistic stories, we first verify that the transformations account for considerable variance in brain activity across the cortical language network. We then demonstrate that the emergent computations performed by individual, functionally-specialized "attention heads" differentially predict brain activity in specific cortical regions. These heads fall along gradients corresponding to different layers and context lengths in a low-dimensional cortical space.

Continuous Theta-Burst Stimulation on the Left Posterior Inferior Frontal Gyrus Perturbs Complex Syntactic Processing Stability in Mandarin Chinese

The structure of human language is inherently hierarchical. The left posterior inferior frontal gyrus (LpIFG) is proposed to be a core region for constructing syntactic hierarchies. However, it remains unclear whether LpIFG plays a causal role in syntactic processing in Mandarin Chinese and whether its contribution depends on syntactic complexity, working memory, or both. We addressed these questions by applying inhibitory continuous theta-burst stimulation (cTBS) over LpIFG. Thirty-two participants processed sentences containing embedded relative clauses (i.e., complex syntactic processing), syntactically simpler coordinated sentences (i.e., simple syntactic processing), and non-hierarchical word lists (i.e., word list processing) after receiving real or sham cTBS. We found that cTBS significantly increased the coefficient of variation, a representative index of processing stability, in complex syntactic processing (esp., when subject relative clause was embedded) but not in the other two conditions. No significant changes in d' and reaction time were detected in these conditions. The findings suggest that (a) inhibitory effect of cTBS on the LpIFG might be prominent in perturbing the complex syntactic processing stability but subtle in altering the processing quality; and (b) the causal role of the LpIFG seems to be specific for syntactic processing rather than working memory capacity, further evidencing their separability in LpIFG. Collectively, these results support the notion of the LpIFG as a core region for complex syntactic processing across languages.

Linguistic inputs must be syntactically parsable to fully engage the language network

Human language comprehension is remarkably robust to ill-formed inputs (e.g., word transpositions). This robustness has led some to argue that syntactic parsing is largely an illusion, and that incremental comprehension is more heuristic, shallow, and semantics-based than is often assumed. However, the available data are also consistent with the possibility that humans always perform rule-like symbolic parsing and simply deploy error correction mechanisms to reconstruct ill-formed inputs when needed. We put these hypotheses to a new stringent test by examining brain responses to a) stimuli that should pose a challenge for syntactic reconstruction but allow for complex meanings to be built within local contexts through associative/shallow processing (sentences presented in a backward word order), and b) grammatically well-formed but semantically implausible sentences that should impede semantics-based heuristic processing. Using a novel behavioral syntactic reconstruction paradigm, we demonstrate that backward-presented sentences indeed impede the recovery of grammatical structure during incremental comprehension. Critically, these backward-presented stimuli elicit a relatively low response in the language areas, as measured with fMRI. In contrast, semantically implausible but grammatically well-formed sentences elicit a response in the language areas similar in magnitude to naturalistic (plausible) sentences. In other words, the ability to build syntactic structures during incremental language processing is both necessary and sufficient to fully engage the language network. Taken together, these results provide strongest to date support for a generalized reliance of human language comprehension on syntactic parsing.

Functional dissociation of the language network and other cognition in early childhood

Is language distinct from other cognition during development? Does neural machinery for language emerge from general-purpose neural mechanisms, becoming tuned for language after years of experience and maturation? Answering these questions will shed light on the origins of domain-specificity in the brain. We address these questions using precision fMRI, scanning young children (35 months to 9 years of age) on an auditory language localizer, spatial working memory localizer (engaging the domain-general multiple demand [MD] network), and a resting-state scan. We create subject-specific functional regions of interest for each network and examine their selectivity, specificity, and functional connectivity. We find young children show domain-specific, left-lateralized language activation, and that the language network is not responsive to domain-general cognitive load. Additionally, the cortically adjacent MD network is selective to cognitive load, but not to language. These networks show higher within versus between-network functional connectivity. This connectivity is stable across ages (examined cross-sectionally and longitudinally), whereas language responses increase with age and across time within subject, reflecting a domain-specific developmental change. Overall, we provide evidence for a double dissociation of the language and MD network throughout development, in both their function and connectivity. These findings suggest that domain-specificity, even for uniquely human cognition like language, develops early and distinctly from mechanisms that presumably support other human cognition.

Precision fMRI reveals that the language network exhibits adult-like left-hemispheric lateralization by 4 years of age

Left hemisphere damage in adulthood often leads to linguistic deficits, but many cases of early damage leave linguistic processing preserved, and a functional language system can develop in the right hemisphere. To explain this early apparent equipotentiality of the two hemispheres for language, some have proposed that the language system is bilateral during early development and only becomes left-lateralized with age. We examined language lateralization using functional magnetic resonance imaging with two large pediatric cohorts (total n=273 children ages 4-16; n=107 adults). Strong, adult-level left-hemispheric lateralization (in activation volume and response magnitude) was evident by age 4. Thus, although the right hemisphere can take over language function in some cases of early brain damage, and although some features of the language system do show protracted development (magnitude of language response and strength of inter-regional correlations in the language network), the left-hemisphere bias for language is robustly present by 4 years of age. These results call for alternative accounts of early equipotentiality of the two hemispheres for language.

Longitudinal associations between language network characteristics in the infant brain and school-age reading abilities are mediated by early-developing phonological skills

Reading acquisition is a prolonged learning process relying on language development starting in utero. Behavioral longitudinal studies reveal prospective associations between infant language abilities and preschool/kindergarten phonological development that relates to subsequent reading performance. While recent pediatric neuroimaging work has begun to characterize the neural network underlying language development in infants, how this neural network scaffolds long-term language and reading acquisition remains unknown. We addressed this question in a 7-year longitudinal study from infancy to school-age. Seventy-six infants completed resting-state fMRI scanning, and underwent standardized language assessments in kindergarten. Of this larger cohort, forty-one were further assessed on their emergent word reading abilities after receiving formal reading instructions. Hierarchical clustering analyses identified a modular infant language network in which functional connectivity (FC) of the inferior frontal module prospectively correlated with kindergarten-age phonological skills and emergent word reading abilities. These correlations were obtained when controlling for infant age at scan, nonverbal IQ and parental education. Furthermore, kindergarten-age phonological skills mediated the relationship between infant FC and school-age reading abilities, implying a critical mid-way milestone for long-term reading development from infancy. Overall, our findings illuminate the neurobiological mechanisms by which infant language capacities could scaffold long-term reading acquisition.

Sentence superiority in the reading brain

When a sequence of written words is briefly presented and participants are asked to identify just one word at a post-cued location, then word identification accuracy is higher when the word is presented in a grammatically correct sequence compared with an ungrammatical sequence. This sentence superiority effect has been reported in several behavioral studies and two EEG investigations. Taken together, the results of these studies support the hypothesis that the sentence superiority effect is primarily driven by rapid access to a sentence-level representation via partial word identification processes that operate in parallel over several words. Here we used MEG to examine the neural structures involved in this early stage of written sentence processing, and to further specify the timing of the different processes involved. Source activities over time showed grammatical vs. ungrammatical differences first in the left inferior frontal gyrus (IFG: 321-406 ms), then the left anterior temporal lobe (ATL: 466-531 ms), and finally in both left IFG (549-602 ms) and left posterior superior temporal gyrus (pSTG: 553-622 ms). We interpret the early IFG activity as reflecting the rapid bottom-up activation of sentence-level representations, including syntax, enabled by partly parallel word processing. Subsequent activity in ATL and pSTG is thought to reflect the constraints imposed by such sentence-level representations on on-going word-based semantic activation (ATL), and the subsequent development of a more detailed sentence-level representation (pSTG). These results provide further support for a cascaded interactive-activation account of sentence reading.

Individual Brain Charting dataset extension, third release for movie watching and retinotopy data

The Individual Brain Charting (IBC) is a multi-task functional Magnetic Resonance Imaging dataset acquired at high spatial-resolution and dedicated to the cognitive mapping of the human brain. It consists in the deep phenotyping of twelve individuals, covering a broad range of psychological domains suitable for functional-atlasing applications. Here, we present the inclusion of task data from both naturalistic stimuli and trial-based designs, to uncover structures of brain activation. We rely on the Fast Shared Response Model (FastSRM) to provide a data-driven solution for modelling naturalistic stimuli, typically containing many features. We show that data from left-out runs can be reconstructed using FastSRM, enabling the extraction of networks from the visual, auditory and language systems. We also present the topographic organization of the visual system through retinotopy. In total, six new tasks were added to IBC, wherein four trial-based retinotopic tasks contributed with a mapping of the visual field to the cortex. IBC is open access: source plus derivatives imaging data and meta-data are available in public repositories.

The Language Network Reliably "Tracks" Naturalistic Meaningful Nonverbal Stimuli

The language network, comprised of brain regions in the left frontal and temporal cortex, responds robustly and reliably during language comprehension but shows little or no response during many nonlinguistic cognitive tasks (e.g., Fedorenko & Blank, 2020). However, one domain whose relationship with language remains debated is semantics-our conceptual knowledge of the world. Given that the language network responds strongly to meaningful linguistic stimuli, could some of this response be driven by the presence of rich conceptual representations encoded in linguistic inputs? In this study, we used a naturalistic cognition paradigm to test whether the cognitive and neural resources that are responsible for language processing are also recruited for processing semantically rich nonverbal stimuli. To do so, we measured BOLD responses to a set of ∼5-minute-long video and audio clips that consisted of meaningful event sequences but did not contain any linguistic content. We then used the intersubject correlation (ISC) approach (Hasson et al., 2004) to examine the extent to which the language network "tracks" these stimuli, that is, exhibits stimulus-related variation. Across all the regions of the language network, meaningful nonverbal stimuli elicited reliable ISCs. These ISCs were higher than the ISCs elicited by semantically impoverished nonverbal stimuli (e.g., a music clip), but substantially lower than the ISCs elicited by linguistic stimuli. Our results complement earlier findings from controlled experiments (e.g., Ivanova et al., 2021) in providing further evidence that the language network shows some sensitivity to semantic content in nonverbal stimuli.

Tracking Components of Bilingual Language Control in Speech Production: An fMRI Study Using Functional Localizers

When bilingual speakers switch back to speaking in their native language (L1) after having used their second language (L2), they often experience difficulty in retrieving words in their L1. This phenomenon is referred to as the L2 after-effect. We used the L2 after-effect as a lens to explore the neural bases of bilingual language control mechanisms. Our goal was twofold: first, to explore whether bilingual language control draws on domain-general or language-specific mechanisms; second, to investigate the precise mechanism(s) that drive the L2 after-effect. We used a precision fMRI approach based on functional localizers to measure the extent to which the brain activity that reflects the L2 after-effect overlaps with the language network (Fedorenko et al., 2010) and the domain-general multiple demand network (Duncan, 2010), as well as three task-specific networks that tap into interference resolution, lexical retrieval, and articulation. Forty-two Polish-English bilinguals participated in the study. Our results show that the L2 after-effect reflects increased engagement of domain-general but not language-specific resources. Furthermore, contrary to previously proposed interpretations, we did not find evidence that the effect reflects increased difficulty related to lexical access, articulation, and the resolution of lexical interference. We propose that difficulty of speech production in the picture naming paradigm-manifested as the L2 after-effect-reflects interference at a nonlinguistic level of task schemas or a general increase of cognitive control engagement during speech production in L1 after L2.

Dissociating language and thought in large language models

Large language models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. Here, we evaluate LLMs using a distinction between formal linguistic competence (knowledge of linguistic rules and patterns) and functional linguistic competence (understanding and using language in the world). We ground this distinction in human neuroscience, which has shown that formal and functional competence rely on different neural mechanisms. Although LLMs are surprisingly good at formal competence, their performance on functional competence tasks remains spotty and often requires specialized fine-tuning and/or coupling with external modules. We posit that models that use language in human-like ways would need to master both of these competence types, which, in turn, could require the emergence of separate mechanisms specialized for formal versus functional linguistic competence.

Language is primarily a tool for communication rather than thought

Language is a defining characteristic of our species, but the function, or functions, that it serves has been debated for centuries. Here we bring recent evidence from neuroscience and allied disciplines to argue that in modern humans, language is a tool for communication, contrary to a prominent view that we use language for thinking. We begin by introducing the brain network that supports linguistic ability in humans. We then review evidence for a double dissociation between language and thought, and discuss several properties of language that suggest that it is optimized for communication. We conclude that although the emergence of language has unquestionably transformed human culture, language does not appear to be a prerequisite for complex thought, including symbolic thought. Instead, language is a powerful tool for the transmission of cultural knowledge; it plausibly co-evolved with our thinking and reasoning capacities, and only reflects, rather than gives rise to, the signature sophistication of human cognition.

Distributed Sensitivity to Syntax and Semantics throughout the Language Network

Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.

Human striatal association megaclusters

The striatum receives projections from multiple regions of the cerebral cortex consistent with the role of the basal ganglia in diverse motor, affective, and cognitive functions. Within the striatum, the caudate receives projections from association cortex, including multiple distinct regions of prefrontal cortex. Building on recent insights about the details of how juxtaposed cortical networks are specialized for distinct aspects of higher-order cognition, we revisited caudate organization using within-individual precision neuroimaging initially in two intensively scanned individuals (each scanned 31 times). Results revealed that the caudate has side-by-side regions that are coupled to at least five distinct distributed association networks, paralleling the organization observed in the cerebral cortex. We refer to these spatial groupings of regions as striatal association megaclusters. Correlation maps from closely juxtaposed seed regions placed within the megaclusters recapitulated the five distinct cortical networks, including their multiple spatially distributed regions. Striatal association megaclusters were explored in 15 additional participants (each scanned at least 8 times), finding that their presence generalizes to new participants. Analysis of the laterality of the regions within the megaclusters further revealed that they possess asymmetries paralleling their cortical counterparts. For example, caudate regions linked to the language network were left lateralized. These results extend the general notion of parallel specialized basal ganglia circuits with the additional discovery that, even within the caudate, there is fine-grained separation of multiple distinct higher-order networks that reflects the organization and lateralization found in the cerebral cortex.NEW & NOTEWORTHY An individualized precision neuroimaging approach reveals juxtaposed zones of the caudate that are coupled with five distinct networks in association cortex. The organization of these caudate zones recapitulates organization observed in the cerebral cortex and extends the notion of specialized basal ganglia circuits.

The Brain's Topographical Organization Shapes Dynamic Interaction Patterns That Support Flexible Behavior Based on Rules and Long-Term Knowledge

Adaptive behavior relies both on specific rules that vary across situations and stable long-term knowledge gained from experience. The frontoparietal control network (FPCN) is implicated in the brain's ability to balance these different influences on action. Here, we investigate how the topographical organization of the cortex supports behavioral flexibility within the FPCN. Functional properties of this network might reflect its juxtaposition between the dorsal attention network (DAN) and the default mode network (DMN), two large-scale systems implicated in top-down attention and memory-guided cognition, respectively. Our study tests whether subnetworks of FPCN are topographically proximal to the DAN and the DMN, respectively, and how these topographical differences relate to functional differences: the proximity of each subnetwork is anticipated to play a pivotal role in generating distinct cognitive modes relevant to working memory and long-term memory. We show that FPCN subsystems share multiple anatomical and functional similarities with their neighboring systems (DAN and DMN) and that this topographical architecture supports distinct interaction patterns that give rise to different patterns of functional behavior. The FPCN acts as a unified system when long-term knowledge supports behavior but becomes segregated into discrete subsystems with different patterns of interaction when long-term memory is less relevant. In this way, our study suggests that the topographical organization of the FPCN and the connections it forms with distant regions of cortex are important influences on how this system supports flexible behavior.

ChineseEEG: A Chinese Linguistic Corpora EEG Dataset for Semantic Alignment and Neural Decoding

An Electroencephalography (EEG) dataset utilizing rich text stimuli can advance the understanding of how the brain encodes semantic information and contribute to semantic decoding in brain-computer interface (BCI). Addressing the scarcity of EEG datasets featuring Chinese linguistic stimuli, we present the ChineseEEG dataset, a high-density EEG dataset complemented by simultaneous eye-tracking recordings. This dataset was compiled while 10 participants silently read approximately 13 hours of Chinese text from two well-known novels. This dataset provides long-duration EEG recordings, along with pre-processed EEG sensor-level data and semantic embeddings of reading materials extracted by a pre-trained natural language processing (NLP) model. As a pilot EEG dataset derived from natural Chinese linguistic stimuli, ChineseEEG can significantly support research across neuroscience, NLP, and linguistics. It establishes a benchmark dataset for Chinese semantic decoding, aids in the development of BCIs, and facilitates the exploration of alignment between large language models and human cognitive processes. It can also aid research into the brain's mechanisms of language processing within the context of the Chinese natural language.

Probing the Link Between Vision and Language in Material Perception Using Psychophysics and Unsupervised Learning

We can visually discriminate and recognize a wide range of materials. Meanwhile, we use language to express our subjective understanding of visual input and communicate relevant information about the materials. Here, we investigate the relationship between visual judgment and language expression in material perception to understand how visual features relate to semantic representations. We use deep generative networks to construct an expandable image space to systematically create materials of well-defined and ambiguous categories. From such a space, we sampled diverse stimuli and compared the representations of materials from two behavioral tasks: visual material similarity judgments and free-form verbal descriptions. Our findings reveal a moderate but significant correlation between vision and language on a categorical level. However, analyzing the representations with an unsupervised alignment method, we discover structural differences that arise at the image-to-image level, especially among materials morphed between known categories. Moreover, visual judgments exhibit more individual differences compared to verbal descriptions. Our results show that while verbal descriptions capture material qualities on the coarse level, they may not fully convey the visual features that characterize the material's optical properties. Analyzing the image representation of materials obtained from various pre-trained data-rich deep neural networks, we find that human visual judgments' similarity structures align more closely with those of the text-guided visual-semantic model than purely vision-based models. Our findings suggest that while semantic representations facilitate material categorization, non-semantic visual features also play a significant role in discriminating materials at a finer level. This work illustrates the need to consider the vision-language relationship in building a comprehensive model for material perception. Moreover, we propose a novel framework for quantitatively evaluating the alignment and misalignment between representations from different modalities, leveraging information from human behaviors and computational models.

From task structures to world models: what do LLMs know?

In what sense does a large language model (LLM) have knowledge? We answer by granting LLMs 'instrumental knowledge': knowledge gained by using next-word generation as an instrument. We then ask how instrumental knowledge is related to the ordinary, 'worldly knowledge' exhibited by humans, and explore this question in terms of the degree to which instrumental knowledge can be said to incorporate the structured world models of cognitive science. We discuss ways LLMs could recover degrees of worldly knowledge and suggest that such recovery will be governed by an implicit, resource-rational tradeoff between world models and tasks. Our answer to this question extends beyond the capabilities of a particular AI system and challenges assumptions about the nature of knowledge and intelligence.

The language network as a natural kind within the broader landscape of the human brain

Language behaviour is complex, but neuroscientific evidence disentangles it into distinct components supported by dedicated brain areas or networks. In this Review, we describe the 'core' language network, which includes left-hemisphere frontal and temporal areas, and show that it is strongly interconnected, independent of input and output modalities, causally important for language and language-selective. We discuss evidence that this language network plausibly stores language knowledge and supports core linguistic computations related to accessing words and constructions from memory and combining them to interpret (decode) or generate (encode) linguistic messages. We emphasize that the language network works closely with, but is distinct from, both lower-level - perceptual and motor - mechanisms and higher-level systems of knowledge and reasoning. The perceptual and motor mechanisms process linguistic signals, but, in contrast to the language network, are sensitive only to these signals' surface properties, not their meanings; the systems of knowledge and reasoning (such as the system that supports social reasoning) are sometimes engaged during language use but are not language-selective. This Review lays a foundation both for in-depth investigations of these different components of the language processing pipeline and for probing inter-component interactions.

Neuroregulatory Effects of Microcone Patch Stimulation on the Auricular Branch of the Vagus Nerve and the Prefrontal Cortex: A Feasibility Study

Background: The primary purpose of this study was to preliminarily examine the effects of autonomic nervous system activity on the dorsolateral prefrontal cortex. Recent studies have examined approaches to modulating autonomic activity using invasive and non-invasive methods, but the effects of changes in autonomic activity during cognitive tasks on the dorsolateral prefrontal cortex have not been fully investigated. The purpose of this preliminary investigation was to examine changes in autonomic activity and blood oxygen saturation in the dorsolateral prefrontal cortex during reading tasks induced by vagus nerve stimulation using a microcone patch. Methods: A cohort of 40 typically developing adults was enrolled in this study. We carefully examined changes in autonomic nervous system activity and blood oxygen saturation in the dorsolateral prefrontal cortex during a reading task in two conditions: with and without microcone patch stimulation. Results: Significant changes in brain activation in the dorsolateral prefrontal cortext due to microcone patch stimulation were confirmed. In addition, hierarchical multiple regression analysis revealed specific changes in reading task-related blood oxygen saturation in the dorsolateral prefrontal region during microcone patch stimulation. Conclusions: It should be recognized that this study is a preliminary investigation and does not have immediate clinical applications. However, our results suggest that changes in autonomic nervous system activity induced by external vagal stimulation may affect activity in specific reading-related regions of the dorsolateral prefrontal cortex. Further research and evaluation are needed to fully understand the implications and potential applications of these findings.

Bayesian modelling disentangles language versus executive control disruption in stroke

Stroke is the leading cause of long-term disability worldwide. Incurred brain damage can disrupt cognition, often with persisting deficits in language and executive capacities. Yet, despite their clinical relevance, the commonalities and differences between language versus executive control impairments remain under-specified. To fill this gap, we tailored a Bayesian hierarchical modelling solution in a largest-of-its-kind cohort (1080 patients with stroke) to deconvolve language and executive control with respect to the stroke topology. Cognitive function was assessed with a rich neuropsychological test battery including global cognitive function (tested with the Mini-Mental State Exam), language (assessed with a picture naming task), executive speech function (tested with verbal fluency tasks), executive control functions (Trail Making Test and Digit Symbol Coding Task), visuospatial functioning (Rey Complex Figure), as well as verbal learning and memory function (Soul Verbal Learning). Bayesian modelling predicted interindividual differences in eight cognitive outcome scores three months after stroke based on specific tissue lesion topologies. A multivariate factor analysis extracted four distinct cognitive factors that distinguish left- and right-hemispheric contributions to ischaemic tissue lesions. These factors were labelled according to the neuropsychological tests that had the strongest factor loadings: One factor delineated language and general cognitive performance and was mainly associated with damage to left-hemispheric brain regions in the frontal and temporal cortex. A factor for executive control summarized mental flexibility, task switching and visual-constructional abilities. This factor was strongly related to right-hemispheric brain damage of posterior regions in the occipital cortex. The interplay of language and executive control was reflected in two distinct factors that were labelled as executive speech functions and verbal memory. Impairments on both factors were mainly linked to left-hemispheric lesions. These findings shed light onto the causal implications of hemispheric specialization for cognition; and make steps towards subgroup-specific treatment protocols after stroke.

Artificial Neural Network Language Models Predict Human Brain Responses to Language Even After a Developmentally Realistic Amount of Training

Artificial neural networks have emerged as computationally plausible models of human language processing. A major criticism of these models is that the amount of training data they receive far exceeds that of humans during language learning. Here, we use two complementary approaches to ask how the models' ability to capture human fMRI responses to sentences is affected by the amount of training data. First, we evaluate GPT-2 models trained on 1 million, 10 million, 100 million, or 1 billion words against an fMRI benchmark. We consider the 100-million-word model to be developmentally plausible in terms of the amount of training data given that this amount is similar to what children are estimated to be exposed to during the first 10 years of life. Second, we test the performance of a GPT-2 model trained on a 9-billion-token dataset to reach state-of-the-art next-word prediction performance on the human benchmark at different stages during training. Across both approaches, we find that (i) the models trained on a developmentally plausible amount of data already achieve near-maximal performance in capturing fMRI responses to sentences. Further, (ii) lower perplexity-a measure of next-word prediction performance-is associated with stronger alignment with human data, suggesting that models that have received enough training to achieve sufficiently high next-word prediction performance also acquire representations of sentences that are predictive of human fMRI responses. In tandem, these findings establish that although some training is necessary for the models' predictive ability, a developmentally realistic amount of training (∼100 million words) may suffice.

Lexical-Semantic Content, Not Syntactic Structure, Is the Main Contributor to ANN-Brain Similarity of fMRI Responses in the Language Network

Representations from artificial neural network (ANN) language models have been shown to predict human brain activity in the language network. To understand what aspects of linguistic stimuli contribute to ANN-to-brain similarity, we used an fMRI data set of responses to n = 627 naturalistic English sentences (Pereira et al., 2018) and systematically manipulated the stimuli for which ANN representations were extracted. In particular, we (i) perturbed sentences' word order, (ii) removed different subsets of words, or (iii) replaced sentences with other sentences of varying semantic similarity. We found that the lexical-semantic content of the sentence (largely carried by content words) rather than the sentence's syntactic form (conveyed via word order or function words) is primarily responsible for the ANN-to-brain similarity. In follow-up analyses, we found that perturbation manipulations that adversely affect brain predictivity also lead to more divergent representations in the ANN's embedding space and decrease the ANN's ability to predict upcoming tokens in those stimuli. Further, results are robust as to whether the mapping model is trained on intact or perturbed stimuli and whether the ANN sentence representations are conditioned on the same linguistic context that humans saw. The critical result-that lexical-semantic content is the main contributor to the similarity between ANN representations and neural ones-aligns with the idea that the goal of the human language system is to extract meaning from linguistic strings. Finally, this work highlights the strength of systematic experimental manipulations for evaluating how close we are to accurate and generalizable models of the human language network.

Limited but specific engagement of the mature language network during linguistic statistical learning

Statistical learning (SL) is the ability to detect and learn regularities from input and is foundational to language acquisition. Despite the dominant role of SL as a theoretical construct for language development, there is a lack of direct evidence supporting the shared neural substrates underlying language processing and SL. It is also not clear whether the similarities, if any, are related to linguistic processing, or statistical regularities in general. The current study tests whether the brain regions involved in natural language processing are similarly recruited during auditory, linguistic SL. Twenty-two adults performed an auditory linguistic SL task, an auditory nonlinguistic SL task, and a passive story listening task as their neural activation was monitored. Within the language network, the left posterior temporal gyrus showed sensitivity to embedded speech regularities during auditory, linguistic SL, but not auditory, nonlinguistic SL. Using a multivoxel pattern similarity analysis, we uncovered similarities between the neural representation of auditory, linguistic SL, and language processing within the left posterior temporal gyrus. No other brain regions showed similarities between linguistic SL and language comprehension, suggesting that a shared neurocomputational process for auditory SL and natural language processing within the left posterior temporal gyrus is specific to linguistic stimuli.

Disentangling neuroplasticity mechanisms in post-stroke language recovery

A major objective in post-stroke aphasia research is to gain a deeper understanding of neuroplastic mechanisms that drive language recovery, with the ultimate goal of enhancing treatment outcomes. Subsequent to recent advances in neuroimaging techniques, we now have the ability to examine more closely how neural activity patterns change after a stroke. However, the way these neural activity changes relate to language impairments and language recovery is still debated. The aim of this review is to provide a theoretical framework to better investigate and interpret neuroplasticity mechanisms underlying language recovery in post-stroke aphasia. We detail two sets of neuroplasticity mechanisms observed at the synaptic level that may explain functional neuroimaging findings in post-stroke aphasia recovery at the network level: feedback-based homeostatic plasticity and associative Hebbian plasticity. In conjunction with these plasticity mechanisms, higher-order cognitive control processes dynamically modulate neural activity in other regions to meet communication demands, despite reduced neural resources. This work provides a network-level neurobiological framework for understanding neural changes observed in post-stroke aphasia and can be used to define guidelines for personalized treatment development.

High-level language brain regions process sublexical regularities

A network of left frontal and temporal brain regions supports language processing. This "core" language network stores our knowledge of words and constructions as well as constraints on how those combine to form sentences. However, our linguistic knowledge additionally includes information about phonemes and how they combine to form phonemic clusters, syllables, and words. Are phoneme combinatorics also represented in these language regions? Across five functional magnetic resonance imaging experiments, we investigated the sensitivity of high-level language processing brain regions to sublexical linguistic regularities by examining responses to diverse nonwords-sequences of phonemes that do not constitute real words (e.g. punes, silory, flope). We establish robust responses in the language network to visually (experiment 1a, n = 605) and auditorily (experiments 1b, n = 12, and 1c, n = 13) presented nonwords. In experiment 2 (n = 16), we find stronger responses to nonwords that are more well-formed, i.e. obey the phoneme-combinatorial constraints of English. Finally, in experiment 3 (n = 14), we provide suggestive evidence that the responses in experiments 1 and 2 are not due to the activation of real words that share some phonology with the nonwords. The results suggest that sublexical regularities are stored and processed within the same fronto-temporal network that supports lexical and syntactic processes.

Driving and suppressing the human language network using large language models

Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of the brain response associated with each sentence. We then use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress the activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also non-invasively control neural activity in higher-level cortical areas, such as the language network.

Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI

How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g. related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages coexist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.

Conversational production and comprehension: fMRI-evidence reminiscent of but deviant from the classical Broca-Wernicke model

A key question in research on the neurobiology of language is to which extent the language production and comprehension systems share neural infrastructure, but this question has not been addressed in the context of conversation. We utilized a public fMRI dataset where 24 participants engaged in unscripted conversations with a confederate outside the scanner, via an audio-video link. We provide evidence indicating that the two systems share neural infrastructure in the left-lateralized perisylvian language network, but diverge regarding the level of activation in regions within the network. Activity in the left inferior frontal gyrus was stronger in production compared to comprehension, while comprehension showed stronger recruitment of the left anterior middle temporal gyrus and superior temporal sulcus, compared to production. Although our results are reminiscent of the classical Broca-Wernicke model, the anterior (rather than posterior) temporal activation is a notable difference from that model. This is one of the findings that may be a consequence of the conversational setting, another being that conversational production activated what we interpret as higher-level socio-pragmatic processes. In conclusion, we present evidence for partial overlap and functional asymmetry of the neural infrastructure of production and comprehension, in the above-mentioned frontal vs temporal regions during conversation.

White matter microstructural plasticity associated with educational intervention in reading disability

Children's reading progress typically slows during extended breaks in formal education, such as summer vacations. This stagnation can be especially concerning for children with reading difficulties or disabilities, such as dyslexia, because of the potential to exacerbate the skills gap between them and their peers. Reading interventions can prevent skill loss and even lead to appreciable gains in reading ability during the summer. Longitudinal studies relating intervention response to brain changes can reveal educationally relevant insights into rapid learning-driven brain plasticity. The current work focused on reading outcomes and white matter connections, which enable communication among the brain regions required for proficient reading. We collected reading scores and diffusion-weighted images at the beginning and end of summer for 41 children with reading difficulties who had completed either 1st or 2nd grade. Children were randomly assigned to either receive an intensive reading intervention (n = 26; Seeing Stars from Lindamood-Bell which emphasizes orthographic fluency) or be deferred to a wait-list group (n = 15), enabling us to analyze how white matter properties varied across a wide spectrum of skill development and regression trajectories. On average, the intervention group had larger gains in reading compared to the non-intervention group, who declined in reading scores. Improvements on a proximal measure of orthographic processing (but not other more distal reading measures) were associated with decreases in mean diffusivity within core reading brain circuitry (left arcuate fasciculus and left inferior longitudinal fasciculus) and increases in fractional anisotropy in the left corticospinal tract. Our findings suggest that responses to intensive reading instruction are related predominantly to white matter plasticity in tracts most associated with reading.

Functional characterization of the language network of polyglots and hyperpolyglots with precision fMRI

How do polyglots-individuals who speak five or more languages-process their languages, and what can this population tell us about the language system? Using fMRI, we identified the language network in each of 34 polyglots (including 16 hyperpolyglots with knowledge of 10+ languages) and examined its response to the native language, non-native languages of varying proficiency, and unfamiliar languages. All language conditions engaged all areas of the language network relative to a control condition. Languages that participants rated as higher-proficiency elicited stronger responses, except for the native language, which elicited a similar or lower response than a non-native language of similar proficiency. Furthermore, unfamiliar languages that were typologically related to the participants' high-to-moderate-proficiency languages elicited a stronger response than unfamiliar unrelated languages. The results suggest that the language network's response magnitude scales with the degree of engagement of linguistic computations (e.g., related to lexical access and syntactic-structure building). We also replicated a prior finding of weaker responses to native language in polyglots than non-polyglot bilinguals. These results contribute to our understanding of how multiple languages co-exist within a single brain and provide new evidence that the language network responds more strongly to stimuli that more fully engage linguistic computations.

Social cognitive regions of human association cortex are selectively connected to the amygdala

Reasoning about someone's thoughts and intentions - i.e., forming a theory of mind - is an important aspect of social cognition that relies on association areas of the brain that have expanded disproportionately in the human lineage. We recently showed that these association zones comprise parallel distributed networks that, despite occupying adjacent and interdigitated regions, serve dissociable functions. One network is selectively recruited by theory of mind processes. What circuit properties differentiate these parallel networks? Here, we show that social cognitive association areas are intrinsically and selectively connected to regions of the anterior medial temporal lobe that are implicated in emotional learning and social behaviors, including the amygdala at or near the basolateral complex and medial nucleus. The results suggest that social cognitive functions emerge through coordinated activity between amygdala circuits and a distributed association network, and indicate the medial nucleus may play an important role in social cognition in humans.

Domain-general and language-specific contributions to speech production in a second language: an fMRI study using functional localizers

For bilinguals, speaking in a second language (L2) compared to the native language (L1) is usually more difficult. In this study we asked whether the difficulty in L2 production reflects increased demands imposed on domain-general or core language mechanisms. We compared the brain response to speech production in L1 and L2 within two functionally-defined networks in the brain: the Multiple Demand (MD) network and the language network. We found that speech production in L2 was linked to a widespread increase of brain activity in the domain-general MD network. The language network did not show a similarly robust differences in processing speech in the two languages, however, we found increased response to L2 production in the language-specific portion of the left inferior frontal gyrus (IFG). To further explore our results, we have looked at domain-general and language-specific response within the brain structures postulated to form a Bilingual Language Control (BLC) network. Within this network, we found a robust increase in response to L2 in the domain-general, but also in some language-specific voxels including in the left IFG. Our findings show that L2 production strongly engages domain-general mechanisms, but only affects language sensitive portions of the left IFG. These results put constraints on the current model of bilingual language control by precisely disentangling the domain-general and language-specific contributions to the difficulty in speech production in L2.

Cognitive and Neural Representations of Fractals in Vision, Music, and Action

The concept of fractal was popularized by Mandelbrot as a tool to tame the geometrical structure of objects with infinite hierarchical depth. The key aspect of fractals is the use of simple parsimonious rules and initial conditions, which when applied recursively can generate unbounded complexity. Fractals are structures ubiquitous in nature, being present in coast lines, bacteria colonies, trees, and physiological time series. However, within the field of cognitive science, the core question is not which phenomena can generate fractal structures, but whether human or animal minds can represent recursive processes, and if so in which domains. In this chapter, we will explore the cognitive and neural mechanisms underlying the representation of recursive hierarchical embedding. Language is the domain in which this capacity is best studied. Humans can generate an infinite array of hierarchically structured sentences, and this capacity distinguishes us from other species. However, recent research suggests that humans can represent similar structures in the domains of music, vision, and action and has provided additional cues as to how these capacities are cognitively implemented. Using a comparative approach, we will map the commonalities and differences across domains and offer a roadmap to understand the neurobiological implementation of fractal cognition.