The Cortical Organization of Syntax

ACKNOWLEDGING THE GAP WHILE BRIDGING IT: The Experimental Versus Theoretical Divide on the Cognitive Science Study of Language

In recent years, the intersection of psycholinguistics, neurolinguistics, and theoretical linguistics has gained considerable attention in studies on the cognitive science of language. However, a significant gap still persists between advanced theoretical models and current experimental research capabilities. This study examines this divide, highlighting examples across various linguistic subfields and proposing potential approaches to bridge the gap.

The role of variation in phonological and semantic working memory capacities in sentence comprehension: neural evidence from healthy and brain-damaged individuals

Research on the role of working memory (WM) in language processing has typically focused on WM for phonological information. However, considerable behavioral evidence supports the existence of a separate semantic WM system that plays a greater role in language processing. We review the neural evidence that supports the distinction between phonological and semantic WM capacities and discuss how individual differences in these capacities relate to sentence processing. In terms of neural substrates, findings from multivariate functional MRI for healthy participants and voxel-based lesion-symptom mapping for brain-damaged participants imply that the left supramarginal gyrus supports phonological WM, whereas the left inferior frontal gyrus (LIFG) and angular gyrus support semantic WM. In sentence comprehension, individual variation in semantic but not phonological WM related to performance in resolving semantic information and the LIFG region implicated in semantic WM showed fMRI activation during the resolution of semantic interference. Moreover, variation for brain-damaged participants in the integrity of a fiber tract supporting semantic WM had a greater relation to the processing of complex sentences than did the integrity of fiber tracts supporting phonological WM. Overall, the neural findings provide converging evidence regarding the distinction of these two capacities and the greater contribution of individual differences in semantic than phonological WM capacity to sentence processing.

A Functional Magnetic Resonance Imaging Study of Phrase Structure and Subject Island Violations

In principle, functional neuroimaging provides uniquely informative data in addressing linguistic questions, because it can indicate distinct processes that are not apparent from behavioral data alone. This could involve adjudicating the source of unacceptability via the different patterns of elicited brain responses to different ungrammatical sentence types. However, it is difficult to interpret brain activations to syntactic violations. Such responses could reflect processes that have nothing intrinsically related to linguistic representations, such as domain-general executive function abilities. To facilitate the potential use of functional neuroimaging methods to identify the source of different syntactic violations, we conducted a functional magnetic resonance imaging experiment to identify the brain activation maps associated with two distinct syntactic violation types: phrase structure (created by inverting the order of two adjacent words within a sentence) and subject islands (created by extracting a wh-phrase out of an embedded subject). The comparison of these violations to control sentences surprisingly showed no indication of a generalized violation response, with almost completely divergent activation patterns. Phrase structure violations seemingly activated regions previously implicated in verbal working memory and structural complexity in sentence processing, whereas the subject islands appeared to activate regions previously implicated in conceptual-semantic processing, broadly defined. We review our findings in the context of previous research on syntactic and semantic violations using ERPs. Although our results suggest potentially distinct underlying mechanisms underlying phrase structure and subject island violations, our results are tentative and suggest important methodological considerations for future research in this area.

A magnitude-independent neural code for linguistic information during sentence production

Humans are the only species with the ability to convey an unbounded number of novel thoughts by combining words into sentences. This process is guided by complex semantic and abstract syntactic representations. Despite their centrality to human cognition, the neural mechanisms underlying these systems remain obscured by inherent limitations of non-invasive brain measures and a near total focus on comprehension paradigms. Here, we address these limitations with high-resolution neurosurgical recordings (electrocorticography) and a controlled sentence production experiment. We uncover distinct cortical networks encoding word-level, semantic, and syntactic information. These networks are broadly distributed across traditional language areas, but with focal sensitivity to syntactic structure in middle and inferior frontal gyri. In contrast to previous findings from comprehension studies, these networks are largely non-overlapping, each specialized for just one of the three linguistic constructs we investigate. Most strikingly, our data reveal an unexpected property of higher-order linguistic information: it is encoded independent of neural activity levels. We propose that this "magnitude-independent coding" scheme represents a novel mechanism for encoding information, reserved for higher-order cognition more broadly.

The crucial role of the left inferior frontal gyrus (BA44) in synergizing syntactic structure and information structure during sentence comprehension

This study examines the neural mechanisms behind integrating syntactic and information structures during sentence comprehension using functional Magnetic Resonance Imaging. Focusing on Japanese sentences with canonical (SOV) and non-canonical (OSV) word orders, the study revealed distinct neural networks responsible for processing these linguistic structures. The left opercular part of the inferior frontal gyrus, left premotor area, and left posterior superior/middle temporal gyrus were primarily involved in syntactic processing. In contrast, the right inferior frontal sulcus, bilateral intraparietal sulci, and the left triangular part of the inferior frontal gyrus were linked to information structure processing. Importantly, the left opercular part of the inferior frontal gyrus (BA44) played a crucial role in integrating these structures during the later stages of comprehension, particularly when processing the second noun phrase. These findings enhance our understanding of the complex interplay between syntactic and information structures in language comprehension.

Neural representation of sensorimotor features in language-motor areas during auditory and visual perception

Speech processing involves a complex interplay between sensory and motor systems in the brain, essential for early language development. Recent studies have extended this sensory-motor interaction to visual word processing, emphasizing the connection between reading and handwriting during literacy acquisition. Here we show how language-motor areas encode motoric and sensory features of language stimuli during auditory and visual perception, using functional magnetic resonance imaging (fMRI) combined with representational similarity analysis. Chinese-speaking adults completed tasks involving the perception of spoken syllables and written characters, alongside syllable articulation and finger writing tasks to localize speech-motor and writing-motor areas. We found that both language-motor and sensory areas generally encode production-related motoric features across modalities, indicating cooperative interactions between motor and sensory systems. Notably, sensory encoding within sensorimotor areas was observed during auditory speech perception, but not in visual character perception. These findings underscore the dual encoding capacities of language-motor areas, revealing both shared and distinct neural representation patterns across modalities, which may be linked to innate sensory-motor mechanisms and modality-specific processing demands. Our results shed light on the sensorimotor integration mechanisms underlying language perception, highlighting the importance of a cross-modality perspective.

Four dimensions of naturalistic language production in aphasia after stroke

There is a rich tradition of research on the neuroanatomical correlates of spoken language production in aphasia using constrained tasks (e.g. picture naming), which offer controlled insights into the distinct processes that govern speech and language (i.e. lexical-semantic access, morphosyntactic construction, phonological encoding, speech motor programming/execution). Yet these tasks do not necessarily reflect everyday language use. In contrast, naturalistic language production (also referred to as 'connected speech' or 'discourse') more closely approximates typical processing demands, requiring the dynamic integration of all aspects of speech and language. The brain bases of naturalistic language production remain relatively unknown, however, in part because of the difficulty in deriving features that are salient, quantifiable and interpretable relative to both speech-language processes and the extant literature. The present cross-sectional observational study seeks to address these challenges by leveraging a validated and comprehensive auditory-perceptual measurement system that yields four explanatory dimensions of performance-Paraphasia (misselection of words and sounds), Logopenia (paucity of words), Agrammatism (grammatical omissions) and Motor speech (impaired speech motor programming/execution). We used this system to characterize naturalistic language production in a large and representative sample of individuals with acute post-stroke aphasia (n = 118). Scores on each of the four dimensions were correlated with lesion metrics, and multivariate associations among the dimensions and brain regions were then explored. Our findings revealed distinct yet overlapping neuroanatomical correlates throughout the left-hemisphere language network. Paraphasia and logopenia were associated primarily with posterior regions, spanning both dorsal and ventral streams, which are critical for lexical-semantic access and phonological encoding. In contrast, agrammatism and motor speech were associated primarily with anterior regions of the dorsal stream that are involved in morphosyntactic construction and speech motor planning/execution, respectively. Collectively, we view these results as constituting a brain-behaviour model of naturalistic language production in aphasia, aligning with both historical and contemporary accounts of the neurobiology of spoken language production.

Brain imaging and electrophysiological markers of anaphoric reference during speech production

Pronouns create cohesive links in discourse by referring to previously mentioned elements. Here, we focus on pronominalization during speech production in three experiments employing ERP and fMRI methodologies. Participants were asked to produce two short sentences describing a man or woman using an object. In the second sentence, they were instructed to use a pronoun to refer to the same person and a noun to refer to a different person. The first ERP experiment revealed that noun conditions elicited more negative ERPs starting at 220 ms, with significant differences in early and later time windows, particularly in the left hemisphere. The second ERP experiment showed divergence at 280 ms, with significant differences between 300 and 400 ms at midline electrodes, again indicating more negative ERPs for nouns. The fMRI experiment identified greater activations for nouns than pronouns in regions like the superior temporal gyrus (STG) and cerebellar vermis, suggesting higher working memory load and lexical retrieval demands for nouns compared to pronouns. Moreover, pronouns elicited an enhanced centro-parietal positivity, indicating increased attentional demands. These findings suggest that while noun processing requires greater working memory and lexical retrieval, pronoun processing engages more attentional resources. This study advances our understanding of the neural mechanisms underlying pronominalization during speech production, highlighting distinct neural responses for nouns and pronouns.

An event-related brain potential analysis of the use of temporal connectives in language production

This study investigates the cognitive and neural mechanisms involved in the linearization of events during language production, focusing on the processing of temporal conjunctions "before" and "after." While natural language typically presents events in chronological order, non-chronological sequences, as required by "before" sentences, impose additional cognitive demands. Using an adapted network task, we recorded event-related potentials (ERPs) in 24 healthy German speaking participants to examine the brain activity associated with these demands. Results showed that "before" sentences elicited early positivity and later negativity in ERPs, particularly over left temporal and frontocentral regions, suggesting increased working memory requirements for reordering events. These findings align with previous behavioral and neuroimaging studies, indicating that both language production and comprehension of "before" sentences necessitate more complex cognitive processing than "after" sentences. This research highlights the significant role of working memory during the conceptualization stage of language production exemplified by the brain's handling of non-chronological sequences.

Verbal working memory and syntactic comprehension segregate into the dorsal and ventral streams, respectively

Syntactic processing and verbal working memory are both essential components to sentence comprehension. Nonetheless, the separability of these systems in the brain remains unclear. To address this issue, we performed causal-inference analyses based on lesion and connectome network mapping using MRI and behavioural testing in two groups of individuals with chronic post-stroke aphasia. We employed a rhyme judgement task with heavy working memory load without articulatory confounds, controlling for the overall ability to match auditory words to pictures and to perform a metalinguistic rhyme judgement, isolating the effect of working memory load (103 individuals). We assessed non-canonical sentence comprehension, isolating syntactic processing by incorporating residual rhyme judgement performance as a covariate for working memory load (78 individuals). Voxel-based lesion analyses and structural connectome-based lesion symptom mapping controlling for total lesion volume were performed, with permutation testing to correct for multiple comparisons (4000 permutations). We observed that effects of working memory load localized to dorsal stream damage: posterior temporal-parietal lesions and frontal-parietal white matter disconnections. These effects were differentiated from syntactic comprehension deficits, which were primarily associated with ventral stream damage: lesions to temporal lobe and temporal-parietal white matter disconnections, particularly when incorporating the residual measure of working memory load as a covariate. Our results support the conclusion that working memory and syntactic processing are associated with distinct brain networks, largely loading onto dorsal and ventral streams, respectively.

Network-based statistics distinguish anomic and Broca's aphasia

INTRODUCTION

Aphasia is a speech-language impairment commonly caused by damage to the left hemisphere. The neural mechanisms that underpin different types of aphasia and their symptoms are still not fully understood. This study aims to identify differences in resting-state functional connectivity between anomic and Broca's aphasia measured through resting-state functional magnetic resonance imaging (rs-fMRI).

METHODS

We used the network-based statistic (NBS) method, as well as voxel- and connectome-based lesion symptom mapping (V-, CLSM), to identify distinct neural correlates of the anomic and Broca's groups. To control for lesion effect, we included lesion volume as a covariate in both the NBS method and LSM.

RESULTS

NBS identified a subnetwork located in the dorsal language stream bilaterally, including supramarginal gyrus, primary sensory, motor, and auditory cortices, and insula. The connections in the subnetwork were weaker in the Broca's group than the anomic group. The properties of the subnetwork were examined through complex network measures, which indicated that regions in right inferior frontal sulcus, right paracentral lobule, and bilateral superior temporal gyrus exhibit intensive interaction. Left superior temporal gyrus, right postcentral gyrus, and left supramarginal gyrus play an important role in information flow and overall communication efficiency. Disruption of this network underlies the constellation of symptoms associated with Broca's aphasia. Whole-brain CLSM did not detect any significant connections, suggesting an advantage of NBS when thousands of connections are considered. However, CLSM identified connections that differentiated Broca's from anomic aphasia when analysis was restricted to a hypothesized network of interest.

DISCUSSION

We identified novel signatures of resting-state brain network differences between groups of individuals with anomic and Broca's aphasia. We identified a subnetwork of connections that statistically differentiated the resting-state brain networks of the two groups, in comparison with standard CLSM results that yielded isolated connections. Network-level analyses are useful tools for the investigation of the neural correlates of language deficits post-stroke.

Wernicke's functional neuroanatomy model of language turns 150: what became of its psychological reflex arcs?

Wernicke (Der aphasische Symptomencomplex: Eine psychologische Studie auf anatomischer Basis. Cohn und Weigert, Breslau.  https://wellcomecollection.org/works/dwv5w9rw , 1874) proposed a model of the functional neuroanatomy of spoken word repetition, production, and comprehension. At the heart of this epoch-making model are psychological reflex arcs underpinned by fiber tracts connecting sensory to motor areas. Here, I evaluate the central assumption of psychological reflex arcs in light of what we have learned about language in the brain during the past 150 years. I first describe Wernicke's 1874 model and the evidence he presented for it. Next, I discuss his updates of the model published in 1886 and posthumously in 1906. Although the model had an enormous immediate impact, it lost influence after the First World War. Unresolved issues included the anatomical underpinnings of the psychological reflex arcs, the role of auditory images in word production, and the sufficiency of psychological reflex arcs, which was questioned by Wundt (Grundzüge der physiologischen Psychologie. Engelmann, Leipzig. http://vlp.mpiwg-berlin.mpg.de/references?id=lit46 , 1874; Grundzüge der physiologischen Psychologie (Vol. 1, 5th ed.). Engelmann, Leipzig. http://vlp.mpiwg-berlin.mpg.de/references?id=lit806 , 1902). After a long dormant period, Wernicke's model was revived by Geschwind (Science 170:940-944. https://doi.org/10.1126/science.170.3961.940 , 1970; Selected papers on language and the brain. Reidel, Dordrecht, 1974), who proposed a version of it that differed in several important respects from Wernicke's original. Finally, I describe how new evidence from modern research has led to a novel view on language in the brain, supplementing contemporary equivalents of psychological reflex arcs by other mechanisms such as attentional control and assuming different neuroanatomical underpinnings. In support of this novel view, I report new analyses of patient data and computer simulations using the WEAVER++/ARC model (Roelofs 2014, 2022) that incorporates attentional control and integrates the new evidence.

Differential neural representations of syntactic and semantic information across languages in Chinese-English bilinguals

Bilingual individuals manage multiple languages that align in conceptual meaning but differ in forms and structures. While prior research has established foundational insights into the neural mechanisms in bilingual processing, the extent to which the first (L1) and second language (L2) systems overlap or diverge across different linguistic components remains unclear. This study probed the neural underpinnings of syntactic and semantic processing for L1 and L2 in Chinese-English bilinguals (N = 44) who performed sentence comprehension tasks and an N-back working memory task during functional MRI scanning. We observed that the increased activation for L2 processing was within the verbal working memory network, suggesting a greater cognitive demand for processing L2. Crucially, we looked for brain regions showing adaptation to the repetition of semantic information and syntactic structure, and found more robust adaptation effects in L1 in the middle and superior temporal cortical areas. The differential adaptation effects between L1 and L2 were more pronounced for the semantic condition. Multivariate pattern analysis further revealed distinct neural sensitivities to syntactic and semantic representations between L1 and L2 across frontotemporal language regions. Our findings suggest that while L1 and L2 engage similar neural systems, finer representation analyses uncover distinct neural patterns for both semantic and syntactic aspects in the two languages. This study advances our understanding of neural representations involved in different language components in bilingual individuals.

Mapping sentence comprehension and syntactic complexity: evidence from 131 stroke survivors

Understanding and interpreting how words are organized in a sentence to convey distinct meanings is a cornerstone of human communication. The neural underpinnings of this ability, known as syntactic comprehension, are far from agreed upon in current neurocognitive models of language comprehension. Traditionally, left frontal regions (e.g. left posterior inferior frontal gyrus) were considered critical, while more recently, left temporal regions (most prominently, left posterior middle temporal gyrus) have been identified as more indispensable to syntactic comprehension. Syntactic processing has been investigated by using different types of non-canonical sentences i.e. those that do not follow prototypical word order and are considered more syntactically complex. However, non-canonical sentences can be complex for different linguistic reasons, and thus, their comprehension might rely on different neural underpinnings. In this cross-sectional study, we explored the neural correlates of syntactic comprehension by investigating the roles of left hemisphere brain regions and white matter pathways in processing sentences with different levels of syntactic complexity. Participants were assessed at a single point in time using structural MRI and behavioural tests. Employing lesion-symptom mapping and indirect structural disconnection mapping in a cohort of 131 left hemisphere stroke survivors, our analysis revealed the following left temporal regions and underlying white matter pathways as crucial for general sentence comprehension: the left mid-posterior superior temporal gyrus, middle temporal gyrus and superior temporal sulcus and the inferior longitudinal fasciculus, the inferior fronto-occipital fasciculus, the middle longitudinal fasciculus, the uncinate fasciculus and the tracts crossing the most posterior part of the corpus callosum. We further found significant involvement of different white matter tracts connecting the left temporal and frontal lobes for different sentence types. Spared connections between the left temporal and frontal regions were critical for the comprehension of non-canonical sentences requiring long-distance retrieval (spared superior longitudinal fasciculus for both subject and object extraction and spared arcuate fasciculus for object extraction) but not for comprehension of non-canonical passive sentences and canonical declarative sentences. Our results challenge traditional language models that emphasize the primary role of the left frontal regions, such as Broca's area, in basic sentence structure comprehension. Our findings suggest a gradient of syntactic complexity, rather than a clear-cut dichotomy between canonical and non-canonical sentence structures. Our findings contribute to a more nuanced understanding of the neural architecture of language comprehension and highlight potential directions for future research.

Syntactic and semantic specialization in 9- to 10-year-old children during auditory sentence processing

Prior literature has debated whether syntax is separable from semantics in the brain. Using functional magnetic resonance imaging and multi-voxel pattern analysis, our previous studies investigated brain activity during morpho-syntactic versus semantic processing. These studies only detected semantic specialization in activation patterns and no syntactic specialization in 5- to 6-year-old and 7- to 8-year-old children. To examine if older children who have mastered morpho-syntactic skills would show specialization for syntax, the current study examined 64 9- to 10-year-old children using the same design and analyses. We observed that only the left IFG pars opercularis was sensitive to syntactic but not semantic information, supporting the hypothesis that this region serves as a core region for syntax. In addition, the left STG which has been implicated in the integration of semantics and syntax, as well as the left MTG and IFG pars triangularis which have been implicated in semantics, were sensitive to both semantic and syntactic information with no evidence of specialization. These findings suggest a lexicalized view of syntax, which argues that semantically sensitive regions are also critical regions for syntactic processing during language comprehension.

Language at a glance: How our brains grasp linguistic structure from parallel visual input

Human brains grasp the gists of visual scenes from a single glance, but to what extent is this possible for language? While we typically think of language in terms of sequential speech, our everyday experience involves numerous rapidly flashing written notifications, which we understand instantly. What do our brains detect in the first few hundred milliseconds after seeing such a stimulus? We flashed short sentences during magnetoencephalography measurement, revealing sentence-sensitive neural activity in left temporal cortex within 130 milliseconds. These signals emerged for subject-verb-object sentences regardless of grammatical or semantic well-formedness, suggesting that at-a-glance language comprehension begins by detecting basic phrase structure, independent of meaning or other grammatical details. Our findings unveil one aspect of how our brains process information rapidly in today's visually saturated world.

Syntax and the brain: language evolution as the missing link(ing theory)?

Introduction

This paper provides proof of concept that neurolinguistic research on human language syntax would benefit greatly by expanding its scope to include evolutionary considerations, as well as non-propositional functions of language, including naming/nicknaming and verbal aggression. In particular, an evolutionary approach can help circumvent the so-called granularity problem in studying the processing of syntax in the brain, that is, the apparent mismatch between the abstract postulates of syntax (e.g. Tense Phrase (TP), Determiner Phrase (DP), etc.) and the concrete units of neurobiology (neurons, axons, etc.).

Methods

First, we decompose syntax into its evolutionary primitives, identifying one of the earliest stages as a simple, flat combination of just one verb and one noun. Next, we identify proxies ("living fossils") of such a stage in present-day languages, including compounds and small clauses, lacking at least some layers of structure, e.g. TPs and DPs. These proxies of ancestral language have been subjected to fMRI neuroimaging experiments.

Results

We discuss the finding that less hierarchical small clauses, in contrast to full sentences with TPs and DPs, show reduced activation in the left Broca's area (BA) 44 and the right basal ganglia, consistent with the hypothesis that more recent, more elaborate syntax requires more connectivity in the Broca's-basal ganglia network, whose neuronal density has been significantly enhanced in recent evolution, implicating mutations in FOXP2 and other genes. We also discuss the finding that the processing of ancestral verb-noun compounds, which are typically used for (derogatory) naming and nicknaming, shows enhanced activation in the right fusiform gyrus area (BA 37), the area that is implicated in the processing of metaphoricity and imageability, but also in naming and face recognition, opening up an intriguing possibility that the enhanced face recognition in humans was facilitated by the early emergence of a simple syntactic strategy for naming.

Discussion

The considerations in this paper are consistent with the hypothesis of a gradual gene-culture co-evolution of syntax and the brain, targeting cortico-striatal brain networks. It is also of note that a sound grounding in neurobiology of language should in turn inform syntactic theories themselves.

Lexical Surprisal Shapes the Time Course of Syntactic Structure Building

When we understand language, we recognize words and combine them into sentences. In this article, we explore the hypothesis that listeners use probabilistic information about words to build syntactic structure. Recent work has shown that lexical probability and syntactic structure both modulate the delta-band (<4 Hz) neural signal. Here, we investigated whether the neural encoding of syntactic structure changes as a function of the distributional properties of a word. To this end, we analyzed MEG data of 24 native speakers of Dutch who listened to three fairytales with a total duration of 49 min. Using temporal response functions and a cumulative model-comparison approach, we evaluated the contributions of syntactic and distributional features to the variance in the delta-band neural signal. This revealed that lexical surprisal values (a distributional feature), as well as bottom-up node counts (a syntactic feature) positively contributed to the model of the delta-band neural signal. Subsequently, we compared responses to the syntactic feature between words with high- and low-surprisal values. This revealed a delay in the response to the syntactic feature as a consequence of the surprisal value of the word: high-surprisal values were associated with a delayed response to the syntactic feature by 150-190 ms. The delay was not affected by word duration, and did not have a lexical origin. These findings suggest that the brain uses probabilistic information to infer syntactic structure, and highlight an importance for the role of time in this process.

Connectivity of Fronto-Temporal Regions in Syntactic Structure Building During Speaking and Listening

The neural infrastructure for sentence production and comprehension has been found to be mostly shared. The same regions are engaged during speaking and listening, with some differences in how strongly they activate depending on modality. In this study, we investigated how modality affects the connectivity between regions previously found to be involved in syntactic processing across modalities. We determined how constituent size and modality affected the connectivity of the pars triangularis of the left inferior frontal gyrus (LIFG) and of the left posterior temporal lobe (LPTL) with the pars opercularis of the LIFG, the left anterior temporal lobe (LATL), and the rest of the brain. We found that constituent size reliably increased the connectivity across these frontal and temporal ROIs. Connectivity between the two LIFG regions and the LPTL was enhanced as a function of constituent size in both modalities, and it was upregulated in production possibly because of linearization and motor planning in the frontal cortex. The connectivity of both ROIs with the LATL was lower and only enhanced for larger constituent sizes, suggesting a contributing role of the LATL in sentence processing in both modalities. These results thus show that the connectivity among fronto-temporal regions is upregulated for syntactic structure building in both sentence production and comprehension, providing further evidence for accounts of shared neural resources for sentence-level processing across modalities.

An fMRI study of phrase structure and subject island violations

In principle, functional neuroimaging provides uniquely informative data in addressing linguistic questions, because it can indicate distinct processes that are not apparent from behavioral data alone. This could involve adjudicating the source of unacceptability via the different patterns of elicited brain responses to different ungrammatical sentence types. However, it is difficult to interpret brain activations to syntactic violations. Such responses could reflect processes that have nothing intrinsically related to linguistic representations, such as domain-general executive function abilities. In order to facilitate the potential use of functional neuroimaging methods to identify the source of different syntactic violations, we conducted an fMRI experiment to identify the brain activation maps associated with two distinct syntactic violation types: phrase structure (created by inverting the order of two adjacent words within a sentence) and subject islands (created by extracting a wh-phrase out of an embedded subject). The comparison of these violations to control sentences surprisingly showed no indication of a generalized violation response, with almost completely divergent activation patterns. Phrase structure violations seemingly activated regions previously implicated in verbal working memory and structural complexity in sentence processing, whereas the subject islands appeared to activate regions previously implicated in conceptual-semantic processing, broadly defined. We review our findings in the context of previous research on syntactic and semantic violations using event-related potentials. Although our results suggest potentially distinct underlying mechanisms underlying phrase structure and subject island violations, our results are tentative and suggest important methodological considerations for future research in this area.

Multiple dimensions of syntactic structure are resolved earliest in posterior temporal cortex

How we combine minimal linguistic units into larger structures remains an unresolved topic in neuroscience. Language processing involves the abstract construction of 'vertical' and 'horizontal' information simultaneously (e.g., phrase structure, morphological agreement), but previous paradigms have been constrained in isolating only one type of composition and have utilized poor spatiotemporal resolution. Using intracranial recordings, we report multiple experiments designed to separate phrase structure from morphosyntactic agreement. Epilepsy patients (n = 10) were presented with auditory two-word phrases grouped into pseudoword-verb ('trab run') and pronoun-verb either with or without Person agreement ('they run' vs. 'they runs'). Phrase composition and Person violations both resulted in significant increases in broadband high gamma activity approximately 300 ms after verb onset in posterior middle temporal gyrus (pMTG) and posterior superior temporal sulcus (pSTS), followed by inferior frontal cortex (IFC) at 500 ms. While sites sensitive to only morphosyntactic violations were distributed, those sensitive to both composition types were generally confined to pSTS/pMTG and IFC. These results indicate that posterior temporal cortex shows the earliest sensitivity for hierarchical linguistic structure across multiple dimensions, providing neural resources for distinct windows of composition. This region is comprised of sparsely interwoven heterogeneous constituents that afford cortical search spaces for dissociable syntactic relations.

Neural populations in the language network differ in the size of their temporal receptive windows

Despite long knowing what brain areas support language comprehension, our knowledge of the neural computations that these frontal and temporal regions implement remains limited. One important unresolved question concerns functional differences among the neural populations that comprise the language network. Here we leveraged the high spatiotemporal resolution of human intracranial recordings (n = 22) to examine responses to sentences and linguistically degraded conditions. We discovered three response profiles that differ in their temporal dynamics. These profiles appear to reflect different temporal receptive windows, with average windows of about 1, 4 and 6 words, respectively. Neural populations exhibiting these profiles are interleaved across the language network, which suggests that all language regions have direct access to distinct, multiscale representations of linguistic input-a property that may be critical for the efficiency and robustness of language processing.

FMRI speech tracking in primary and non-primary auditory cortex while listening to noisy scenes

Invasive and non-invasive electrophysiological measurements during "cocktail-party"-like listening indicate that neural activity in the human auditory cortex (AC) "tracks" the envelope of relevant speech. However, due to limited coverage and/or spatial resolution, the distinct contribution of primary and non-primary areas remains unclear. Here, using 7-Tesla fMRI, we measured brain responses of participants attending to one speaker, in the presence and absence of another speaker. Through voxel-wise modeling, we observed envelope tracking in bilateral Heschl's gyrus (HG), right middle superior temporal sulcus (mSTS) and left temporo-parietal junction (TPJ), despite the signal's sluggish nature and slow temporal sampling. Neurovascular activity correlated positively (HG) or negatively (mSTS, TPJ) with the envelope. Further analyses comparing the similarity between spatial response patterns in the single speaker and concurrent speakers conditions and envelope decoding indicated that tracking in HG reflected both relevant and (to a lesser extent) non-relevant speech, while mSTS represented the relevant speech signal. Additionally, in mSTS, the similarity strength correlated with the comprehension of relevant speech. These results indicate that the fMRI signal tracks cortical responses and attention effects related to continuous speech and support the notion that primary and non-primary AC process ongoing speech in a push-pull of acoustic and linguistic information.

Hierarchical neural processing in γ oscillations for syntactic and semantic operations accounts for first- and second-language epistemology

Introduction

We discuss event-related power differences (ERPDs) in low- and broadband-γ oscillations as the embedded-clause edge is processed in wh-dependencies such as Which decision regarding/about him/her did Paul say that Lydie rejected without hesitation? in first (L1) and second language (L2) French speakers.

Methods

The experimental conditions manipulated whether pronouns appeared in modifiers (Mods; regarding him/her) or in noun complements (Comps; about him/her) and whether they matched or mismatched a matrix-clause subject in gender.

Results

Across L1 and L2 speakers, we found that anaphora-linked ERPDs for Mods vs. Comps in evoked power first arose in low γ and then in broadband γ. Referential elements first seem to be retrieved from working memory by narrowband processes in low γ and then referential identification seems to be computed in broadband-γ output. Interactions between discourse- and syntax-based referential processes for the Mods vs. Comps in these ERPDs furthermore suggest that multidomain γ-band processing enables a range of elementary operations for discourse and semantic interpretation.

Discussion

We argue that a multidomain mechanism enabling operations conditioned by the syntactic and semantic nature of the elements processed interacts with local brain microcircuits representing features and feature sets that have been established in L1 or L2 acquisition, accounting for a single language epistemology across learning contexts.

Decoding Single and Paired Phonemes Using 7T Functional MRI

Several studies have shown that mouth movements related to the pronunciation of individual phonemes are represented in the sensorimotor cortex. This would theoretically allow for brain computer interfaces that are capable of decoding continuous speech by training classifiers based on the activity in the sensorimotor cortex related to the production of individual phonemes. To address this, we investigated the decodability of trials with individual and paired phonemes (pronounced consecutively with one second interval) using activity in the sensorimotor cortex. Fifteen participants pronounced 3 different phonemes and 3 combinations of two of the same phonemes in a 7T functional MRI experiment. We confirmed that support vector machine (SVM) classification of single and paired phonemes was possible. Importantly, by combining classifiers trained on single phonemes, we were able to classify paired phonemes with an accuracy of 53% (33% chance level), demonstrating that activity of isolated phonemes is present and distinguishable in combined phonemes. A SVM searchlight analysis showed that the phoneme representations are widely distributed in the ventral sensorimotor cortex. These findings provide insights about the neural representations of single and paired phonemes. Furthermore, it supports the notion that speech BCI may be feasible based on machine learning algorithms trained on individual phonemes using intracranial electrode grids.

Verbal short term memory contribution to sentence comprehension decreases with increasing syntactic complexity in people with aphasia

Sentence comprehension requires the integration of linguistic units presented in a temporal sequence based on a non-linear underlying syntactic structure. While it is uncontroversial that storage is mandatory for this process, there are opposing views regarding the relevance of general short-term-/working-memory capacities (STM/WM) versus language specific resources. Here we report results from 43 participants with an acquired brain lesion in the extended left hemispheric language network and resulting language deficits, who performed a sentence-to-picture matching task and an experimental task assessing phonological short-term memory. The sentence task systematically varied syntactic complexity (embedding depth and argument order) while lengths, number of propositions and plausibility were kept constant. Clinical data including digit-/ block-spans and lesion size and site were additionally used in the analyses. Correlational analyses confirm that performance on STM/WM-tasks (experimental task and digit-span) are the only two relevant predictors for correct sentence-picture-matching, while reaction times only depended on age and lesion size. Notably increasing syntactic complexity reduced the correlational strength speaking for the additional recruitment of language specific resources independent of more general verbal STM/WM capacities, when resolving complex syntactic structure. The complementary lesion-behaviour analysis yielded different lesion volumes correlating with either the sentence-task or the STM-task. Factoring out STM measures lesions in the anterior temporal lobe correlated with a larger decrease in accuracy with increasing syntactic complexity. We conclude that overall sentence comprehension depends on STM/WM capacity, while increases in syntactic complexity tax another independent cognitive resource.

The cortical representation of transitivity: Insights from tractography-based inhibitory nTMS

Navigated Transcranial Magnetic Stimulation (nTMS) is commonly used to causally identify cortical regions involved in language processing. Combining tractography with nTMS has been shown to increase induced error rates by targeting stimulation of cortical terminations of white matter fibers. According to functional Magnetic Resonance Imaging (fMRI) data, bilateral cortical areas connected by the arcuate fasciculus (AF) have been implicated in the processing of transitive compared to unergative verbs. To test this connection between transitivity and bilateral perisylvian regions, we administered a tractography-based inhibitory nTMS protocol during action naming of finite transitive (The man reads) and unergative (The man sails) verbs. After tracking the left and right AF, we stimulated the cortical terminations of the tract in frontal, parietal and temporal regions in 20 neurologically healthy native speakers of German. Results revealed that nTMS induced more errors during transitive compared to unergative verb naming when stimulating the left (vs right) AF terminations. This effect was specific to the left temporal terminations of the AF, whereas no differences between the two verb types were identified when stimulating inferior parietal and frontal AF terminations. Induced errors for transitive verbs over left temporal terminations mostly manifested as access errors (i.e., hesitations). Given the inhibitory nature of our nTMS protocol, these results suggest that temporal regions of the left hemisphere play a crucial role in argument structure processing. Our findings align with previous data on the role of left posterior temporal regions in language processing and by providing further evidence from a language production experiment using tractography-based inhibitory nTMS.

Brain and grammar: revealing electrophysiological basic structures with competing statistical models

Acoustic, lexical, and syntactic information are simultaneously processed in the brain requiring complex strategies to distinguish their electrophysiological activity. Capitalizing on previous works that factor out acoustic information, we could concentrate on the lexical and syntactic contribution to language processing by testing competing statistical models. We exploited electroencephalographic recordings and compared different surprisal models selectively involving lexical information, part of speech, or syntactic structures in various combinations. Electroencephalographic responses were recorded in 32 participants during listening to affirmative active declarative sentences. We compared the activation corresponding to basic syntactic structures, such as noun phrases vs. verb phrases. Lexical and syntactic processing activates different frequency bands, partially different time windows, and different networks. Moreover, surprisal models based on part of speech inventory only do not explain well the electrophysiological data, while those including syntactic information do. By disentangling acoustic, lexical, and syntactic information, we demonstrated differential brain sensitivity to syntactic information. These results confirm and extend previous measures obtained with intracranial recordings, supporting our hypothesis that syntactic structures are crucial in neural language processing. This study provides a detailed understanding of how the brain processes syntactic information, highlighting the importance of syntactic surprisal in shaping neural responses during language comprehension.

Structural and sequential regularities modulate phrase-rate neural tracking

Electrophysiological brain activity has been shown to synchronize with the quasi-regular repetition of grammatical phrases in connected speech-so-called phrase-rate neural tracking. Current debate centers around whether this phenomenon is best explained in terms of the syntactic properties of phrases or in terms of syntax-external information, such as the sequential repetition of parts of speech. As these two factors were confounded in previous studies, much of the literature is compatible with both accounts. Here, we used electroencephalography (EEG) to determine if and when the brain is sensitive to both types of information. Twenty native speakers of Mandarin Chinese listened to isochronously presented streams of monosyllabic words, which contained either grammatical two-word phrases (e.g., catch fish, sell house) or non-grammatical word combinations (e.g., full lend, bread far). Within the grammatical conditions, we varied two structural factors: the position of the head of each phrase and the type of attachment. Within the non-grammatical conditions, we varied the consistency with which parts of speech were repeated. Tracking was quantified through evoked power and inter-trial phase coherence, both derived from the frequency-domain representation of EEG responses. As expected, neural tracking at the phrase rate was stronger in grammatical sequences than in non-grammatical sequences without syntactic structure. Moreover, it was modulated by both attachment type and head position, revealing the structure-sensitivity of phrase-rate tracking. We additionally found that the brain tracks the repetition of parts of speech in non-grammatical sequences. These data provide an integrative perspective on the current debate about neural tracking effects, revealing that the brain utilizes regularities computed over multiple levels of linguistic representation in guiding rhythmic computation.

Perplexity of utterances in untreated first-episode psychosis: an ultra-high field MRI dynamic causal modelling study of the semantic network

BACKGROUND

Psychosis involves a distortion of thought content, which is partly reflected in anomalous ways in which words are semantically connected into utterances in speech. We sought to explore how these linguistic anomalies are realized through putative circuit-level abnormalities in the brain's semantic network.

METHODS

Using a computational large-language model, Bidirectional Encoder Representations from Transformers (BERT), we quantified the contextual expectedness of a given word sequence (perplexity) across 180 samples obtained from descriptions of 3 pictures by patients with first-episode schizophrenia (FES) and controls matched for age, parental social status, and sex, scanned with 7 T ultra-high field functional magnetic resonance imaging (fMRI). Subsequently, perplexity was used to parametrize a spectral dynamic causal model (DCM) of the effective connectivity within (intrinsic) and between (extrinsic) 4 key regions of the semantic network at rest, namely the anterior temporal lobe, the inferior frontal gyrus (IFG), the posterior middle temporal gyrus (MTG), and the angular gyrus.

RESULTS

We included 60 participants, including 30 patients with FES and 30 controls. We observed higher perplexity in the FES group, indicating that speech was less predictable by the preceding context among patients. Results of Bayesian model comparisons showed that a DCM including the group by perplexity interaction best explained the underlying patterns of neural activity. We observed an increase of self-inhibitory effective connectivity within the IFG, as well as reduced self-inhibitory tone within the pMTG, in the FES group. An increase in self-inhibitory tone in the IFG correlated strongly and positively with inter-regional excitation between the IFG and posterior MTG, while self-inhibition of the posterior MTG was negatively correlated with this interregional excitation.

LIMITATION

Our design did not address connectivity in the semantic network during tasks that selectively activated the semantic network, which could corroborate findings from this resting-state fMRI study. Furthermore, we do not present a replication study, which would ideally use speech in a different language.

CONCLUSION

As an explanation for peculiar speech in psychosis, these results index a shift in the excitatory-inhibitory balance regulating information flow across the semantic network, confined to 2 regions that were previously linked specifically to the executive control of meaning. Based on our approach of combining a large language model with causal connectivity estimates, we propose loss in semantic control as a potential neurocognitive mechanism contributing to disorganization in psychosis.

Impact of theta transcranial alternating current stimulation on language production in adult classic galactosemia patients

Patients with classic galactosemia (CG), an inborn error of galactose metabolism, suffer from impairments in cognition, including language processing. Potential causes are atypical brain oscillations. Recent electroencephalogram (EEG) showed differences in the P300 event-related-potential (ERP) and alterations in the alpha/theta-range during speech planning. This study investigated whether transcranial alternating current stimulation (tACS) at theta-frequency compared to sham can cause a normalization of the ERP post stimulation and improves language performance. Eleven CG patients and fourteen healthy controls participated in two tACS-sessions (theta 6.5 Hz/sham). They were engaged in an active language task, describing animated scenes at three moments, that is, pre/during/post stimulation. Pre and post stimulation, behavior (naming accuracy, voice-onset-times; VOT) and mean-amplitudes of ERP were compared, by means of a P300 time-window analysis and cluster-based-permutation testing during speech planning. The results showed that theta stimulation, not sham, significantly reduced naming error-percentage in patients, not in controls. Theta did not systematically speed up naming beyond a general learning effect, which was larger for the patients. The EEG analysis revealed a significant pre-post stimulation effect (P300/late positivity), in patients and during theta stimulation only. In conclusion, theta-tACS improved accuracy in language performance in CG patients compared to controls and altered the P300 and late positive ERP-amplitude, suggesting a lasting effect on neural oscillation and behavior.

The speech neuroprosthesis

Loss of speech after paralysis is devastating, but circumventing motor-pathway injury by directly decoding speech from intact cortical activity has the potential to restore natural communication and self-expression. Recent discoveries have defined how key features of speech production are facilitated by the coordinated activity of vocal-tract articulatory and motor-planning cortical representations. In this Review, we highlight such progress and how it has led to successful speech decoding, first in individuals implanted with intracranial electrodes for clinical epilepsy monitoring and subsequently in individuals with paralysis as part of early feasibility clinical trials to restore speech. We discuss high-spatiotemporal-resolution neural interfaces and the adaptation of state-of-the-art speech computational algorithms that have driven rapid and substantial progress in decoding neural activity into text, audible speech, and facial movements. Although restoring natural speech is a long-term goal, speech neuroprostheses already have performance levels that surpass communication rates offered by current assistive-communication technology. Given this accelerated rate of progress in the field, we propose key evaluation metrics for speed and accuracy, among others, to help standardize across studies. We finish by highlighting several directions to more fully explore the multidimensional feature space of speech and language, which will continue to accelerate progress towards a clinically viable speech neuroprosthesis.

Shared functional specialization in transformer-based language models and the human brain

When processing language, the brain is thought to deploy specialized computations to construct meaning from complex linguistic structures. Recently, artificial neural networks based on the Transformer architecture have revolutionized the field of natural language processing. Transformers integrate contextual information across words via structured circuit computations. Prior work has focused on the internal representations ("embeddings") generated by these circuits. In this paper, we instead analyze the circuit computations directly: we deconstruct these computations into the functionally-specialized "transformations" that integrate contextual information across words. Using functional MRI data acquired while participants listened to naturalistic stories, we first verify that the transformations account for considerable variance in brain activity across the cortical language network. We then demonstrate that the emergent computations performed by individual, functionally-specialized "attention heads" differentially predict brain activity in specific cortical regions. These heads fall along gradients corresponding to different layers and context lengths in a low-dimensional cortical space.

Speech prosody enhances the neural processing of syntax

Human language relies on the correct processing of syntactic information, as it is essential for successful communication between speakers. As an abstract level of language, syntax has often been studied separately from the physical form of the speech signal, thus often masking the interactions that can promote better syntactic processing in the human brain. However, behavioral and neural evidence from adults suggests the idea that prosody and syntax interact, and studies in infants support the notion that prosody assists language learning. Here we analyze a MEG dataset to investigate how acoustic cues, specifically prosody, interact with syntactic representations in the brains of native English speakers. More specifically, to examine whether prosody enhances the cortical encoding of syntactic representations, we decode syntactic phrase boundaries directly from brain activity, and evaluate possible modulations of this decoding by the prosodic boundaries. Our findings demonstrate that the presence of prosodic boundaries improves the neural representation of phrase boundaries, indicating the facilitative role of prosodic cues in processing abstract linguistic features. This work has implications for interactive models of how the brain processes different linguistic features. Future research is needed to establish the neural underpinnings of prosody-syntax interactions in languages with different typological characteristics.

Sentence superiority in the reading brain

When a sequence of written words is briefly presented and participants are asked to identify just one word at a post-cued location, then word identification accuracy is higher when the word is presented in a grammatically correct sequence compared with an ungrammatical sequence. This sentence superiority effect has been reported in several behavioral studies and two EEG investigations. Taken together, the results of these studies support the hypothesis that the sentence superiority effect is primarily driven by rapid access to a sentence-level representation via partial word identification processes that operate in parallel over several words. Here we used MEG to examine the neural structures involved in this early stage of written sentence processing, and to further specify the timing of the different processes involved. Source activities over time showed grammatical vs. ungrammatical differences first in the left inferior frontal gyrus (IFG: 321-406 ms), then the left anterior temporal lobe (ATL: 466-531 ms), and finally in both left IFG (549-602 ms) and left posterior superior temporal gyrus (pSTG: 553-622 ms). We interpret the early IFG activity as reflecting the rapid bottom-up activation of sentence-level representations, including syntax, enabled by partly parallel word processing. Subsequent activity in ATL and pSTG is thought to reflect the constraints imposed by such sentence-level representations on on-going word-based semantic activation (ATL), and the subsequent development of a more detailed sentence-level representation (pSTG). These results provide further support for a cascaded interactive-activation account of sentence reading.

Motor or non-motor speech interference? A multimodal fMRI and direct cortical stimulation mapping study

We retrospectively analyzed data from 15 patients, with a normal pre-operative cognitive performance, undergoing awake surgery for left fronto-temporal low-grade glioma. We combined a pre-surgical measure (fMRI maps of motor- and language-related centers) with intra-surgical measures (MNI-registered cortical sites data obtained during intra-operative direct electrical stimulation, DES, while they performed the two most common language tasks: number counting and picture naming). Selective DES effects along the precentral gyrus/inferior frontal gyrus (and/or the connected speech articulation network) were obtained. DES of the precentral gyrus evoked the motor speech arrest, i.e., anarthria (with apparent mentalis muscle movements). We calculated the number of shared voxels between the lip-tongue and overt counting related- and silent naming-related fMRI maps and the Volumes of Interest (VOIs) obtained by merging together the MNI sites at which a given speech disturbance was observed, normalized on their mean the values (i.e., Z score). Both tongue- and lips-related movements fMRI maps maximally overlapped (Z = 1.05 and Z = 0.94 for lips and tongue vs. 0.16 and -1.003 for counting and naming) with the motor speech arrest seed. DES of the inferior frontal gyrus, pars opercularis and the rolandic operculum induced speech arrest proper (without apparent mentalis muscle movements). This area maximally overlapped with overt counting-related fMRI map (Z = -0.11 and Z = 0.09 for lips and tongue vs. 0.9 and 0.0006 for counting and naming). Interestingly, our fMRI maps indicated reduced Broca's area activity during silent speech compared to overt speech. Lastly, DES of the inferior frontal gyrus, pars opercularis and triangularis evoked variations of the output, i.e., dysarthria, a motor speech disorder occurring when patients cannot control the muscles used to produce articulated sounds (phonemes). Silent object naming-related fMRI map maximally overlapped (Z = -0.93 and Z = -1.04 for lips and tongue vs. -1.07 and 0.99 for counting and naming) with this seed. Speech disturbances evoked by DES may be thought of as selective interferences with specific recruitment of left inferior frontal gyrus and precentral cortex which are differentiable in terms of the specific interference induced.

Lesion-symptom Mapping of Acceptability Judgments in Chronic Poststroke Aphasia Reveals the Neurobiological Underpinnings of Receptive Syntax

Disagreements persist regarding the neural basis of syntactic processing, which has been linked both to inferior frontal and posterior temporal regions of the brain. One focal point of the debate concerns the role of inferior frontal areas in receptive syntactic ability, which is mostly assessed using sentence comprehension involving complex syntactic structures, a task that is potentially confounded with working memory. Syntactic acceptability judgments may provide a better measure of receptive syntax by reducing the need to use high working memory load and complex sentences and by enabling assessment of various types of syntactic violations. We therefore tested the perception of grammatical violations by people with poststroke aphasia (n = 25), along with matched controls (n = 16), using English sentences involving errors in word order, agreement, or subcategorization. Lesion data were also collected. Control participants performed near ceiling in accuracy with higher discriminability of agreement and subcategorization violations than word order; aphasia participants were less able to discriminate violations, but, on average, paralleled control participants discriminability of types of violations. Lesion-symptom mapping showed a correlation between discriminability and posterior temporal regions, but not inferior frontal regions. We argue that these results diverge from models holding that frontal areas are amodal core regions in syntactic structure building and favor models that posit a core hierarchical system in posterior temporal regions.

Distributed Sensitivity to Syntax and Semantics throughout the Language Network

Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.

Verbal working memory and syntactic comprehension segregate into the dorsal and ventral streams

Syntactic processing and verbal working memory are both essential components to sentence comprehension. Nonetheless, the separability of these systems in the brain remains unclear. To address this issue, we performed causal-inference analyses based on lesion and connectome network mapping using MRI and behavioral testing in 103 individuals with chronic post-stroke aphasia. We employed a rhyme judgment task with heavy working memory load without articulatory confounds, controlling for the overall ability to match auditory words to pictures and to perform a metalinguistic rhyme judgment, isolating the effect of working memory load. We assessed noncanonical sentence comprehension, isolating syntactic processing by incorporating residual rhyme judgment performance as a covariate for working memory load. Voxel-based lesion analyses and structural connectome-based lesion symptom mapping controlling for total lesion volume were performed, with permutation testing to correct for multiple comparisons (4,000 permutations). We observed that effects of working memory load localized to dorsal stream damage: posterior temporal-parietal lesions and frontal-parietal white matter disconnections. These effects were differentiated from syntactic comprehension deficits, which were primarily associated with ventral stream damage: lesions to temporal lobe and temporal-parietal white matter disconnections, particularly when incorporating the residual measure of working memory load as a covariate. Our results support the conclusion that working memory and syntactic processing are associated with distinct brain networks, largely loading onto dorsal and ventral streams, respectively.

Neural Correlates of Analogical Reasoning on Syntactic Patterns

Analogical reasoning is central to thought and learning. However, previous neuroscience studies have focused mainly on neural substrates for visuospatial and semantic analogies. There has not yet been research on the neural correlates of analogical reasoning on syntactic patterns generated by the syntactic rules, a key feature of human language faculty. The present investigation took an initial step to address this paucity. Twenty-four participants, whose brain activity was monitored by fMRI, engaged in first-order and second-order relational judgments of syntactic patterns as well as simple and complex working memory tasks. After scanning, participants rated the difficulty of each step during analogical reasoning; these ratings were related to signal intensities in activated regions of interest using Spearman correlation analyses. After prior research, differences in activation levels during second-order and first-order relational judgments were taken as evidence of analogical reasoning. These analyses showed that analogical reasoning on syntactic patterns recruited brain regions consistent with those supporting visuospatial and semantic analogies, including the anterior and posterior parts of the left middle frontal gyrus, anatomically corresponding to the left rostrolateral pFC and the left dorsolateral pFC. The correlation results further revealed that the posterior middle frontal gyrus might be involved in analogical access and mapping with syntactic patterns. Our study is the first to investigate the process of analogical reasoning on syntactic patterns at the neurobiological level and provide evidence of the specific functional roles of related regions during subprocesses of analogical reasoning.

Negation mitigates rather than inverts the neural representations of adjectives

Combinatoric linguistic operations underpin human language processes, but how meaning is composed and refined in the mind of the reader is not well understood. We address this puzzle by exploiting the ubiquitous function of negation. We track the online effects of negation ("not") and intensifiers ("really") on the representation of scalar adjectives (e.g., "good") in parametrically designed behavioral and neurophysiological (MEG) experiments. The behavioral data show that participants first interpret negated adjectives as affirmative and later modify their interpretation towards, but never exactly as, the opposite meaning. Decoding analyses of neural activity further reveal significant above chance decoding accuracy for negated adjectives within 600 ms from adjective onset, suggesting that negation does not invert the representation of adjectives (i.e., "not bad" represented as "good"); furthermore, decoding accuracy for negated adjectives is found to be significantly lower than that for affirmative adjectives. Overall, these results suggest that negation mitigates rather than inverts the neural representations of adjectives. This putative suppression mechanism of negation is supported by increased synchronization of beta-band neural activity in sensorimotor areas. The analysis of negation provides a steppingstone to understand how the human brain represents changes of meaning over time.

Lateralization of dorsal fiber tract targeting Broca's area concurs with language skills during development

Language is bounded to the left hemisphere in the adult brain and the functional lateralization can already be observed early during development. Here we investigate whether this is paralleled by a lateralization of the white matter structural language network. We analyze the strength and microstructural properties of language-related fiber tracts connecting temporal and frontal cortices with a separation of two dorsal tracts, one targeting the posterior Broca's area (BA44) and one targeting the precentral gyrus (BA6). In a large sample of young children (3-6 years), we demonstrate that, in contrast to the BA6-targeting tract, the microstructural asymmetry of the BA44-targeting fiber tract significantly correlates locally with different aspects of development. While the asymmetry in its anterior segment reflects age, the asymmetry in its posterior segment is associated with the children's language skills. These findings demonstrate a fine-grained structure-to-function mapping in the lateralized network and go beyond our current view of language-related human brain maturation.

Finding structure during incremental speech comprehension

A core aspect of human speech comprehension is the ability to incrementally integrate consecutive words into a structured and coherent interpretation, aligning with the speaker's intended meaning. This rapid process is subject to multidimensional probabilistic constraints, including both linguistic knowledge and non-linguistic information within specific contexts, and it is their interpretative coherence that drives successful comprehension. To study the neural substrates of this process, we extract word-by-word measures of sentential structure from BERT, a deep language model, which effectively approximates the coherent outcomes of the dynamic interplay among various types of constraints. Using representational similarity analysis, we tested BERT parse depths and relevant corpus-based measures against the spatiotemporally resolved brain activity recorded by electro-/magnetoencephalography when participants were listening to the same sentences. Our results provide a detailed picture of the neurobiological processes involved in the incremental construction of structured interpretations. These findings show when and where coherent interpretations emerge through the evaluation and integration of multifaceted constraints in the brain, which engages bilateral brain regions extending beyond the classical fronto-temporal language system. Furthermore, this study provides empirical evidence supporting the use of artificial neural networks as computational models for revealing the neural dynamics underpinning complex cognitive processes in the brain.

Neural correlates of semantic-driven syntactic parsing in sentence comprehension

For sentence comprehension, information carried by semantic relations between constituents must be combined with other information to decode the constituent structure of a sentence, due to atypical and noisy situations of language use. Neural correlates of decoding sentence structure by semantic information have remained largely unexplored. In this functional MRI study, we examine the neural basis of semantic-driven syntactic parsing during sentence reading and compare it with that of other types of syntactic parsing driven by word order and case marking. Chinese transitive sentences of various structures were investigated, differing in word order, case making, and agent-patient semantic relations (i.e., same vs. different in animacy). For the non-canonical unmarked sentences without usable case marking, a semantic-driven effect triggered by agent-patient ambiguity was found in the left inferior frontal gyrus opercularis (IFGoper) and left inferior parietal lobule, with the activity not being modulated by naturalness factors of the sentences. The comparison between each type of non-canonical sentences with canonical sentences revealed that the non-canonicity effect engaged the left posterior frontal and temporal regions, in line with previous studies. No extra neural activity was found responsive to case marking within the non-canonical sentences. A word order effect across all types of sentences was also found in the left IFGoper, suggesting a common neural substrate between different types of parsing. The semantic-driven effect was also observed for the non-canonical marked sentences but not for the canonical sentences, suggesting that semantic information is used in decoding sentence structure in addition to case marking. The current findings illustrate the neural correlates of syntactic parsing with semantics, and provide neural evidence of how semantics facilitates syntax together with other information.

Developmental changes in brain activation during novel grammar learning in 8-25-year-olds

While it is well established that grammar learning success varies with age, the cause of this developmental change is largely unknown. This study examined functional MRI activation across a broad developmental sample of 165 Dutch-speaking individuals (8-25 years) as they were implicitly learning a new grammatical system. This approach allowed us to assess the direct effects of age on grammar learning ability while exploring its neural correlates. In contrast to the alleged advantage of children language learners over adults, we found that adults outperformed children. Moreover, our behavioral data showed a sharp discontinuity in the relationship between age and grammar learning performance: there was a strong positive linear correlation between 8 and 15.4 years of age, after which age had no further effect. Neurally, our data indicate two important findings: (i) during grammar learning, adults and children activate similar brain regions, suggesting continuity in the neural networks that support initial grammar learning; and (ii) activation level is age-dependent, with children showing less activation than older participants. We suggest that these age-dependent processes may constrain developmental effects in grammar learning. The present study provides new insights into the neural basis of age-related differences in grammar learning in second language acquisition.

Resting-state brain network connectivity is an independent predictor of responsiveness to language therapy in chronic post-stroke aphasia

Post-stroke aphasia recovery, especially in the chronic phase, is challenging to predict. Functional integrity of the brain and brain network topology have been suggested as biomarkers of language recovery. This study sought to investigate functional connectivity in four predefined brain networks (i.e., language, default mode, dorsal attention, and salience networks), in relation to aphasia severity and response to language therapy. Thirty patients with chronic post-stroke aphasia were recruited and received a treatment targeting word finding. Structural and functional brain scans were acquired at baseline and resting state functional connectivity for each network was calculated. Additionally, graph measures quantifying network properties were calculated for each network. These included global efficiency for all networks and average strength and clustering coefficient for the language network. Linear mixed effects models showed that mean functional connectivity in the default mode, dorsal attention, and salience networks as well as graph measures of all four networks are independent predictors of response to therapy. While greater mean functional connectivity and global efficiency of the dorsal attention and salience networks predicted greater treatment response, greater mean functional connectivity and global efficiency in the default mode network predicted poorer treatment response. Results for the language network were more nuanced with more efficient network configurations (as reflected in graph measures), but not mean functional connectivity, predicting greater treatment response. These findings highlight the prognostic value of resting-state functional connectivity in chronic treatment-induced aphasia recovery.

Localizing Syntactic Composition with Left-Corner Recurrent Neural Network Grammars

In computational neurolinguistics, it has been demonstrated that hierarchical models such as recurrent neural network grammars (RNNGs), which jointly generate word sequences and their syntactic structures via the syntactic composition, better explained human brain activity than sequential models such as long short-term memory networks (LSTMs). However, the vanilla RNNG has employed the top-down parsing strategy, which has been pointed out in the psycholinguistics literature as suboptimal especially for head-final/left-branching languages, and alternatively the left-corner parsing strategy has been proposed as the psychologically plausible parsing strategy. In this article, building on this line of inquiry, we investigate not only whether hierarchical models like RNNGs better explain human brain activity than sequential models like LSTMs, but also which parsing strategy is more neurobiologically plausible, by developing a novel fMRI corpus where participants read newspaper articles in a head-final/left-branching language, namely Japanese, through the naturalistic fMRI experiment. The results revealed that left-corner RNNGs outperformed both LSTMs and top-down RNNGs in the left inferior frontal and temporal-parietal regions, suggesting that there are certain brain regions that localize the syntactic composition with the left-corner parsing strategy.

Discriminating nonfluent/agrammatic and logopenic PPA variants with automatically extracted morphosyntactic measures from connected speech

Morphosyntactic assessments are important for characterizing individuals with nonfluent/agrammatic variant primary progressive aphasia (nfvPPA). Yet, standard tests are subject to examiner bias and often fail to differentiate between nfvPPA and logopenic variant PPA (lvPPA). Moreover, relevant neural signatures remain underexplored. Here, we leverage natural language processing tools to automatically capture morphosyntactic disturbances and their neuroanatomical correlates in 35 individuals with nfvPPA relative to 10 healthy controls (HC) and 26 individuals with lvPPA. Participants described a picture, and ensuing transcripts were analyzed via part-of-speech tagging to extract sentence-related features (e.g., subordinating and coordinating conjunctions), verbal-related features (e.g., tense markers), and nominal-related features (e.g., subjective and possessive pronouns). Gradient boosting machines were used to classify between groups using all features. We identified the most discriminant morphosyntactic marker via a feature importance algorithm and examined its neural correlates via voxel-based morphometry. Individuals with nfvPPA produced fewer morphosyntactic elements than the other two groups. Such features robustly discriminated them from both individuals with lvPPA and HCs with an AUC of .95 and .82, respectively. The most discriminatory feature corresponded to subordinating conjunctions was correlated with cortical atrophy within the left posterior inferior frontal gyrus across groups (pFWE < .05). Automated morphosyntactic analysis can efficiently differentiate nfvPPA from lvPPA. Also, the most sensitive morphosyntactic markers correlate with a core atrophy region of nfvPPA. Our approach, thus, can contribute to a key challenge in PPA diagnosis.

Alpha and Beta Oscillations Differentially Support Word Production in a Rule-Switching Task

Research into the role of brain oscillations in basic perceptual and cognitive functions has suggested that the alpha rhythm reflects functional inhibition while the beta rhythm reflects neural ensemble (re)activation. However, little is known regarding the generalization of these proposed fundamental operations to linguistic processes, such as speech comprehension and production. Here, we recorded magnetoencephalography in participants performing a novel rule-switching paradigm. Specifically, Dutch native speakers had to produce an alternative exemplar from the same category or a feature of a given target word embedded in spoken sentences (e.g., for the word "tuna", an exemplar from the same category-"seafood"-would be "shrimp", and a feature would be "pink"). A cue indicated the task rule-exemplar or feature-either before (pre-cue) or after (retro-cue) listening to the sentence. Alpha power during the working memory delay was lower for retro-cue compared with that for pre-cue in the left hemispheric language-related regions. Critically, alpha power negatively correlated with reaction times, suggestive of alpha facilitating task performance by regulating inhibition in regions linked to lexical retrieval. Furthermore, we observed a different spatiotemporal pattern of beta activity for exemplars versus features in the right temporoparietal regions, in line with the proposed role of beta in recruiting neural networks for the encoding of distinct categories. Overall, our study provides evidence for the generalizability of the role of alpha and beta oscillations from perceptual to more "complex, linguistic processes" and offers a novel task to investigate links between rule-switching, working memory, and word production.

Diverging neural dynamics for syntactic structure building in naturalistic speaking and listening

The neural correlates of sentence production are typically studied using task paradigms that differ considerably from the experience of speaking outside of an experimental setting. In this fMRI study, we aimed to gain a better understanding of syntactic processing in spontaneous production versus naturalistic comprehension in three regions of interest (BA44, BA45, and left posterior middle temporal gyrus). A group of participants (n = 16) was asked to speak about the events of an episode of a TV series in the scanner. Another group of participants (n = 36) listened to the spoken recall of a participant from the first group. To model syntactic processing, we extracted word-by-word metrics of phrase-structure building with a top-down and a bottom-up parser that make different hypotheses about the timing of structure building. While the top-down parser anticipates syntactic structure, sometimes before it is obvious to the listener, the bottom-up parser builds syntactic structure in an integratory way after all of the evidence has been presented. In comprehension, neural activity was found to be better modeled by the bottom-up parser, while in production, it was better modeled by the top-down parser. We additionally modeled structure building in production with two strategies that were developed here to make different predictions about the incrementality of structure building during speaking. We found evidence for highly incremental and anticipatory structure building in production, which was confirmed by a converging analysis of the pausing patterns in speech. Overall, this study shows the feasibility of studying the neural dynamics of spontaneous language production.