Binding language: structuring sentences through precisely timed oscillatory mechanisms

Multiple dimensions of syntactic structure are resolved earliest in posterior temporal cortex

How we combine minimal linguistic units into larger structures remains an unresolved topic in neuroscience. Language processing involves the abstract construction of 'vertical' and 'horizontal' information simultaneously (e.g., phrase structure, morphological agreement), but previous paradigms have been constrained in isolating only one type of composition and have utilized poor spatiotemporal resolution. Using intracranial recordings, we report multiple experiments designed to separate phrase structure from morphosyntactic agreement. Epilepsy patients (n = 10) were presented with auditory two-word phrases grouped into pseudoword-verb ('trab run') and pronoun-verb either with or without Person agreement ('they run' vs. 'they runs'). Phrase composition and Person violations both resulted in significant increases in broadband high gamma activity approximately 300 ms after verb onset in posterior middle temporal gyrus (pMTG) and posterior superior temporal sulcus (pSTS), followed by inferior frontal cortex (IFC) at 500 ms. While sites sensitive to only morphosyntactic violations were distributed, those sensitive to both composition types were generally confined to pSTS/pMTG and IFC. These results indicate that posterior temporal cortex shows the earliest sensitivity for hierarchical linguistic structure across multiple dimensions, providing neural resources for distinct windows of composition. This region is comprised of sparsely interwoven heterogeneous constituents that afford cortical search spaces for dissociable syntactic relations.

The role of alpha oscillations in free- and goal-directed semantic associations

Alpha oscillations are known to play a central role in several higher-order cognitive functions, especially selective attention, working memory, semantic memory, and creative thinking. Nonetheless, we still know very little about the role of alpha in the generation of more remote semantic associations, which is key to creative and semantic cognition. Furthermore, it remains unclear how these oscillations are shaped by the intention to "be creative," which is the case in most creativity tasks. We aimed to address these gaps in two experiments. In Experiment 1, we compared alpha oscillatory activity (using a method which distinguishes genuine oscillatory activity from transient events) during the generation of free associations which were more vs. less distant from a given concept. In Experiment 2, we replicated these findings and also compared alpha oscillatory activity when people were generating free associations versus associations with the instruction to be creative (i.e. goal-directed). We found that alpha was consistently higher during the generation of more distant semantic associations, in both experiments. This effect was widespread, involving areas in both left and right hemispheres. Importantly, the instruction to be creative seems to increase alpha phase synchronisation from left to right temporal brain areas, suggesting that intention to be creative changed the flux of information in the brain, likely reflecting an increase in top-down control of semantic search processes. We conclude that goal-directed generation of remote associations relies on top-down mechanisms compared to when associations are freely generated.

Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language

The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.

Exploring the neurobiology of Merge at a basic level: insights from a novel artificial grammar paradigm

Introduction

Human language allows us to generate an infinite number of linguistic expressions. It's proposed that this competence is based on a binary syntactic operation, Merge, combining two elements to form a new constituent. An increasing number of recent studies have shifted from complex syntactic structures to two-word constructions to investigate the neural representation of this operation at the most basic level.

Methods

This fMRI study aimed to develop a highly flexible artificial grammar paradigm for testing the neurobiology of human syntax at a basic level. During scanning, participants had to apply abstract syntactic rules to assess whether a given two-word artificial phrase could be further merged with a third word. To control for lower-level template-matching and working memory strategies, an additional non-mergeable word-list task was set up.

Results

Behavioral data indicated that participants complied with the experiment. Whole brain and region of interest (ROI) analyses were performed under the contrast of "structure > word-list." Whole brain analysis confirmed significant involvement of the posterior inferior frontal gyrus [pIFG, corresponding to Brodmann area (BA) 44]. Furthermore, both the signal intensity in Broca's area and the behavioral performance showed significant correlations with natural language performance in the same participants. ROI analysis within the language atlas and anatomically defined Broca's area revealed that only the pIFG was reliably activated.

Discussion

Taken together, these results support the notion that Broca's area, particularly BA 44, works as a combinatorial engine where words are merged together according to syntactic information. Furthermore, this study suggests that the present artificial grammar may serve as promising material for investigating the neurobiological basis of syntax, fostering future cross-species studies.

Modulation in alpha band activity reflects syntax composition: an MEG study of minimal syntactic binding

Successful sentence comprehension requires the binding, or composition, of multiple words into larger structures to establish meaning. Using magnetoencephalography, we investigated the neural mechanisms involved in binding at the syntax level, in a task where contributions from semantics were minimized. Participants were auditorily presented with minimal sentences that required binding (pronoun and pseudo-verb with the corresponding morphological inflection; "she grushes") and pseudo-verb wordlists that did not require binding ("cugged grushes"). Relative to no binding, we found that syntactic binding was associated with a modulation in alpha band (8-12 Hz) activity in left-lateralized language regions. First, we observed a significantly smaller increase in alpha power around the presentation of the target word ("grushes") that required binding (-0.05 to 0.1 s), which we suggest reflects an expectation of binding to occur. Second, during binding of the target word (0.15-0.25 s), we observed significantly decreased alpha phase-locking between the left inferior frontal gyrus and the left middle/inferior temporal cortex, which we suggest reflects alpha-driven cortical disinhibition serving to strengthen communication within the syntax composition neural network. Altogether, our findings highlight the critical role of rapid spatial-temporal alpha band activity in controlling the allocation, transfer, and coordination of the brain's resources during syntax composition.

Online neurostimulation of Broca's area does not interfere with syntactic predictions: A combined TMS-EEG approach to basic linguistic combination

Categorical predictions have been proposed as the key mechanism supporting the fast pace of syntactic composition in language. Accordingly, grammar-based expectations are formed-e.g., the determiner "a" triggers the prediction for a noun-and facilitate the analysis of incoming syntactic information, which is then checked against a single or few other word categories. Previous functional neuroimaging studies point towards Broca's area in the left inferior frontal gyrus (IFG) as one fundamental cortical region involved in categorical prediction during incremental language processing. Causal evidence for this hypothesis is however still missing. In this study, we combined Electroencephalography (EEG) and Transcranial Magnetic Stimulation (TMS) to test whether Broca's area is functionally relevant in predictive mechanisms for language. We transiently perturbed Broca's area during the first word in a two-word construction, while simultaneously measuring the Event-Related Potential (ERP) correlates of syntactic composition. We reasoned that if Broca's area is involved in predictive mechanisms for syntax, disruptive TMS during the first word would mitigate the difference in the ERP responses for predicted and unpredicted categories in basic two-word constructions. Contrary to this hypothesis, perturbation of Broca's area at the predictive stage did not affect the ERP correlates of basic composition. The correlation strength between the electrical field induced by TMS and the ERP responses further confirmed this pattern. We discuss the present results considering an alternative account of the role of Broca's area in syntactic composition, namely the bottom-up integration of words into constituents, and of compensatory mechanisms within the language predictive network.

Cross-linguistic differences in case marking shape neural power dynamics and gaze behavior during sentence planning

Languages differ in how they mark the dependencies between verbs and arguments, e.g., by case. An eye tracking and EEG picture description study examined the influence of case marking on the time course of sentence planning in Basque and Swiss German. While German assigns an unmarked (nominative) case to subjects, Basque specifically marks agent arguments through ergative case. Fixations to agents and event-related synchronization (ERS) in the theta and alpha frequency bands, as well as desynchronization (ERD) in the alpha and beta bands revealed multiple effects of case marking on the time course of early sentence planning. Speakers decided on case marking under planning early when preparing sentences with ergative-marked agents in Basque, whereas sentences with unmarked agents allowed delaying structural commitment across languages. These findings support hierarchically incremental accounts of sentence planning and highlight how cross-linguistic differences shape the neural dynamics underpinning language use.

Task-Modulated Oscillation Differences in Auditory and Spoken Chinese-English Bilingual Processing: An Electroencephalography Study

Neurophysiological research on the bilingual activity of interpretation or interpreting has been very fruitful in understanding the bilingual brain and has gained increasing popularity recently. Issues like word interpreting and the directionality of interpreting have been attended to by many researchers, mainly with localizing techniques. Brain structures such as the dorsolateral prefrontal cortex have been repeatedly identified during interpreting. However, little is known about the oscillation and synchronization features of interpreting, especially sentence-level overt interpreting. In this study we implemented a Chinese-English sentence-level overt interpreting experiment with electroencephalography on 43 Chinese-English bilinguals and compared the oscillation and synchronization features of interpreting with those of listening, speaking and shadowing. We found significant time-frequency power differences in the delta-theta (1–7 Hz) and gamma band (above 30 Hz) between motor and silent tasks. Further theta-gamma coupling analysis revealed different synchronization networks in between speaking, shadowing and interpreting, indicating an idea-formulation dependent mechanism. Moreover, interpreting incurred robust right frontotemporal gamma coactivation network compared with speaking and shadowing, which we think may reflect the language conversion process inherent in interpreting.

Minimal Phrase Composition Revealed by Intracranial Recordings

The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.

Detecting impaired language processing in patients with mild cognitive impairment using around-the-ear cEEgrid electrodes

Mild cognitive impairment (MCI) is the term used to identify those individuals with subjective and objective cognitive decline but with preserved activities of daily living and an absence of dementia. Although MCI can impact functioning in different cognitive domains, most notably episodic memory, relatively little is known about the comprehension of language in MCI. In this study, we used around-the-ear electrodes (cEEGrids) to identify impairments during language comprehension in patients with MCI. In a group of 23 patients with MCI and 23 age-matched controls, language comprehension was tested in a two-word phrase paradigm. We examined the oscillatory changes following word onset as a function of lexico-semantic single-word retrieval (e.g., swrfeq vs. swift) and multiword binding processes (e.g., horse preceded by swift vs. preceded by swrfeq). Electrophysiological signatures (as measured by the cEEGrids) were significantly different between patients with MCI and controls. In controls, lexical retrieval was associated with a rebound in the alpha/beta range, and binding was associated with a post-word alpha/beta suppression. In contrast, both the single-word retrieval and multiword binding signatures were absent in the MCI group. The signatures observed using cEEGrids in controls were comparable with those signatures obtained with a full-cap EEG setup. Importantly, our findings suggest that patients with MCI have impaired electrophysiological signatures for comprehending single words and multiword phrases. Moreover, cEEGrid setups provide a noninvasive and sensitive clinical tool for detecting early impairments in language comprehension in MCI.

How the healthy ageing brain supports semantic binding during language comprehension

Semantic binding refers to constructing complex meaning based on elementary building blocks. Using electroencephalography (EEG), we investigated the age-related changes in modulations of oscillatory brain activity supporting lexical retrieval and semantic binding. Young and older adult participants were visually presented two-word phrases, which for the first word revealed a lexical retrieval signature (e.g., swift vs. swrfeq) and for the second word revealed a semantic binding signature (e.g., horse in a semantic binding "swift horse" vs. no binding "swrfeq horse" context). The oscillatory brain activity associated with lexical retrieval as well as semantic binding significantly differed between healthy older and young adults. Specifically for lexical retrieval, we found that different age groups exhibited opposite patterns of theta and alpha modulation, which as a combined picture suggest that lexical retrieval is associated with different and delayed signatures in older compared with young adults. For semantic binding, in young adults, we found a signature in the low-beta range centred around the target word onset (i.e., a smaller low-beta increase for binding relative to no binding), whereas in healthy older adults, we found an opposite binding signature about ~500 ms later in the low- and high-beta range (i.e., a smaller low- and high-beta decrease for binding relative to no binding). The novel finding of a different and delayed oscillatory signature for semantic binding in healthy older adults reflects that the integration of word meaning into the semantic context takes longer and relies on different mechanisms in healthy older compared with young adults.

The oscillatory mechanisms associated with syntactic binding in healthy ageing

Older adults frequently display differential patterns of brain activity compared to young adults in the same task, alongside widespread neuroanatomical changes. Differing functional activity patterns in older adults are commonly interpreted as being compensatory (e.g., Cabeza et al., 2002). We examined the oscillatory activity in the EEG during syntactic binding in young and older adults, as well as the relationship between oscillatory activity and behavioural performance on a syntactic judgement task within the older adults. 19 young and 41 older adults listened to two-word sentences that differentially load onto morpho-syntactic binding: correct syntactic binding (morpho-syntactically correct, e.g., "I dotch"); incorrect syntactic binding (morpho-syntactic agreement violation, e.g., "they dotches") and no syntactic binding (minimizing morpho-syntactic binding, e.g., "dotches spuff"). Behavioural performance, assessed in a syntactic judgement task, was characterized by inter-individual variability especially in older adults, with accuracy ranging from 76 to 100% in young adults and 58-100% in older adults. Compared to young adults, older adults were slower, but not less accurate. Functional neural signatures for syntactic binding were assessed as the difference in oscillatory power between the correct and no syntactic binding condition. In older adults, syntactic binding was associated with a smaller increase in theta (4-7 Hz), alpha (8-12 Hz) and beta (15-20 Hz) power in a time window surrounding the second word. There was a significant difference between the older and young adults: in the alpha range, the condition difference seemed to be in the opposite direction for older versus young adults. Our findings thus suggest that the neural signature associated with syntactic binding in older adults is different from young adults. However, we found no evidence of a significant association between behavioural performance and the neural signatures of syntactic binding for older adults, which does not readily support the predictions of compensatory models of language and ageing.

The neural basis of combinatory syntax and semantics

Human language allows us to create an infinitude of ideas from a finite set of basic building blocks. What is the neurobiology of this combinatory system? Research has begun to dissect the neural basis of natural language syntax and semantics by analyzing the basics of meaning composition, such as two-word phrases. This work has revealed a system of composition that involves rapidly peaking activity in the left anterior temporal lobe and later engagement of the medial prefrontal cortex. Both brain regions show evidence of shared processing between comprehension and production, as well as between spoken and signed language. Both appear to compute meaning, not syntactic structure. This Review discusses how language builds meaning and lays out directions for future neurobiological research on the combinatory system.

Selective effects of acute low-grade inflammation on human visual attention

Illness is often accompanied by perceived cognitive sluggishness, a symptom that may stem from immune system activation. The current study used electroencephalography (EEG) to assess how inflammation affected three different distinct attentional processes: alerting, orienting and executive control. In a double-blinded placebo-controlled within-subjects design (20 healthy males, mean age = 24.5, SD = 3.4), Salmonella typhoid vaccination (0.025 mg; Typhim Vi, Sanofi Pasteur) was used to induce transient mild inflammation, while a saline injection served as a placebo-control. Participants completed the Attention Network Test with concurrent EEG recorded 6 h post-injection. Analyses focused on behavioral task performance and on modulation of oscillatory EEG activity in the alpha band (9-12 Hz) for alerting as well as orienting attention and frontal theta band (4-8 Hz) for executive control. Vaccination induced mild systemic inflammation, as assessed by interleukin-6 (IL-6) levels. While no behavioral task performance differences between the inflammation and placebo condition were evident, inflammation caused significant alterations to task-related brain activity. Specifically, inflammation produced greater cue-induced suppression of alpha power in the alerting aspect of attention and individual variation in the inflammatory response was significantly correlated with the degree of alpha power suppression. Notably, inflammation did not affect orienting (i.e., alpha lateralization) or executive control (i.e., frontal theta activity). These results reveal a unique neurophysiological sensitivity to acute mild inflammation of the neural network that underpins attentional alerting functions. Observed in the absence of performance decrements, these novel findings suggest that acute inflammation requires individuals to exert greater cognitive effort when preparing for a task in order to maintain adequate behavioral performance.