Reconciling time, space and function: a new dorsal-ventral stream model of sentence comprehension

Lesion-symptom Mapping of Acceptability Judgments in Chronic Poststroke Aphasia Reveals the Neurobiological Underpinnings of Receptive Syntax

Disagreements persist regarding the neural basis of syntactic processing, which has been linked both to inferior frontal and posterior temporal regions of the brain. One focal point of the debate concerns the role of inferior frontal areas in receptive syntactic ability, which is mostly assessed using sentence comprehension involving complex syntactic structures, a task that is potentially confounded with working memory. Syntactic acceptability judgments may provide a better measure of receptive syntax by reducing the need to use high working memory load and complex sentences and by enabling assessment of various types of syntactic violations. We therefore tested the perception of grammatical violations by people with poststroke aphasia (n = 25), along with matched controls (n = 16), using English sentences involving errors in word order, agreement, or subcategorization. Lesion data were also collected. Control participants performed near ceiling in accuracy with higher discriminability of agreement and subcategorization violations than word order; aphasia participants were less able to discriminate violations, but, on average, paralleled control participants discriminability of types of violations. Lesion-symptom mapping showed a correlation between discriminability and posterior temporal regions, but not inferior frontal regions. We argue that these results diverge from models holding that frontal areas are amodal core regions in syntactic structure building and favor models that posit a core hierarchical system in posterior temporal regions.

Distributed Sensitivity to Syntax and Semantics throughout the Language Network

Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.

Verbal working memory and syntactic comprehension segregate into the dorsal and ventral streams

Syntactic processing and verbal working memory are both essential components to sentence comprehension. Nonetheless, the separability of these systems in the brain remains unclear. To address this issue, we performed causal-inference analyses based on lesion and connectome network mapping using MRI and behavioral testing in 103 individuals with chronic post-stroke aphasia. We employed a rhyme judgment task with heavy working memory load without articulatory confounds, controlling for the overall ability to match auditory words to pictures and to perform a metalinguistic rhyme judgment, isolating the effect of working memory load. We assessed noncanonical sentence comprehension, isolating syntactic processing by incorporating residual rhyme judgment performance as a covariate for working memory load. Voxel-based lesion analyses and structural connectome-based lesion symptom mapping controlling for total lesion volume were performed, with permutation testing to correct for multiple comparisons (4,000 permutations). We observed that effects of working memory load localized to dorsal stream damage: posterior temporal-parietal lesions and frontal-parietal white matter disconnections. These effects were differentiated from syntactic comprehension deficits, which were primarily associated with ventral stream damage: lesions to temporal lobe and temporal-parietal white matter disconnections, particularly when incorporating the residual measure of working memory load as a covariate. Our results support the conclusion that working memory and syntactic processing are associated with distinct brain networks, largely loading onto dorsal and ventral streams, respectively.

Cortical networks responsive to phrase structure and subject island violations

In principle, functional neuroimaging provides uniquely informative data in addressing linguistic questions, because it can indicate distinct processes that are not apparent from behavioral data alone. This could involve adjudicating the source of unacceptability via the different patterns of elicited brain responses to different ungrammatical sentence types. However, it is difficult to interpret brain activations to syntactic violations. Such responses could reflect processes that have nothing intrinsically related to linguistic representations, such as domain-general executive function abilities. In order to facilitate the potential use of functional neuroimaging methods to identify the source of different syntactic violations, we conducted an fMRI experiment to identify the brain activation maps associated with two distinct syntactic violation types: phrase structure (created by inverting the order of two adjacent words within a sentence) and subject islands (created by extracting a wh-phrase out of an embedded subject). The comparison of these violations to control sentences surprisingly showed no indication of a generalized violation response, with almost completely divergent activation patterns. Phrase structure violations seemingly activated regions previously implicated in verbal working memory and structural complexity in sentence processing, whereas the subject islands appeared to activate regions previously implicated in conceptual-semantic processing, broadly defined. We review our findings in the context of previous research on syntactic and semantic violations using event-related potentials. We suggest that functional neuroimaging is a potentially fruitful technique in unpacking the distinct sets of cognitive processes elicited by theoretically-relevant syntactic violations, when interpreted with care and paired with appropriate control conditions.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Neural mechanisms of sentence production: a volumetric study of primary progressive aphasia

Studies on the neural bases of sentence production have yielded mixed results, partly due to differences in tasks and participant types. In this study, 101 individuals with primary progressive aphasia (PPA) were evaluated using a test that required spoken production following an auditory prime (Northwestern Assessment of Verbs and Sentences-Sentence Production Priming Test, NAVS-SPPT), and one that required building a sentence by ordering word cards (Northwestern Anagram Test, NAT). Voxel-Based Morphometry revealed that gray matter (GM) volume in left inferior/middle frontal gyri (L IFG/MFG) was associated with sentence production accuracy on both tasks, more so for complex sentences, whereas, GM volume in left posterior temporal regions was exclusively associated with NAVS-SPPT performance and predicted by performance on a Digit Span Forward (DSF) task. Verb retrieval deficits partly mediated the relationship between L IFG/MFG and performance on the NAVS-SPPT. These findings underscore the importance of L IFG/MFG for sentence production and suggest that this relationship is partly accounted for by verb retrieval deficits, but not phonological loop integrity. In contrast, it is possible that the posterior temporal cortex is associated with auditory short-term memory ability, to the extent that DSF performance is a valid measure of this in aphasia.

Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language

The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.

Predictions about prosody facilitate lexical access: Evidence from P50/N100 and MMN components

Research into the neural foundation of perception asserts a model where top-down predictions modulate the bottom-up processing of sensory input. Despite becoming increasingly influential in cognitive neuroscience, the precise account of this predictive coding framework remains debated. In this study, we aim to contribute to this debate by investigating how predictions about prosody facilitate speech perception, and to shed light especially on lexical access influenced by simultaneous predictions in different domains, inter alia, prosodic and semantic. Using a passive auditory oddball paradigm, we examined neural responses to prosodic changes, leading to a semantic change as in Dutch nouns canon ['kaːnɔn] 'canon' vs kanon [kaː'nɔn] 'cannon', and used acoustically identical pseudowords as controls. Results from twenty-eight native speakers of Dutch (age range 18-32 years) indicated an enhanced P50/N100 complex to prosodic change in pseudowords as well as an MMN response to both words and pseudowords. The enhanced P50/N100 response to pseudowords is claimed to indicate that all relevant auditory information is still processed by the brain, whereas the reduced response to words might reflect the suppression of information that has already been encoded. The MMN response to pseudowords and words, on the other hand, is best justified by the unification of previously established prosodic representations with sensory and semantic input respectively. This pattern of results is in line with the predictive coding framework acting on multiple levels and is of crucial importance to indicate that predictions about linguistic prosodic information are utilized by the brain as early as 50 ms.

Both stronger and weaker cerebro-cerebellar functional connectivity patterns during processing of spoken sentences in autism spectrum disorder

Cerebellar differences have long been documented in autism spectrum disorder (ASD), yet the extent to which such differences might impact language processing in ASD remains unknown. To investigate this, we recorded brain activity with magnetoencephalography (MEG) while ASD and age-matched typically developing (TD) children passively processed spoken meaningful English and meaningless Jabberwocky sentences. Using a novel source localization approach that allows higher resolution MEG source localization of cerebellar activity, we found that, unlike TD children, ASD children showed no difference between evoked responses to meaningful versus meaningless sentences in right cerebellar lobule VI. ASD children also had atypically weak functional connectivity in the meaningful versus meaningless speech condition between right cerebellar lobule VI and several left-hemisphere sensorimotor and language regions in later time windows. In contrast, ASD children had atypically strong functional connectivity for in the meaningful versus meaningless speech condition between right cerebellar lobule VI and primary auditory cortical areas in an earlier time window. The atypical functional connectivity patterns in ASD correlated with ASD severity and the ability to inhibit involuntary attention. These findings align with a model where cerebro-cerebellar speech processing mechanisms in ASD are impacted by aberrant stimulus-driven attention, which could result from atypical temporal information and predictions of auditory sensory events by right cerebellar lobule VI.

Causal evidence for a coordinated temporal interplay within the language network

Recent neurobiological models on language suggest that auditory sentence comprehension is supported by a coordinated temporal interplay within a left-dominant brain network, including the posterior inferior frontal gyrus (pIFG), posterior superior temporal gyrus and sulcus (pSTG/STS), and angular gyrus (AG). Here, we probed the timing and causal relevance of the interplay between these regions by means of concurrent transcranial magnetic stimulation and electroencephalography (TMS-EEG). Our TMS-EEG experiments reveal region- and time-specific causal evidence for a bidirectional information flow from left pSTG/STS to left pIFG and back during auditory sentence processing. Adapting a condition-and-perturb approach, our findings further suggest that the left pSTG/STS can be supported by the left AG in a state-dependent manner.

Cerebral perfusion in post-stroke aphasia and its relationship to residual language abilities

Stroke alters blood flow to the brain resulting in damaged tissue and cell death. Moreover, the disruption of cerebral blood flow (perfusion) can be observed in areas surrounding and distal to the lesion. These structurally preserved but suboptimally perfused regions may also affect recovery. Thus, to better understand aphasia recovery, the relationship between cerebral perfusion and language needs to be systematically examined. In the current study, we aimed to evaluate (i) how stroke affects perfusion outside of lesioned areas in chronic aphasia and (ii) how perfusion in specific cortical areas and perilesional tissue relates to language outcomes in aphasia. We analysed perfusion data from a large sample of participants with chronic aphasia due to left hemisphere stroke (n = 43) and age-matched healthy controls (n = 25). We used anatomically defined regions of interest that covered the frontal, parietal, and temporal areas of the perisylvian cortex in both hemispheres, areas typically known to support language, along with several control regions not implicated in language processing. For the aphasia group, we also looked at three regions of interest in the perilesional tissue. We compared perfusion levels between the two groups and investigated the relationship between perfusion levels and language subtest scores while controlling for demographic and lesion variables. First, we observed that perfusion levels outside the lesioned areas were significantly reduced in frontal and parietal regions in the left hemisphere in people with aphasia compared to the control group, while no differences were observed for the right hemisphere regions. Second, we found that perfusion in the left temporal lobe (and most strongly in the posterior part of both superior and middle temporal gyri) and inferior parietal areas (supramarginal gyrus) was significantly related to residual expressive and receptive language abilities. In contrast, perfusion in the frontal regions did not show such a relationship; no relationship with language was also observed for perfusion levels in control areas and all right hemisphere regions. Third, perilesional perfusion was only marginally related to language production abilities. Cumulatively, the current findings demonstrate that blood flow is reduced beyond the lesion site in chronic aphasia and that hypoperfused neural tissue in critical temporoparietal language areas has a negative impact on behavioural outcomes. These results, using perfusion imaging, underscore the critical and general role that left hemisphere posterior temporal regions play in various expressive and receptive language abilities. Overall, the study highlights the importance of exploring perfusion measures in stroke.

Effects of Damage to the Integrity of the Left Dual-Stream Frontotemporal Network Mediated by the Arcuate Fasciculus and Uncinate Fasciculus on Acute/Subacute Post-Stroke Aphasia

(1) Background: To investigate the correlation between the integrity of the left dual-stream frontotemporal network mediated by the arcuate fasciculus (AF) and uncinate fasciculus (UF), and acute/subacute post-stroke aphasia (PSA). (2) Methods: Thirty-six patients were recruited and received both a language assessment and a diffusion tensor imaging (DTI) scan. Correlations between diffusion indices in the bilateral LSAF/UF and language performance assessment were analyzed with correlation analyses. Multiple linear regression analysis was also implemented to investigate the effects of the integrity of the left LSAF/UF on language performance. (3) Results: Correlation analyses showed that the diffusion indices, including mean fractional anisotropy (FA) values and the fiber number of the left LSAF rather than the left UF was significantly positively associated with language domain scores (p < 0.05). Multiple linear regression analysis revealed an independent and positive association between the mean FA value of the left LSAF and the percentage score of language subsets. In addition, no interaction effect of the integrity of the left LSAF and UF on language performance was found (p > 0.05). (4) Conclusions: The integrity of the left LSAF, but not the UF, might play important roles in supporting residual language ability in individuals with acute/subacute PSA; simultaneous disruption of the dual-stream frontotemporal network mediated by the left LSAF and UF would not result in more severe aphasia than damage to either pathway alone.

Wolf-hound vs. sled-dog: neurolinguistic evidence for semantic decomposition in the recognition of German noun-noun compounds

Animacy is an intrinsic semantic property of words referring to living things. A long line of evidence shows that words with animate referents require lower processing costs during word recognition than words with inanimate referents, leading among others to a decreased N400 amplitude in reaction to animate relative to inanimate objects. In the current study, we use this animacy effect to provide evidence for access to the semantic properties of constituents in German noun-noun compounds. While morphological decomposition of noun-noun compounds is well-researched and illustrated by the robust influence of lexical constituent properties like constituent length and frequency, findings for semantic decomposition are less clear in the current literature. By manipulating the animacy of compound modifiers and heads, we are able to manipulate the relative ease of lexical access strictly due to intrinsic semantic properties of the constituents. Our results show additive effects of constituent animacy, with a higher number of animate constituents leading to gradually attenuated N400 amplitudes. We discuss the implications of our findings for current models of complex word recognition, as well as stimulus construction practices in psycho-and neurolinguistic research.

Hodological organization of spoken language production and singing in the human brain

Theories expounding the neural relationship between speech and singing range from sharing neural circuitry, to relying on opposite hemispheres. Yet, hodological studies exploring their shared and distinct neural networks remain scarce. In this study, we combine a white matter connectometry approach together with comprehensive and naturalistic appraisal of verbal expression during spoken language production and singing in a sample of individuals with post-stroke aphasia. Our results reveal that both spoken language production and singing are mainly supported by the left hemisphere language network and projection pathways. However, while spoken language production mostly engaged dorsal and ventral streams of speech processing, singing was associated primarily with the left ventral stream. These findings provide evidence that speech and singing share core neuronal circuitry within the left hemisphere, while distinct ventral stream contributions explain frequently observed dissociations in aphasia. Moreover, the results suggest prerequisite biomarkers for successful singing-based therapeutic interventions.

The processing of stress in a foreign language modulates functional antagonism between default mode and attention network regions

Lexical stress is an essential element of prosody. Mastering this prosodic feature is challenging, especially in a free-stress foreign language for individuals native to a fixed-stress language, a phenomenon referred to as stress deafness. By using functional magnetic resonance imaging, we elucidated the neuronal underpinnings of stress processing in a free-stress foreign language, and determined the underlying mechanism of stress deafness. Here, we contrasted behavioral and hemodynamic responses revealed by native speakers of a free-stress (German; N = 38) and a fixed-stress (French; N = 47) language while discriminating pairs of words in a free-stress foreign language (Spanish). Consistent with the stress deafness phenomenon, French speakers performed worse than German speakers in discriminating Spanish words based on cues of stress but not of vowel. Whole-brain analyses revealed widespread bilateral networks (cerebral regions including frontal, temporal and parietal areas as well as insular, subcortical and cerebellar structures), overlapping with the ones previously associated with stress processing within native languages. Moreover, our results provide evidence that the structures pertaining to a right-lateralized attention system (i.e., middle frontal gyrus, anterior insula) and the Default Mode Network modulate stress processing as a function of the performance level. In comparison to the German speakers, the French speakers activated the attention system and deactivated the Default Mode Network to a stronger degree, reflecting attentive engagement, likely a compensatory mechanism underlying the "stress-deaf" brain. The mechanism modulating stress processing argues for a rightward lateralization, indeed overlapping with the location covered by the dorsal stream but remaining unspecific to speech.

Atypical cortical processing of bottom-up speech binding cues in children with autism spectrum disorders

Individuals with autism spectrum disorder (ASD) commonly display speech processing abnormalities. Binding of acoustic features of speech distributed across different frequencies into coherent speech objects is fundamental in speech perception. Here, we tested the hypothesis that the cortical processing of bottom-up acoustic cues for speech binding may be anomalous in ASD. We recorded magnetoencephalography while ASD children (ages 7-17) and typically developing peers heard sentences of sine-wave speech (SWS) and modulated SWS (MSS) where binding cues were restored through increased temporal coherence of the acoustic components and the introduction of harmonicity. The ASD group showed increased long-range feedforward functional connectivity from left auditory to parietal cortex with concurrent decreased local functional connectivity within the parietal region during MSS relative to SWS. As the parietal region has been implicated in auditory object binding, our findings support our hypothesis of atypical bottom-up speech binding in ASD. Furthermore, the long-range functional connectivity correlated with behaviorally measured auditory processing abnormalities, confirming the relevance of these atypical cortical signatures to the ASD phenotype. Lastly, the group difference in the local functional connectivity was driven by the youngest participants, suggesting that impaired speech binding in ASD might be ameliorated upon entering adolescence.

Anticipatory Processing in a Verb-Initial Mayan Language: Eye-Tracking Evidence During Sentence Comprehension in Tseltal

We present a visual world eye-tracking study on Tseltal (a Mayan language) and investigate whether verbal information can be used to anticipate an upcoming referent. Basic word order in transitive sentences in Tseltal is Verb-Object-Subject (VOS). The verb is usually encountered first, making argument structure and syntactic information available at the outset, which should facilitate anticipation of the post-verbal arguments. Tseltal speakers listened to verb-initial sentences with either an object-predictive verb (e.g., "eat") or a general verb (e.g., "look for") (e.g., "Ya slo'/sle ta stukel on te kereme," Is eating/is looking (for) by himself the avocado the boy/ "The boy is eating/is looking (for) an avocado by himself") while seeing a visual display showing one potential referent (e.g., avocado) and three distractors (e.g., bag, toy car, coffee grinder). We manipulated verb type (predictive vs. general) and recorded participants' eye movements while they listened and inspected the visual scene. Participants' fixations to the target referent were analyzed using multilevel logistic regression models. Shortly after hearing the predictive verb, participants fixated the target object before it was mentioned. In contrast, when the verb was general, fixations to the target only started to increase once the object was heard. Our results suggest that Tseltal hearers pre-activate semantic features of the grammatical object prior to its linguistic expression. This provides evidence from a verb-initial language for online incremental semantic interpretation and anticipatory processing during language comprehension. These processes are comparable to the ones identified in subject-initial languages, which is consistent with the notion that different languages follow similar universal processing principles.

Dual-axes of functional organisation across lateral parietal cortex: the angular gyrus forms part of a multi-modal buffering system

Decades of neuropsychological and neuroimaging evidence have implicated the lateral parietal cortex (LPC) in a myriad of cognitive domains, generating numerous influential theoretical models. However, these theories fail to explain why distinct cognitive activities appear to implicate common neural regions. Here we discuss a unifying model in which the angular gyrus forms part of a wider LPC system with a core underlying neurocomputational function; the multi-sensory buffering of spatio-temporally extended representations. We review the principles derived from computational modelling with neuroimaging task data and functional and structural connectivity measures that underpin the unified neurocomputational framework. We propose that although a variety of cognitive activities might draw on shared underlying machinery, variations in task preference across angular gyrus, and wider LPC, arise from graded changes in the underlying structural connectivity of the region to different input/output information sources. More specifically, we propose two primary axes of organisation: a dorsal-ventral axis and an anterior-posterior axis, with variations in task preference arising from underlying connectivity to different core cognitive networks (e.g. the executive, language, visual, or episodic memory networks).

Deep language algorithms predict semantic comprehension from brain activity

Deep language algorithms, like GPT-2, have demonstrated remarkable abilities to process text, and now constitute the backbone of automatic translation, summarization and dialogue. However, whether these models encode information that relates to human comprehension still remains controversial. Here, we show that the representations of GPT-2 not only map onto the brain responses to spoken stories, but they also predict the extent to which subjects understand the corresponding narratives. To this end, we analyze 101 subjects recorded with functional Magnetic Resonance Imaging while listening to 70 min of short stories. We then fit a linear mapping model to predict brain activity from GPT-2's activations. Finally, we show that this mapping reliably correlates ([Formula: see text]) with subjects' comprehension scores as assessed for each story. This effect peaks in the angular, medial temporal and supra-marginal gyri, and is best accounted for by the long-distance dependencies generated in the deep layers of GPT-2. Overall, this study shows how deep language models help clarify the brain computations underlying language comprehension.

The posterior middle temporal gyrus serves as a hub in syntactic comprehension: A model on the syntactic neural network

Neuroimaging studies have revealed a distributed neural network involving multiple fronto-temporal regions that are active during syntactic processing. Here, we investigated how these regions work collaboratively to support syntactic comprehension by examining the behavioral relevance of the global functional integration of the syntax network (SN). We found that individuals with a stronger resting-state within-network integration in the left posterior middle temporal gyrus (lpMTG) were better at syntactic comprehension. Furthermore, the pair-wise functional connectivity between the lpMTG and the Broca's area, the middle frontal gyrus, and the angular and supramarginal gyri was positively correlated with participants' syntactic processing ability. In short, our study reveals the behavioral significance of intrinsic functional integration of the SN in syntactic comprehension, and provides empirical evidence for the hub-like role of the lpMTG. We proposed a neural model for syntactic comprehension highlighting the hub of the SN and its interactions with other regions in the network.

Rapid adaptation of predictive models during language comprehension: Aperiodic EEG slope, individual alpha frequency and idea density modulate individual differences in real-time model updating

Predictive coding provides a compelling, unified theory of neural information processing, including for language. However, there is insufficient understanding of how predictive models adapt to changing contextual and environmental demands and the extent to which such adaptive processes differ between individuals. Here, we used electroencephalography (EEG) to track prediction error responses during a naturalistic language processing paradigm. In Experiment 1, 45 native speakers of English listened to a series of short passages. Via a speaker manipulation, we introduced changing intra-experimental adjective order probabilities for two-adjective noun phrases embedded within the passages and investigated whether prediction error responses adapt to reflect these intra-experimental predictive contingencies. To this end, we calculated a novel measure of speaker-based, intra-experimental surprisal (“speaker-based surprisal”) as defined on a trial-by-trial basis and by clustering together adjectives with a similar meaning. N400 amplitude at the position of the critical second adjective was used as an outcome measure of prediction error. Results showed that N400 responses attuned to speaker-based surprisal over the course of the experiment, thus indicating that listeners rapidly adapt their predictive models to reflect local environmental contingencies (here: the probability of one type of adjective following another when uttered by a particular speaker). Strikingly, this occurs in spite of the wealth of prior linguistic experience that participants bring to the laboratory. Model adaptation effects were strongest for participants with a steep aperiodic (1/f) slope in resting EEG and low individual alpha frequency (IAF), with idea density (ID) showing a more complex pattern. These results were replicated in a separate sample of 40 participants in Experiment 2, which employed a highly similar design to Experiment 1. Overall, our results suggest that individuals with a steep aperiodic slope adapt their predictive models most strongly to context-specific probabilistic information. Steep aperiodic slope is thought to reflect low neural noise, which in turn may be associated with higher neural gain control and better cognitive control. Individuals with a steep aperiodic slope may thus be able to more effectively and dynamically reconfigure their prediction-related neural networks to meet current task demands. We conclude that predictive mechanisms in language are highly malleable and dynamic, reflecting both the affordances of the present environment as well as intrinsic information processing capabilities of the individual.

Comparing human and chimpanzee temporal lobe neuroanatomy reveals modifications to human language hubs beyond the frontotemporal arcuate fasciculus

The biological foundation for the language-ready brain in the human lineage remains a debated subject. In humans, the arcuate fasciculus (AF) white matter and the posterior portions of the middle temporal gyrus are crucial for language. Compared with other primates, the human AF has been shown to dramatically extend into the posterior temporal lobe, which forms the basis of a number of models of the structural connectivity basis of language. Recent advances in both language research and comparative neuroimaging invite a reassessment of the anatomical differences in language streams between humans and our closest relatives. Here, we show that posterior temporal connectivity via the AF in humans compared with chimpanzees is expanded in terms of its connectivity not just to the ventral frontal cortex but also to the parietal cortex. At the same time, posterior temporal regions connect more strongly to the ventral white matter in chimpanzees as opposed to humans. This pattern is present in both brain hemispheres. Additionally, we show that the anterior temporal lobe harbors a combination of connections present in both species through the inferior fronto-occipital fascicle and human-unique expansions through the uncinate and middle and inferior longitudinal fascicles. These findings elucidate structural changes that are unique to humans and may underlie the anatomical foundations for full-fledged language capacity.

Minimal Phrase Composition Revealed by Intracranial Recordings

The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.

Associations Between Sign Language Skills and Resting-State Functional Connectivity in Deaf Early Signers

The processing of a language involves a neural language network including temporal, parietal, and frontal cortical regions. This applies to spoken as well as signed languages. Previous research suggests that spoken language proficiency is associated with resting-state functional connectivity (rsFC) between language regions and other regions of the brain. Given the similarities in neural activation for spoken and signed languages, rsFC-behavior associations should also exist for sign language tasks. In this study, we explored the associations between rsFC and two types of linguistic skills in sign language: phonological processing skill and accuracy in elicited sentence production. Fifteen adult, deaf early signers were enrolled in a resting-state functional magnetic resonance imaging (fMRI) study. In addition to fMRI data, behavioral tests of sign language phonological processing and sentence reproduction were administered. Using seed-to-voxel connectivity analysis, we investigated associations between behavioral proficiency and rsFC from language-relevant nodes: bilateral inferior frontal gyrus (IFG) and posterior superior temporal gyrus (STG). Results showed that worse sentence processing skill was associated with stronger positive rsFC between the left IFG and left sensorimotor regions. Further, sign language phonological processing skill was associated with positive rsFC from right IFG to middle frontal gyrus/frontal pole although this association could possibly be explained by domain-general cognitive functions. Our findings suggest a possible connection between rsFC and developmental language outcomes in deaf individuals.

Towards a model of language neurobiology in early development

Understanding language neurobiology in early childhood is essential for characterizing the developmental structural and functional changes that lead to the mature adult language network. In the last two decades, the field of language neurodevelopment has received increasing attention, particularly given the rapid advances in the implementation of neuroimaging techniques and analytic approaches that allow detailed investigations into the developing brain across a variety of cognitive domains. These methodological and analytical advances hold the promise of developing early markers of language outcomes that allow diagnosis and clinical interventions at the earliest stages of development. Here, we argue that findings in language neurobiology need to be integrated within an approach that captures the dynamic nature and inherent variability that characterizes the developing brain and the interplay between behavior and (structural and functional) neural patterns. Accordingly, we describe a framework for understanding language neurobiology in early development, which minimally requires an explicit characterization of the following core domains: i) computations underlying language learning mechanisms, ii) developmental patterns of change across neural and behavioral measures, iii) environmental variables that reinforce language learning (e.g., the social context), and iv) brain maturational constraints for optimal neural plasticity, which determine the infant's sensitivity to learning from the environment. We discuss each of these domains in the context of recent behavioral and neuroimaging findings and consider the need for quantitatively modeling two main sources of variation: individual differences or trait-like patterns of variation and within-subject differences or state-like patterns of variation. The goal is to enable models that allow prediction of language outcomes from neural measures that take into account these two types of variation. Finally, we examine how future methodological approaches would benefit from the inclusion of more ecologically valid paradigms that complement and allow generalization of traditional controlled laboratory methods.

Functional differentiation in the language network revealed by lesion-symptom mapping

Theories of language organization in the brain commonly posit that different regions underlie distinct linguistic mechanisms. However, such theories have been criticized on the grounds that many neuroimaging studies of language processing find similar effects across regions. Moreover, condition by region interaction effects, which provide the strongest evidence of functional differentiation between regions, have rarely been offered in support of these theories. Here we address this by using lesion-symptom mapping in three large, partially-overlapping groups of aphasia patients with left hemisphere brain damage due to stroke (N = 121, N = 92, N = 218). We identified multiple measure by region interaction effects, associating damage to the posterior middle temporal gyrus with syntactic comprehension deficits, damage to posterior inferior frontal gyrus with expressive agrammatism, and damage to inferior angular gyrus with semantic category word fluency deficits. Our results are inconsistent with recent hypotheses that regions of the language network are undifferentiated with respect to high-level linguistic processing.

Predicting speech from a cortical hierarchy of event-based time scales

How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.

Predicting speech from a cortical hierarchy of event-based time scales

How do predictions in the brain incorporate the temporal unfolding of context in our natural environment? We here provide evidence for a neural coding scheme that sparsely updates contextual representations at the boundary of events. This yields a hierarchical, multilayered organization of predictive language comprehension. Training artificial neural networks to predict the next word in a story at five stacked time scales and then using model-based functional magnetic resonance imaging, we observe an event-based “surprisal hierarchy” evolving along a temporoparietal pathway. Along this hierarchy, surprisal at any given time scale gated bottom-up and top-down connectivity to neighboring time scales. In contrast, surprisal derived from continuously updated context influenced temporoparietal activity only at short time scales. Representing context in the form of increasingly coarse events constitutes a network architecture for making predictions that is both computationally efficient and contextually diverse.

Neural Resources Supporting Language Production vs. Comprehension in Chronic Post-stroke Aphasia: A Meta-Analysis Using Activation Likelihood Estimates

In post-stroke aphasia, language tasks recruit a combination of residual regions within the canonical language network, as well as regions outside of it in the left and right hemispheres. However, there is a lack of consensus as to how the neural resources engaged by language production and comprehension following a left hemisphere stroke differ from one another and from controls. The present meta-analysis used activation likelihood estimates to aggregate across 44 published fMRI and PET studies to characterize the functional reorganization patterns for expressive and receptive language processes in persons with chronic post-stroke aphasia (PWA). Our results in part replicate previous meta-analyses: we find that PWA activate residual regions within the left lateralized language network, regardless of task. Our results extend this work to show differential recruitment of the left and right hemispheres during language production and comprehension in PWA. First, we find that PWA engage left perilesional regions during language comprehension, and that the extent of this activation is likely driven by stimulus type and domain-general cognitive resources needed for task completion. In contrast to comprehension, language production was associated with activation of the right frontal and temporal cortices. Further analyses linked right hemisphere regions involved in motor speech planning for language production with successful naming in PWA, while unsuccessful naming was associated with the engagement of the right inferior frontal gyrus, a region often implicated in domain-general cognitive processes. While the within-group findings indicate that the engagement of the right hemisphere during language tasks in post-stroke aphasia differs for expressive vs. receptive tasks, the overall lack of major between-group differences between PWA and controls implies that PWA rely on similar cognitive-linguistic resources for language as controls. However, more studies are needed that report coordinates for PWA and controls completing the same tasks in order for future meta-analyses to characterize how aphasia affects the neural resources engaged during language, particularly for specific tasks and as a function of behavioral performance.

Neural bases of elements of syntax during speech production in patients with aphasia

The ability to string together words into a structured arrangement capable of conveying nuanced information is key to speech production. The assessment of the neural bases for structuring sentences has been challenged by the need of experts to delineate the aberrant morphosyntactic structures in aphasic speech. Most studies have relied on focused tasks with limited ecological validity. We characterized syntactic complexity during connected speech produced by patients with chronic post-stroke aphasia. We automated this process by employing Natural Language Processing (NLP). We conducted voxel-based and connectome-based lesion-symptom mapping to identify brain regions crucially associated with sentence production and syntactic complexity. Posterior-inferior aspects of left frontal and parietal lobes, as well as white matter tracts connecting these areas, were essential for syntactic complexity, particularly the posterior inferior frontal gyrus. These findings suggest that sentence structuring during word production depends on the integrity of Broca's area and the dorsal stream of language processing.

Attenuation of auditory N2 for self-modulated tones during continuous actions

Event-related potentials elicited by tones generated by one's own discrete actions (e.g., button presses) are attenuated compared to those elicited by tones generated externally. The present study investigated whether ERP attenuation would occur when the timing or pitch of tones is modulated by continuous actions, as for such actions, a weak association between actions and their auditory consequences is assumed. In a modulation condition, participants modulated the time interval between tones (Experiment 1) or the pitch of tones (Experiment 2) by turning a steering wheel. In a listening condition, participants listened to the same tones as in the modulation condition without any action. The results revealed that the amplitude of N2 elicited by tones decreased in the modulation compared to listening conditions, consistently in the two experiments, suggesting relatively higher-order auditory processing can be mainly influenced by the prediction of action consequences when continuous actions modulate features of auditory stimuli.

Positive emotion of self-referential contexts could facilitate adult's novel word learning: An fNIRS study

Learning words through contextual inference is a key way to enlarge one's vocabulary especially for adults. However, few studies focused on the effects of different information contained in contexts on novel word learning. The present study used behavioral and fNIRS techniques to investigate the influences of positive, neutral and negative emotions inherent in self-related or other-related referential contexts. Participants were asked to perform a semantic consistency and a source judgment task after learning the relations between novel words and concepts in different contexts. The results showed that self-reference during lexical encoding could promote word learning generally. More importantly, there existed a self-positivity bias which is manifested in the significant interactions between contextual emotions and referential value. These interactions are related to the neural activities of the DLPFC and IFG. These results revealed the contextual information's integrative contributions to semantic meaning acquisition and episodic source memory related with novel word learning.

Dissociating nouns and verbs in temporal and perisylvian networks: Evidence from neurodegenerative diseases

Naming of nouns and verbs can be selectively impaired in neurological disorders, but the specificity of the neural and cognitive correlates of such dissociation remains unclear. Functional imaging and stroke research sought to identify cortical regions selectively recruited for nouns versus verbs, yet findings are inconsistent. The present study investigated this issue in neurodegenerative diseases known to selectively affect different brain networks, thus providing new critical evidence of network specificity. We examined naming performances on nouns and verbs in 146 patients with different neurodegenerative syndromes (Primary Progressive Aphasia - PPA, Alzheimer's disease - AD, and behavioral variant Frontotemporal Dementia - FTD) and 30 healthy adults. We then correlated naming scores with MRI-derived cortical thickness values as well as with performances in semantic and syntactic tasks, across all subjects. Results indicated that patients with the semantic variant PPA named significantly fewer nouns than verbs. Instead, nonfluent/agrammatic PPA patients named fewer verbs than nouns. Across all subjects, performance on nouns (adjusted for verbs) specifically correlated with cortical atrophy in left anterior temporal regions, and performance on verbs (adjusted for nouns) with atrophy in left inferior and middle frontal, inferior parietal and posterior temporal regions. Furthermore, lower lexical-semantic abilities correlated with deficits in naming both nouns and verbs, while lower syntactic abilities only correlated with naming verbs. Our results show that different neural and cognitive mechanisms underlie naming of specific grammatical categories in neurodegenerative diseases. Importantly, our findings showed that verb processing depends on a widespread perisylvian networks, suggesting that some regions might be involved in processing different types of action knowledge. These findings have important implications for early differential diagnosis of neurodegenerative disorders.

The Cortical Organization of Syntax

Syntax, the structure of sentences, enables humans to express an infinite range of meanings through finite means. The neurobiology of syntax has been intensely studied but with little consensus. Two main candidate regions have been identified: the posterior inferior frontal gyrus (pIFG) and the posterior middle temporal gyrus (pMTG). Integrating research in linguistics, psycholinguistics, and neuroscience, we propose a neuroanatomical framework for syntax that attributes distinct syntactic computations to these regions in a unified model. The key theoretical advances are adopting a modern lexicalized view of syntax in which the lexicon and syntactic rules are intertwined, and recognizing a computational asymmetry in the role of syntax during comprehension and production. Our model postulates a hierarchical lexical-syntactic function to the pMTG, which interconnects previously identified speech perception and conceptual-semantic systems in the temporal and inferior parietal lobes, crucial for both sentence production and comprehension. These relational hierarchies are transformed via the pIFG into morpho-syntactic sequences, primarily tied to production. We show how this architecture provides a better account of the full range of data and is consistent with recent proposals regarding the organization of phonological processes in the brain.

A Unifying Account of Angular Gyrus Contributions to Episodic and Semantic Cognition

The angular gyrus (AG) region of lateral parietal cortex has been implicated in a wide variety of tasks and functions, generating numerous influential theories. However, these theories largely fail to explain why so many apparently distinct cognitive activities implicate common parietal structures. We propose a unifying model, based on a set of central principles, to account for coalescences of cognitive task activations across AG. To illustrate the proposed framework, we show how these principles account for findings from studies of episodic and semantic memory that have independently implicated the same AG regions but thus far been considered from largely domain-specific perspectives. We conclude that AG computations, as part of a wider lateral parietal system, enable the online dynamic buffering of multisensory spatiotemporally extended representations.

Neural signatures of syntactic variation in speech planning

Planning to speak is a challenge for the brain, and the challenge varies between and within languages. Yet, little is known about how neural processes react to these variable challenges beyond the planning of individual words. Here, we examine how fundamental differences in syntax shape the time course of sentence planning. Most languages treat alike (i.e., align with each other) the 2 uses of a word like “gardener” in “the gardener crouched” and in “the gardener planted trees.” A minority keeps these formally distinct by adding special marking in 1 case, and some languages display both aligned and nonaligned expressions. Exploiting such a contrast in Hindi, we used electroencephalography (EEG) and eye tracking to suggest that this difference is associated with distinct patterns of neural processing and gaze behavior during early planning stages, preceding phonological word form preparation. Planning sentences with aligned expressions induces larger synchronization in the theta frequency band, suggesting higher working memory engagement, and more visual attention to agents than planning nonaligned sentences, suggesting delayed commitment to the relational details of the event. Furthermore, plain, unmarked expressions are associated with larger desynchronization in the alpha band than expressions with special markers, suggesting more engagement in information processing to keep overlapping structures distinct during planning. Our findings contrast with the observation that the form of aligned expressions is simpler, and they suggest that the global preference for alignment is driven not by its neurophysiological effect on sentence planning but by other sources, possibly by aspects of production flexibility and fluency or by sentence comprehension. This challenges current theories on how production and comprehension may affect the evolution and distribution of syntactic variants in the world’s languages.

Little is known about the neural processes involved in planning to speak. This study uses eye-tracking and EEG to show that speakers prepare sentence structures in different ways and rely on alpha and theta oscillations differently when planning sentences with and without agent case marking, challenging theories on how production and comprehension affect language evolution.

Common and distinct neural substrates of sentence production and comprehension

Functional neuroimaging and lesion-symptom mapping investigations implicate a left frontal-temporal-parietal network for sentence processing. The majority of studies have focused on sentence comprehension, with fewer in the domain of sentence production, which have not fully elucidated overlapping and/or unique brain structures associated with the two domains, particularly for sentences with noncanonical word order. Using voxel-based lesion symptom mapping (VLSM) we examined the relationship between lesions within the left hemisphere language network and both sentence comprehension and production of simple and complex syntactic structures in 76 participants with chronic stroke-induced aphasia. Results revealed shared regions across domains in the anterior and posterior superior temporal gyri (aSTG, pSTG), and the temporal pole (adjusted for verb production/comprehension). Additionally, comprehension was associated with lesions in the anterior and posterior middle temporal gyri (aMTG, pMTG), the MTG temporooccipital regions, SMG/AG, central and parietal operculum, and the insula. Subsequent VLSM analyses (production versus comprehension) revealed critical regions associated with each domain: anterior temporal lesions were associated with production; posterior temporo-parietal lesions were associated with comprehension, implicating important roles for regions within the ventral and dorsal stream processing routes, respectively. Processing of syntactically complex, noncanonical (adjusted for canonical), sentences was associated with damage to the pSTG across domains, with additional damage to the pMTG and IPL associated with impaired sentence comprehension, suggesting that the pSTG is crucial for computing noncanonical sentences across domains and that the pMTG, and IPL are necessary for re-analysis of thematic roles as required for resolution of long-distance dependencies. These findings converge with previous studies and extend our knowledge of the neural mechanisms of sentence comprehension to production, highlighting critical regions associated with both domains, and further address the mechanism engaged for syntactic computation, controlled for the contribution of verb processing.

Decoding the Real-Time Neurobiological Properties of Incremental Semantic Interpretation

Communication through spoken language is a central human capacity, involving a wide range of complex computations that incrementally interpret each word into meaningful sentences. However, surprisingly little is known about the spatiotemporal properties of the complex neurobiological systems that support these dynamic predictive and integrative computations. Here, we focus on prediction, a core incremental processing operation guiding the interpretation of each upcoming word with respect to its preceding context. To investigate the neurobiological basis of how semantic constraints change and evolve as each word in a sentence accumulates over time, in a spoken sentence comprehension study, we analyzed the multivariate patterns of neural activity recorded by source-localized electro/magnetoencephalography (EMEG), using computational models capturing semantic constraints derived from the prior context on each upcoming word. Our results provide insights into predictive operations subserved by different regions within a bi-hemispheric system, which over time generate, refine, and evaluate constraints on each word as it is heard.

Computer code comprehension shares neural resources with formal logical inference in the fronto-parietal network

Despite the importance of programming to modern society, the cognitive and neural bases of code comprehension are largely unknown. Programming languages might 'recycle' neurocognitive mechanisms originally developed for natural languages. Alternatively, comprehension of code could depend on fronto-parietal networks shared with other culturally-invented symbol systems, such as formal logic and symbolic math such as algebra. Expert programmers (average 11 years of programming experience) performed code comprehension and memory control tasks while undergoing fMRI. The same participants also performed formal logic, symbolic math, executive control, and language localizer tasks. A left-lateralized fronto-parietal network was recruited for code comprehension. Patterns of activity within this network distinguish between 'for' loops and 'if' conditional code functions. In terms of the underlying neural basis, code comprehension overlapped extensively with formal logic and to a lesser degree math. Overlap with executive processes and language was low, but laterality of language and code covaried across individuals. Cultural symbol systems, including code, depend on a distinctive fronto-parietal cortical network.

Autism Spectrum Disorder and Childhood Apraxia of Speech: Early Language-Related Hallmarks across Structural MRI Study

Autism Spectrum Disorder (ASD) and Childhood Apraxia of Speech (CAS) are developmental disorders with distinct diagnostic criteria and different epidemiology. However, a common genetic background as well as overlapping clinical features between ASD and CAS have been recently reported. To date, brain structural language-related abnormalities have been detected in both the conditions, but no study directly compared young children with ASD, CAS and typical development (TD). In the current work, we aim: (i) to test the hypothesis that ASD and CAS display neurostructural differences in comparison with TD through morphometric Magnetic Resonance Imaging (MRI)-based measures (ASD vs. TD and CAS vs. TD); (ii) to investigate early possible disease-specific brain structural patterns in the two clinical groups (ASD vs. CAS); (iii) to evaluate predictive power of machine-learning (ML) techniques in differentiating the three samples (ASD, CAS, TD). We retrospectively analyzed the T1-weighted brain MRI scans of 68 children (age range: 34-74 months) grouped into three cohorts: (1) 26 children with ASD (mean age ± standard deviation: 56 ± 11 months); (2) 24 children with CAS (57 ± 10 months); (3) 18 children with TD (55 ± 13 months). Furthermore, a ML analysis based on a linear-kernel Support Vector Machine (SVM) was performed. All but one brain structures displayed significant higher volumes in both ASD and CAS children than TD peers. Specifically, ASD alterations involved fronto-temporal regions together with basal ganglia and cerebellum, while CAS alterations are more focused and shifted to frontal regions, suggesting a possible speech-related anomalies distribution. Caudate, superior temporal and hippocampus volumes directly distinguished the two conditions in terms of greater values in ASD compared to CAS. The ML analysis identified significant differences in brain features between ASD and TD children, whereas only some trends in the ML classification capability were detected in CAS as compared to TD peers. Similarly, the MRI structural underpinnings of two clinical groups were not significantly different when evaluated with linear-kernel SVM. Our results may represent the first step towards understanding shared and specific neural substrate in ASD and CAS conditions, which subsequently may contribute to early differential diagnosis and tailoring specific early intervention.

Psycholinguistic mechanisms of classifier processing in sign language

Nonsigners viewing sign language are sometimes able to guess the meaning of signs by relying on the overt connection between form and meaning, or iconicity (cf. Ortega, Özyürek, & Peeters, 2020; Strickland et al., 2015). One word class in sign languages that appears to be highly iconic is classifiers: verb-like signs that can refer to location change or handling. Classifier use and meaning are governed by linguistic rules, yet in comparison with lexical verb signs, classifiers are highly variable in their morpho-phonology (variety of potential handshapes and motion direction within the sign). These open-class linguistic items in sign languages prompt a question about the mechanisms of their processing: Are they part of a gestural-semiotic system (processed like the gestures of nonsigners), or are they processed as linguistic verbs? To examine the psychological mechanisms of classifier comprehension, we recorded the electroencephalogram (EEG) activity of signers who watched videos of signed sentences with classifiers. We manipulated the sentence word order of the stimuli (subject-object-verb [SOV] vs. object-subject-verb [OSV]), contrasting the two conditions, which, according to different processing hypotheses, should incur increased processing costs for OSV orders. As previously reported for lexical signs, we observed an N400 effect for OSV compared with SOV, reflecting increased cognitive load for linguistic processing. These findings support the hypothesis that classifiers are a linguistic part of speech in sign language, extending the current understanding of processing mechanisms at the interface of linguistic form and meaning. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Syntax-Sensitive Regions of the Posterior Inferior Frontal Gyrus and the Posterior Temporal Lobe Are Differentially Recruited by Production and Perception

Matchin and Hickok (2020) proposed that the left posterior inferior frontal gyrus (PIFG) and the left posterior temporal lobe (PTL) both play a role in syntactic processing, broadly construed, attributing distinct functions to these regions with respect to production and perception. Consistent with this hypothesis, functional dissociations between these regions have been demonstrated with respect to lesion-symptom mapping in aphasia. However, neuroimaging studies of syntactic comprehension typically show similar activations in these regions. In order to identify whether these regions show distinct activation patterns with respect to syntactic perception and production, we performed an fMRI study contrasting the subvocal articulation and perception of structured jabberwocky phrases (syntactic), sequences of real words (lexical), and sequences of pseudowords (phonological). We defined two sets of language-selective regions of interest (ROIs) in individual subjects for the PIFG and the PTL using the contrasts [syntactic > lexical] and [syntactic > phonological]. We found robust significant interactions of comprehension and production between these 2 regions at the syntactic level, for both sets of language-selective ROIs. This suggests a core difference in the function of these regions with respect to production and perception, consistent with the lesion literature.

Semantic reversal anomalies under the microscope: Task and modality influences on language-associated event-related potentials

Semantic reversal anomalies (SRAs)-sentences where an implausibility is created by reversing participant roles-have attracted much attention in the literature on the electrophysiology of language. In spite of being syntactically well formed but semantically implausible, these sentences unexpectedly elicited a monophasic P600 effect in English and Dutch rather than an N400 effect. Subsequent research revealed variability in the presence/absence of an N400 effect to SRAs depending on the language examined and the choice of verb type in English. However, most previous studies employed the same presentation modality (visual) and task (acceptability judgement). Here, we conducted two experiments and three statistical analyses to investigate the influence of stimulus modality, task demand and statistical choices on event-related potential (ERP) response patterns to SRAs in English. We reproduced a previous study's procedure and analysis (N. Bourguignon et al. (2012) Brain and Language, 122, 179-189) and further introduced between-subjects factors of task type and modality, using mixed-effects modelling to analyse the data. We observed an N400 effect to typical English SRAs (agent subject verbs, e.g. "the fries will eat the boys"), which contrasts existing literature and was not predicted by existing theories that account for SRA processing. Task demand modulated the ERPs elicited by SRAs, while auditory presentation led to increased comprehension accuracy and a more broadly distributed ERP. Finally, the statistical methods used influenced the presence/absence of ERP effects. Our results suggest a sensitivity of language-related ERP patterns to methodological parameters, and we conclude that future experiments should take this into careful consideration.

Overarching Principles and Dimensions of the Functional Organization in the Inferior Parietal Cortex

The parietal cortex (PC) is implicated in a confusing myriad of different cognitive processes/tasks. Consequently, understanding the nature and organization of the core underlying neurocomputations is challenging. According to the Parietal Unified Connectivity-biased Computation model, two properties underpin PC function and organization. Firstly, PC is a multidomain, context-dependent buffer of time- and space-varying input, the function of which, over time, becomes sensitive to the statistical temporal/spatial structure of events. Secondly, over and above this core buffering computation, differences in long-range connectivity will generate graded variations in task engagement across subregions. The current study tested these hypotheses using a group independent component analysis technique with two independent functional magnetic resonance imaging datasets (task and resting state data). Three functional organizational principles were revealed: Factor 1, inferior PC was sensitive to the statistical structure of sequences for all stimulus types (pictures, sentences, numbers); Factor 2, a dorsal–ventral variation in generally task-positive versus task-negative (variable) engagement; and Factor 3, an anterior–posterior dimension in inferior PC reflecting different engagement in verbal versus visual tasks, respectively. Together, the data suggest that the core neurocomputation implemented by PC is common across domains, with graded task engagement across regions reflecting variations in the connectivity of task-specific networks that interact with PC.

Localizing syntactic predictions using recurrent neural network grammars

Brain activity in numerous perisylvian brain regions is modulated by the expectedness of linguistic stimuli. We leverage recent advances in computational parsing models to test what representations guide the processes reflected by this activity. Recurrent Neural Network Grammars (RNNGs) are generative models of (tree, string) pairs that use neural networks to drive derivational choices. Parsing with them yields a variety of incremental complexity metrics that we evaluate against a publicly available fMRI data-set recorded while participants simply listen to an audiobook story. Surprisal, which captures a word's un-expectedness, correlates with a wide range of temporal and frontal regions when it is calculated based on word-sequence information using a top-performing LSTM neural network language model. The explicit encoding of hierarchy afforded by the RNNG additionally captures activity in left posterior temporal areas. A separate metric tracking the number of derivational steps taken between words correlates with activity in the left temporal lobe and inferior frontal gyrus. This pattern of results narrows down the kinds of linguistic representations at play during predictive processing across the brain's language network.

No evidence for differences among language regions in their temporal receptive windows

The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.

Dynamic brain connectivity attuned to the complexity of relative clause sentences revealed by a single-trial analysis

To explore the issue of how the human brain processes sentences with different levels of complexity, we sought to compare the neural substrates underlying the processing of Chinese subject-extracted relative clause (SRC) and object-extracted relative clause (ORC) sentences in a trial-by-trial fashion. Previous neuroimaging studies have demonstrated that the involvement of the left inferior frontal gyrus (LIFG) and the left superior temporal gyrus (LSTG) is critical for the processing of relative clause (RC) sentences. In this study, we employed independent component analysis (ICA) to decompose brain activity into a set of independent components. Then, the independent component maps were spatially normalized using a surface-based approach in order to further spatially correlate and match the equivalent components from individual participants. The selected equivalent components indicated that the LIFG and the LSTG were consistently engaged in sentence processing among the participants. Subsequently, we observed alterations in the functional coupling between the LIFG and the LSTG in response to SRCs and ORCs using a Granger causality analysis. Specifically, comprehending Chinese ORCs with a canonical word order only involved a unidirectional connection from the LIFG to the LSTG for the integration of lexical-syntactic information. On the other hand, comprehending Chinese SRCs required bi-directional connectivity between the LIFG and the LSTG to fulfill increased integration demands in reconstructing the argument hierarchy due to a non-canonical word order. Furthermore, through a single-trial analysis, the strength of the connectivity from the LIFG to the LSTG was found to be significantly correlated with the complexity of the SRC sentences as quantified by eye-tracking measures. These findings indicated that the effective connectivity from the LIFG to the LSTG played an important role in the comprehension of complex sentences and that enhanced strength of this connectivity might reflect increased integration demands and restructuring attempts during sentence processing. Taken together, the results of the present study reveal that interregional interaction in the brain network for sentence processing can be dynamically engaged in response to different levels of complexity and also shed some light on the interpretation of neuroimaging and behavioral evidence when accounting for the nature of sentence complexity during reading.