The response of left temporal cortex to sentences

Verbal short term memory contribution to sentence comprehension decreases with increasing syntactic complexity in people with aphasia

Sentence comprehension requires the integration of linguistic units presented in a temporal sequence based on a non-linear underlying syntactic structure. While it is uncontroversial that storage is mandatory for this process, there are opposing views regarding the relevance of general short-term-/working-memory capacities (STM/WM) versus language specific resources. Here we report results from 43 participants with an acquired brain lesion in the extended left hemispheric language network and resulting language deficits, who performed a sentence-to-picture matching task and an experimental task assessing phonological short-term memory. The sentence task systematically varied syntactic complexity (embedding depth and argument order) while lengths, number of propositions and plausibility were kept constant. Clinical data including digit-/ block-spans and lesion size and site were additionally used in the analyses. Correlational analyses confirm that performance on STM/WM-tasks (experimental task and digit-span) are the only two relevant predictors for correct sentence-picture-matching, while reaction times only depended on age and lesion size. Notably increasing syntactic complexity reduced the correlational strength speaking for the additional recruitment of language specific resources independent of more general verbal STM/WM capacities, when resolving complex syntactic structure. The complementary lesion-behaviour analysis yielded different lesion volumes correlating with either the sentence-task or the STM-task. Factoring out STM measures lesions in the anterior temporal lobe correlated with a larger decrease in accuracy with increasing syntactic complexity. We conclude that overall sentence comprehension depends on STM/WM capacity, while increases in syntactic complexity tax another independent cognitive resource.

Instruction alters the influence of allocentric landmarks in a reach task

Allocentric landmarks have an implicit influence on aiming movements, but it is not clear how an explicit instruction (to aim relative to a landmark) influences reach accuracy and precision. Here, 12 participants performed a task with two instruction conditions (egocentric vs. allocentric) but with similar sensory and motor conditions. Participants fixated gaze near the center of a display aligned with their right shoulder while a target stimulus briefly appeared alongside a visual landmark in one visual field. After a brief mask/memory delay the landmark then reappeared at a different location (same or opposite visual field), creating an ego/allocentric conflict. In the egocentric condition, participants were instructed to ignore the landmark and point toward the remembered location of the target. In the allocentric condition, participants were instructed to remember the initial target location relative to the landmark and then reach relative to the shifted landmark (same or opposite visual field). To equalize motor execution between tasks, participants were instructed to anti-point (point to the visual field opposite to the remembered target) on 50% of the egocentric trials. Participants were more accurate and precise and quicker to react in the allocentric condition, especially when pointing to the opposite field. We also observed a visual field effect, where performance was worse overall in the right visual field. These results suggest that, when egocentric and allocentric cues conflict, explicit use of the visual landmark provides better reach performance than reliance on noisy egocentric signals. Such instructions might aid rehabilitation when the egocentric system is compromised by disease or injury.

The truth is in there: Belief processes in the human brain

Belief, defined by William James as the mental state or function of cognizing reality, is a core psychological function with strong influence on emotion and behavior. Furthermore, strong and aberrant beliefs about the world and oneself play important roles in mental disorders. The underlying processes of belief have been the matter of a long debate in philosophy and psychology, and modern neuroimaging techniques can provide insight into the underlying neural processes. Here, we conducted a functional magnetic resonance imaging study with N = 30 healthy participants in which we presented statements about facts, politics, religion, conspiracy theories, and superstition. Participants judged whether they considered them as true (belief) or not (disbelief) and reported their certainty in the decision. We found belief-associated activations in bilateral dorsolateral prefrontal cortex, left superior parietal cortex, and left lateral frontopolar cortex. Disbelief-associated activations were found in an anterior temporal cluster extending into the amygdala. We found a larger deactivation for disbelief than belief in the ventromedial prefrontal cortex that was most pronounced during decisions, suggesting a role of the vmPFC in belief-related decision-making. As a category-specific effect, we found disbelief-associated activation in retrosplenial cortex and parahippocampal gyrus for conspiracy theory statements. Exploratory analyses identified networks centered at anterior cingulate cortex for certainty, and dorsomedial prefrontal cortex for uncertainty. The uncertainty effect identifies a neural substrate for Alexander Bain's notion from 1859 of uncertainty as the real opposite of belief. Taken together, our results suggest a two-factor neural process model of belief with falsehood/veracity and uncertainty/certainty factors.

Shared functional specialization in transformer-based language models and the human brain

When processing language, the brain is thought to deploy specialized computations to construct meaning from complex linguistic structures. Recently, artificial neural networks based on the Transformer architecture have revolutionized the field of natural language processing. Transformers integrate contextual information across words via structured circuit computations. Prior work has focused on the internal representations ("embeddings") generated by these circuits. In this paper, we instead analyze the circuit computations directly: we deconstruct these computations into the functionally-specialized "transformations" that integrate contextual information across words. Using functional MRI data acquired while participants listened to naturalistic stories, we first verify that the transformations account for considerable variance in brain activity across the cortical language network. We then demonstrate that the emergent computations performed by individual, functionally-specialized "attention heads" differentially predict brain activity in specific cortical regions. These heads fall along gradients corresponding to different layers and context lengths in a low-dimensional cortical space.

Distributed Sensitivity to Syntax and Semantics throughout the Language Network

Human language is expressive because it is compositional: The meaning of a sentence (semantics) can be inferred from its structure (syntax). It is commonly believed that language syntax and semantics are processed by distinct brain regions. Here, we revisit this claim using precision fMRI methods to capture separation or overlap of function in the brains of individual participants. Contrary to prior claims, we find distributed sensitivity to both syntax and semantics throughout a broad frontotemporal brain network. Our results join a growing body of evidence for an integrated network for language in the human brain within which internal specialization is primarily a matter of degree rather than kind, in contrast with influential proposals that advocate distinct specialization of different brain areas for different types of linguistic functions.

Electrophysiological correlates of basic semantic composition in people with aphasia

The neuroanatomical correlates of basic semantic composition have been investigated in previous neuroimaging and lesion studies, but research on the electrophysiology of the involved processes is scarce. A large literature on sentence-level event-related potentials (ERPs) during semantic processing has identified at least two relevant components - the N400 and the P600. Other studies demonstrated that these components are reduced and/or delayed in people with aphasia (PWA). However, it remains to be shown if these findings generalize beyond the sentence level. Specifically, it is an open question if an alteration in ERP responses in PWA can also be observed during basic semantic composition, providing a potential future diagnostic tool. The present study aimed to elucidate the electrophysiological dynamics of basic semantic composition in a group of post-stroke PWA. We included 20 PWA and 20 age-matched controls (mean age 58 years) and measured ERP responses while they performed a plausibility judgment task on two-word phrases that were either meaningful ("anxious horse"), anomalous ("anxious wood") or had the noun replaced by a pseudoword ("anxious gufel"). The N400 effect for anomalous versus meaningful phrases was similar in both groups. In contrast, unlike the control group, PWA did not show an N400 effect between pseudoword and meaningful phrases. Moreover, both groups exhibited a parietal P600 effect towards pseudoword phrases, while PWA showed an additional P600 over frontal electrodes. Finally, PWA showed an inverse correlation between the magnitude of the N400 and P600 effects: PWA exhibiting no or even reversed N400 effects towards anomalous and pseudoword phrases showed a stronger P600 effect. These results may reflect a compensatory mechanism which allows PWA to arrive at the correct interpretation of the phrase. When compositional processing capacities are impaired in the early N400 time-window, PWA may make use of a more elaborate re-analysis process reflected in the P600.

How can graph theory inform the dual-stream model of speech processing? a resting-state fMRI study of post-stroke aphasia

The dual-stream model of speech processing has been proposed to represent the cortical networks involved in speech comprehension and production. Although it is arguably the prominent neuroanatomical model of speech processing, it is not yet known if the dual-stream model represents actual intrinsic functional brain networks. Furthermore, it is unclear how disruptions after a stroke to the functional connectivity of the dual-stream model's regions are related to specific types of speech production and comprehension impairments seen in aphasia. To address these questions, in the present study, we examined two independent resting-state fMRI datasets: (1) 28 neurotypical matched controls and (2) 28 chronic left-hemisphere stroke survivors with aphasia collected at another site. Structural MRI, as well as language and cognitive behavioral assessments, were collected. Using standard functional connectivity measures, we successfully identified an intrinsic resting-state network amongst the dual-stream model's regions in the control group. We then used both standard functional connectivity analyses and graph theory approaches to determine how the functional connectivity of the dual-stream network differs in individuals with post-stroke aphasia, and how this connectivity may predict performance on clinical aphasia assessments. Our findings provide strong evidence that the dual-stream model is an intrinsic network as measured via resting-state MRI, and that weaker functional connectivity of the hub nodes of the dual-stream network defined by graph theory methods, but not overall average network connectivity, is weaker in the stroke group than in the control participants. Also, the functional connectivity of the hub nodes predicted specific types of impairments on clinical assessments. In particular, the relative strength of connectivity of the right hemisphere's homologues of the left dorsal stream hubs to the left dorsal hubs versus right ventral stream hubs is a particularly strong predictor of post-stroke aphasia severity and symptomology.

Getting language right: Relating individual differences in right hemisphere contributions to language learning and relearning

Language, or the diverse set of dynamic processes through which symbolic, perceptual codes are linked to meaning representations in memory, has long been assumed to be lateralized to the left hemisphere (LH). However, after over 150 years of investigation, we still lack a unifying account of when, and for whom, a particular linguistic process relies upon LH or right hemisphere (RH) computations, or both. With a focus on individual differences, this article integrates existing theories of hemispheric contributions to language and cognition into a novel proposed framework for understanding how, when, and for whom the RH contributes to linguistic processes. We use evidence from first and second language learning and language relearning following focal brain damage to highlight the critical contributions of the RH.

Word-producing brain: Contribution of the left anterior middle temporal gyrus to word production patterns in spoken language

Vocabulary is based on semantic knowledge. The anterior temporal lobe (ATL) has been considered an essential region for processing semantic knowledge; nonetheless, the association between word production patterns and the structural and functional characteristics of the ATL remains unclear. To examine this, we analyzed over one million words from group conversations among community-dwelling older adults and their multimodal magnetic resonance imaging data. A quantitative index for the word production patterns, namely the exponent β of Heaps' law, positively correlated with the left anterior middle temporal gyrus volume. Moreover, β negatively correlated with its resting-state functional connectivity with the precuneus. There was no significant correlation with the diffusion tensor imaging metrics in any fiber. These findings suggest that the vocabulary richness in spoken language depends on the brain status characterized by the semantic knowledge-related brain structure and its activation dissimilarity with the precuneus, a core region of the default mode network.

The role of left temporo-parietal and inferior frontal cortex in comprehending syntactically complex sentences: A brain stimulation study

BACKGROUND AND OBJECTIVES

Syntactic competence relies on a left-lateralized network converging on hubs in inferior-frontal and posterior-temporal cortices. We address the question whether anodal transcranial direct current stimulation (a-tDCS) over these hubs can modulate comprehension of sentences, whose syntactic complexity systematically varied along the factors embedding depths and canonicity. Semantic content and length of the sentences were kept identical and forced choice picture matching was required after the full sentence had been presented.

METHODS

We used a single-blind, within-subject, sham-controlled design, applying a-tDCS targeting left posterior tempo-parietal (TP) and left inferior frontal cortex (FC). Stimulation sites were determined by individual neuro-navigation. 20 participants were included of whom 19 entered the analysis. Results were analysed using (generalized) mixed models. In a pilot-experiment in another group of 20 participants we validated the manipulation of syntactic complexity by the two factors embedding depth and argument-order.

RESULTS

Reaction times increased and accuracy decreased with higher embedding depth and non-canonical argument order in both experiments. Notably a-tDCS over TP enhanced sentence-to-picture matching, while FC-stimulation showed no consistent effect. Moreover, the analysis disclosed a session effect, indicating improvements of task performance especially regarding speed.

CONCLUSIONS

We conclude that the posterior 'hub' of the neuronal network affording syntactic analysis represents a 'bottleneck', likely due to working-memory capacity and the challenges of mapping semantic to syntactic information allowing for role assignment. While this does not challenge the role of left inferior-frontal cortex for syntax processing and novel-grammar learning, the application of highly established syntactic rules during sentence comprehension may be considered optimized, thus not augmentable by a-tDCS in the uncompromised network.

SIGNIFICANCE STATEMENT

Anodal transcranial direct current stimulation (a-tDCS) over left temporo-parietal cortex enhances comprehension of complex sentences in uncompromised young speakers. Since a-tDCS over left frontal cortex did not elicit any change, the 'bottleneck' for the understanding of complex sentences seems to be the posterior, temporo-parietal rather than the anterior inferior-frontal 'hub' of language processing. Regarding the attested role of inferior-frontal cortex in syntax processing, we suggest that its function is optimized in competent young speakers, preventing further enhancement by (facilitatory) tDCS. Results shed light on the functional anatomy of syntax processing during sentence comprehension; moreover, they open perspectives for research in the lesioned language network of people with syntactic deficits due to aphasia.

Late dominance of the right hemisphere during narrative comprehension

PET and fMRI studies suggest that auditory narrative comprehension is supported by a bilateral multilobar cortical network. The superior temporal resolution of magnetoencephalography (MEG) makes it an attractive tool to investigate the dynamics of how different neuroanatomic substrates engage during narrative comprehension. Using beta-band power changes as a marker of cortical engagement, we studied MEG responses during an auditory story comprehension task in 31 healthy adults. The protocol consisted of two runs, each interleaving 7 blocks of the story comprehension task with 15 blocks of an auditorily presented math task as a control for phonological processing, working memory, and attention processes. Sources at the cortical surface were estimated with a frequency-resolved beamformer. Beta-band power was estimated in the frequency range of 16-24 Hz over 1-sec epochs starting from 400 msec after stimulus onset until the end of a story or math problem presentation. These power estimates were compared to 1-second epochs of data before the stimulus block onset. The task-related cortical engagement was inferred from beta-band power decrements. Group-level source activations were statistically compared using non-parametric permutation testing. A story-math contrast of beta-band power changes showed greater bilateral cortical engagement within the fusiform gyrus, inferior and middle temporal gyri, parahippocampal gyrus, and left inferior frontal gyrus (IFG) during story comprehension. A math-story contrast of beta power decrements showed greater bilateral but left-lateralized engagement of the middle frontal gyrus and superior parietal lobule. The evolution of cortical engagement during five temporal windows across the presentation of stories showed significant involvement during the first interval of the narrative of bilateral opercular and insular regions as well as the ventral and lateral temporal cortex, extending more posteriorly on the left and medially on the right. Over time, there continued to be sustained right anterior ventral temporal engagement, with increasing involvement of the right anterior parahippocampal gyrus, STG, MTG, posterior superior temporal sulcus, inferior parietal lobule, frontal operculum, and insula, while left hemisphere engagement decreased. Our findings are consistent with prior imaging studies of narrative comprehension, but in addition, they demonstrate increasing right-lateralized engagement over the course of narratives, suggesting an important role for these right-hemispheric regions in semantic integration as well as social and pragmatic inference processing.

Online neurostimulation of Broca's area does not interfere with syntactic predictions: A combined TMS-EEG approach to basic linguistic combination

Categorical predictions have been proposed as the key mechanism supporting the fast pace of syntactic composition in language. Accordingly, grammar-based expectations are formed-e.g., the determiner "a" triggers the prediction for a noun-and facilitate the analysis of incoming syntactic information, which is then checked against a single or few other word categories. Previous functional neuroimaging studies point towards Broca's area in the left inferior frontal gyrus (IFG) as one fundamental cortical region involved in categorical prediction during incremental language processing. Causal evidence for this hypothesis is however still missing. In this study, we combined Electroencephalography (EEG) and Transcranial Magnetic Stimulation (TMS) to test whether Broca's area is functionally relevant in predictive mechanisms for language. We transiently perturbed Broca's area during the first word in a two-word construction, while simultaneously measuring the Event-Related Potential (ERP) correlates of syntactic composition. We reasoned that if Broca's area is involved in predictive mechanisms for syntax, disruptive TMS during the first word would mitigate the difference in the ERP responses for predicted and unpredicted categories in basic two-word constructions. Contrary to this hypothesis, perturbation of Broca's area at the predictive stage did not affect the ERP correlates of basic composition. The correlation strength between the electrical field induced by TMS and the ERP responses further confirmed this pattern. We discuss the present results considering an alternative account of the role of Broca's area in syntactic composition, namely the bottom-up integration of words into constituents, and of compensatory mechanisms within the language predictive network.

Efforts for the Correct Comprehension of Deceitful and Ironic Communicative Intentions in Schizophrenia: A Functional Magnetic Resonance Imaging Study on the Role of the Left Middle Temporal Gyrus

Deficits in social cognition and more specifically in communication have an important impact on the real-life functioning of people with schizophrenia (SZ). In particular, patients have severe problems in communicative-pragmatics, for example, in correctly inferring the speaker's communicative intention in everyday conversational interactions. This limit is associated with morphological and functional alteration of the left middle temporal gyrus (L-MTG), a cerebral area involved in various communicative processes, in particular in the distinction of ironic communicative intention from sincere and deceitful ones. We performed an fMRI study on 20 patients with SZ and 20 matched healthy controls (HCs) while performing a pragmatic task testing the comprehension of sincere, deceitful, and ironic communicative intentions. We considered the L-MTG as the region of interest. SZ patients showed difficulties in the correct comprehension of all types of communicative intentions and, when correctly answering to the task, they exhibited a higher activation of the L-MTG, as compared to HC, under all experimental conditions. This greater involvement of the L-MTG in the group of patients could depend on different factors, such as the increasing inferential effort required in correctly understanding the speaker's communicative intentions, and the higher integrative semantic processes involved in sentence processing. Future studies with a larger sample size and functional connectivity analysis are needed to study deeper the specific role of the L-MTG in pragmatic processes in SZ, also in relation to other brain areas.

Examining empathy deficits across familial forms of frontotemporal dementia within the GENFI cohort

BACKGROUND

Reduced empathy is a common symptom in frontotemporal dementia (FTD). Although empathy deficits have been extensively researched in sporadic cases, few studies have explored the differences in familial forms of FTD.

METHODS

Empathy was examined using a modified version of the Interpersonal Reactivity Index (mIRI) in 676 participants from the Genetic FTD Initiative: 216 mutation-negative controls, 192 C9orf72 expansion carriers, 193 GRN mutation carriers and 75 MAPT mutation carriers. Using global scores from the CDR® plus NACC FTLD, mutation carriers were divided into three groups, asymptomatic (0), very mildly symptomatic/prodromal (.5), or fully symptomatic (1 or more). The mIRI Total score, as well as the subscores of Empathic Concern (EC) and Perspective Taking (PT) were assessed. Linear regression models with bootstrapping were used to assess empathy ratings across genetic groups, as well as across phenotypes in the symptomatic carriers. Neural correlates of empathy deficits were examined using a voxel-based morphometry (VBM) analysis.

RESULTS

All fully symptomatic groups scored lower on the mIRI Total, EC, and PT when compared to controls and their asymptomatic or prodromal counterparts (all p < .001). Prodromal C9orf72 expansion carriers also scored significantly lower than controls on the mIRI Total score (p = .046). In the phenotype analysis, all groups (behavioural variant FTD, primary progressive aphasia and FTD with amyotrophic lateral sclerosis) scored significantly lower than controls (all p < .007). VBM revealed an overlapping neural correlate of the mIRI Total score across genetic groups in the orbitofrontal lobe but with additional involvement in the temporal lobe, insula and basal ganglia in both the GRN and MAPT groups, and uniquely more posterior regions such as the parietal lobe and thalamus in the GRN group, and medial temporal structures in the MAPT group.

CONCLUSIONS

Significant empathy deficits present in genetic FTD, particularly in symptomatic individuals and those with a bvFTD phenotype, while prodromal deficits are only seen using the mIRI in C9orf72 expansion carriers.

Controversy over the temporal cortical terminations of the left arcuate fasciculus: a reappraisal

The arcuate fasciculus has been considered a major dorsal fronto-temporal white matter pathway linking frontal language production regions with auditory perception in the superior temporal gyrus, the so-called Wernicke's area. In line with this tradition, both historical and contemporary models of language function have assigned primacy to superior temporal projections of the arcuate fasciculus. However, classical anatomical descriptions and emerging behavioural data are at odds with this assumption. On one hand, fronto-temporal projections to Wernicke's area may not be unique to the arcuate fasciculus. On the other hand, dorsal stream language deficits have been reported also for damage to middle, inferior and basal temporal gyri which may be linked to arcuate disconnection. These findings point to a reappraisal of arcuate projections in the temporal lobe. Here, we review anatomical and functional evidence regarding the temporal cortical terminations of the left arcuate fasciculus by incorporating dissection and tractography findings with stimulation data using cortico-cortical evoked potentials and direct electrical stimulation mapping in awake patients. Firstly, we discuss the fibers of the arcuate fasciculus projecting to the superior temporal gyrus and the functional rostro-caudal gradient in this region where both phonological encoding and auditory-motor transformation may be performed. Caudal regions within the temporoparietal junction may be involved in articulation and associated with temporoparietal projections of the third branch of the superior longitudinal fasciculus, while more rostral regions may support encoding of acoustic phonetic features, supported by arcuate fibres. We then move to examine clinical data showing that multimodal phonological encoding is facilitated by projections of the arcuate fasciculus to superior, but also middle, inferior and basal temporal regions. Hence, we discuss how projections of the arcuate fasciculus may contribute to acoustic (middle-posterior superior and middle temporal gyri), visual (posterior inferior temporal/fusiform gyri comprising the visual word form area) and lexical (anterior-middle inferior temporal/fusiform gyri in the basal temporal language area) information in the temporal lobe to be processed, encoded and translated into a dorsal phonological route to the frontal lobe. Finally, we point out surgical implications for this model in terms of the prediction and avoidance of neurological deficit.

The Cortical Organization of Syntactic Processing Is Supramodal: Evidence from American Sign Language

Areas within the left-lateralized neural network for language have been found to be sensitive to syntactic complexity in spoken and written language. Previous research has revealed that these areas are active for sign language as well, but whether these areas are specifically responsive to syntactic complexity in sign language independent of lexical processing has yet to be found. To investigate the question, we used fMRI to neuroimage deaf native signers' comprehension of 180 sign strings in American Sign Language (ASL) with a picture-probe recognition task. The ASL strings were all six signs in length but varied at three levels of syntactic complexity: sign lists, two-word sentences, and complex sentences. Syntactic complexity significantly affected comprehension and memory, both behaviorally and neurally, by facilitating accuracy and response time on the picture-probe recognition task and eliciting a left lateralized activation response pattern in anterior and posterior superior temporal sulcus (aSTS and pSTS). Minimal or absent syntactic structure reduced picture-probe recognition and elicited activation in bilateral pSTS and occipital-temporal cortex. These results provide evidence from a sign language, ASL, that the combinatorial processing of anterior STS and pSTS is supramodal in nature. The results further suggest that the neurolinguistic processing of ASL is characterized by overlapping and separable neural systems for syntactic and lexical processing.

Hierarchical cortical networks of "voice patches" for processing voices in human brain

Humans have an extraordinary ability to recognize and differentiate voices. It is yet unclear whether voices are uniquely processed in the human brain. To explore the underlying neural mechanisms of voice processing, we recorded electrocorticographic signals from intracranial electrodes in epilepsy patients while they listened to six different categories of voice and nonvoice sounds. Subregions in the temporal lobe exhibited preferences for distinct voice stimuli, which were defined as "voice patches." Latency analyses suggested a dual hierarchical organization of the voice patches. We also found that voice patches were functionally connected under both task-engaged and resting states. Furthermore, the left motor areas were coactivated and correlated with the temporal voice patches during the sound-listening task. Taken together, this work reveals hierarchical cortical networks in the human brain for processing human voices.

The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Incremental Language Comprehension Difficulty Predicts Activity in the Language Network but Not the Multiple Demand Network

What role do domain-general executive functions play in human language comprehension? To address this question, we examine the relationship between behavioral measures of comprehension and neural activity in the domain-general "multiple demand" (MD) network, which has been linked to constructs like attention, working memory, inhibitory control, and selection, and implicated in diverse goal-directed behaviors. Specifically, functional magnetic resonance imaging data collected during naturalistic story listening are compared with theory-neutral measures of online comprehension difficulty and incremental processing load (reading times and eye-fixation durations). Critically, to ensure that variance in these measures is driven by features of the linguistic stimulus rather than reflecting participant- or trial-level variability, the neuroimaging and behavioral datasets were collected in nonoverlapping samples. We find no behavioral-neural link in functionally localized MD regions; instead, this link is found in the domain-specific, fronto-temporal "core language network," in both left-hemispheric areas and their right hemispheric homotopic areas. These results argue against strong involvement of domain-general executive circuits in language comprehension.

Incremental Language Comprehension Difficulty Predicts Activity in the Language Network but Not the Multiple Demand Network

What role do domain-general executive functions play in human language comprehension? To address this question, we examine the relationship between behavioral measures of comprehension and neural activity in the domain-general "multiple demand" (MD) network, which has been linked to constructs like attention, working memory, inhibitory control, and selection, and implicated in diverse goal-directed behaviors. Specifically, functional magnetic resonance imaging data collected during naturalistic story listening are compared with theory-neutral measures of online comprehension difficulty and incremental processing load (reading times and eye-fixation durations). Critically, to ensure that variance in these measures is driven by features of the linguistic stimulus rather than reflecting participant- or trial-level variability, the neuroimaging and behavioral datasets were collected in nonoverlapping samples. We find no behavioral-neural link in functionally localized MD regions; instead, this link is found in the domain-specific, fronto-temporal "core language network," in both left-hemispheric areas and their right hemispheric homotopic areas. These results argue against strong involvement of domain-general executive circuits in language comprehension.

Visual experience modulates whole-brain connectivity dynamics: A resting-state fMRI study using the model of radiologists

Visual expertise refers to proficiency in visual recognition. It is attributed to accumulated visual experience in a specific domain and manifests in widespread neural activities that extend well beyond the visual cortex to multiple high‐level brain areas. An extensive body of studies has centered on the neural mechanisms underlying a distinctive domain of visual expertise, while few studies elucidated how visual experience modulates resting‐state whole‐brain connectivity dynamics. The current study bridged this gap by modeling the subtle alterations in interregional spontaneous connectivity patterns with a group of superior radiological interns. Functional connectivity analysis was based on functional brain segmentation, which was derived from a data‐driven clustering approach to discriminate subtle changes in connectivity dynamics. Our results showed there was radiographic visual experience accompanied with integration within brain circuits supporting visual processing and decision making, integration across brain circuits supporting high‐order functions, and segregation between high‐order and low‐order brain functions. Also, most of these alterations were significantly correlated with individual nodule identification performance. Our results implied that visual expertise is a controlled, interactive process that develops from reciprocal interactions between the visual system and multiple top‐down factors, including semantic knowledge, top‐down attentional control, and task relevance, which may enhance participants' local brain functional integration to promote their acquisition of specific visual information and modulate the activity of some regions for lower‐order visual feature processing to filter out nonrelevant visual details. The current findings may provide new ideas for understanding the central mechanism underlying the formation of visual expertise.

Parental Educational Attainment, the Superior Temporal Cortical Surface Area, and Reading Ability among American Children: A Test of Marginalization-Related Diminished Returns

BACKGROUND

Recent studies have shown that parental educational attainment is associated with a larger superior temporal cortical surface area associated with higher reading ability in children. Simultaneously, the marginalization-related diminished returns (MDRs) framework suggests that, due to structural racism and social stratification, returns of parental education are smaller for black and other racial/ethnic minority children compared to their white counterparts.

PURPOSE

This study used a large national sample of 9-10-year-old American children to investigate associations between parental educational attainment, the right and left superior temporal cortical surface area, and reading ability across diverse racial/ethnic groups.

METHODS

This was a cross-sectional analysis that included 10,817 9-10-year-old children from the Adolescent Brain Cognitive Development (ABCD) study. Parental educational attainment was treated as a five-level categorical variable. Children's right and left superior temporal cortical surface area and reading ability were continuous variables. Race/ethnicity was the moderator. To adjust for the nested nature of the ABCD data, mixed-effects regression models were used to test the associations between parental education, superior temporal cortical surface area, and reading ability overall and by race/ethnicity.

RESULTS

Overall, high parental educational attainment was associated with greater superior temporal cortical surface area and reading ability in children. In the pooled sample, we found statistically significant interactions between race/ethnicity and parental educational attainment on children's right and left superior temporal cortical surface area, suggesting that high parental educational attainment has a smaller boosting effect on children's superior temporal cortical surface area for black than white children. We also found a significant interaction between race and the left superior temporal surface area on reading ability, indicating weaker associations for Alaskan Natives, Native Hawaiians, and Pacific Islanders (AIAN/NHPI) than white children. We also found interactions between race and parental educational attainment on reading ability, indicating more potent effects for black children than white children.

CONCLUSION

While parental educational attainment may improve children's superior temporal cortical surface area, promoting reading ability, this effect may be unequal across racial/ethnic groups. To minimize the racial/ethnic gap in children's brain development and school achievement, we need to address societal barriers that diminish parental educational attainment's marginal returns for middle-class minority families. Social and public policies need to go beyond equal access and address structural and societal barriers that hinder middle-class families of color and their children. Future research should test how racism, social stratification, segregation, and discrimination, which shape the daily lives of non-white individuals, take a toll on children's brains and academic development.

Linguistic processing of task-irrelevant speech at a cocktail party

Paying attention to one speaker in a noisy place can be extremely difficult, because to-be-attended and task-irrelevant speech compete for processing resources. We tested whether this competition is restricted to acoustic-phonetic interference or if it extends to competition for linguistic processing as well. Neural activity was recorded using Magnetoencephalography as human participants were instructed to attend to natural speech presented to one ear, and task-irrelevant stimuli were presented to the other. Task-irrelevant stimuli consisted either of random sequences of syllables, or syllables structured to form coherent sentences, using hierarchical frequency-tagging. We find that the phrasal structure of structured task-irrelevant stimuli was represented in the neural response in left inferior frontal and posterior parietal regions, indicating that selective attention does not fully eliminate linguistic processing of task-irrelevant speech. Additionally, neural tracking of to-be-attended speech in left inferior frontal regions was enhanced when competing with structured task-irrelevant stimuli, suggesting inherent competition between them for linguistic processing.

Dissociable contributions of frontal and temporal brain regions to basic semantic composition

Semantic composition is the ability to combine single words to form complex meanings and is an essential component for successful communication. Evidence from neuroimaging studies suggests that semantic composition engages a widely distributed left-hemispheric network, including the anterior temporal lobe, the inferior frontal gyrus and the angular gyrus. To date, the functional relevance of these regions remains unclear. Here, we investigate the impact of lesions to key regions in the semantic network on basic semantic composition. We conducted a multivariate lesion-behaviour mapping study in 36 native German speaking participants with chronic lesions to the language network after left-hemispheric stroke. During the experiment, participants performed a plausibility judgement task on auditorily presented adjective-noun phrases that were either meaningful (‘anxious horse’), anomalous (‘anxious salad’) or had the noun replaced by a pseudoword (‘anxious gufel’), as well as a single-word control condition (‘horse’). We observed that reduced accuracy for anomalous phrases is associated with lesions in left anterior inferior frontal gyrus, whereas increased reaction times for anomalous phrases correlates with lesions in anterior-to-mid temporal lobe. These results indicate that anterior inferior frontal gyrus is relevant for accurate semantic decisions, while anterior-to-mid temporal lobe lesions lead to slowing of the decision for anomalous two-word phrases. These differential effects of lesion location support the notion that anterior inferior frontal gyrus affords executive control for decisions on semantic composition while anterior-to-mid temporal lobe lesions slow the semantic processing of the individual constituents of the phrase.

Cavernomas cerebrales en la infancia y desarrollo atípico de la comunicación y el lenguaje

Los cavernomas cerebrales corresponden a malformaciones vasculares del sistema nervioso central, con baja prevalencia en la población pediátrica. Estas malformaciones pueden aparecer como lesiones únicas o múltiples. La manifestación sintomatológica de los cavernomas se ha asociado, principalmente, a la ubicación topográfica de las lesiones. En este artículo se reportan las habilidades de comunicación y lenguaje de un niño de 3 años 10 meses, diagnosticado con cavernomatosis cerebral múltiple, y se discute la posible relación entre las habilidades evidenciadas y el cuadro neurológico de base. La indagatoria se efectuó mediante la aplicación de los siguientes tres procedimientos: 1. compilación y análisis de antecedentes clínicos en ficha médica, 2. elaboración y análisis de muestra naturalista de comunicación y lenguaje, 3. aplicación y análisis de instrumento Inventario de Desarrollo Comunicativo MacArthur. El análisis cualitativo de los antecedentes recabados permite sugerir una asociación entre las habilidades atípicas de comunicación y lenguaje observadas y el diagnóstico de cavernomatosis cerebral múltiple, en particular, debido a la ubicación topográfica de las lesiones. A nuestro entender, este artículo representa la primera descripción de habilidades atípicas de comunicación y lenguaje, asociadas al diagnóstico de cavernomatosis cerebral múltiple en edad pediátrica.

Lists with and without Syntax: A New Approach to Measuring the Neural Processing of Syntax

In the neurobiology of syntax, a methodological challenge is to vary syntax while holding semantics constant. Changes in syntactic structure usually correlate with changes in meaning. We approached this challenge from a new angle. We deployed word lists-typically, the unstructured control in studies of syntax-as both test and control stimuli. Three-noun lists ("lamps, dolls, guitars") were embedded in sentences ("The eccentric man hoarded lamps, dolls, guitars…") and in longer lists ("forks, pen, toilet, rodeo, lamps, dolls, guitars…"). This allowed us to minimize contributions from lexical semantics and local phrasal combinatorics: the same words occurred in both conditions, and in neither case did the list items locally compose into phrases (e.g., "lamps" and "dolls" do not form a phrase). Crucially, the list partakes in a syntactic tree in one case but not the other. Lists-in-sentences increased source-localized MEG activity at ∼250-300 ms from each of the list item onsets in the left inferior frontal cortex, at ∼300-350 ms in the left anterior temporal lobe and, most reliably, at ∼330-400 ms in left posterior temporal cortex. In contrast, the main effects of semantic association strength, which we also varied, localized in the left temporoparietal cortex, with high associations increasing activity at ∼400 ms. This dissociation offers a novel characterization of the structure versus word meaning contrast in the brain: the frontotemporal network that is familiar from studies of sentence processing can be driven by the sheer presence of global sentence structure, while associative semantics has a more posterior neural signature.SIGNIFICANCE STATEMENT Human languages all have a syntax, which both enables the infinitude of linguistic creativity and determines what is grammatical in a language. The neurobiology of syntactic processing has, however, been challenging to characterize despite decades of study. One reason is pure manipulations of syntax are difficult to design. The approach here offers a novel control of two variables that are notoriously hard to keep constant when syntax is manipulated: word meaning and phrasal combinatorics. The same noun lists occurred inside longer lists and sentences, while semantic associations also varied. Our MEG results show that classic frontotemporal language regions can be driven by sentence structure even when local semantic contributions are absent. In contrast, the left temporoparietal junction tracks associative relationships.

Design of complex neuroscience experiments using mixed-integer linear programming

Over the past few decades, neuroscience experiments have become increasingly complex and naturalistic. Experimental design has in turn become more challenging, as experiments must conform to an ever-increasing diversity of design constraints. In this article, we demonstrate how this design process can be greatly assisted using an optimization tool known as mixed-integer linear programming (MILP). MILP provides a rich framework for incorporating many types of real-world design constraints into a neuroscience experiment. We introduce the mathematical foundations of MILP, compare MILP to other experimental design techniques, and provide four case studies of how MILP can be used to solve complex experimental design challenges.

Differential contributions of left-hemispheric language regions to basic semantic composition

Semantic composition, the ability to combine single words to form complex meanings, is a core feature of human language. Despite growing interest in the basis of semantic composition, the neural correlates and the interaction of regions within this network remain a matter of debate. We designed a well-controlled two-word fMRI paradigm in which phrases only differed along the semantic dimension while keeping syntactic information alike. Healthy participants listened to meaningful ("fresh apple"), anomalous ("awake apple") and pseudoword phrases ("awake gufel") while performing an implicit and an explicit semantic task. We identified neural signatures for distinct processes during basic semantic composition. When lexical information is kept constant across conditions and the evaluation of phrasal plausibility is examined (meaningful vs. anomalous phrases), a small set of mostly left-hemispheric semantic regions, including the anterior part of the left angular gyrus, is found active. Conversely, when the load of lexical information-independently of phrasal plausibility-is varied (meaningful or anomalous vs. pseudoword phrases), conceptual combination involves a wide-spread left-hemispheric network comprising executive semantic control regions and general conceptual representation regions. Within this network, the functional coupling between the left anterior inferior frontal gyrus, the bilateral pre-supplementary motor area and the posterior angular gyrus specifically increases for meaningful phrases relative to pseudoword phrases. Stronger effects in the explicit task further suggest task-dependent neural recruitment. Overall, we provide a separation between distinct nodes of the semantic network, whose functional contributions depend on the type of compositional process under analysis.

Common and distinct neural substrates of sentence production and comprehension

Functional neuroimaging and lesion-symptom mapping investigations implicate a left frontal-temporal-parietal network for sentence processing. The majority of studies have focused on sentence comprehension, with fewer in the domain of sentence production, which have not fully elucidated overlapping and/or unique brain structures associated with the two domains, particularly for sentences with noncanonical word order. Using voxel-based lesion symptom mapping (VLSM) we examined the relationship between lesions within the left hemisphere language network and both sentence comprehension and production of simple and complex syntactic structures in 76 participants with chronic stroke-induced aphasia. Results revealed shared regions across domains in the anterior and posterior superior temporal gyri (aSTG, pSTG), and the temporal pole (adjusted for verb production/comprehension). Additionally, comprehension was associated with lesions in the anterior and posterior middle temporal gyri (aMTG, pMTG), the MTG temporooccipital regions, SMG/AG, central and parietal operculum, and the insula. Subsequent VLSM analyses (production versus comprehension) revealed critical regions associated with each domain: anterior temporal lesions were associated with production; posterior temporo-parietal lesions were associated with comprehension, implicating important roles for regions within the ventral and dorsal stream processing routes, respectively. Processing of syntactically complex, noncanonical (adjusted for canonical), sentences was associated with damage to the pSTG across domains, with additional damage to the pMTG and IPL associated with impaired sentence comprehension, suggesting that the pSTG is crucial for computing noncanonical sentences across domains and that the pMTG, and IPL are necessary for re-analysis of thematic roles as required for resolution of long-distance dependencies. These findings converge with previous studies and extend our knowledge of the neural mechanisms of sentence comprehension to production, highlighting critical regions associated with both domains, and further address the mechanism engaged for syntactic computation, controlled for the contribution of verb processing.

When a sentence loses semantics: Selective involvement of a left anterior temporal subregion in semantic processing

Although the left anterior temporal lobe (ATL) has been associated with semantic processing, the role of this region in syntactic structure building of sentences remains a subject of debate. Functional neuroimaging studies contrasting well-formed sentences with word lists lacking syntactic structure have produced mixed results. The current functional magnetic resonance imaging study examined whether the left ATL is selectively involved in semantic processing or also plays a role in syntactic structure building by manipulating syntactic complexity and meaningfulness in a novel way. To deprive semantic/pragmatic information from a sentence, we replaced all content words with pronounceable meaningless placeholders. We conducted an experiment with a 2 × 2 factorial design with factors of SEMANTICS (natural sentences [NAT]; sentences with placeholders [SPH]) and SYNTAX (the basic Japanese Subject-Object-Verb [SOV] word order; a changed Object-Subject-Verb [OSV] word order). A main effect of SEMANTICS (NAT > SPH) was found in the left ATL, as well as in the ventral occipitotemporal regions. The opposite contrast (SPH > NAT) revealed activation in the dorsal regions encompassing Brodmann area 44, the premotor area, and the parietal cortex in the left hemisphere. We found no main effect of SYNTAX (OSV > SOV) in a subregion of the left ATL that was more responsive to natural sentences than meaningless sentences. These results indicate selective involvement of a subregion of the left ATL in semantic/pragmatic processing.

Neural Correlates of Group Versus Individual Problem Solving Revealed by fMRI

Group problem solving is a prototypical complex collective intellectual activity. Psychological research provides compelling evidence that problem solving in groups is both qualitatively and quantitatively different from doing so alone. However, the question of whether individual and collective problem solving involve the same neural substrate has not yet been addressed, mainly due to methodological limitations. In the current study, functional magnetic resonance imaging was performed to compare brain activation when participants solved Raven-like matrix problems in a small group and individually. In the group condition, the participant in the scanner was able to discuss the problem with other team members using a special communication device. In the individual condition, the participant was required to think aloud while solving the problem in the silent presence of the other team members. Greater activation was found in several brain regions during group problem solving, including the medial prefrontal cortex; lateral parietal, cingulate, precuneus and retrosplenial cortices; frontal and temporal poles. These areas have been identified as potential components of the so-called "social brain" on the basis of research using offline judgments of material related to socializing. Therefore, this study demonstrated the actual involvement of these regions in real-time social interactions, such as group problem solving. However, further connectivity analysis revealed that the social brain components are co-activated, but do not increase their coupling during cooperation as would be suggested for a holistic network. We suggest that the social mode of the brain may be described instead as a re-configuration of connectivity between basic networks, and we found decreased connectivity between the language and salience networks in the group compared to the individual condition. A control experiment showed that the findings from the main experiment cannot be entirely accounted for by discourse comprehension. Thus, the study demonstrates affordances provided by the presented new technique for neuroimaging the "group mind," implementing the single-brain version of the second-person neuroscience approach.

No evidence for differences among language regions in their temporal receptive windows

The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.

Barking up the right tree: Univariate and multivariate fMRI analyses of homonym comprehension

Homonyms are a critical test case for investigating how the brain resolves ambiguity in language and, more generally, how context influences semantic processing. Previous neuroimaging studies have associated processing of homonyms with greater engagement of regions involved in executive control of semantic processing. However, the precise role of these areas and the involvement of semantic representational regions in homonym comprehension remain elusive. We addressed this by combining univariate and multivariate fMRI analyses of homonym processing. We tested whether multi-voxel activation patterns could discriminate between presentations of the same homonym in different contexts (e.g., bark following tree vs. bark following dog). The ventral anterior temporal lobe, implicated in semantic representation but not previously in homonym comprehension, showed this meaning-specific coding, despite not showing increased mean activation for homonyms. Within inferior frontal gyrus (IFG), a key site for semantic control, there was a dissociation between pars orbitalis, which also showed meaning-specific coding, and pars triangularis, which discriminated more generally between semantically related and unrelated word pairs. IFG effects were goal-dependent, only occurring when the task required semantic decisions, in line with a top-down control function. Finally, posterior middle temporal cortex showed a hybrid pattern of responses, supporting the idea that it acts as an interface between semantic representations and the control system. The study provides new evidence for context-dependent coding in the semantic system and clarifies the role of control regions in processing ambiguity. It also highlights the importance of combining univariate and multivariate neuroimaging data to fully elucidate the role of a brain region in semantic cognition.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

Lack of selectivity for syntax relative to word meanings throughout the language network

To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.

The Cortical Maps of Hierarchical Linguistic Structures during Speech Perception

The hierarchical nature of language requires human brain to internally parse connected-speech and incrementally construct abstract linguistic structures. Recent research revealed multiple neural processing timescales underlying grammar-based configuration of linguistic hierarchies. However, little is known about where in the whole cerebral cortex such temporally scaled neural processes occur. This study used novel magnetoencephalography source imaging techniques combined with a unique language stimulation paradigm to segregate cortical maps synchronized to 3 levels of linguistic units (i.e., words, phrases, and sentences). Notably, distinct ensembles of cortical loci were identified to feature structures at different levels. The superior temporal gyrus was found to be involved in processing all 3 linguistic levels while distinct ensembles of other brain regions were recruited to encode each linguistic level. Neural activities in the right motor cortex only followed the rhythm of monosyllabic words which have clear acoustic boundaries, whereas the left anterior temporal lobe and the left inferior frontal gyrus were selectively recruited in processing phrases or sentences. Our results ground a multi-timescale hierarchical neural processing of speech in neuroanatomical reality with specific sets of cortices responsible for different levels of linguistic units.

The relationship between language ability and brain activity across language processes and modalities

Existing neuroimaging studies on the relationship between language ability and brain activity have found contradictory evidence: On the one hand, increased activity with higher language ability has been interpreted as deeper or more adaptive language processing. On the other hand, decreased activity with higher language ability has been interpreted as more efficient language processing. In contrast to previous studies, the current study investigated the relationship between language ability and neural activity across different language processes and modalities while keeping non-linguistic cognitive task demands to a minimum. fMRI data were collected from 22 healthy adults performing a sentence listening task, a sentence reading task and a phonological production task. Outside the MRI scanner, language ability was assessed with the verbal scale of the Wechsler Abbreviated Scale of Intelligence (WASI-II) and a verbal fluency task. As expected, sentence comprehension activated the left anterior temporal lobe while phonological processing activated the left inferior frontal gyrus. Higher language ability was associated with increased activity in the left temporal lobe during auditory sentence processing and with increased activity in the left frontal lobe during phonological processing, reflected in both, higher intensity and greater extent of activations. Evidence for decreased activity with higher language ability was less consistent and restricted to verbal fluency. Together, the results predominantly support the hypothesis of deeper language processing in individuals with higher language ability. The consistency of results across language processes, modalities, and brain regions suggests a general positive link between language abilities and brain activity within the core language network. However, a negative relationship seems to exist for non-linguistic cognitive functions located outside the language network.

Localizing syntactic predictions using recurrent neural network grammars

Brain activity in numerous perisylvian brain regions is modulated by the expectedness of linguistic stimuli. We leverage recent advances in computational parsing models to test what representations guide the processes reflected by this activity. Recurrent Neural Network Grammars (RNNGs) are generative models of (tree, string) pairs that use neural networks to drive derivational choices. Parsing with them yields a variety of incremental complexity metrics that we evaluate against a publicly available fMRI data-set recorded while participants simply listen to an audiobook story. Surprisal, which captures a word's un-expectedness, correlates with a wide range of temporal and frontal regions when it is calculated based on word-sequence information using a top-performing LSTM neural network language model. The explicit encoding of hierarchy afforded by the RNNG additionally captures activity in left posterior temporal areas. A separate metric tracking the number of derivational steps taken between words correlates with activity in the left temporal lobe and inferior frontal gyrus. This pattern of results narrows down the kinds of linguistic representations at play during predictive processing across the brain's language network.

Revealing the neural networks that extract conceptual gestalts from continuously evolving or changing semantic contexts

Reading a book, understanding the news reports or any other behaviour involving the processing of meaningful stimuli requires the semantic system to have two main features: being active during an extended period of time and flexibly adapting the internal representation according to the changing environment. Despite being key features of many everyday tasks, formation and updating of the semantic “gestalt” are still poorly understood. In this fMRI study we used naturalistic stimuli and task manipulations to identify the neural network that forms and updates conceptual gestalts during time-extended integration of meaningful stimuli. Univariate and multivariate techniques allowed us to draw a distinction between networks that are crucial for the formation of a semantic gestalt (meaning integration) and those that instead are important for linking incoming cues about the current context (e.g., time and space cues) into a schema representation. Specifically, we revealed that time-extended formation of the conceptual gestalt was reflected in the neuro-computations of the anterior temporal lobe accompanied by multi-demand areas and hippocampus, with a key role of brain structures in the right hemisphere. This “semantic gestalt network” was strongly recruited when an update of the current semantic representation was required during narrative processing. A distinct fronto-parietal network, instead, was recruited for context integration, independently from the meaning associations between words (semantic coherence). Finally, in contrast with accounts positing that the default mode network (DMN) may have a crucial role in semantic cognition, our findings revealed that DMN activity was sensitive to task difficulty, but not to semantic integration. The implications of these findings for neurocognitive models of semantic cognition and the literature on narrative processing are discussed.

•

fMRI revealed areas and networks for semantic integration during narrative reading.

•

ATL has a key role in the formation of the conceptual gestalt.

•

IFG, pMTG and dAG support the update of the conceptual gestalt.

•

Left AG (mid-PGp) has a key role in context integration.

Two Ways to Build a Thought: Distinct Forms of Compositional Semantic Representation across Brain Regions

To understand a simple sentence such as "the woman chased the dog", the human mind must dynamically organize the relevant concepts to represent who did what to whom. This structured recombination of concepts (woman, dog, chased) enables the representation of novel events, and is thus a central feature of intelligence. Here, we use functional magnetic resonance (fMRI) and encoding models to delineate the contributions of three brain regions to the representation of relational combinations. We identify a region of anterior-medial prefrontal cortex (amPFC) that shares representations of noun-verb conjunctions across sentences: for example, a combination of "woman" and "chased" to encode woman-as-chaser, distinct from woman-as-chasee. This PFC region differs from the left-mid superior temporal cortex (lmSTC) and hippocampus, two regions previously implicated in representing relations. lmSTC represents broad role combinations that are shared across verbs (e.g., woman-as-agent), rather than narrow roles, limited to specific actions (woman-as-chaser). By contrast, a hippocampal sub-region represents events sharing narrow conjunctions as dissimilar. The success of the hippocampal conjunctive encoding model is anti-correlated with generalization performance in amPFC on a trial-by-trial basis, consistent with a pattern separation mechanism. Thus, these three regions appear to play distinct, but complementary, roles in encoding compositional event structure.

The Cortical Organization of Syntax

Syntax, the structure of sentences, enables humans to express an infinite range of meanings through finite means. The neurobiology of syntax has been intensely studied but with little consensus. Two main candidate regions have been identified: the posterior inferior frontal gyrus (pIFG) and the posterior middle temporal gyrus (pMTG). Integrating research in linguistics, psycholinguistics, and neuroscience, we propose a neuroanatomical framework for syntax that attributes distinct syntactic computations to these regions in a unified model. The key theoretical advances are adopting a modern lexicalized view of syntax in which the lexicon and syntactic rules are intertwined, and recognizing a computational asymmetry in the role of syntax during comprehension and production. Our model postulates a hierarchical lexical-syntactic function to the pMTG, which interconnects previously identified speech perception and conceptual-semantic systems in the temporal and inferior parietal lobes, crucial for both sentence production and comprehension. These relational hierarchies are transformed via the pIFG into morpho-syntactic sequences, primarily tied to production. We show how this architecture provides a better account of the full range of data and is consistent with recent proposals regarding the organization of phonological processes in the brain.

Dissociating the neural correlates of the sociality and plausibility effects in simple conceptual combination

Neuroimaging studies have indicated that a brain network distributed in the supramodal cortical regions of the frontal, temporal, and parietal lobes plays a central role in conceptual processing. The activation of this network is modulated by two orthogonal dimensions in conceptual processing-the semantic features of individual concepts and the meaningfulness of conceptual combinations-but it remains unclear how the network is functionally organized along these two dimensions. In this fMRI study, we focused on two specific factors, i.e. the social semantic richness of words and the semantic plausibility of word combinations, along the two dimensions. In literature, the distributions of the effects of the two factors are very similar, but have not been rigorously compared in one study. We orthogonally manipulated the two factors in a phrase comprehension task and found a clear dissociation between their effects. The combination of these results with our previous findings reveals three adjacently distributed subnetworks of the supramodal semantic network, associated with the sociality effect, imageability effect, and semantic plausibility effect, respectively. Further analysis of the resting-state functional connectivity data indicated that the functional dissociation among the three subnetworks is associated with their underlying intrinsic connectivity structures.

fMRI reveals language-specific predictive coding during naturalistic sentence comprehension

Much research in cognitive neuroscience supports prediction as a canonical computation of cognition across domains. Is such predictive coding implemented by feedback from higher-order domain-general circuits, or is it locally implemented in domain-specific circuits? What information sources are used to generate these predictions? This study addresses these two questions in the context of language processing. We present fMRI evidence from a naturalistic comprehension paradigm (1) that predictive coding in the brain's response to language is domain-specific, and (2) that these predictions are sensitive both to local word co-occurrence patterns and to hierarchical structure. Using a recently developed continuous-time deconvolutional regression technique that supports data-driven hemodynamic response function discovery from continuous BOLD signal fluctuations in response to naturalistic stimuli, we found effects of prediction measures in the language network but not in the domain-general multiple-demand network, which supports executive control processes and has been previously implicated in language comprehension. Moreover, within the language network, surface-level and structural prediction effects were separable. The predictability effects in the language network were substantial, with the model capturing over 37% of explainable variance on held-out data. These findings indicate that human sentence processing mechanisms generate predictions about upcoming words using cognitive processes that are sensitive to hierarchical structure and specialized for language processing, rather than via feedback from high-level executive control mechanisms.

Genetic Intersections of Language and Neuropsychiatric Conditions

PURPOSE OF REVIEW

To better understand the shared basis of language and mental health, this review examines the behavioral and neurobiological features of aberrant language in five major neuropsychiatric conditions. Special attention is paid to genes implicated in both language and neuropsychiatric disorders, as they reveal biological domains likely to underpin the processes controlling both.

RECENT FINDINGS

Abnormal language and communication are common manifestations of neuropsychiatric conditions, and children with impaired language are more likely to develop psychiatric disorders than their peers. Major themes in the genetics of both language and psychiatry include master transcriptional regulators, like FOXP2; key developmental regulators, like AUTS2; and mediators of neurotransmission, like GRIN2A and CACNA1C.

Written sentence context effects on acoustic-phonetic perception: fMRI reveals cross-modal semantic-perceptual interactions

This study examines cross-modality effects of a semantically-biased written sentence context on the perception of an acoustically-ambiguous word target identifying neural areas sensitive to interactions between sentential bias and phonetic ambiguity. Of interest is whether the locus or nature of the interactions resembles those previously demonstrated for auditory-only effects. FMRI results show significant interaction effects in right mid-middle temporal gyrus (RmMTG) and bilateral anterior superior temporal gyri (aSTG), regions along the ventral language comprehension stream that map sound onto meaning. These regions are more anterior than those previously identified for auditory-only effects; however, the same cross-over interaction pattern emerged implying similar underlying computations at play. The findings suggest that the mechanisms that integrate information across modality and across sentence and phonetic levels of processing recruit amodal areas where reading and spoken lexical and semantic access converge. Taken together, results support interactive accounts of speech and language processing.

More than a scaffold: Language is a neuroenhancement

What role does language play in our thoughts? A longstanding proposal that has gained traction among supporters of embodied or grounded cognition suggests that it serves as a cognitive scaffold. This idea turns on the fact that language-with its ability to capture statistical regularities, leverage culturally acquired information, and engage grounded metaphors-is an effective and readily available support for our thinking. In this essay, I argue that language should be viewed as more than this; it should be viewed as a neuroenhancement. The neurologically realized language system is an important subcomponent of a flexible, multimodal, and multilevel conceptual system. It is not merely a source for information about the world but also a computational add-on that extends our conceptual reach. This approach provides a compelling explanation of the course of development, our facility with abstract concepts, and even the scope of language-specific influences on cognition.

Group-Level Neural Responses to Service-to-Service Brand Extension

Brand extension is a marketing strategy leveraging well-established brand to promote new offerings provided as goods or service. The previous neurophysiological studies on goods-to-goods brand extension have proposed that categorization and semantic memory processes are involved in brand extension evaluation. However, it is unknown whether these same processes also underlie service-to-service brand extension. The present study, therefore, aims to investigate neural processes in consumers underlying their judgment of service-to-service brand extension. Specifically, we investigated human electroencephalographic responses to extended services that were commonly considered to fit well or badly with parent brand among consumers. For this purpose, we proposed a new stimulus grouping method to find commonly acceptable or unacceptable service extensions. In the experiment, participants reported the acceptability of 56 brand extension pairs, consisting of parent brand name (S1) and extended service name (S2). From individual acceptability responses, we assigned each pair to one of the three fit levels: high- (i.e., highly acceptable), low-, and mid-fit. Next, we selected stimuli that received high/low-fit evaluations from a majority of participants (i.e., >85%) and assigned them to a high/low population-fit group. A comparison of event-related potentials (ERPs) between population-fit groups through a paired t-test showed significant differences in the fronto-central N2 and fronto-parietal P300 amplitudes. We further evaluated inter-subject variability of these ERP components by a decoding analysis that classified N2 and/or P300 amplitudes into a high, or low population-fit class using a support vector machine. Leave-one-subject-out validation revealed classification accuracy of 60.35% with N2 amplitudes, 78.95% with P300, and 73.68% with both, indicating a relatively high inter-subject variability of N2 but low for P300. This validation showed that fronto-parietal P300 reflected neural processes more consistent across subjects in service-to-service brand extension. We further observed that the left frontal P300 amplitude was increased as fit-level increased across stimuli, indicating a semantic retrieval process to evaluate a semantic link between S1 and S2. Parietal P300 showed a higher amplitude in the high population-fit group, reflecting a similarity-based categorization process. In sum, our results suggest that service-to-service brand extension evaluation may share similar neural processes with goods-to-goods brand extension.

Nontask-Related Brain Lateralization Biomarkers in Children: The Asymmetry of Language Areas on Functional Connectivity Functional Magnetic Resonance Imaging

In this work, we will test the hypothesis that the connectivity of language areas in normal children is asymmetric between the hemispheres. Intrahemispheric region of interest (ROI)-to-ROI connectivity was assessed in 40 normal right-handed children. Asymmetries were assessed (1) between the hemispheres (global language connectivity); (2) between Brodmann areas (BAs) pairs (pairwise connectivity); and (3) between two homotopic BA (Global BA connectivity). Sixteen BAs were selected: 6, 7, 9, 19, 21, 22, 37, 38, 39, 40, 41, 42, 44, 45, 46, and 47. T scores for connectivity of each BA pair were ascertained using the MATLAB toolbox CONN. Lateralization index (LI) scores based on T-values were obtained. Only LIs with 2SD above the mean were considered as significant. Comparisons between T-value groups (per side and per BA) were performed utilizing double-sided T-tests. Null hypothesis was rejected for p < 0.05. There was not a statistical difference between global left and right connectivity strength (p = 0.40). There was significant pairwise connectivity asymmetry for the following pairs: BA7-BA44 (LI = 0.662); BA21-BA42 (LI = -0.616); BA21-BA40 (LI = -0.595); BA38-BA44 (LI = 0.470); BA39-BA44 (LI = -0.903); and BA42-BA47 (LI = -0.445). Language-related brain connectivity asymmetries have been demonstrated in a group of children and young adolescents. Two pairs related to Broca's area were left dominant (BA44-BA38 and BA44-BA7) and four pairs right dominant (BA42-BA47, BA39-BA44, BA21-BA40, and BA21-BA42).