The effect of semantic relatedness on syntactic analysis: An fMRI study

Neural correlates of semantic-driven syntactic parsing in sentence comprehension

For sentence comprehension, information carried by semantic relations between constituents must be combined with other information to decode the constituent structure of a sentence, due to atypical and noisy situations of language use. Neural correlates of decoding sentence structure by semantic information have remained largely unexplored. In this functional MRI study, we examine the neural basis of semantic-driven syntactic parsing during sentence reading and compare it with that of other types of syntactic parsing driven by word order and case marking. Chinese transitive sentences of various structures were investigated, differing in word order, case making, and agent-patient semantic relations (i.e., same vs. different in animacy). For the non-canonical unmarked sentences without usable case marking, a semantic-driven effect triggered by agent-patient ambiguity was found in the left inferior frontal gyrus opercularis (IFGoper) and left inferior parietal lobule, with the activity not being modulated by naturalness factors of the sentences. The comparison between each type of non-canonical sentences with canonical sentences revealed that the non-canonicity effect engaged the left posterior frontal and temporal regions, in line with previous studies. No extra neural activity was found responsive to case marking within the non-canonical sentences. A word order effect across all types of sentences was also found in the left IFGoper, suggesting a common neural substrate between different types of parsing. The semantic-driven effect was also observed for the non-canonical marked sentences but not for the canonical sentences, suggesting that semantic information is used in decoding sentence structure in addition to case marking. The current findings illustrate the neural correlates of syntactic parsing with semantics, and provide neural evidence of how semantics facilitates syntax together with other information.

Information-Restricted Neural Language Models Reveal Different Brain Regions' Sensitivity to Semantics, Syntax, and Context

A fundamental question in neurolinguistics concerns the brain regions involved in syntactic and semantic processing during speech comprehension, both at the lexical (word processing) and supra-lexical levels (sentence and discourse processing). To what extent are these regions separated or intertwined? To address this question, we introduce a novel approach exploiting neural language models to generate high-dimensional feature sets that separately encode semantic and syntactic information. More precisely, we train a lexical language model, GloVe, and a supra-lexical language model, GPT-2, on a text corpus from which we selectively removed either syntactic or semantic information. We then assess to what extent the features derived from these information-restricted models are still able to predict the fMRI time courses of humans listening to naturalistic text. Furthermore, to determine the windows of integration of brain regions involved in supra-lexical processing, we manipulate the size of contextual information provided to GPT-2. The analyses show that, while most brain regions involved in language comprehension are sensitive to both syntactic and semantic features, the relative magnitudes of these effects vary across these regions. Moreover, regions that are best fitted by semantic or syntactic features are more spatially dissociated in the left hemisphere than in the right one, and the right hemisphere shows sensitivity to longer contexts than the left. The novelty of our approach lies in the ability to control for the information encoded in the models' embeddings by manipulating the training set. These "information-restricted" models complement previous studies that used language models to probe the neural bases of language, and shed new light on its spatial organization.

Evolutionary neuroanatomical expansion of Broca's region serving a human-specific function

The question concerning the evolution of language is directly linked to the debate on whether language and action are dependent or not and to what extent Broca's region serves as a common neural basis. The debate resulted in two opposing views, one arguing for and one against the dependence of language and action mainly based on neuroscientific data. This article presents an evolutionary neuroanatomical framework which may offer a solution to this dispute. It is proposed that in humans, Broca's region houses language and action independently in spatially separated subregions. This became possible due to an evolutionary expansion of Broca's region in the human brain, which was not paralleled by a similar expansion in the chimpanzee's brain, providing additional space needed for the neural representation of language in humans.

Network analysis studies in patients with eating disorders: A systematic review and methodological quality assessment

INTRODUCTION

Network psychometrics has been enthusiastically embraced by researchers studying eating disorders (ED), but a rigorous evaluation of the methodological quality of works is still missing. This systematic review aims to assess the methodological quality of cross-sectional network analysis (NA) studies conducted on ED clinical populations.

METHODS

PRISMA and PICOS criteria were used to retrieve NA studies on ED. Methodological quality was evaluated based on five criteria: variable-selection procedure, network estimation method, stability checks, topological overlap checks, and handling of missing data.

RESULTS

Thirty-three cross-sectional NA studies were included. Most studies focused on populations that were female, white and, with an anorexia nervosa (AN) diagnosis. Depending on how many criteria were satisfied, 27.3% of studies (n = 9) were strictly adherent, 30.3% (n = 10) moderately adherent, 33.3% (n = 11) sufficiently adherent, and 9.1% (n = 3) poorly adherent. Missing topological overlap checks and not reporting missing data represented most unreported criteria, lacking, respectively, in 63.6% and 48.5% of studies.

CONCLUSIONS

Almost all reviewed cross-sectional NA studies on ED report those methodological procedures (variable-selection procedure, network estimation method, stability checks) necessary for a network study to provide reliable results. Nonetheless these minimum reporting data require further improvement. Moreover, elements closely related to the validity of an NA study (controls for topological overlap and management of missing data) are lacking in most studies. Recommendations to overcome such methodological weaknesses in future NA studies on ED are discussed together with the need to conduct NA studies with longitudinal design, to address diversity issues in study samples and heterogeneity of assessment tools.

PUBLIC SIGNIFICANCE

The present work aims to evaluate the quality of ED NA studies to support applications of this approach in ED research. Results show that most studies adopted basic procedures to produce reliable results; however, other important procedures linked to NA study validity were mostly neglected. Network methodology in ED is extremely promising, but future studies should consistently include topological overlap control procedures and provide information on missing data.

Children’s syntax is supported by the maturation of BA44 at 4 years, but of the posterior STS at 3 years of age

Within the first years of life, children learn major aspects of their native language. However, the ability to process complex sentence structures, a core faculty in human language called syntax, emerges only slowly. A milestone in syntax acquisition is reached around the age of 4 years, when children learn a variety of syntactic concepts. Here, we ask which maturational changes in the child’s brain underlie the emergence of syntactically complex sentence processing around this critical age. We relate markers of cortical brain maturation to 3- and 4-year-olds’ sentence processing in contrast to other language abilities. Our results show that distinct cortical brain areas support sentence processing in the two age groups. Sentence production abilities at 3 years were associated with increased surface area in the most posterior part of the left superior temporal sulcus, whereas 4-year-olds showed an association with cortical thickness in the left posterior part of Broca’s area, i.e. BA44. The present findings suggest that sentence processing abilities rely on the maturation of distinct cortical regions in 3- compared to 4-year-olds. The observed shift to more mature regions involved in processing syntactically complex sentences may underlie behavioral milestones in syntax acquisition at around 4 years.

Neural classification maps for distinct word combinations in Broca's area

Humans are equipped with the remarkable ability to comprehend an infinite number of utterances. Relations between grammatical categories restrict the way words combine into phrases and sentences. How the brain recognizes different word combinations remains largely unknown, although this is a necessary condition for combinatorial unboundedness in language. Here, we used functional magnetic resonance imaging and multivariate pattern analysis to explore whether distinct neural populations of a known language network hub-Broca's area-are specialized for recognizing distinct simple word combinations. The phrases consisted of a noun (flag) occurring either with a content word, an adjective (green flag), or with a function word, a determiner (that flag). The key result is that the distribution of neural populations classifying word combination in Broca's area seems sensitive to neuroanatomical subdivisions within this area, irrespective of task. The information patterns for adjective + noun were localized in its anterior part (BA45) whereas those for determiner + noun were localized in its posterior part (BA44). Our findings provide preliminary answers to the fundamental question of how lexical and grammatical category information interact during simple word combination, with the observation that Broca's area is sensitive to the recognition of categorical relationships during combinatory processing, based on different demands placed on syntactic and semantic information. This supports the hypothesis that the combinatorial power of language consists of some neural computation capturing phrasal differences when processing linguistic input.

Both activation and deactivation of functional networks support increased sentence processing costs

The research on the neural correlates underlying the language system has gradually moved away from the traditional Broca-Wernicke framework to a network perspective in the past 15 years. Language processing is found to be supported by the co-activation of both core and peripheral brain regions. However, the dynamic co-activation patterns of these brain regions serving different language functions remain to be fully revealed. The present functional magnetic resonance imaging (fMRI) study focused on sentence processing at different syntactic complexity levels to examine how the co-activation of different brain networks will be modulated by increased processing costs. Chinese relative clauses were used to probe the two dimensions of syntactic complexity: embeddedness (left-branching vs. center-embedded) and gap-filler dependency (subject-gap vs. object-gap) using the general linear model (GLM) approach, independent component analysis (ICA) and graph theoretical analysis. In contrast to localized activation revealed by the GLM approach, ICA identified more extensive networks both positively and negatively correlated with the task. We found that the posterior default mode network was anti-correlated to the gap-filler integration costs with increased deactivation for the left-branching object relative clauses compared to subject relative clauses, suggesting the involvement of this network in leveraging the cognitive resources based on the complexity level of the language task. Concurrent activation and deactivation of networks were found to be associated with the higher costs induced by center-embedding and its interaction with gap-filler integration. The graph theoretical analysis further unveiled that center-embeddedness imposed more attentional demand on the subject relative clause, as characterized by its higher degree and strength in the ventral attention network, and higher processing costs of syntactic reanalysis on the object relative clause, as characterized by increased intermodular connections of the language network with other networks. The results suggest that network activation and deactivation profiles are modulated by different dimensions of syntactic complexity to serve the higher demand of creating a coherent semantic representation.

A Computational Theory for the Emergence of Grammatical Categories in Cortical Dynamics

A general agreement in psycholinguistics claims that syntax and meaning are unified precisely and very quickly during online sentence processing. Although several theories have advanced arguments regarding the neurocomputational bases of this phenomenon, we argue that these theories could potentially benefit by including neurophysiological data concerning cortical dynamics constraints in brain tissue. In addition, some theories promote the integration of complex optimization methods in neural tissue. In this paper we attempt to fill these gaps introducing a computational model inspired in the dynamics of cortical tissue. In our modeling approach, proximal afferent dendrites produce stochastic cellular activations, while distal dendritic branches–on the other hand–contribute independently to somatic depolarization by means of dendritic spikes, and finally, prediction failures produce massive firing events preventing formation of sparse distributed representations. The model presented in this paper combines semantic and coarse-grained syntactic constraints for each word in a sentence context until grammatically related word function discrimination emerges spontaneously by the sole correlation of lexical information from different sources without applying complex optimization methods. By means of support vector machine techniques, we show that the sparse activation features returned by our approach are well suited—bootstrapping from the features returned by Word Embedding mechanisms—to accomplish grammatical function classification of individual words in a sentence. In this way we develop a biologically guided computational explanation for linguistically relevant unification processes in cortex which connects psycholinguistics to neurobiological accounts of language. We also claim that the computational hypotheses established in this research could foster future work on biologically-inspired learning algorithms for natural language processing applications.

Common Neural System for Sentence and Picture Comprehension Across Languages: A Chinese-Japanese Bilingual Study

While common semantic representations for individual words across languages have been identified, a common meaning system at sentence-level has not been determined. In this study, fMRI was used to investigate whether an across-language sentence comprehension system exists. Chinese–Japanese bilingual participants (n = 32) were asked to determine whether two consecutive stimuli were related (coherent) or not (incoherent) to the same event. Stimuli were displayed with three different modalities (Chinese written sentences, Japanese written sentences, and pictures). The behavioral results showed no significant difference in accuracy and response times among the three modalities. Multi-voxel pattern analysis (MVPA) of fMRI data was used to classify the semantic relationship (coherent or incoherent) across the stimulus modalities. The classifier was first trained to determine coherency within Chinese sentences and then tested with Japanese sentences, and vice versa. A whole-brain searchlight analysis revealed significant above-chance classification accuracy across Chinese and Japanese sentences in the supramarginal gyrus (BA 40), extending into the angular gyrus (BA 39) as well as the opercular (BA 44) and triangular (BA 45) parts of the inferior frontal gyrus in the left hemisphere (cluster-level FWE corrected p < 0.05). Significant above-chance classification accuracy was also found across Japanese sentences and pictures in the supramarginal (BA 40) and angular gyrus (BA 39). These results indicate that a common meaning system for sentence processing across languages and modalities exists, and it involves the left inferior parietal gyrus.

Neural networks for sentence comprehension and production: An ALE-based meta-analysis of neuroimaging studies

Comprehending and producing sentences is a complex endeavor requiring the coordinated activity of multiple brain regions. We examined three issues related to the brain networks underlying sentence comprehension and production in healthy individuals: First, which regions are recruited for sentence comprehension and sentence production? Second, are there differences for auditory sentence comprehension vs. visual sentence comprehension? Third, which regions are specifically recruited for the comprehension of syntactically complex sentences? Results from activation likelihood estimation (ALE) analyses (from 45 studies) implicated a sentence comprehension network occupying bilateral frontal and temporal lobe regions. Regions implicated in production (from 15 studies) overlapped with the set of regions associated with sentence comprehension in the left hemisphere, but did not include inferior frontal cortex, and did not extend to the right hemisphere. Modality differences between auditory and visual sentence comprehension were found principally in the temporal lobes. Results from the analysis of complex syntax (from 37 studies) showed engagement of left inferior frontal and posterior temporal regions, as well as the right insula. The involvement of the right hemisphere in the comprehension of these structures has potentially important implications for language treatment and recovery in individuals with agrammatic aphasia following left hemisphere brain damage.

Cortical regions supporting reading comprehension skill for single words and discourse

A substantial amount of variation in reading comprehension skill is explained by listening comprehension skill, suggesting tight links between printed and spoken discourse processing. In addition, both word level (e.g., vocabulary) and discourse-level sub-skills (e.g., inference-making) support overall comprehension. However, while these contributions to variation in comprehension skill have been well-studied behaviorally, the underlying neurobiological basis of these relationships is less well understood. In order to examine the neural bases of individual differences in reading comprehension as a function of input modality and processing level, we examined functional neural activation to both spoken and printed single words and passages in adolescents with a range of comprehension skill. Data driven Partial Least Squares Correlation (PLSC) analyses revealed that comprehension skill was positively related to activation in a number of regions associated with discourse comprehension and negatively related to activation in regions associated with executive function and memory across processing levels and input modalities.

Building by Syntax: The Neural Basis of Minimal Linguistic Structures

Language comes in utterances in which words are bound together according to a simple rule-based syntactic computation (merge), which creates linguistic hierarchies of potentially infinite length-phrases and sentences. In the current functional magnetic resonance imaging study, we compared prepositional phrases and sentences-both involving merge-to word lists-not involving merge-to explore how this process is implemented in the brain. We found that merge activates the pars opercularis of the left inferior frontal gyrus (IFG; Brodmann Area [BA] 44) and a smaller region in the posterior superior temporal sulcus (pSTS). Within the IFG, sentences engaged a more anterior portion of the area (pars triangularis, BA 45)-compared with phrases-which showed activity peak in BA 44. As prepositional phrases, in contrast to sentences, do not contain verbs, activity in BA 44 may reflect structure-building syntactic processing, while the involvement of BA 45 may reflect the encoding of propositional meaning initiated by the verb. The pSTS appears to work together with the IFG during thematic role assignment not only at the sentential level, but also at the phrasal level. The present results suggest that merge, the process of binding words together into syntactic hierarchies, is primarily supported by BA 44 in the IFG.

Functional organization of the language network in three- and six-year-old children

The organization of the language network undergoes continuous changes during development as children learn to understand sentences. In the present study, functional magnetic resonance imaging and behavioral measures were utilized to investigate functional activation and functional connectivity (FC) in three-year-old (3yo) and six-year-old (6yo) children during sentence comprehension. Transitive German sentences varying the word order (subject-initial and object-initial) with case marking were presented auditorily. We selected children who were capable of processing the subject-initial sentences above chance level accuracy from each age group to ensure that we were tapping real comprehension. Both age groups showed a main effect of word order in the left posterior superior temporal gyrus (pSTG), with greater activation for object-initial compared to subject-initial sentences. However, age differences were observed in the FC between left pSTG and the left inferior frontal gyrus (IFG). The 6yo group showed stronger FC between the left pSTG and Brodmann area (BA) 44 of the left IFG compared to the 3yo group. For the 3yo group, in turn, the FC between left pSTG and left BA 45 was stronger than with left BA 44. Our study demonstrates that while task-related activation was comparable, the small behavioral differences between age groups were reflected in the underlying functional organization revealing the ongoing development of the neural language network.

•

We examined functional connectivity of sentence processing in 3- and 6-year-olds.

•

Performance-matched age groups activated left pSTG for processing complex syntax.

•

6-year-olds had stronger connectivity between left BA44 and pSTG than 3-year-olds.

•

3-year-olds had greater connectivity between left BA45 and pSTG than BA44 and pSTG.

•

Functional connectivity results could be related to behavioral performance.

Eye Gaze Behavior at Turn Transition: How Aphasic Patients Process Speakers' Turns during Video Observation

The human turn-taking system regulates the smooth and precise exchange of speaking turns during face-to-face interaction. Recent studies investigated the processing of ongoing turns during conversation by measuring the eye movements of noninvolved observers. The findings suggest that humans shift their gaze in anticipation to the next speaker before the start of the next turn. Moreover, there is evidence that the ability to timely detect turn transitions mainly relies on the lexico-syntactic content provided by the conversation. Consequently, patients with aphasia, who often experience deficits in both semantic and syntactic processing, might encounter difficulties to detect and timely shift their gaze at turn transitions. To test this assumption, we presented video vignettes of natural conversations to aphasic patients and healthy controls, while their eye movements were measured. The frequency and latency of event-related gaze shifts, with respect to the end of the current turn in the videos, were compared between the two groups. Our results suggest that, compared with healthy controls, aphasic patients have a reduced probability to shift their gaze at turn transitions but do not show significantly increased gaze shift latencies. In healthy controls, but not in aphasic patients, the probability to shift the gaze at turn transition was increased when the video content of the current turn had a higher lexico-syntactic complexity. Furthermore, the results from voxel-based lesion symptom mapping indicate that the association between lexico-syntactic complexity and gaze shift latency in aphasic patients is predicted by brain lesions located in the posterior branch of the left arcuate fasciculus. Higher lexico-syntactic processing demands seem to lead to a reduced gaze shift probability in aphasic patients. This finding may represent missed opportunities for patients to place their contributions during everyday conversation.

The ontogeny of the cortical language network

Language-processing functions follow heterogeneous developmental trajectories. The human embryo can already distinguish vowels in utero, but grammatical complexity is usually not fully mastered until at least 7 years of age. Examining the current literature, we propose that the ontogeny of the cortical language network can be roughly subdivided into two main developmental stages. In the first stage extending over the first 3 years of life, the infant rapidly acquires bottom-up processing capacities, which are primarily implemented bilaterally in the temporal cortices. In the second stage continuing into adolescence, top-down processes emerge gradually with the increasing functional selectivity and structural connectivity of the left inferior frontal cortex.

How the brain attunes to sentence processing: Relating behavior, structure, and function

Unlike other aspects of language comprehension, the ability to process complex sentences develops rather late in life. Brain maturation as well as verbal working memory (vWM) expansion have been discussed as possible reasons. To determine the factors contributing to this functional development, we assessed three aspects in different age-groups (5–6 years, 7–8 years, and adults): first, functional brain activity during the processing of increasingly complex sentences; second, brain structure in language-related ROIs; and third, the behavioral comprehension performance on complex sentences and the performance on an independent vWM test. At the whole-brain level, brain functional data revealed a qualitatively similar neural network in children and adults including the left pars opercularis (PO), the left inferior parietal lobe together with the posterior superior temporal gyrus (IPL/pSTG), the supplementary motor area, and the cerebellum. While functional activation of the language-related ROIs PO and IPL/pSTG predicted sentence comprehension performance for all age-groups, only adults showed a functional selectivity in these brain regions with increased activation for more complex sentences. The attunement of both the PO and IPL/pSTG toward a functional selectivity for complex sentences is predicted by region-specific gray matter reduction while that of the IPL/pSTG is additionally predicted by vWM span. Thus, both structural brain maturation and vWM expansion provide the basis for the emergence of functional selectivity in language-related brain regions leading to more efficient sentence processing during development.

Merge in the Human Brain: A Sub-Region Based Functional Investigation in the Left Pars Opercularis

Language is thought to represent one of the most complex cognitive functions in humans. Here we break down complexity of language to its most basic syntactic computation which hierarchically binds single words together to form larger phrases and sentences. So far, the neural implementation of this basic operation has only been inferred indirectly from studies investigating more complex linguistic phenomena. In the present sub-region based functional magnetic resonance imaging (fMRI) study we directly assessed the neuroanatomical nature of this process. Our results showed that syntactic phrases—compared to word-list sequences—corresponded to increased neural activity in the ventral-anterior portion of the left pars opercularis [Brodmann Area (BA) 44], whereas the adjacently located deep frontal operculum/anterior insula (FOP/aINS), a phylogenetically older and less specialized region, was found to be equally active for both conditions. Crucially, the functional activity of syntactic binding was confined to one out of five clusters proposed by a recent fine-grained sub-anatomical parcellation for BA 44, with consistency across individuals. Neuroanatomically, the present results call for a redefinition of BA 44 as a region with internal functional specializations. Neurocomputationally, they support the idea of invariance within BA 44 in the location of activation across participants for basic syntactic building processing.

Preschoolers' brains rely on semantic cues prior to the mastery of syntax during sentence comprehension

Sentence comprehension requires the integration of both syntactic and semantic information, the acquisition of which seems to have different trajectories in the developing brain. Using functional magnetic resonance imaging, we examined the neural correlates underlying syntactic and semantic processing during auditory sentence comprehension as well as its development in preschool children by manipulating case marking and animacy hierarchy cues, respectively. A functional segregation was observed within Broca's area in the left inferior frontal gyrus for adults, where the pars opercularis was involved in syntactic processing and the pars triangularis in semantic processing. By contrast, five-year-old children sensitive to animacy hierarchy cues showed diffuse activation for semantic processing in the left inferior frontal and posterior temporal cortices. While no main effect of case marking was found in the left fronto-temporal language network, children with better syntactic skills showed greater neural responses for syntactically complex sentences, most prominently in the posterior superior temporal cortex. The current study provides both behavioral and neural evidence that five-year-old children compared to adults rely more on semantic information than on syntactic cues during sentence comprehension, but with the development of syntactic abilities, their brain activation in the left fronto-temporal network increases for syntactic processing.

•

Adults showed a functional segregation in Broca's area for syntax and semantics.

•

Brodmann Area (BA) 44 was involved in syntactic and BA 45 in semantic processing.

•

Preschoolers relied more on semantic animacy than on syntactic case marking cues.

•

Children showed adult-like left fronto-temporal activation for semantic processing.

•

The left fronto-temporal activation for syntax correlated with syntactic abilities.

How the brain learns how few are "many": An fMRI study of the flexibility of quantifier semantics

Previous work has shown that the meaning of a quantifier such as "many" or "few" depends in part on quantity. However, the meaning of a quantifier may vary depending on the context, e.g. in the case of common entities such as "many ants" (perhaps several thousands) compared to endangered species such as "many pandas" (perhaps a dozen). In a recent study (Heim et al., 2015 Front. Psychol.) we demonstrated that the relative meaning of "many" and "few" may be changed experimentally. In a truth value judgment task, displays with 40% of circles in a named color initially had a low probability of being labeled "many". After a training phase, the likelihood of acceptance 40% as "many" increased. Moreover, the semantic learning effect also generalized to the related quantifier "few" which had not been mentioned in the training phase. Thus, fewer 40% arrays were considered "few." In the present study, we tested the hypothesis that this semantic adaptation effect was supported by cytoarchitectonic Brodmann area (BA) 45 in Broca's region which may contribute to semantic evaluation in the context of language and quantification. In an event-related fMRI study, 17 healthy volunteers performed the same paradigm as in the previous behavioral study. We found a relative signal increase when comparing the critical, trained proportion to untrained proportions. This specific effect was found in left BA 45 for the trained quantifier "many", and in left BA 44 for both quantifiers, reflecting the semantic adjustment for the untrained but related quantifier "few." These findings demonstrate the neural basis for processing the flexible meaning of a quantifier, and illustrate the neuroanatomical structures that contribute to variable meanings that can be associated with a word when used in different contexts.

Brain structural correlates of complex sentence comprehension in children

Prior structural imaging studies found initial evidence for the link between structural gray matter changes and the development of language performance in children. However, previous studies generally only focused on sentence comprehension. Therefore, little is known about the relationship between structural properties of brain regions relevant to sentence processing and more specific cognitive abilities underlying complex sentence comprehension. In this study, whole-brain magnetic resonance images from 59 children between 5 and 8 years were assessed. Scores on a standardized sentence comprehension test determined grammatical proficiency of our participants. A confirmatory factory analysis corroborated a grammar-relevant and a verbal working memory-relevant factor underlying the measured performance. Voxel-based morphometry of gray matter revealed that while children's ability to assign thematic roles is positively correlated with gray matter probability (GMP) in the left inferior temporal gyrus and the left inferior frontal gyrus, verbal working memory-related performance is positively correlated with GMP in the left parietal operculum extending into the posterior superior temporal gyrus. Since these areas are known to be differentially engaged in adults' complex sentence processing, our data suggest a specific correspondence between children's GMP in language-relevant brain regions and differential cognitive abilities that guide their sentence comprehension.

Development of a selective left-hemispheric fronto-temporal network for processing syntactic complexity in language comprehension

The development of language comprehension abilities in childhood is closely related to the maturation of the brain, especially the ability to process syntactically complex sentences. Recent studies proposed that the fronto-temporal connection within left perisylvian regions, supporting the processing of syntactically complex sentences, is still immature at preschool age. In the current study, resting state functional magnetic resonance imaging data were acquired from typically developing 5-year-old children and adults to shed further light on the brain functional development. Children additionally performed a behavioral syntactic comprehension test outside the scanner. The amplitude of low-frequency fluctuations was analyzed in order to identify the functional correlation networks of language-relevant brain regions. Results showed an intrahemispheric correlation between left inferior frontal gyrus (IFG) and left posterior superior temporal sulcus (pSTS) in adults, whereas an interhemispheric correlation between left IFG and its right-hemispheric homolog was predominant in children. Correlation analysis between resting-state functional connectivity and sentence processing performance in 5-year-olds revealed that local connectivity within the left IFG is associated with competence of processing syntactically simple canonical sentences, while long-range connectivity between IFG and pSTS in left hemisphere is associated with competence of processing syntactically relatively more complex non-canonical sentences. The present developmental data suggest that a selective left fronto-temporal connectivity network for processing complex syntax is already in functional connection at the age of 5 years when measured in a non-task situation. The correlational findings provide new insight into the relationship between intrinsic functional connectivity and syntactic language abilities in preschool children.

•

resting state ALFF correlated in adults between left IFG and left pSTS.

•

resting state ALFF correlated in children between left IFG and right homolog area.

•

intrahemispheric connectivity co-varies with syntactic processing skills in children.

Fluency-dependent cortical activation associated with speech production and comprehension in second language learners

This functional magnetic resonance imaging (fMRI) study investigated the brain regions underlying language task performance in adult second language (L2) learners. Specifically, we identified brain regions where the level of activation was associated with L2 fluency levels. Thirty Japanese-speaking adults participated in the study. All participants were L2 learners of English and had achieved varying levels of fluency, as determined by a standardized L2 English proficiency test, the Versant English Test (Pearson Education Inc., 2011). When participants performed the oral sentence building task from the production tasks administered, the dorsal part of the left inferior frontal gyrus (dIFG) showed activation patterns that differed depending on the L2 fluency levels: The more fluent the participants were, the more dIFG activation decreased. This decreased activation of the dIFG might reflect the increased automaticity of a syntactic building process. In contrast, when participants performed an oral story comprehension task, the left posterior superior temporal gyrus (pSTG) showed increased activation with higher fluency levels. This suggests that the learners with higher L2 fluency were actively engaged in post-syntactic integration processing supported by the left pSTG. These data imply that L2 fluency predicts neural resource allocation during language comprehension tasks as well as in production tasks. This study sheds light on the neural underpinnings of L2 learning by identifying the brain regions recruited during different language tasks across different modalities (production vs. comprehension).

Localising semantic and syntactic processing in spoken and written language comprehension: an Activation Likelihood Estimation meta-analysis

We conducted an Activation Likelihood Estimation (ALE) meta-analysis to identify brain regions that are recruited by linguistic stimuli requiring relatively demanding semantic or syntactic processing. We included 54 functional MRI studies that explicitly varied the semantic or syntactic processing load, while holding constant demands on earlier stages of processing. We included studies that introduced a syntactic/semantic ambiguity or anomaly, used a priming manipulation that specifically reduced the load on semantic/syntactic processing, or varied the level of syntactic complexity. The results confirmed the critical role of the posterior left Inferior Frontal Gyrus (LIFG) in semantic and syntactic processing. These results challenge models of sentence comprehension highlighting the role of anterior LIFG for semantic processing. In addition, the results emphasise the posterior (but not anterior) temporal lobe for both semantic and syntactic processing.

Neural bases of event knowledge and syntax integration in comprehension of complex sentences

Comprehension of complex sentences is necessarily supported by both syntactic and semantic knowledge, but what linguistic factors trigger a readers' reliance on a specific system? This functional neuroimaging study orthogonally manipulated argument plausibility and verb event type to investigate cortical bases of the semantic effect on argument comprehension during reading. The data suggest that telic verbs facilitate online processing by means of consolidating the event schemas in episodic memory and by easing the computation of syntactico-thematic hierarchies in the left inferior frontal gyrus. The results demonstrate that syntax-semantics integration relies on trade-offs among a distributed network of regions for maximum comprehension efficiency.

Hierarchical processing in the prefrontal cortex in a variety of cognitive domains

This review scrutinizes several findings on human hierarchical processing within the prefrontal cortex (PFC) in diverse cognitive domains. Converging evidence from previous studies has shown that the PFC, specifically, BA44, may function as the essential region for hierarchical processing across the domains. In language fMRI studies, BA 44 was significantly activated for the hierarchical processing of center-embedded sentences and this pattern of activations was also observed in artificial grammar. The same pattern was observed in the visuo-spatial domain where BA44 was actively involved in the processing of hierarchy for the visual symbol. Musical syntax, which is the rule-based arrangement of musical sets, has also been construed as hierarchical processing as in the language domain such that the activation in BA44 was observed in a chord sequence paradigm. P600 ERP was also engendered during the processing of musical hierarchy. Along with a longstanding idea that a human's number faculty is developed as a "by-product of language faculty", BA44 was closely involved in hierarchical processing in mental arithmetic. This review extended its discussion of hierarchical "processing" to hierarchical "behavior", that is, human action which has been referred to as being hierarchically composed. Several lesion and TMS studies supported the involvement of BA44 for hierarchical processing in the action domain. Lastly, the hierarchical organization of cognitive controls was discussed within the PFC, forming a cascade of top-down hierarchical processes operating along a posterior-to-anterior axis of the lateral PFC including BA44 within the network. It is proposed that PFC is actively involved in different forms of hierarchical processing and specifically BA44 may play an integral role in the process. Taking levels of proficiency and subcortical areas into consideration may provide further insight into the functional role of BA44 for hierarchical processing.

Common molecular basis of the sentence comprehension network revealed by neurotransmitter receptor fingerprints

The language network is a well-defined large-scale neural network of anatomically and functionally interacting cortical areas. The successful language process requires the transmission of information between these areas. Since neurotransmitter receptors are key molecules of information processing, we hypothesized that cortical areas which are part of the same functional language network may show highly similar multireceptor expression pattern ("receptor fingerprint"), whereas those that are not part of this network should have different fingerprints. Here we demonstrate that the relation between the densities of 15 different excitatory, inhibitory and modulatory receptors in eight language-related areas are highly similar and differ considerably from those of 18 other brain regions not directly involved in language processing. Thus, the fingerprints of all cortical areas underlying a large-scale cognitive domain such as language is a characteristic, functionally relevant feature of this network and an important prerequisite for the underlying neuronal processes of language functions.

Syntax gradually segregates from semantics in the developing brain

An essential computational component of the human language faculty is syntax as it regulates how words are combined into sentences. Although its neuroanatomical basis is well-specified in adults, its emergence in the maturing brain is not yet understood. Using event-related functional magnetic resonance imaging (fMRI) in a cross-sectional design, we discovered, that in contrast to what is known about adults 3-to-4- and 6-to-7-year-old children do not process syntax independently from semantics at the neural level already before these two types of information are integrated for the interpretation of a sentence. It is not until the end of the 10th year of life that children show a neural selectivity for syntax, segregated and gradually independent from semantics, in the left inferior frontal cortex as in the adult brain. Our results indicate that it takes until early adolescence for the domain-specific selectivity of syntax within the language network to develop.

The neural bases of argument structure processing revealed by primed lexical decision

Previous studies have reported anticipatory effects during sentence processing. However, the source of these effects has not been clearly characterized. This study investigated the hypothesis that one source of anticipatory effects, particularly during verb processing, is the automatic triggering of argument structure processes. If argument structure processes are automatically triggered it was hypothesized that the task need not require the initiation of the process, as such a primed lexical decision task was used that examined the neural priming of cross-grammatical class prime pairs (e.g., verb-noun priming). While previous studies, as does the current study, have revealed behavioral priming for cross-grammatical class and within-class (noun-noun and verb-verb) prime/target pairs, the current results revealed significant activation differences. Enhancement effects were observed for cross-grammatical class priming in the language network, particularly the inferior frontal gyrus (BA 47), and the posterior temporal cortex. Both regions have been linked to argument structure processing previously. Within-class priming resulted in neural suppression of the inferior temporal/occipital regions. Together, the data presented suggest the automatic triggering of argument structure representations and demonstrate that priming is a fruitful mechanism to explore aspects of sentence processing.

Does degree of handedness in a group of right-handed individuals affect language comprehension?

The impact of handedness on language processing has been studied extensively and the results indicate that there is a relationship between the two variables; however, the nature of the relationship is not at all clear. In the current study we explored degree of handedness (DH) opposed to direction in a group of right-handed individuals. fMRI was used to explore the impact of DH on the sentence comprehension network. The results revealed that during sentence comprehension activation in regions linked to semantic memory (e.g., anterior temporal cortex) were modulated by DH. Also, unexpectedly the precuneus/posterior cingulate gyrus which has been linked to episodic memory was also affected by DH. These results extend those reported previously by showing that the neural architecture that supports sentence comprehension is modulated by DH. More specifically, together the results presented here support the hypothesis proposed by Townsend, Carrithers, and Bever (2001) that DH interacts with the language system and impacts the strategy used during sentence comprehension.

Two principles of organization in the prefrontal cortex are cognitive hierarchy and degree of automaticity

The lateral prefrontal cortex is known to be organized by cognitive hierarchies following a posterior-to-anterior gradient. Here we test whether this model applies across different cognitive domains by varying levels of cognitive hierarchy in first language, second language and non-language domains. These domains vary in their degree of automaticity with first language being the most automatic. For second language/non-language a clear gradient pattern of activation depending on the level of hierarchy is observed in the prefrontal cortex with the highest level of hierarchy recruiting its most anterior region, whereas for first language the highest level of hierarchy recruits its most posterior region. Moreover, second language/non-language and first language differ in the structural connectivity of their underlying networks. The current data strongly suggest that functional segregation of the prefrontal cortex is determined by cognitive hierarchy and the degree of automaticity.

Neural basis of semantic and syntactic interference in sentence comprehension

According to the cue-based parsing approach (Lewis, Vasishth, & Van Dyke, 2006), sentence comprehension difficulty derives from interference from material that partially matches syntactic and semantic retrieval cues. In a 2 (low vs. high semantic interference)×2 (low vs. high syntactic interference) fMRI study, greater activation was observed in left BA44/45 for high versus low syntactic interference conditions following sentences and in left BA45/47 for high versus low semantic interference conditions following comprehension questions. A conjunction analysis showed BA45 associated with both types of interference, while BA47 was associated with only semantic interference. Greater activation was also observed in the left STG in the high interference conditions. Importantly, the results for the LIFG could not be attributed to greater working memory capacity demands for high interference conditions. The results favor a fractionation of the LIFG wherein BA45 is associated with post-retrieval selection and BA47 with controlled retrieval of semantic information.

Adaptive significance of right hemisphere activation in aphasic language comprehension

Aphasic patients often exhibit increased right hemisphere activity during language tasks. This may represent takeover of function by regions homologous to the left-hemisphere language networks, maladaptive interference, or adaptation of alternate compensatory strategies. To distinguish between these accounts, we tested language comprehension in 25 aphasic patients using an online sentence-picture matching paradigm while measuring brain activation with MEG. Linguistic conditions included semantically irreversible ("The boy is eating the apple") and reversible ("The boy is pushing the girl") sentences at three levels of syntactic complexity. As expected, patients performed well above chance on irreversible sentences, and at chance on reversible sentences of high complexity. Comprehension of reversible non-complex sentences ranged from nearly perfect to chance, and was highly correlated with offline measures of language comprehension. Lesion analysis revealed that comprehension deficits for reversible sentences were predicted by damage to the left temporal lobe. Although aphasic patients activated homologous areas in the right temporal lobe, such activation was not correlated with comprehension performance. Rather, patients with better comprehension exhibited increased activity in dorsal fronto-parietal regions. Correlations between performance and dorsal network activity occurred bilaterally during perception of sentences, and in the right hemisphere during a post-sentence memory delay. These results suggest that effortful reprocessing of perceived sentences in short-term memory can support improved comprehension in aphasia, and that strategic recruitment of alternative networks, rather than homologous takeover, may account for some findings of right hemisphere language activation in aphasia.

Hierarchical functional connectivity between the core language system and the working memory system

Language processing inevitably involves working memory (WM) operations, especially for sentences with complex syntactic structures. Evidence has been provided for a neuroanatomical segregation between core syntactic processes and WM, but the dynamic relation between these systems still has to be explored. In the present functional magnetic resonance imaging (fMRI) study, we investigated the network dynamics of regions involved in WM operations which support sentence processing during reading, comparing a set of dynamic causal models (DCM) with different assumptions about the underlying connectional architecture. The DCMs incorporated the core language processing regions (pars opercularis and middle temporal gyrus), WM related regions (inferior frontal sulcus and intraparietal sulcus), and visual word form area (fusiform gyrus). The results indicate a processing hierarchy from the visual to WM to core language systems, and moreover, a clear increase of connectivity between WM regions and language regions as the processing load increases for syntactically complex sentences.

The language network

Language processing is supported by different regions located in separate parts of the brain. A crucial condition for these regions to function as a network is the information transfer between them. This is guaranteed by dorsal and ventral pathways connecting prefrontal and temporal language-relevant regions. Based on functional brain imaging studies, these pathways' language functions can be assigned indirectly. Dorsally, one pathway connecting the temporal cortex (TC) and premotor cortex supports speech repetition, another one connecting the TC and posterior Broca's area supports complex syntactic processes. Ventrally, the uncinate fascile and the inferior fronto-occipital fascile subserve semantic and basic syntactic processes. Thus, the available evidence points towards a neural language network with at least two dorsal and two ventral pathways.

The effect of individual differences in working memory capacity on sentence comprehension: an FMRI study

This study explores the interaction between working memory systems and language processing by examining how differences in working memory capacity (WMC) modulates neural activation levels and functional connectivity during sentence comprehension. The results indicate that two working memory systems may be involved in sentence comprehension, the verbal working memory system and the episodic buffer, but during different phases of the task. A sub-region of the left inferior frontal gyrus (BA 45) was correlated with WMC during the probe and not during sentence reading while the only region to reveal a correlation with WMC during sentence reading was the posterior cingulate/precuneus area, a region linked to event representation. In addition, functional connectivity analysis suggests that there were two distinct networks affected by WMC. The first was a semantic network that included the middle temporal cortex, an anterior region of the inferior frontal gyrus and the inferior parietal region. The second included the posterior cingulate and BA 45 of the inferior frontal gyrus. We propose here that high capacity readers may generate an event representation of the sentence during reading that aids in comprehension and that this event representation involves the processing of the posterior cingulate cortex.

An approach to separating the levels of hierarchical structure building in language and mathematics

We aimed to dissociate two levels of hierarchical structure building in language and mathematics, namely 'first-level' (the build-up of hierarchical structure with externally given elements) and 'second-level' (the build-up of hierarchical structure with internally represented elements produced by first-level processes). Using functional magnetic resonance imaging, we investigated these processes in three domains: sentence comprehension, arithmetic calculation (using Reverse Polish notation, which gives two operands followed by an operator) and a working memory control task. All tasks required the build-up of hierarchical structures at the first- and second-level, resulting in a similar computational hierarchy across language and mathematics, as well as in a working memory control task. Using a novel method that estimates the difference in the integration cost for conditions of different trial durations, we found an anterior-to-posterior functional organization in the prefrontal cortex, according to the level of hierarchy. Common to all domains, the ventral premotor cortex (PMv) supports first-level hierarchy building, while the dorsal pars opercularis (POd) subserves second-level hierarchy building, with lower activation for language compared with the other two tasks. These results suggest that the POd and the PMv support domain-general mechanisms for hierarchical structure building, with the POd being uniquely efficient for language.

Subdivision of frontal cortex mechanisms for language production in aphasia

Ventrolateral prefrontal cortex (VLPFC) has long been linked to language production, but the precise mechanisms are still being elucidated. Using neuropsychological case studies, we explored possible sub-specialization within this region for different linguistic and executive functions. Frontal patients with different lesion profiles completed two sequencing tasks, which were hypothesized to engage partially overlapping components. The multi-word priming task tested the sequencing of co-activated representations and the overriding of primed word orders. The sequence reproduction task tested the sequencing of co-activated representations, but did not employ a priming manipulation. We compared patients' performance on the two tasks to that of healthy, age-matched controls. Results are partially consistent with an anterior-posterior gradient of cognitive control within lateral prefrontal cortex (Koechlin & Summerfield, 2007). However, we also found a stimulus-specific pattern, which suggests that sub-specialization might be contingent on type of representation as well as type of control signal. Isolating such components functionally and anatomically might lead to a better understanding of language production deficits in aphasia.

Old proverbs in new skins - an FMRI study on defamiliarization

We investigated how processing fluency and defamiliarization (the art of rendering familiar notions unfamiliar) contribute to the affective and esthetic processing of reading in an event-related functional magnetic-resonance-imaging experiment. We compared the neural correlates of processing (a) familiar German proverbs, (b) unfamiliar proverbs, (c) defamiliarized variations with altered content relative to the original proverb (proverb-variants), (d) defamiliarized versions with unexpected wording but the same content as the original proverb (proverb-substitutions), and (e) non-rhetorical sentences. Here, we demonstrate that defamiliarization is an effective way of guiding attention, but that the degree of affective involvement depends on the type of defamiliarization: enhanced activation in affect-related regions (orbito-frontal cortex, medPFC) was found only if defamiliarization altered the content of the original proverb. Defamiliarization on the level of wording was associated with attention processes and error monitoring. Although proverb-variants evoked activation in affect-related regions, familiar proverbs received the highest beauty ratings.

The cortical language circuit: from auditory perception to sentence comprehension

Over the years, a large body of work on the brain basis of language comprehension has accumulated, paving the way for the formulation of a comprehensive model. The model proposed here describes the functional neuroanatomy of the different processing steps from auditory perception to comprehension as located in different gray matter brain regions. It also specifies the information flow between these regions, taking into account white matter fiber tract connections. Bottom-up, input-driven processes proceeding from the auditory cortex to the anterior superior temporal cortex and from there to the prefrontal cortex, as well as top-down, controlled and predictive processes from the prefrontal cortex back to the temporal cortex are proposed to constitute the cortical language circuit.

Processing noncanonical sentences in broca's region: reflections of movement distance and type

Various noncanonical sentence constructions are derived from basic sentence structures by a phrase displacement called Movement. The moved phrase (filler) leaves a silent copy at the extracted position (gap) and is reactivated when the hearer/reader passes over the gap. Consequently, memory operations are assumed to occur to establish the filler-gap link. For languages that have a relatively free word order like German, a distinct linguistic operation called Scrambling is proposed. Although Movement and Scrambling are assumed to be different linguistic operations, they both involve memory prone filler-gap processes. To clarify whether filler-gap memory processes in Scrambling and Movement differ neuroanatomically, we designed a functional magnetic resonance imaging study and compared the effect of memory load parameterized by filler-gap distance in the 2 sentence types. Here, we show that processing of the 2 sentence types commonly relies on a left hemispheric network consisting of the inferior frontal gyrus, middle part of the middle temporal gyrus, and intraparietal sulcus. However, we found differences for the 2 sentence types in the linearity of filler-gap distance effect. Thus, the present results suggest that the same neural substrate supports the memory processes of sentences constructed by Movement and Scrambling, although differentially modulated by memory load.