PET studies of syntactic processing with auditory sentence presentation

Engagement of the speech motor system in challenging speech perception: Activation likelihood estimation meta-analyses

The relationship between speech production and perception is a topic of ongoing debate. Some argue that there is little interaction between the two, while others claim they share representations and processes. One perspective suggests increased recruitment of the speech motor system in demanding listening situations to facilitate perception. However, uncertainties persist regarding the specific regions involved and the listening conditions influencing its engagement. This study used activation likelihood estimation in coordinate-based meta-analyses to investigate the neural overlap between speech production and three speech perception conditions: speech-in-noise, spectrally degraded speech and linguistically complex speech. Neural overlap was observed in the left frontal, insular and temporal regions. Key nodes included the left frontal operculum (FOC), left posterior lateral part of the inferior frontal gyrus (IFG), left planum temporale (PT), and left pre-supplementary motor area (pre-SMA). The left IFG activation was consistently observed during linguistic processing, suggesting sensitivity to the linguistic content of speech. In comparison, the left pre-SMA activation was observed when processing degraded and noisy signals, indicating sensitivity to signal quality. Activations of the left PT and FOC activation were noted in all conditions, with the posterior FOC area overlapping in all conditions. Our meta-analysis reveals context-independent (FOC, PT) and context-dependent (pre-SMA, posterior lateral IFG) regions within the speech motor system during challenging speech perception. These regions could contribute to sensorimotor integration and executive cognitive control for perception and production.

Enhanced activations in the dorsal inferior frontal gyrus specifying the who, when, and what for successful building of sentence structures in a new language

It has been argued that the principles constraining first language acquisition also constrain second language acquisition; however, neuroscientific evidence for this is scant, and even less for third and subsequent languages. We conducted fMRI experiments to evaluate this claim by focusing on the building of complex sentence structures in Kazakh, a new language for participants having acquired at least two languages. The participants performed grammaticality judgment and subject-verb matching tasks with spoken sentences. We divided the participants into two groups based on the performance levels attained in one of the experimental tasks: High in Group I and Low in Group II. A direct comparison of the two groups, which examined those participants who parsed the structures, indicated significantly stronger activations for Group I in the dorsal left inferior frontal gyrus (L. IFG). Focusing on Group I, we tested the contrast between the initial and final phases in our testing, which examined when the structures were parsed, as well as the contrast which examined what structures were parsed. These analyses further demonstrated focal activations in the dorsal L. IFG alone. Among the individual participants, stronger activation in the dorsal L. IFG, measured during the sentence presentations, predicted higher accuracy rates and shorter response times for executing the tasks that followed. These results cannot be explained by task difficulty or memory loads, and they, instead, indicate a critical and consistent role of the dorsal L. IFG during the initial to intermediate stages of grammar acquisition in a new target language. Such functional specificity of the dorsal L. IFG provides neuroscientific evidence consistent with the claims made by the Cumulative-Enhancement model in investigating language acquisition beyond target second and third languages.

A subject relative clause preference in a split-ergative language: ERP evidence from Georgian

A fascinating descriptive property of human language processing whose explanation is still debated is that subject-gap relative clauses are easier to process than object-gap relative clauses, across a broad range of languages with different properties. However, recent work suggests that this generalization does not hold in Basque, an ergative language, and has motivated an alternative generalization in which the preference is for gaps in morphologically unmarked positions-subjects in nominative-accusative languages, and objects and intransitive subjects in ergative-absolutive languages. Here we examined whether this generalization extends to another ergative-absolutive language, Georgian. ERP and self-paced reading results show a large anterior negativity and slower reading times when a relative clause is disambiguated to an object relative vs a subject relative. These data thus suggest that in at least some ergative-absolutive languages, the classic descriptive generalization-that object relative clauses are more costly than subject relative clauses-still holds.

German Language Adaptation of the NAVS (NAVS-G) and of the NAT (NAT-G): Testing Grammar in Aphasia

Grammar provides the framework for understanding and producing language. In aphasia, an acquired language disorder, grammatical deficits are diversified and widespread. However, the few assessments for testing grammar in the German language do not consider current linguistic, psycholinguistic, and functional imaging data, which have been shown to be crucial for effective treatment. This study developed German language versions of the Northwestern Assessment of Verbs and Sentences (NAVS-G) and the Northwestern Anagram Test (NAT-G) to examine comprehension and production of verbs, controlling for the number and optionality of verb arguments, and sentences with increasing syntactic complexity. The NAVS-G and NAT-G were tested in 27 healthy participants, 15 right hemispheric stroke patients without aphasia, and 15 stroke patients with mild to residual aphasia. Participants without aphasia showed near-perfect performance, with the exception of (object) relative sentences, where accuracy was associated with educational level. In each patient with aphasia, deficits in more than one subtest were observed. The within and between population-groups logistic mixed regression analyses identified significant impairments in processing syntactic complexity at the verb and sentence levels. These findings indicate that the NAVS-G and NAT-G have potential for testing grammatical competence in (German) stroke patients.

Age-related effects on the neural processing of semantic complexity in a continuous narrative: Modulation by gestures already present in young to middle-aged adults

The processing of semantically complex speech is a demanding task which can be facilitated by speech-associated arm and hand gestures. However, the role of age concerning the perception of semantic complexity and the influence of gestures in this context remains unclear. The goal of this study was to investigate if age-related differences are already present in early adulthood during the processing of semantic complexity and gestures. To this end, we analyzed fMRI images of a sample of 38 young and middle-aged participants (age-range: 19-55). They had the task to listen and to watch a narrative. The narrative contained segments varying in the degree of semantic complexity, and they were spontaneously accompanied by gestures. The semantic complexity of the story was measured by the idea density. Consistent with previous findings in young adults, we observed increased activation for passages with lower compared to higher complexity in bilateral temporal areas and the precuneus. BOLD signal in the left frontal and left parietal regions correlated during the perception of complex passages with increasing age. This correlation was reduced for passages presented with gestures. Median-split based post-hoc comparisons confirmed that group differences between younger (19-23 years) and older adults within the early adult lifespan (24-55 years) were significantly reduced in passages with gestures. Our results suggest that older adults within early adulthood adapt to the requirements of highly complex passages activating additional regions when no gesture information is available. Gestures might play a facilitative role with increasing age, especially when speech is complex.

Both activation and deactivation of functional networks support increased sentence processing costs

The research on the neural correlates underlying the language system has gradually moved away from the traditional Broca-Wernicke framework to a network perspective in the past 15 years. Language processing is found to be supported by the co-activation of both core and peripheral brain regions. However, the dynamic co-activation patterns of these brain regions serving different language functions remain to be fully revealed. The present functional magnetic resonance imaging (fMRI) study focused on sentence processing at different syntactic complexity levels to examine how the co-activation of different brain networks will be modulated by increased processing costs. Chinese relative clauses were used to probe the two dimensions of syntactic complexity: embeddedness (left-branching vs. center-embedded) and gap-filler dependency (subject-gap vs. object-gap) using the general linear model (GLM) approach, independent component analysis (ICA) and graph theoretical analysis. In contrast to localized activation revealed by the GLM approach, ICA identified more extensive networks both positively and negatively correlated with the task. We found that the posterior default mode network was anti-correlated to the gap-filler integration costs with increased deactivation for the left-branching object relative clauses compared to subject relative clauses, suggesting the involvement of this network in leveraging the cognitive resources based on the complexity level of the language task. Concurrent activation and deactivation of networks were found to be associated with the higher costs induced by center-embedding and its interaction with gap-filler integration. The graph theoretical analysis further unveiled that center-embeddedness imposed more attentional demand on the subject relative clause, as characterized by its higher degree and strength in the ventral attention network, and higher processing costs of syntactic reanalysis on the object relative clause, as characterized by increased intermodular connections of the language network with other networks. The results suggest that network activation and deactivation profiles are modulated by different dimensions of syntactic complexity to serve the higher demand of creating a coherent semantic representation.

Brain Damage Associated with Impaired Sentence Processing in Acute Aphasia

Left-hemisphere brain damage commonly affects patients' abilities to produce and comprehend syntactic structures, a condition typically referred to as "agrammatism." The neural correlates of agrammatism remain disputed in the literature, and distributed areas have been implicated as important predictors of performance, for example, Broca's area, anterior temporal areas, and temporo-parietal areas. We examined the association between damage to specific language-related ROIs and impaired syntactic processing in acute aphasia. We hypothesized that damage to the posterior middle temporal gyrus, and not Broca's area, would predict syntactic processing abilities. One hundred four individuals with acute aphasia (<20 days poststroke) were included in the study. Structural MRI scans were obtained, and all participants completed a 45-item sentence-picture matching task. We performed an ROI-based stepwise regression analyses to examine the relation between cortical brain damage and impaired comprehension of canonical and noncanonical sentences. Damage to the posterior middle temporal gyrus was the strongest predictor for overall task performance and performance on noncanonical sentences. Damage to the angular gyrus was the strongest predictor for performance on canonical sentences, and damage to the posterior superior temporal gyrus predicted noncanonical scores when performance on canonical sentences was included as a cofactor. Overall, our models showed that damage to temporo-parietal and posterior temporal areas was associated with impaired syntactic comprehension. Our results indicate that the temporo-parietal area is crucially implicated in complex syntactic processing, whereas the role of Broca's area may be complementary.

Neural Mechanisms Underlying the Processing of Complex Sentences: An fMRI Study

Previous research has shown effects of syntactic complexity on sentence processing. In linguistics, syntactic complexity (caused by different word orders) is traditionally explained by distinct linguistic operations. This study investigates whether different complex word orders indeed result in distinct patterns of neural activity, as would be expected when distinct linguistic operations are applied. Twenty-two older adults performed an auditory sentence processing paradigm in German with and without increased cognitive load. The results show that without increased cognitive load, complex sentences show distinct activation patterns compared with less complex, canonical sentences: complex object-initial sentences show increased activity in the left inferior frontal and temporal regions, whereas complex adjunct-initial sentences show increased activity in occipital and right superior frontal regions. Increased cognitive load seems to affect the processing of different sentence structures differently, increasing neural activity for canonical sentences, but leaving complex sentences relatively unaffected. We discuss these results in the context of the idea that linguistic operations required for processing sentence structures with higher levels of complexity involve distinct brain operations.

Neural Connectivity in Syntactic Movement Processing

Linguistic theory suggests non-canonical sentences subvert the dominant agent-verb-theme order in English via displacement of sentence constituents to argument (NP-movement) or non-argument positions (wh-movement). Both processes have been associated with the left inferior frontal gyrus and posterior superior temporal gyrus, but differences in neural activity and connectivity between movement types have not been investigated. In the current study, functional magnetic resonance imaging data were acquired from 21 adult participants during an auditory sentence-picture verification task using passive and active sentences contrasted to isolate NP-movement, and object- and subject-cleft sentences contrasted to isolate wh-movement. Then, functional magnetic resonance imaging data from regions common to both movement types were entered into a dynamic causal modeling analysis to examine effective connectivity for wh-movement and NP-movement. Results showed greater left inferior frontal gyrus activation for Wh > NP-movement, but no activation for NP > Wh-movement. Both types of movement elicited activity in the opercular part of the left inferior frontal gyrus, left posterior superior temporal gyrus, and left medial superior frontal gyrus. The dynamic causal modeling analyses indicated that neither movement type significantly modulated the connection from the left inferior frontal gyrus to the left posterior superior temporal gyrus, nor vice-versa, suggesting no connectivity differences between wh- and NP-movement. These findings support the idea that increased complexity of wh-structures, compared to sentences with NP-movement, requires greater engagement of cognitive resources via increased neural activity in the left inferior frontal gyrus, but both movement types engage similar neural networks.

Neural networks for sentence comprehension and production: An ALE-based meta-analysis of neuroimaging studies

Comprehending and producing sentences is a complex endeavor requiring the coordinated activity of multiple brain regions. We examined three issues related to the brain networks underlying sentence comprehension and production in healthy individuals: First, which regions are recruited for sentence comprehension and sentence production? Second, are there differences for auditory sentence comprehension vs. visual sentence comprehension? Third, which regions are specifically recruited for the comprehension of syntactically complex sentences? Results from activation likelihood estimation (ALE) analyses (from 45 studies) implicated a sentence comprehension network occupying bilateral frontal and temporal lobe regions. Regions implicated in production (from 15 studies) overlapped with the set of regions associated with sentence comprehension in the left hemisphere, but did not include inferior frontal cortex, and did not extend to the right hemisphere. Modality differences between auditory and visual sentence comprehension were found principally in the temporal lobes. Results from the analysis of complex syntax (from 37 studies) showed engagement of left inferior frontal and posterior temporal regions, as well as the right insula. The involvement of the right hemisphere in the comprehension of these structures has potentially important implications for language treatment and recovery in individuals with agrammatic aphasia following left hemisphere brain damage.

Morpho-syntactic complexity modulates brain activation in Persian-English bilinguals: An fMRI study

The Persian language can be considered to have a relatively more complex and combinatorial morpho-syntax than languages like Chinese and English. For example, the Persian verbal system is largely constituted of light verb constructions, in which light verbs are combined with specific items coming from other grammatical classes to generate entirely new verbal entities. This study was designed to examine the mediating effect of language-inherent properties related to morpho-syntax on activation of the left inferior frontal gyrus (LIFG), a brain area involved in morpho-syntactic processing. To this end, 20 late Persian-English bilinguals were required to covertly generate verbs and nouns from object and action pictures, within a cued grammatical context. Consistent with predictions, the results of an ROI analysis revealed an interaction between task and language in BA 44 of the LIFG and its right homologue, with greater activation of this region during the production of Persian compared to English verbs. In contrast, there was greater activation of the BA 44 during the production of English compared to Persian nouns, consistent with the more effortful processing of their less proficient second language (English). The findings suggest that language-specific properties such as morpho-syntactic complexity can modulate the recruitment of Broca's area, over and above the more well-documented effects of language proficiency.

Listening under difficult conditions: An activation likelihood estimation meta-analysis

The brain networks supporting speech identification and comprehension under difficult listening conditions are not well specified. The networks hypothesized to underlie effortful listening include regions responsible for executive control. We conducted meta-analyses of auditory neuroimaging studies to determine whether a common activation pattern of the frontal lobe supports effortful listening under different speech manipulations. Fifty-three functional neuroimaging studies investigating speech perception were divided into three independent Activation Likelihood Estimate analyses based on the type of speech manipulation paradigm used: Speech-in-noise (SIN, 16 studies, involving 224 participants); spectrally degraded speech using filtering techniques (15 studies involving 270 participants); and linguistic complexity (i.e., levels of syntactic, lexical and semantic intricacy/density, 22 studies, involving 348 participants). Meta-analysis of the SIN studies revealed higher effort was associated with activation in left inferior frontal gyrus (IFG), left inferior parietal lobule, and right insula. Studies using spectrally degraded speech demonstrated increased activation of the insula bilaterally and the left superior temporal gyrus (STG). Studies manipulating linguistic complexity showed activation in the left IFG, right middle frontal gyrus, left middle temporal gyrus and bilateral STG. Planned contrasts revealed left IFG activation in linguistic complexity studies, which differed from activation patterns observed in SIN or spectral degradation studies. Although there were no significant overlap in prefrontal activation across these three speech manipulation paradigms, SIN and spectral degradation showed overlapping regions in left and right insula. These findings provide evidence that there is regional specialization within the left IFG and differential executive networks underlie effortful listening.

Explicit Performance in Girls and Implicit Processing in Boys: A Simultaneous fNIRS-ERP Study on Second Language Syntactic Learning in Young Adolescents

Learning a second language (L2) proceeds with individual approaches to proficiency in the language. Individual differences including sex, as well as working memory (WM) function appear to have strong effects on behavioral performance and cortical responses in L2 processing. Thus, by considering sex and WM capacity, we examined neural responses during L2 sentence processing as a function of L2 proficiency in young adolescents. In behavioral tests, girls significantly outperformed boys in L2 tests assessing proficiency and grammatical knowledge, and in a reading span test (RST) assessing WM capacity. Girls, but not boys, showed significant correlations between L2 tests and RST scores. Using functional near-infrared spectroscopy (fNIRS) and event-related potential (ERP) simultaneously, we measured cortical responses while participants listened to syntactically correct and incorrect sentences. ERP data revealed a grammaticality effect only in boys in the early time window (100–300 ms), implicated in phrase structure processing. In fNIRS data, while boys had significantly increased activation in the left prefrontal region implicated in syntactic processing, girls had increased activation in the posterior language-related region involved in phonology, semantics, and sentence processing with proficiency. Presumably, boys implicitly focused on rule-based syntactic processing, whereas girls made full use of linguistic knowledge and WM function. The present results provide important fundamental data for learning and teaching in L2 education.

The Neurobiology of Agrammatic Sentence Comprehension: A Lesion Study

Broca's area has long been implicated in sentence comprehension. Damage to this region is thought to be the central source of "agrammatic comprehension" in which performance is substantially worse (and near chance) on sentences with noncanonical word orders compared with canonical word order sentences (in English). This claim is supported by functional neuroimaging studies demonstrating greater activation in Broca's area for noncanonical versus canonical sentences. However, functional neuroimaging studies also have frequently implicated the anterior temporal lobe (ATL) in sentence processing more broadly, and recent lesion-symptom mapping studies have implicated the ATL and mid temporal regions in agrammatic comprehension. This study investigates these seemingly conflicting findings in 66 left-hemisphere patients with chronic focal cerebral damage. Patients completed two sentence comprehension measures, sentence-picture matching and plausibility judgments. Patients with damage including Broca's area (but excluding the temporal lobe; n = 11) on average did not exhibit the expected agrammatic comprehension pattern-for example, their performance was >80% on noncanonical sentences in the sentence-picture matching task. Patients with ATL damage ( n = 18) also did not exhibit an agrammatic comprehension pattern. Across our entire patient sample, the lesions of patients with agrammatic comprehension patterns in either task had maximal overlap in posterior superior temporal and inferior parietal regions. Using voxel-based lesion-symptom mapping, we find that lower performances on canonical and noncanonical sentences in each task are both associated with damage to a large left superior temporal-inferior parietal network including portions of the ATL, but not Broca's area. Notably, however, response bias in plausibility judgments was significantly associated with damage to inferior frontal cortex, including gray and white matter in Broca's area, suggesting that the contribution of Broca's area to sentence comprehension may be related to task-related cognitive demands.

Domain-General Brain Regions Do Not Track Linguistic Input as Closely as Language-Selective Regions

Language comprehension engages a cortical network of left frontal and temporal regions. Activity in this network is language-selective, showing virtually no modulation by nonlinguistic tasks. In addition, language comprehension engages a second network consisting of bilateral frontal, parietal, cingulate, and insular regions. Activity in this "multiple demand" (MD) network scales with comprehension difficulty, but also with cognitive effort across a wide range of nonlinguistic tasks in a domain-general fashion. Given the functional dissociation between the language and MD networks, their respective contributions to comprehension are likely distinct, yet such differences remain elusive. Prior neuroimaging studies have suggested that activity in each network covaries with some linguistic features that, behaviorally, influence on-line processing and comprehension. This sensitivity of the language and MD networks to local input characteristics has often been interpreted, implicitly or explicitly, as evidence that both networks track linguistic input closely, and in a manner consistent across individuals. Here, we used fMRI to directly test this assumption by comparing the BOLD signal time courses in each network across different people (n = 45, men and women) listening to the same story. Language network activity showed fewer individual differences, indicative of closer input tracking, whereas MD network activity was more idiosyncratic and, moreover, showed lower reliability within an individual across repetitions of a story. These findings constrain cognitive models of language comprehension by suggesting a novel distinction between the processes implemented in the language and MD networks.SIGNIFICANCE STATEMENT Language comprehension recruits both language-specific mechanisms and domain-general mechanisms that are engaged in many cognitive processes. In the human cortex, language-selective mechanisms are implemented in the left-lateralized "core language network", whereas domain-general mechanisms are implemented in the bilateral "multiple demand" (MD) network. Here, we report the first direct comparison of the respective contributions of these networks to naturalistic story comprehension. Using a novel combination of neuroimaging approaches we find that MD regions track stories less closely than language regions. This finding constrains the possible contributions of the MD network to comprehension, contrasts with accounts positing that this network has continuous access to linguistic input, and suggests a new typology of comprehension processes based on their extent of input tracking.

An fMRI study dissociating distance measures computed by Broca's area in movement processing: clause boundary vs. identity

Behavioral studies of sentence comprehension suggest that processing long-distance dependencies is subject to interference effects when Noun Phrases (NP) similar to the dependency head intervene in the dependency. Neuroimaging studies converge in localizing such effects to Broca's area, showing that activity in Broca's area increases with the number of NP interveners crossed by a moved NP of the same type. To test if NP interference effects are modulated by adding an intervening clause boundary, which should by hypothesis increase the number of successive-cyclic movements, we conducted an fMRI study contrasting NP interveners with clausal (CP) interveners. Our design thus had two components: (I) the number of NP interveners crossed by movement was parametrically modulated; (II) CP-intervention was contrasted with NP-intervention. The number of NP interveners parametrically modulated a cluster straddling left BA44/45 of Broca's area, replicating earlier studies. Adding an intervening clause boundary did not significantly modulate the size of the NP interference effect in Broca's area. Yet, such an interaction effect was observed in the Superior Frontal Gyrus (SFG). Therefore, the involvement of Broca's area in processing syntactic movement is best captured by memory mechanisms affected by a grammatically instantiated type-identity (i.e., NP) intervention.

Written production in a case of locked-in syndrome with bilateral corticopontic degeneration

Patients in locked-in syndrome show normal or near normal mental abilities that contrast with the limited motor capacity that hinders voluntary communication. However, eye movements and blinking are usually preserved and can be used to establish a communication system. We report an exceptional case of locked-in syndrome. The aetiology was basilar thrombosis consecutive to a cervical manipulation. In addition, brain MRI performed 23 years later showed a ventral pontine stroke with bilateral corticopontic degeneration. In this study the patient was able to produce written output using a chin-controlled Morse system decoded by a computer. A detailed linguistic analysis of text written over 20 years by the patient was carried out. The data demonstrate that improvements in language performance can be observed even in patients with brain lesions in areas associated with high-level cognitive processes. The data show a decrease of typing, grammatical and lexical errors over time, use of less frequent words, and an increase of more complex linguistic structures. This paper adds to previous findings confirming the value of daily practice and rehabilitation to enhance quality of life in this group of patients.

MEG evidence that the LIFG effect of object extraction requires similarity-based interference

This study addresses a much-debated effect on a much-debated region: the increase of left inferior frontal gyrus (LIFG) activation associated with object-extracted relative clauses. This haemodynamic result is one of the most central and most cited findings in the cognitive neuroscience of syntax and it has robustly contributed to the popular association of Broca's region with syntax. Our study had two goals: (1) to characterise the timing of this classic effect with magnetoencephalography (MEG) and (2) to connect it to psycholinguistic research on the effects of similarity-based interference during sentence processing. Specifically, behavioural studies have shown that object relatives are primarily only costly when the two preverbal noun phrases are parallel in their surface syntax, for example, both consisting of a definite determiner and a noun (e.g. the reporter who the senator attacked), as opposed to employing, for example, a definite noun phrase and a proper name (the reporter who Bill attacked). This finding suggests that the difficulty of object extraction lies not within its syntax but rather in similarity-based interference affecting working memory processes. Although working memory is a prominent hypothesis for the LIFG engagement in object extraction, the haemodynamic literature has routinely employed stimuli involving parallel as opposed to non-parallel syntax. Using written sentences presented word-by-word, we tested whether an LIFG effect of object extraction is obtained with MEG, allowing us to characterise its timing, and whether it reduces or disappears if the two preverbal noun phrases are non-parallel in their surface syntax. Our results show an LIFG increase for object relatives at around 600 ms after verb onset, but only when the preverbal arguments are parallel. These findings are consistent with memory and competition-based explanations of the LIFG effect of object extraction and challenge accounts attributing it to displacement.

Distinct regional anatomic and functional correlates of neurodegenerative apraxia of speech and aphasia: an MRI and FDG-PET study

Progressive apraxia of speech (AOS) can result from neurodegenerative disease and can occur in isolation or in the presence of agrammatic aphasia. We aimed to determine the neuroanatomical and metabolic correlates of progressive AOS and aphasia. Thirty-six prospectively recruited subjects with progressive AOS or agrammatic aphasia, or both, underwent the Western Aphasia Battery (WAB) and Token Test to assess aphasia, an AOS rating scale (ASRS), 3T MRI and 18-F fluorodeoxyglucose (FDG) PET. Correlations between clinical measures and imaging were assessed. The only region that correlated to ASRS was left superior premotor volume. In contrast, WAB and Token Test correlated with hypometabolism and volume of a network of left hemisphere regions, including pars triangularis, pars opercularis, pars orbitalis, middle frontal gyrus, superior temporal gyrus, precentral gyrus and inferior parietal lobe. Progressive agrammatic aphasia and AOS have non-overlapping regional correlations, suggesting that these are dissociable clinical features that have different neuroanatomical underpinnings.

Multilingualism and fMRI: Longitudinal Study of Second Language Acquisition

BOLD fMRI is often used for the study of human language. However, there are still very few attempts to conduct longitudinal fMRI studies in the study of language acquisition by measuring auditory comprehension and reading. The following paper is the first in a series concerning a unique longitudinal study devoted to the analysis of bi- and multilingual subjects who are: (1) already proficient in at least two languages; or (2) are acquiring Russian as a second/third language. The focus of the current analysis is to present data from the auditory sections of a set of three scans acquired from April, 2011 through April, 2012 on a five-person subject pool who are learning Russian during the study. All subjects were scanned using the same protocol for auditory comprehension on the same General Electric LX 3T Signa scanner in Duke University Hospital. Using a multivariate analysis of covariance (MANCOVA) for statistical analysis, proficiency measurements are shown to correlate significantly with scan results in the Russian conditions over time. The importance of both the left and right hemispheres in language processing is discussed. Special attention is devoted to the importance of contextualizing imaging data with corresponding behavioral and empirical testing data using a multivariate analysis of variance. This is the only study to date that includes: (1) longitudinal fMRI data with subject-based proficiency and behavioral data acquired in the same time frame; and (2) statistical modeling that demonstrates the importance of covariate language proficiency data for understanding imaging results of language acquisition.

Mechanism of case processing in the brain: an fMRI study

In sentence comprehension research, the case system, which is one of the subsystems of the language processing system, has been assumed to play a crucial role in signifying relationships in sentences between noun phrases (NPs) and other elements, such as verbs, prepositions, nouns, and tense. However, so far, less attention has been paid to the question of how cases are processed in our brain. To this end, the current study used fMRI and scanned the brain activity of 15 native English speakers during an English-case processing task. The results showed that, while the processing of all cases activates the left inferior frontal gyrus and posterior part of the middle temporal gyrus, genitive case processing activates these two regions more than nominative and accusative case processing. Since the effect of the difference in behavioral performance among these three cases is excluded from brain activation data, the observed different brain activations would be due to the different processing patterns among the cases, indicating that cases are processed differently in our brains. The different brain activations between genitive case processing and nominative/accusative case processing may be due to the difference in structural complexity between them.

A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading

The anatomy of language has been investigated with PET or fMRI for more than 20 years. Here I attempt to provide an overview of the brain areas associated with heard speech, speech production and reading. The conclusions of many hundreds of studies were considered, grouped according to the type of processing, and reported in the order that they were published. Many findings have been replicated time and time again leading to some consistent and undisputable conclusions. These are summarised in an anatomical model that indicates the location of the language areas and the most consistent functions that have been assigned to them. The implications for cognitive models of language processing are also considered. In particular, a distinction can be made between processes that are localized to specific structures (e.g. sensory and motor processing) and processes where specialisation arises in the distributed pattern of activation over many different areas that each participate in multiple functions. For example, phonological processing of heard speech is supported by the functional integration of auditory processing and articulation; and orthographic processing is supported by the functional integration of visual processing, articulation and semantics. Future studies will undoubtedly be able to improve the spatial precision with which functional regions can be dissociated but the greatest challenge will be to understand how different brain regions interact with one another in their attempts to comprehend and produce language.

The neural substrates associated with attentional resources and difficulty of concurrent processing of the two verbal tasks

The kana pick-out test has been widely used in Japan to evaluate the ability to divide attention in both adult and pediatric patients. However, the neural substrates underlying the ability to divide attention using the kana pick-out test, which requires participants to pick out individual letters (vowels) in a story while also reading for comprehension, thus requiring simultaneous allocation of attention to both activities, are still unclear. Moreover, outside of the clinical area, neuroimaging studies focused on the mechanisms of divided attention during complex story comprehension are rare. Thus, the purpose of the present study, to clarify the neural substrates of kana pick-out test, improves our current understanding of the basic neural mechanisms of dual task performance in verbal memory function. We compared patterns of activation in the brain obtained during performance of the individual tasks of vowel identification and story comprehension, to levels of activation when participants performed the two tasks simultaneously during the kana pick-out test. We found that activations of the left dorsal inferior frontal gyrus and superior parietal lobule increase in functional connectivity to a greater extent during the dual task condition compared to the two single task conditions. In contrast, activations of the left fusiform gyrus and middle temporal gyrus, which are significantly involved in picking out letters and complex sentences during story comprehension, respectively, were reduced in the dual task condition compared to during the two single task conditions. These results suggest that increased activations of the dorsal inferior frontal gyrus and superior parietal lobule during dual task performance may be associated with the capacity for attentional resources, and reduced activations of the left fusiform gyrus and middle temporal gyrus may reflect the difficulty of concurrent processing of the two tasks. In addition, the increase in synchronization between the left dorsal inferior frontal gyrus and superior parietal lobule in the dual task condition may induce effective communication between these brain regions and contribute to more attentional processing than in the single task condition, due to greater and more complex demands on voluntary attentional resources.

Differences in neural activation between preterm and full term born adolescents on a sentence comprehension task: implications for educational accommodations

Adolescent survivors of preterm birth experience persistent functional problems that negatively impact academic outcomes, even when standardized measures of cognition and language suggest normal ability. In this fMRI study, we compared the neural activation supporting auditory sentence comprehension in two groups of adolescents (ages 9-16 years); sentences varied in length and syntactic difficulty. Preterms (n=18, mean gestational age 28.8 weeks) and full terms (n=14) had scores on verbal IQ, receptive vocabulary, and receptive language tests that were within or above normal limits and similar between groups. In early and late phases of the trial, we found interactions by group and length; in the late phase, we also found a group by syntactic difficulty interaction. Post hoc tests revealed that preterms demonstrated significant activation in the left and right middle frontal gyri as syntactic difficulty increased. ANCOVA showed that the interactions could not be attributed to differences in age, receptive language skill, or reaction time. Results are consistent with the hypothesis that preterm birth modulates brain-behavior relations in sentence comprehension as task demands increase. We suggest preterms' differences in neural processing may indicate a need for educational accommodations, even when formal test scores indicate normal academic achievement.

Effects of tasks on BOLD signal responses to sentence contrasts: Review and commentary

Functional neuroimaging studies of syntactic processing have been interpreted as identifying the neural locations of parsing and interpretive operations. However, current behavioral studies of sentence processing indicate that many operations occur simultaneously with parsing and interpretation. In this review, we point to issues that arise in discriminating the effects of these concurrent processes from those of the parser/interpreter in neural measures and to approaches that may help resolve them.

Stretched, jumped, and fell: an fMRI investigation of reflexive verbs and other intransitives

This study used fMRI to inform a debate between two theories concerning the representation of reflexive verbs. Reflexives are verbs that denote an action that the subject applies on herself (e.g., The woman stretched). These verbs are derived by a lexical operation that creates a reflexive from its transitive counterpart. Theories differ with respect to which thematic role is reduced by the lexical operation: the agent or the theme, and, consequently, whether the construction of sentences with reflexives in subject-verb order includes movement of the object to the subject position. To test this, we compared reflexive verbs with unaccusative verbs (e.g., The woman fell), and with unergative verbs (e.g., The woman jumped). Unaccusatives are derived by reduction of the role of the agent, and thus SV sentences with unaccusatives include movement to subject position. Unergatives do not undergo lexical operations and do not involve movement in SV sentences. The reflexives behaved like unergatives, and differently from unaccusatives: the activation pattern of unaccusatives compared with reflexives showed similar cortical pattern to that of unaccusatives compared with unergatives, with activations in the left inferior frontal gyrus and the left middle temporal gyrus (MTG). Comparing reflexives and unergatives revealed activation in the right MTG. These results indicate that reflexives differ from unaccusatives in their derivation. That is, reflexives do not involve the reduction of the agent of the parallel transitive, and hence no syntactic movement is involved in sentences in which the subject precedes the reflexive verb.

Broca's area and sentence comprehension: a relationship parasitic on dependency, displacement or predictability?

The current rapid event-related fMRI study used optional parasitic-gap constructions, such as [Which paper] did the tired student submit [(gap)--] after reviewing [(p-gap)--/it]?, to test 3 potential roles for Broca's area in sentence processing. These 3 functional options are: I. any intra-sentential Dependency relation activates Broca's area. II. This region specifically processes syntactic Displacement or movement. III. Broca's area handles any dependency relation, as long as it is predictable at an early stage of processing. Broca's area was only activated by the contrast that tested predictability within BA 45, as determined by its overlap with cytoarchitectonic probability maps. These results imply that an alternative or modified functional account of Broca's area, from those presently available, is required. Constraints on either a displacement account to movements that are not parasitic or a Working Memory one to predicted dependencies that cross verbal arguments or noun phrases would achieve the necessary consistency. Further, the results from the minimal contrasts investigating displacement and dependency have implications to potential language regions outside of Broca's area. The minimal contrast investigating displacement activated the left anterior Middle Temporal Gyrus, which has more recently been claimed to play a role in syntactic operations.

The neural basis of reversible sentence comprehension: evidence from voxel-based lesion symptom mapping in aphasia

We explored the neural basis of reversible sentence comprehension in a large group of aphasic patients (n = 79). Voxel-based lesion symptom mapping revealed a significant association between damage in temporo-parietal cortex and impaired sentence comprehension. This association remained after we controlled for phonological working memory. We hypothesize that this region plays an important role in the thematic or what-where processing of sentences. In contrast, we detected weak or no association between reversible sentence comprehension and the ventrolateral pFC, which includes Broca's area, even for syntactically complex sentences. This casts doubt on theories that presuppose a critical role for this region in syntactic computations.

The Role of Broca's Area in Sentence Comprehension

The role of Broca's area in sentence processing has been debated for the last 30 years. A central and still unresolved issue is whether Broca's area plays a specific role in some aspect of syntactic processing (e.g., syntactic movement, hierarchical structure building) or whether it serves a more general function on which sentence processing relies (e.g., working memory). This review examines the functional organization of Broca's area in regard to its contributions to sentence comprehension, verbal working memory, and other multimodal cognitive processes. We suggest that the data are consistent with the view that at least a portion of the contribution of Broca's area to sentence comprehension can be attributed to its role as a phonological short-term memory resource. Furthermore, our review leads us to conclude that there is no compelling evidence that there are sentence-specific processing regions within Broca's area.

Neural correlates of syntactic processing in the nonfluent variant of primary progressive aphasia

The left posterior inferior frontal cortex (IFC) is important for syntactic processing, and has been shown in many functional imaging studies to be differentially recruited for the processing of syntactically complex sentences relative to simpler ones. In the nonfluent variant of primary progressive aphasia (PPA), degeneration of the posterior IFC is associated with expressive and receptive agrammatism; however, the functional status of this region in nonfluent PPA is not well understood. Our objective was to determine whether the atrophic posterior IFC is differentially recruited for the processing of syntactically complex sentences in nonfluent PPA. Using structural and functional magnetic resonance imaging, we quantified tissue volumes and functional responses to a syntactic comprehension task in eight patients with nonfluent PPA, compared to healthy age-matched controls. In controls, the posterior IFC showed more activity for syntactically complex sentences than simpler ones, as expected. In nonfluent PPA patients, the posterior IFC was atrophic and, unlike controls, showed an equivalent level of functional activity for syntactically complex and simpler sentences. This abnormal pattern of functional activity was specific to the posterior IFC: the mid-superior temporal sulcus, another region modulated by syntactic complexity in controls, showed normal modulation by complexity in patients. A more anterior inferior frontal region was recruited by patients, but did not support successful syntactic processing. We conclude that in nonfluent PPA, the posterior IFC is not only structurally damaged, but also functionally abnormal, suggesting a critical role for this region in the breakdown of syntactic processing in this syndrome.

Proficiency differences in syntactic processing of monolingual native speakers indexed by event-related potentials

Although anecdotally there appear to be differences in the way native speakers use and comprehend their native language, most empirical investigations of language processing study university students and none have studied differences in language proficiency, which may be independent of resource limitations such as working memory span. We examined differences in language proficiency in adult monolingual native speakers of English using an ERP paradigm. ERPs were recorded to insertion phrase structure violations in naturally spoken English sentences. Participants recruited from a wide spectrum of society were given standardized measures of English language proficiency, and two complementary ERP analyses were performed. In between-groups analyses, participants were divided on the basis of standardized proficiency scores into lower proficiency and higher proficiency groups. Compared with lower proficiency participants, higher proficiency participants showed an early anterior negativity that was more focal, both spatially and temporally, and a larger and more widely distributed positivity (P600) to violations. In correlational analyses, we used a wide spectrum of proficiency scores to examine the degree to which individual proficiency scores correlated with individual neural responses to syntactic violations in regions and time windows identified in the between-groups analyses. This approach also used partial correlation analyses to control for possible confounding variables. These analyses provided evidence for the effects of proficiency that converged with the between-groups analyses. These results suggest that adult monolingual native speakers of English who vary in language proficiency differ in the recruitment of syntactic processes that are hypothesized to be at least in part automatic as well as of those thought to be more controlled. These results also suggest that to fully characterize neural organization for language in native speakers it is necessary to include participants of varying proficiency.

The neural correlates of linguistic distinctions: unaccusative and unergative verbs

Unaccusative verbs like fall are special in that their sole argument is syntactically generated at the object position of the verb rather than at the subject position. Unaccusative verbs are derived by a lexical operation that reduces the agent from transitive verbs. Their insertion into a sentence often involves a syntactic movement from the object to the subject position. To explore the neurological reality of the distinction between different verb types and to identify the cortical activations associated with the lexical and syntactic operations, we compared unaccusative verbs with verbs that do not undergo such operations--unergatives (verbs with one argument, an agent) and transitives (verbs with two arguments). The observed pattern of activation revealed that the brain distinguishes between unaccusative and unergative verbs, lending neurological support for the linguistic distinction. A conjunction analysis between the comparisons between unaccusatives and the other verb types revealed activations in the left inferior frontal gyrus and the left posterior middle temporal gyrus. These, together with previous neuroimaging results, suggest that the inferior frontal gyrus may be involved with the execution of the syntactic operation, whereas the middle temporal gyrus may be responsible for the lexical operation that derives unaccusative verbs.

Task effects on BOLD signal correlates of implicit syntactic processing

BOLD signal was measured in sixteen participants who made timed font change detection judgments in visually presented sentences that varied in syntactic structure and the order of animate and inanimate nouns. Behavioral data indicated that sentences were processed to the level of syntactic structure. BOLD signal increased in visual association areas bilaterally and left supramarginal gyrus in the contrast of sentences with object- and subject-extracted relative clauses without font changes in which the animacy order of the nouns biased against the syntactically determined meaning of the sentence. This result differs from the findings in a non-word detection task (Caplan et al, 2008a), in which the same contrast led to increased BOLD signal in the left inferior frontal gyrus. The difference in areas of activation indicates that the sentences were processed differently in the two tasks. These differences were further explored in an eye tracking study using the materials in the two tasks. Issues pertaining to how parsing and interpretive operations are affected by a task that is being performed, and how this might affect BOLD signal correlates of syntactic contrasts, are discussed.

Neuronal activation for semantically reversible sentences

Semantically reversible sentences are prone to misinterpretation and take longer for typically developing children and adults to comprehend; they are also particularly problematic for those with language difficulties such as aphasia or Specific Language Impairment. In our study, we used fMRI to compare the processing of semantically reversible and nonreversible sentences in 41 healthy participants to identify how semantic reversibility influences neuronal activation. By including several linguistic and nonlinguistic conditions within our paradigm, we were also able to test whether the processing of semantically reversible sentences places additional load on sentence-specific processing, such as syntactic processing and syntactic-semantic integration, or on phonological working memory. Our results identified increased activation for reversible sentences in a region on the left temporal-parietal boundary, which was also activated when the same group of participants carried out an articulation task which involved saying "one, three" repeatedly. We conclude that the processing of semantically reversible sentences places additional demands on the subarticulation component of phonological working memory.

fMRI adaptation dissociates syntactic complexity dimensions

The current fMRI adaptation study sought to elucidate the dimensions of syntactic complexity and their underlying neural substrates. For the first time with fMRI, we investigated repetition suppression (i.e., fMRI adaptation) for two orthogonal dimensions of sentence complexity: embedding position (right-branching vs. center-embedding) and movement type (subject vs. object). Two novel results were obtained: First, we found syntactic adaptation in Broca's area and second, this adaptation was structured. Anterior Broca's area (BA 45) selectively adapted to movement type, while posterior Broca's area (BA 44) demonstrated adaptation to both movement type and embedding position (as did left posterior superior temporal gyrus and right inferior precentral sulcus). The functional distinction within Broca's area is critical not only to an understanding of the functional neuroanatomy of language, but also to theoretical accounts of syntactic complexity, demonstrating its multi-dimensional nature. These results implicate that during syntactic comprehension, a large network of areas is engaged, but that only anterior Broca's area is selective to syntactic movement.

Sentence integration processes: an ERP study of Chinese sentence comprehension with relative clauses

In an event-related potentials (ERPs) study, we examined the comprehension of different types of Chinese (Mandarin) relative clauses (object vs. subject-extracted) to test the universality and language specificity of sentence comprehension processes. Because Chinese lacks morphosyntactic cues to sentence constituent relations, it allows a test of the possibility that semantic-contextual processes dominate the extraction of clausal relations, in contrast to the structure-dependent processing in English and many other languages. ERP results at the RC embedded verbs showed a P600 effect for the subject-extraction type, reflecting a processing of phrasal reconfiguration, and an N400 effect for the object-extraction type, reflecting a processing of meaning reinterpretation. A central-frontal sustained negativity was produced by the RC head noun of object-extraction, suggesting a combined effect of meaning derivation and referents establishment. LORETA (Low Resolution Electrical Tomography) source localization showed activation of posterior dominance (e.g., BA 22/39/19/41/42) supporting the integration of structure mapping (P600) and meaning derivation (N400) in a developing sentential representation, consistent with the memory unification and control model (Hagoort, 2005). More left-lateralized anterior regions of a frontal-temporal network (e.g., BA 47/38) became active later in the sentence (a sustained central-frontal negativity), when the thematic-role specification for multiple referents may have required additional cognitive and memory resources. Our findings suggest that Chinese sentence reading recruits a neural network that is sensitive to the sequential/hierarchical organization of linguistic inputs in a manner that resembles to the structure-dependent cognitive processes in other languages, reflecting a universal property of language processing. The ERP data shows that early lexical processes are important in the integration process, but also challenges the view that Chinese text reading depends primarily on semantic-contextual processing in the derivation of meaning representation.

The effect of presentation paradigm on syntactic processing: An event-related fMRI study

An event-related fMRI study was conducted to investigate the effect of two different sentence presentation paradigms-rapid serial visual presentation (RSVP) and whole sentence presentation-on syntactic processing. During scanning, sentences were presented using one of the two presentation paradigms and were followed by a short delay and a probe to verify sentence comprehension. The delay was included in an attempt to separate sentence-related activity from probe-related activity. The behavioral data showed a main effect of syntactic complexity for reaction time and accuracy, and accuracy revealed an interaction between complexity and the presentation paradigm employed-RSVP produced many more errors for syntactically complex sentences than did whole sentence presentation. The imaging data revealed a syntactic complexity effect during the sentence phase in left BA 44 and during the probe phase in left BA 44 and the left posterior MTG. In addition, timecourse analysis revealed that these two regions also showed an interaction between complexity and presentation paradigm such that there was no complexity effect during RSVP but a significant effect during whole sentence presentation. In addition to finding that these two presentation paradigms differentially affected syntactic processing, there were main effects within the visual pathway (V1/V2 vs. V5) and the hippocampus that revealed significant differences in activation between the paradigms.

Neural aspects of sentence comprehension: syntactic complexity, reversibility, and reanalysis

Broca's area is preferentially activated by reversible sentences with complex syntax, but various linguistic factors may be responsible for this finding, including syntactic movement, working-memory demands, and post hoc reanalysis. To distinguish between these, we tested the interaction of syntactic complexity and semantic reversibility in a functional magnetic resonance imaging study of sentence–picture matching. During auditory comprehension, semantic reversibility induced selective activation throughout the left perisylvian language network. In contrast, syntactic complexity (object-embedded vs. subject-embedded relative clauses) within reversible sentences engaged only the left inferior frontal gyrus (LIFG) and left precentral gyrus. Within irreversible sentences, only the LIFG was sensitive to syntactic complexity, confirming a unique role for this region in syntactic processing. Nonetheless, larger effects of reversibility itself occurred in the same regions, suggesting that full syntactic parsing may be a nonautomatic process applied as needed. Complex reversible sentences also induced enhanced signals in LIFG and left precentral regions on subsequent picture selection, but with additional recruitment of the right hemisphere homolog area (right inferior frontal gyrus) as well, suggesting that post hoc reanalysis of sentence structure, compared with initial comprehension, engages an overlapping but larger network of brain regions. These dissociable effects may offer a basis for studying the reorganization of receptive language function after brain damage.

The pars triangularis in dyslexia and ADHD: A comprehensive approach

Limited research has been conducted on the structure of the pars triangularis (PT) in dyslexia despite functional neuroimaging research finding it may play a role in phonological processing. Furthermore, research to date has not examined PT size in ADHD even though the right inferior frontal region has been implicated in the disorder. Hence, one of the purposes of this study was to examine the structure of the PT in dyslexia and ADHD. The other purposes included examining the PT in relation to overall expressive language ability and in relation to several specific linguistic functions given language functioning often is affected in both dyslexia and ADHD. Participants included 50 children: 10 with dyslexia, 15 with comorbid dyslexia/ADHD, 15 with ADHD, and 10 controls. Using a 2 (dyslexia or not) x 2 (ADHD or not) MANCOVA, findings revealed PT length and shape were comparable between those with and without dyslexia. However, children with ADHD had smaller right PT lengths than those without ADHD, and right anterior ascending ramus length was related to attention problems in the total sample. In terms of linguistic functioning, presence of an extra sulcus in the left PT was related to poor expressive language ability. In those with adequate expressive language functioning, left PT length was related to phonological awareness, phonological short-term memory and rapid automatic naming (RAN). Right PT length was related to RAN and semantic processing. Further work on PT morphology in relation to ADHD and linguistic functioning is warranted.

Off-line sentence processing: what is involved in answering a comprehension probe?

The aim of this study was to better characterize the influence of the comprehension probe on syntax-related activation patterns observed in fMRI studies of sentence comprehension. In this study, sentence comprehension was assessed by presenting a true/false statement after each sentence. To disassociate the sentence reading from the comprehension probe activation, a 6-s delay was placed between these processing phases. Two factors were manipulated, one affected the sentence and the other affected the probe. The sentences were manipulated by varying their syntactic complexity; conjoined-active and object-relative sentences were examined. The comprehension probes asked whether one of the first two mentioned nouns in the preceding sentence performed the action of one of the two verbs. The probes were manipulated by varying the distance (number of intervening words) between the noun and verb within the sentence; there were three probe types: short distance, long distance, and false statements. The results, which focused on the processing taking place during the probe, showed that the distance manipulation resulted in significant differences in both behavioral and brain activation measures. This was particularly true of BA 44, which revealed an interaction between complexity and distance such that the complexity effect was all but eliminated for the long-distance condition. Additionally, we replicated our previous finding of syntactic complexity effects during the probe phase. Finally, post hoc analysis revealed that participants used two distinct strategies during sentence reading; significant effects of strategy use on both behavioral and brain activation data were observed.

Neural processing during older adults' comprehension of spoken sentences: age differences in resource allocation and connectivity

Speech comprehension remains largely preserved in older adults despite significant age-related neurophysiological change. However, older adults' performance declines more rapidly than that of young adults when listening conditions are challenging. We investigated the cortical network underlying speech comprehension in healthy aging using short sentences differing in syntactic complexity, with processing demands further manipulated through speech rate. Neural activity was monitored using blood oxygen level-dependent functional magnetic resonance imaging. Comprehension of syntactically complex sentences activated components of a core sentence-processing network in both young and older adults, including the left inferior and middle frontal gyri, left inferior parietal cortex, and left middle temporal gyrus. However, older adults showed reduced recruitment of inferior frontal regions relative to young adults; the individual degree of recruitment predicted accuracy at the more difficult fast speech rate. Older adults also showed increased activity in frontal regions outside the core sentence-processing network, which may have played a compensatory role. Finally, a functional connectivity analysis demonstrated reduced coherence between activated regions in older adults. We conclude that decreased activation of specialized processing regions, and limited ability to coordinate activity between regions, contribute to older adults' difficulty with sentence comprehension under difficult listening conditions.