Who did what? A causal role for cognitive control in thematic role assignment during sentence comprehension

Resolving syntactic-semantic conflicts: comprehension and processing patterns by deaf Chinese readers

The current study combined sentence plausibility judgment and self-paced reading tasks to examine the comprehension strategies and processing patterns of Chinese deaf individuals when comprehending written Chinese sentences with syntactic-semantic cue conflicts. Similar to findings from previous crosslinguistic studies on deaf readers, the Chinese deaf readers showed great variability in their comprehension strategies, with only 38% robustly relying on syntactic cues. Regardless of their overall comprehension preferences, the deaf readers all showed additional processing efforts as reflected by longer reading time at the verb regions when they relied on the syntactic cues. Those with less robust reliance on syntactic cues also showed longer reading time at the verb regions even when they relied on the semantic cues, suggesting sensitivity to the syntactic cues regardless of the comprehension strategy. These findings suggest that deaf readers in general endure more processing burden while resolving conflicting syntactic and semantic cues, likely due to their overall high reliance on semantic information during sentence comprehension. Increased processing burden thus may contribute to an overall tendency of over-reliance on semantic cues when comprehending sentences with cue conflicts.

Evidence for conflict monitoring during speech recognition in noise

During difficult tasks, conflict can benefit performance on a subsequent trial. One theory for such performance adjustments is that people monitor for conflict and reactively engage cognitive control. This hypothesis has been challenged because tasks that control for associative learning do not show such "cognitive control" effects. The current study experimentally controlled associative learning by presenting a novel stimulus on every trial of a picture-speech conflict task and found that performance adjustments still occur. Thirty-one healthy young adults listened to and repeated words presented in background noise while viewing pictures that were congruent or incongruent (i.e., phonological neighbors) with the word. Following conflict, participants had higher word recognition (+17% points) on incongruent but not congruent trials. This result was not attributable to posterror effects nor a speed-accuracy trade-off. An analysis of erroneous responses showed that participants made more phonologically related errors than nonrelated errors only on incongruent trials, demonstrating elevated phonological conflict when the picture was a neighbor of the target word. Additionally, postconflict improvements appear to be due to better resolution of phonological conflict in the mental lexicon rather than decreased attention to the picture or increased attention to the speech signal. Our findings provide new evidence for conflict monitoring and suggest that cognitive control helps resolve phonological conflict during speech recognition in noise.

Fractionating difficulty during sentence comprehension using functional neuroimaging

Sentence comprehension is highly practiced and largely automatic, but this belies the complexity of the underlying processes. We used functional neuroimaging to investigate garden-path sentences that cause difficulty during comprehension, in order to unpack the different processes used to support sentence interpretation. By investigating garden-path and other types of sentences within the same individuals, we functionally profiled different regions within the temporal and frontal cortices in the left hemisphere. The results revealed that different aspects of comprehension difficulty are handled by left posterior temporal, left anterior temporal, ventral left frontal, and dorsal left frontal cortices. The functional profiles of these regions likely lie along a spectrum of specificity to generality, including language-specific processing of linguistic representations, more general conflict resolution processes operating over linguistic representations, and processes for handling difficulty in general. These findings suggest that difficulty is not unitary and that there is a role for a variety of linguistic and non-linguistic processes in supporting comprehension.

Multimodal measures of sentence comprehension in agrammatism

Agrammatic or asyntactic comprehension is a common language impairment in aphasia. We considered three possible hypotheses about the underlying cause of this deficit, namely problems in syntactic processing, over-reliance on semantics, and a deficit in cognitive control. We tested four individuals showing asyntactic comprehension on their comprehension of syntax-semantics conflict sentences (e.g., The robber handcuffed the cop), where semantic cues pushed towards a different interpretation from syntax. Two of the four participants performed above chance on such sentences indicating that not all agrammatic individuals are impaired in structure-based interpretation. We collected additional eyetracking measures from the other two participants, who performed at chance on the conflict sentences. These measures suggested distinct underlying processing profiles in the two individuals. Cognitive assessments further suggested that one participant might have performed poorly due to a linguistic cognitive control impairment while the other had difficulty due to over-reliance on semantics. Together, the results highlight the importance of multimodal measures for teasing apart aphasic individuals' underlying deficits. They corroborate findings from neurotypical adults by showing that semantics can strongly influence comprehension and that cognitive control could be relevant for choosing between competing sentence interpretations. They extend previous findings by demonstrating variability between individuals with aphasia-cognitive control might be especially relevant for patients who are not overly reliant on semantics. Clinically, the identification of distinct underlying problems in different individuals suggests that different treatment paths might be warranted for cases who might look similar on behavioral assessments.

The State of Cognitive Control in Language Processing

Understanding language requires readers and listeners to cull meaning from fast-unfolding messages that often contain conflicting cues pointing to incompatible ways of interpreting the input (e.g., "The cat was chased by the mouse"). This article reviews mounting evidence from multiple methods demonstrating that cognitive control plays an essential role in resolving conflict during language comprehension. How does cognitive control accomplish this task? Psycholinguistic proposals have conspicuously failed to address this question. We introduce an account in which cognitive control aids language processing when cues conflict by sending top-down biasing signals that strengthen the interpretation supported by the most reliable evidence available. We also provide a computationally plausible model that solves the critical problem of how cognitive control "knows" which way to direct its biasing signal by allowing linguistic knowledge itself to issue crucial guidance. Such a mental architecture can explain a range of experimental findings, including how moment-to-moment shifts in cognitive-control state-its level of activity within a person-directly impact how quickly and successfully language comprehension is achieved.

Older Adults Show Intraindividual Variation in the Use of Predictive Processing

BACKGROUND

The use of prediction can aid language comprehension through preactivation of relevant word features. However, predictions can be wrong, and it has been proposed that resolving the mismatch between the predicted and presented item requires cognitive resources. Older adults tend not to predict and instead rely more on passive comprehension. Here, we tested, using an intraindividual approach, whether older adults consistently use this less demanding processing strategy while reading or whether they attempt to predict on some trials.

METHODS

We used a cross-task conflict paradigm. Younger and older participants self-paced to read sentences that ended with either an expected or unexpected word. Each sentence was then followed by a flanker stimulus that could be congruent or incongruent. We examined responses within and across the two tasks.

RESULTS

Unexpected words were in general read as quickly as expected words, indicating that typical processing of these words was similar. However, for both younger and older adults, there was a greater proportion of very slow trials for unexpected words, revealing different processing on a subset of trials. Critically, in older adults, these slowly read unexpected words engaged control, as seen in speeded responses to incongruent flanker stimuli.

CONCLUSION

Using a cross-task conflict paradigm, we showed that older adults are able to predict and engage cognitive resources to cope with prediction violations, but do not opt to use these processes consistently.

Variation in how cognitive control modulates sentence processing

Prior research suggests that cognitive control can assist the comprehension of sentences that create conflict between interpretations, at least under some circumstances. However, the mixed pattern of results suggests that cognitive control may not always be necessary for accurate comprehension. We tested whether cognitive control recruitment for language processing is systematically variable, depending on the type of sentential ambiguity or conflict, individual differences in cognitive control, and task demands. Participants completed two sessions in a web-based experiment. The first session tested conflict modulation using interleaved Stroop and sentence comprehension trials. Critical sentences contained syntax-semantics or phrase-attachment conflict. In the second session, participants completed three cognitive control and three working memory tasks. Exploratory factor analysis was used to index individual differences in a cognitive control factor and a working memory factor. At the group level, there were no significant conflict modulation effects for either syntax-semantics or phrase-attachment conflict. At the individual differences level, the cognitive control factor correlated with offline comprehension accuracy but not online processing measures for both types of conflict. Together, the results suggest that the role of cognitive control in sentence processing may vary according to task demands. When overt decisions are required, individual differences in cognitive control may matter such that better cognitive control results in better language comprehension performance. The results add to the mixed evidence on conflict modulation and raise questions about the situations under which cognitive control influences online processing.

Cognitive control mechanisms in language processing: are there both within- and across-task conflict adaptation effects?

Cognitive conflict is regarded as a crucial factor in triggering subsequent adjustments in cognitive control. Recent studies have suggested that the implementation of control following conflict detection might be domain-general in that conflict experienced in the language domain recruits control processes that deal with conflict experienced in non-linguistic domains. During language comprehension, humans often have to recover from conflicting interpretations as quickly and accurately as possible. In this study, we investigate how people adapt to conflict experienced during processing semantically ambiguous sentences. Experiments 1 to 3 investigated whether such semantic conflict produces the congruency sequence effect (CSE) within a subsequent manual Stroop task and whether Stroop conflict leads to adjustments in semantic processing. Experiments 4 to 6 investigated whether semantic conflict results in conflict adaptation in subsequent sentence processing. Although processing conflict was consistently experienced during sentence reading and in the Stroop task, we did not observe any within-task or cross-task adaptation effects. Specifically, there were no cross-task CSEs from the linguistic task to the Stroop task and vice versa (experiments 1-3)-speaking against the assumption of domain-general control mechanisms. Moreover, experiencing conflict within a semantically ambiguous sentence did not ease the processing of a subsequent ambiguous sentence (experiments 4-6). Implications of these findings will be discussed.

Moving From Bilingual Traits to States: Understanding Cognition and Language Processing Through Moment-to-Moment Variation

The study of how bilingualism is linked to cognitive processing, including executive functioning, has historically focused on comparing bilinguals to monolinguals across a range of tasks. These group comparisons presume to capture relatively stable cognitive traits and have revealed important insights about the architecture of the language processing system that could not have been gleaned from studying monolinguals alone. However, there are drawbacks to using a group-comparison, or Traits, approach. In this theoretical review, we outline some limitations of treating executive functions as stable traits and of treating bilinguals as a uniform group when compared to monolinguals. To build on what we have learned from group comparisons, we advocate for an emerging complementary approach to the question of cognition and bilingualism. Using an approach that compares bilinguals to themselves under different linguistic or cognitive contexts allows researchers to ask questions about how language and cognitive processes interact based on dynamically fluctuating cognitive and neural states. A States approach, which has already been used by bilingualism researchers, allows for cause-and-effect hypotheses and shifts our focus from questions of group differences to questions of how varied linguistic environments influence cognitive operations in the moment and how fluctuations in cognitive engagement impact language processing.

Developmental effects in the online use of morphosyntactic cues in sentence processing: Evidence from Tagalog

Children must necessarily process their input in order to learn it, yet the architecture of the developing parsing system and how it interfaces with acquisition is unclear. In the current paper we report experimental and corpus data investigating adult and children's use of morphosyntactic cues for making incremental online predictions of thematic roles in Tagalog, a verb-initial symmetrical voice language of the Philippines. In Study 1, Tagalog-speaking adults completed a visual world eye-tracking experiment in which they viewed pictures of causative actions that were described by transitive sentences manipulated for voice and word order. The pattern of results showed that adults process agent and patient voice differently, predicting the upcoming noun in the patient voice but not in the agent voice, consistent with the observation of a patient voice preference in adult sentence production. In Study 2, our analysis of a corpus of child-directed speech showed that children heard more patient voice- than agent voice-marked verbs. In Study 3, 5-, 7-, and 9-year-old children completed a similar eye-tracking task as used in Study 1. The overall pattern of results suggested that, like the adults in Study 1, children process agent and patient voice differently in a manner that reflects the input distributions, with children developing towards the adult state across early childhood. The results are most consistent with theoretical accounts that identify a key role for input distributions in acquisition and language processing.

Change is hard: Individual differences in children's lexical processing and executive functions after a shift in dimensions

Language comprehension involves cognitive abilities that are specific to language as well as cognitive abilities that are more general and involved in a wide range of behaviors. One set of domain-general abilities that support language comprehension are executive functions (EFs), also known as cognitive control. A diverse body of research has demonstrated that EFs support language comprehension when there is conflict between competing, incompatible interpretations of temporarily ambiguous words or phrases. By engaging EFs, children and adults are able to select or bias their attention towards the correct interpretation. However, the degree to which language processing engages EFs in the absence of ambiguity is poorly understood. In the current experiment, we tested whether EFs may be engaged when comprehending speech that does not elicit conflicting interpretations. Different components of EFs were measured using several behavioral tasks and language comprehension was measured using an eye-tracking procedure. Five-year-old children (n=56) saw pictures of familiar objects and heard sentences identifying the objects using either their names or colors. After a series of objects were identified using one dimension, children were significantly less accurate in fixating target objects that were identified using a second dimension. Further results reveal that this decrease in accuracy does not occur because children struggle to shift between dimensions, but rather because they are unable to predict which dimension will be used. These effects of predictability are related to individual differences in children's EFs. Taken together, these findings suggest that EFs may be more broadly involved when children comprehend language, even in instances that do not require conflict resolution.

Influence of homophone processing during auditory language comprehension on executive control processes: A dual-task paradigm

In the present preregistered study, we evaluated the possibility of a shared cognitive mechanism during verbal and non-verbal tasks and therefore the implication of domain-general cognitive control during language comprehension. We hypothesized that a behavioral cost will be observed during a dual-task including both verbal and non-verbal difficult processing. Specifically, to test this claim, we designed a dual-task paradigm involving: an auditory language comprehension task (sentence comprehension) and a non-verbal Flanker task (including congruent and incongruent trials). We manipulated sentence ambiguity and evaluated if the ambiguity effect modified behavioral performances in the non-verbal Flanker task. Under the assumption that ambiguous sentences induce a more difficult process than unambiguous sentences, we expected non-verbal flanker task performances to be impaired only when a simultaneous difficult language processing is performed. This would be specifically reflected by a performance cost during incongruent Flanker items only during ambiguous sentence presentation. Conversely, we observed a facilitatory effect for the incongruent Flanker items during ambiguous sentence suggesting better non-verbal inhibitory performances when an ambiguous sentence was simultaneously processed. Exploratory data analysis suggests that this effect is not only related to a more difficult language processing but also to the previous (n-1) Flanker item. Indeed, results showed that incongruent n-1 Flanker items led to a facilitation of the incongruent synchronized Flanker items only when ambiguous sentences were conjointly presented. This result, even if it needs to be corroborated in future studies, suggests that the recruitment of executive control mechanisms facilitates subsequent executive control implication during difficult language processing. The present study suggests a common executive control mechanism during difficult verbal and non-verbal tasks.

Neural interaction between language control and cognitive control: Evidence from cross-task adaptation

It has been documented that conflict adaptation (conflict resolution in a task enhanced by that in a previous task) exists not only in the same domain but also across different domains with shared cognitive control mechanisms. For the first time, the present study adopted a cross-task adaptive blocked design to examine the relationship between bilingual language control and cognitive control from the perspective of the immediately adjacent, mutual influence on the neural connectivity level. The results showed that the conflict setting induced by previous tasks changed the nodal degrees of the anterior cingulate cortex/presupplementary motor area and the right thalamus, and connectivity strength of shared links between adjacent language and cognitive control tasks. In addition, pre-activation of the cognitive control network affected the transitivity of the successive use of the language control network. These findings not only indicate a cross-task adaptation effect on the neural connectivity level, but also provide evidence for similarities in conflict detection and inhibition control between language-specific control and domain-general cognitive control. In addition, our results also suggest that there is only partial overlap between bilingual language control and domain-general cognitive control.

Neural Mechanisms Underlying the Dynamic Updating of Native Language

Language users encounter different sentence structures from different people in different contexts. Although syntactic variability and adults' ability to adapt to it are both widely acknowledged, the relevant mechanisms and neural substrates are unknown. We hypothesized that syntactic updating might rely on cognitive control, which can help detect and resolve mismatch between prior linguistic expectations and new language experiences that countervail those expectations and thereby assist in accurately encoding new input. Using functional neuroimaging (fMRI), we investigated updating in garden-path sentence comprehension to test the prediction that regions within the left inferior frontal cortex might be relevant neural substrates, and additionally, explored the role of regions within the multiple demand network. Participants read ambiguous and unambiguous main-verb and relative-clause sentences. Ambiguous relative-clause sentences led to a garden-path effect in the left pars opercularis within the lateral frontal cortex and the left anterior insula/frontal operculum within the multiple demand network. This effect decreased upon repeated exposure to relative-clause sentences, consistent with updating. The two regions showed several contrastive patterns, including different activation relative to baseline, correlation with performance in a cognitive control task (the Stroop task), and verb-specificity versus generality in adaptation. Together, these results offer new insight into how the brain updates native language. They demonstrate the involvement of left frontal brain regions in helping the language system adjust to new experiences, with different areas playing distinct functional roles.

Direct impact of cognitive control on sentence processing and comprehension

Incremental language processing means that listeners confront temporary ambiguity about how to structure the input, which can generate misinterpretations. In four "visual-world" experiments, we tested whether engaging cognitive control - which detects and resolves conflict - assists revision during comprehension. We recorded listeners' eye-movements and actions while following instructions that were ripe for misanalysis. In Experiments 1 and 3, sentences followed trials from a nonverbal conflict task that manipulated cognitive-control engagement, to test its impact on the ability to revise. To isolate conflict-driven effects of cognitive-control on comprehension, we manipulated attention in a non-conflict task in Experiments 2 and 4. We observed fewer comprehension errors, and earlier revision, when cognitive control (more than attention) was elicited on an immediately preceding trial. These results extend previous correlations between cognitive control and language processing by revealing the influence of domain-general cognitive-control engagement on the temporal unfolding of error-revision processes during language comprehension.

The Role of Animacy in Children's Interpretation of Relative Clauses in English: Evidence From Sentence-Picture Matching and Eye Movements

Subject relative clauses (SRCs) are typically processed more easily than object relative clauses (ORCs), but this difference is diminished by an inanimate head-noun in semantically non-reversible ORCs ("The book that the boy is reading"). In two eye-tracking experiments, we investigated the influence of animacy on online processing of semantically reversible SRCs and ORCs using lexically inanimate items that were perceptually animate due to motion (e.g., "Where is the tractor that the cow is chasing"). In Experiment 1, 48 children (aged 4;5-6;4) and 32 adults listened to sentences that varied in the lexical animacy of the NP1 head-noun (Animate/Inanimate) and relative clause (RC) type (SRC/ORC) with an animate NP2 while viewing two images depicting opposite actions. As expected, inanimate head-nouns facilitated the correct interpretation of ORCs in children; however, online data revealed children were more likely to anticipate an SRC as the RC unfolded when an inanimate head-noun was used, suggesting processing was sensitive to perceptual animacy. In Experiment 2, we repeated our design with inanimate (rather than animate) NP2s (e.g., "where is the tractor that the car is following") to investigate whether our online findings were due to increased visual surprisal at an inanimate as agent, or to similarity-based interference. We again found greater anticipation for an SRC in the inanimate condition, supporting our surprisal hypothesis. Across the experiments, offline measures show that lexical animacy influenced children's interpretation of ORCs, whereas online measures reveal that as RCs unfolded, children were sensitive to the perceptual animacy of lexically inanimate NPs, which was not reflected in the offline data. Overall measures of syntactic comprehension, inhibitory control, and verbal short-term memory and working memory were not predictive of children's accuracy in RC interpretation, with the exception of a positive correlation with a standardized measure of syntactic comprehension in Experiment 1.

Auditory Sentence Processing in Bilinguals: The Role of Cognitive Control

A number of research studies have shown that the unique need in bilinguals to manage both of their languages positively impacts their cognitive control processes. Yet, due to a dearth of studies at the sentence level, it is still unclear if this benefit extends to sentence processing. In monolinguals and bilinguals, cognitive control helps in reinterpretation of garden path sentences but it is still unknown how it supports the real-time resolution of interference during parsing, such as the type of interference seen in the processing of object relative (OR) sentences. In this study, we compared monolinguals and bilinguals during online spoken OR sentence processing and examined if both groups used cognitive control to resolve interference. In this eye-tracking visual world (ETL-vw) study, OR sentences were aurally presented to 19 monolingual and 21 Spanish-English bilingual adults while gaze patterns were captured throughout the time course of the sentence. Of particular interest was the post-verb position, where the listener connects the verb to its direct object. In OR constructions (e.g., "The man that the boy pushes__ has a red shirt."), the verb ('pushes') links to its syntactically licensed direct object ('the man') at verb offset. During syntactic linking, the parser crosses over an intervening noun phrase (NP, 'the boy') and the two NP activations create interference. The nature of this paradigm allows us to measure interference and its resolution between the intervening NP and the displaced object in real-time. By relating sentence processing patterns with cognitive control measures, high- and no- conflict N-Back tasks, we investigated group differences in the use of cognitive control during sentence processing. Overall, bilinguals showed less interference than monolinguals from the intervening NP during the real time processing of OR sentences. This interference effect and its resolution was significantly predicted by cognitive control skills for bilingual, but not monolingual listeners. This enhanced effect in bilinguals extends previous findings of interference resolution to real time spoken sentence processing suggesting that bilinguals are more efficient than monolinguals at managing interference during complex sentence processing.

Interactional context mediates the consequences of bilingualism for language and cognition

Proficient bilinguals use two languages actively, but the contexts in which they do so may differ dramatically. The present study asked what consequences the contexts of language use hold for the way in which cognitive resources modulate language abilities. Three groups of speakers were compared, all of whom were highly proficient Spanish-English bilinguals who differed with respect to the contexts in which they used the two languages in their everyday lives. They performed two lexical production tasks and the "AX" variant of the Continuous Performance Task (AX-CPT), a nonlinguistic measure of cognitive control. Results showed that lexical access in each language, and how it related to cognitive control ability, depended on whether bilinguals used their languages separately or interchangeably or whether they were immersed in their second language. These findings suggest that even highly proficient bilinguals who speak the same languages are not necessarily alike in the way in which they engage cognitive resources. Findings support recent proposals that being bilingual does not, in itself, identify a unique pattern of cognitive control. An important implication is that much of the controversy that currently surrounds the consequences of bilingualism may be understood, in part, as a failure to characterize the complexity associated with the context of language use. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

How cognitive reserve influences older adults' cognitive state, executive functions and language comprehension: A structural equation model

Cognitive reserve has been defined as the individuals' ability to tolerate age-related and neurodegenerative changes in the brain without developing clinical symptoms or signs of disease. Formal education, occupational attainment, and knowledge of other languages have been assessed as the most relevant factors determining cognitive reserve. The main objective of this study was to develop a structural equation model that reflects the direct influence of cognitive reserve on old adults' general cognitive status and executive functioning, and indirectly on sentence comprehension performance through executive functions mediation. One hundred and fifty eight Spanish-speaking older adults, cognitively intact, were assessed to obtain cognitive reserve data, general cognitive status, executive functioning (inhibitory control, working memory and cognitive flexibility), and sentence comprehension measures. High indicators of adjustment of the proposed model were obtained. The most related factors to cognitive reserve were education and occupational attainment. As we hypothesize, cognitive reserve had a higher direct significant relation to cognitive status and, in a lesser extent, to executive functioning. Participants' general cognitive status and executive function were high and directly related. Furthermore, cognitive reserve has an indirect positive relation to sentence comprehension via executive functions' mediation.

Cognitive Control Facilitates Attentional Disengagement during Second Language Comprehension

Bilinguals learn to resolve conflict between their two languages and that skill has been hypothesized to create long-term adaptive changes in cognitive functioning. Yet, little is known about how bilinguals recruit cognitive control to enable efficient use of one of their languages, especially in the less skilled and more effortful second language (L2). Here we examined how real-time cognitive control engagement influences L2 sentence comprehension (i.e., conflict adaptation). We tested a group of English monolinguals and a group of L2 English speakers using a recently-developed cross-task adaptation paradigm. Stroop sequences were pseudo-randomly interleaved with a visual-world paradigm in which participants were asked to carry out spoken instructions that were either syntactically ambiguous or unambiguous. Consistent with previous research, eye-movement results showed that Stroop-related conflict improved the ability to engage correct-goal interpretations, and disengage incorrect-goal interpretations, during ambiguous instructions. Such cognitive-to-language modulations were similar in both groups, but only in the engagement piece. In the disengagement portion, the modulation emerged earlier in bilinguals than in monolinguals, suggesting group differences in attentional disengagement following cognitive control recruitment. Additionally, incorrect-goal eye-movements were modulated by individual differences in working memory, although differently for each group, suggesting an involvement of both language-specific and domain-general resources.