How the Brain Processes Causal Inferences in Text

The neural and cognitive basis of expository text comprehension

As science and technology rapidly progress, it becomes increasingly important to understand how individuals comprehend expository technical texts that explain these advances. This study examined differences in individual readers' technical comprehension performance and differences among texts, using functional brain imaging to measure regional brain activity while students read passages on technical topics and then took a comprehension test. Better comprehension of the technical passages was related to higher activation in regions of the left inferior frontal gyrus, left superior parietal lobe, bilateral dorsolateral prefrontal cortex, and bilateral hippocampus. These areas are associated with the construction of a mental model of the passage and with the integration of new and prior knowledge in memory. Poorer comprehension of the passages was related to greater activation of the ventromedial prefrontal cortex and the precuneus, areas involved in autobiographical and episodic memory retrieval. More comprehensible passages elicited more brain activation associated with establishing links among different types of information in the text and activation associated with establishing conceptual coherence within the text representation. These findings converge with previous behavioral research in their implications for teaching technical learners to become better comprehenders and for improving the structure of instructional texts, to facilitate scientific and technological comprehension.

A common neural code for meaning in discourse production and comprehension

How does the brain code the meanings conveyed by language? Neuroimaging studies have investigated this by linking neural activity patterns during discourse comprehension to semantic models of language content. Here, we applied this approach to the production of discourse for the first time. Participants underwent fMRI while producing and listening to discourse on a range of topics. We used a distributional semantic model to quantify the similarity between different speech passages and identified where similarity in neural activity was predicted by semantic similarity. When people produced discourse, speech on similar topics elicited similar activation patterns in a widely distributed and bilateral brain network. This network was overlapping with, but more extensive than, the regions that showed similarity effects during comprehension. Critically, cross-task neural similarities between comprehension and production were also predicted by similarities in semantic content. This result suggests that discourse semantics engages a common neural code that is shared between comprehension and production. Effects of semantic similarity were bilateral in all three RSA analyses, even while univariate activation contrasts in the same data indicated left-lateralised BOLD responses. This indicates that right-hemisphere regions encode semantic properties even when they are not activated above baseline. We suggest that right-hemisphere regions play a supporting role in processing the meaning of discourse during both comprehension and production.

Weaving a story: Narrative formation over prolonged time scales engages social cognition and frontoparietal networks

Forming narratives is of key importance to human experience, enabling one to render large amounts of information into relatively compacted stories for future retrieval, giving meaning to otherwise fragmented occurrences. The neural mechanisms that underlie coherent narrative construction of causally connected information over prolonged temporal periods are yet unclear. Participants in this fMRI study observed consecutive scenes from a full-length movie either in their original order, enabling causal inferences over time, or in reverse order, impeding a key component of coherent narratives-causal inference. In between scenes, we presented short periods of blank screens for examining post-encoding processing effects. Using multivariate pattern analysis (MVPA) followed by seed-base correlation analysis, we hypothesized that networks involved in online monitoring of incoming information on the one hand, and offline processing of previous occurrences on the other would differ between the groups. We found that despite the exposure to the same scenes, the chronological-order condition exhibited enhanced functional connectivity in frontoparietal regions associated with information integration and working memory. The reverse-order condition yielded offline, post-scene coactivation of neural networks involved in social cognition and particularly theory of mind and action comprehension. These findings shed light on offline processes of narrative construction efforts, highlighting the role of social cognition networks in seeking for narrative coherence.

Understanding an implicated causality: The brain network for processing concessive relations

Concessive relations, often indicated by conjunction words such as although, are semantically and pragmatically more complex than causal relations (expressed using because), as they involve more semantic features such as implicated meaning and negation. However, it remains unclear how linguistic-level complexity is manifested through different brain activities and functional connectivities. This fMRI study investigated how the neural underpinnings of concessive relations differ from those of causal relations. Pragmatically congruent and incongruent words were embedded in causal as well as concessive sentences. The whole-brain analysis revealed that relative to because-congruent sentences, although-congruent sentences evoked increased activations in a left network including IFG, bilateral MFG, mPFC, pMTG, and TPJ. DCM analysis showed that while the functional connectivity from IFG to MFG was commonly involved in processing concessive and causal relations, functional connectivities from pMTG to IFG and from pMTG to TPJ were involved in processing causal and concessive relations, respectively.

Neural Correlates of Causal Inferences in Discourse Understanding and Logical Problem-Solving: A Meta-Analysis Study

In discourse comprehension, we need to draw inferences to make sense of discourse. Previous neuroimaging studies have investigated the neural correlates of causal inferences in discourse understanding. However, these findings have been divergent, and how these types of inferences are related to causal inferences in logical problem-solving remains unclear. Using the activation likelihood estimation (ALE) approach, the current meta-analysis analyzed 19 experiments on causal inferences in discourse understanding and 20 experiments on those in logical problem-solving to identify the neural correlates of these two cognitive processes and their shared and distinct neural correlates. We found that causal inferences in discourse comprehension recruited a left-lateralized frontotemporal brain system, including the left inferior frontal gyrus, the left middle temporal gyrus (MTG), and the bilateral medial prefrontal cortex (MPFC), while causal inferences in logical problem-solving engaged a nonoverlapping brain system in the frontal and parietal cortex, including the left inferior frontal gyrus, the bilateral middle frontal gyri, the dorsal MPFC, and the left inferior parietal lobule (IPL). Furthermore, the pattern similarity analyses showed that causal inferences in discourse understanding were primarily related to the terms about language processing and theory-of-mind processing. Both types of inferences were found to be related to the terms about memory and executive function. These findings suggest that causal inferences in discourse understanding recruit distinct neural bases from those in logical problem-solving and rely more on semantic knowledge and social interaction experiences.

More Than Words: Extra-Sylvian Neuroanatomic Networks Support Indirect Speech Act Comprehension and Discourse in Behavioral Variant Frontotemporal Dementia

Indirect speech acts—responding “I forgot to wear my watch today” to someone who asked for the time—are ubiquitous in daily conversation, but are understudied in current neurobiological models of language. To comprehend an indirect speech act like this one, listeners must not only decode the lexical-semantic content of the utterance, but also make a pragmatic, bridging inference. This inference allows listeners to derive the speaker’s true, intended meaning—in the above dialog, for example, that the speaker cannot provide the time. In the present work, we address this major gap by asking non-aphasic patients with behavioral variant frontotemporal dementia (bvFTD, n = 21) and brain-damaged controls with amnestic mild cognitive impairment (MCI, n = 17) to judge simple question-answer dialogs of the form: “Do you want some cake for dessert?” “I’m on a very strict diet right now,” and relate the results to structural and diffusion MRI. Accuracy and reaction time results demonstrate that subjects with bvFTD, but not MCI, are selectively impaired in indirect relative to direct speech act comprehension, due in part to their social and executive limitations, and performance is related to caregivers’ judgment of communication efficacy. MRI imaging associates the observed impairment in bvFTD to cortical thinning not only in traditional language-associated regions, but also in fronto-parietal regions implicated in social and executive cerebral networks. Finally, diffusion tensor imaging analyses implicate white matter tracts in both dorsal and ventral projection streams, including superior longitudinal fasciculus, frontal aslant, and uncinate fasciculus. These results have strong implications for updated neurobiological models of language, and emphasize a core, language-mediated social disorder in patients with bvFTD.

The hippocampal region is necessary for text comprehension and memorization: a combined VBM/DTI study in neuropsychological patients

According to the Construction-Integration model (Kintsch 1988; Kintsch 1998), two forms of representation are activated during the reading and the comprehension of a text: 1) the text base, which includes semantic propositions and 2) the situation model, corresponding to the integration of the information contained in the text to the memories and knowledge of the reader. Functional neuroimaging studies in healthy subjects have shown that the text base is underpinned by frontal regions and lateral temporal regions whereas the situation model would rather depend on the posterior cingulate cortex, the precuneus and other regions depending on the dimension studied. However, the brain regions highlighted so far were only involved in comprehension and not necessary for this cognitive ability. For the first time, we explored the brain structures necessary to understand texts using a combined VBM/DTI approach in neuropsychological patients with whom we obtained comprehension scores (text base and situation model) after the reading of narrative texts. To our great surprise and contrary to our hypotheses, which were based on the results of functional neuroimaging studies, our own results show that it is the hippocampal region that is necessary to activate and memorize/remember the text base and the situation model. The highlighting of a link between the integrity of a portion of the uncinate fasciculus which is well known to play a role in semantic processing and the performance scores of the text base suggests that the hippocampal region is necessary not only for the retrieval of the text base and of the situation model thanks to episodic memory, but also for the activation of the text base during the reading and the comprehension of a text.

Simulating a Computational Biological Model, Rather Than Reading, Elicits Changes in Brain Activity during Biological Reasoning

The creation and analysis of models is integral to all scientific disciplines, and modeling is considered a core competency in undergraduate biology education. There remains a gap in understanding how modeling activities may support changes in students' neural representations. The aim of this study was to evaluate the effects of simulating a model on undergraduates' behavioral accuracy and neural response patterns when reasoning about biological systems. During brief tutorials, students (n = 30) either simulated a computer model or read expert analysis of a gene regulatory system. Subsequently, students underwent functional magnetic resonance imaging while responding to system-specific questions and system-general questions about modeling concepts. Although groups showed similar behavioral accuracy, the Simulate group showed higher levels of activation than the Read group in right cuneal and postcentral regions during the system-specific task and in the posterior insula and cingulate gyrus during the system-general task. Students' behavioral accuracy during the system-specific task correlated with lateral prefrontal brain activity independent of instruction group. Findings highlight the sensitivity of neuroimaging methods for identifying changes in representations that may not be evident at the behavioral level. This work provides a foundation for research on how distinct pedagogical approaches may affect the neural networks students engage when reasoning about biological phenomena.

Pragmatic influences on sentence integration: Evidence from eye movements

To understand a discourse, readers must rapidly process semantic and syntactic information and extract the pragmatic information these sources imply. An important question concerns how this pragmatic information influences discourse processing in return. We address this issue in two eye movement experiments that investigate the influence of pragmatic inferences on the processing of inter-sentence integration. In Experiments 1a and 1b, participants read two-sentence discourses in Chinese in which the first sentence introduced an event and the second described its consequence, where the sentences were linked using either the causal connective "suoyi" (meaning "so" or "therefore") or not. The second sentence included a target word that was unmarked or marked using the focus particle "zhiyou" (meaning "only") in Experiment 1a or "shi" (equivalent to an it-cleft) in Experiment 1b. These particles have the pragmatic function of implying a contrast between a target element and its alternatives. The results showed that while the causal connective facilitated the processing of unmarked words in causal contexts (a connective facilitation effect), this effect was eliminated by the presence of the focus particle. This implies that contrastive information is inferred sufficiently rapidly during reading that it can influence semantic processes involved in sentence integration. Experiment 2 showed that disruption due to conflict between the processing requirements of focus and inter-sentence integration occurred only in causal and not adversative connective contexts, confirming that processing difficulty occurred when a contrastive relationship was not possible.

Gamma tACS over the temporal lobe increases the occurrence of Eureka! moments

The solution to a problem might manifest itself as a burst of unexpected, unpredictable clarity. Such Eureka! events, or Insight moments, are among the most fascinating mysteries of human cognition, whose neurophysiological substrate seems to include a role for oscillatory activity within the α and γ bands in the right parietal and temporal brain regions. We tested this hypothesis on thirty-one healthy participants using transcranial Alternating Current Stimulation (tACS) to externally amplify α (10 Hz) and γ (40 Hz) activity in the right parietal and temporal lobes, respectively. During γ-tACS over the right temporal lobe, we observed an increase in accuracy on a verbal insight task. Furthermore, electroencephalography (EEG) data revealed an increase in γ spectral power over bilateral temporal lobes after stimulation. Additionally, resting-state functional MRI data acquired before the stimulation session suggested a correlation between behavioral response to right temporal lobe tACS and functional connectivity of bilateral temporal lobes, in line with the bilateral increase in γ band revealed by EEG. Overall, results suggest the possibility of enhancing the probability of generating Eureka! moments in humans by means of frequency-specific noninvasive brain stimulation.

Grounding the neurobiology of language in first principles: The necessity of non-language-centric explanations for language comprehension

Recent decades have ushered in tremendous progress in understanding the neural basis of language. Most of our current knowledge on language and the brain, however, is derived from lab-based experiments that are far removed from everyday language use, and that are inspired by questions originating in linguistic and psycholinguistic contexts. In this paper we argue that in order to make progress, the field needs to shift its focus to understanding the neurobiology of naturalistic language comprehension. We present here a new conceptual framework for understanding the neurobiological organization of language comprehension. This framework is non-language-centered in the computational/neurobiological constructs it identifies, and focuses strongly on context. Our core arguments address three general issues: (i) the difficulty in extending language-centric explanations to discourse; (ii) the necessity of taking context as a serious topic of study, modeling it formally and acknowledging the limitations on external validity when studying language comprehension outside context; and (iii) the tenuous status of the language network as an explanatory construct. We argue that adopting this framework means that neurobiological studies of language will be less focused on identifying correlations between brain activity patterns and mechanisms postulated by psycholinguistic theories. Instead, they will be less self-referential and increasingly more inclined towards integration of language with other cognitive systems, ultimately doing more justice to the neurobiological organization of language and how it supports language as it is used in everyday life.

Inference comprehension in text reading: Performance of individuals with right- versus left-hemisphere lesions and the influence of cognitive functions

Background

Right-hemisphere lesions (RHL) may impair inference comprehension. However, comparative studies between left-hemisphere lesions (LHL) and RHL are rare, especially regarding reading comprehension. Moreover, further knowledge of the influence of cognition on inferential processing in this task is needed.

Objectives

To compare the performance of patients with RHL and LHL on an inference reading comprehension task. We also aimed to analyze the effects of lesion site and to verify correlations between cognitive functions and performance on the task.

Methods

Seventy-five subjects were equally divided into the groups RHL, LHL, and control group (CG). The Implicit Management Test was used to evaluate inference comprehension. In this test, subjects read short written passages and subsequently answer five types of questions (explicit, logical, distractor, pragmatic, and other), which require different types of inferential reasoning. The cognitive functional domains of attention, memory, executive functions, language, and visuospatial abilities were assessed using the Cognitive Linguistic Quick Test (CLQT).

Results

The LHL and RHL groups presented difficulties in inferential comprehension in comparison with the CG. However, the RHL group presented lower scores than the LHL group on logical, pragmatic and other questions. A covariance analysis did not show any effect of lesion site within the hemispheres. Overall, all cognitive domains were correlated with all the types of questions from the inference test (especially logical, pragmatic, and other). Attention and visuospatial abilities affected the scores of both the RHL and LHL groups, and only memory influenced the performance of the RHL group.

Conclusions

Lesions in either hemisphere may cause difficulties in making inferences during reading. However, processing more complex inferences was more difficult for patients with RHL than for those with LHL, which suggests that the right hemisphere plays an important role in tasks with higher comprehension demands. Cognition influences inferential processing during reading in brain-injured subjects.

The influence of perceptual similarity and individual differences on false memories in aging

Previous false memory research has suggested that older adults' false memories are based on an overreliance on gist processing in the absence of item-specific details. Yet, false memory studies have rarely taken into consideration the precise role of item-item similarity on the cognitive and neural mechanisms underlying perceptual false memories in older adults. In addition, work in our laboratory has suggested that when investigating the neural basis of false memories in older adults, it is equally as critical to take into account interindividual variability in behavior. With both factors in mind, the present study was the first to examine how both controlled, systematic differences in perceptual relatedness between targets and lures and individual differences in true and false recognition contribute to the neural basis of both true and false memories in older adults. Results suggest that between-subject variability in memory performance modulates neural activity in key regions associated with false memories in aging, whereas systematic differences in perceptual similarity did not modulate neural activity associated with false memories.

Human Brain Activity Time-Locked to Narrative Event Boundaries

Readers structure narrative text into a series of events in order to understand and remember the text. In this study, subjects read brief narratives describing everyday activities while brain activity was recorded with functional magnetic resonance imaging. Subjects later read the stories again to divide them into large and small events. During the initial reading, points later identified as boundaries between events were associated with transient increases in activity in a number of brain regions whose activity was mediated by changes in the narrated situation, such as changes in characters' goals. These results indicate that the segmentation of narrated activities into events is a spontaneous part of reading, and that this process of segmentation is likely dependent on neural responses to changes in the narrated situation.

Integration Processes Compared: Cortical Differences for Consistency Evaluation and Passive Comprehension in Local and Global Coherence

This research studies the neural systems underlying two integration processes that take place during natural discourse comprehension: consistency evaluation and passive comprehension. Evaluation was operationalized with a consistency judgment task and passive comprehension with a passive listening task. Using fMRI, the experiment examined the integration of incoming sentences with more recent, local context and with more distal, global context in these two tasks. The stimuli were stories in which we manipulated the consistency of the endings with the local context and the relevance of the global context for the integration of the endings. A whole-brain analysis revealed several differences between the two tasks. Two networks previously associated with semantic processing and attention orienting showed more activation during the judgment than the passive listening task. A network previously associated with episodic memory retrieval and construction of mental scenes showed greater activity when global context was relevant, but only during the judgment task. This suggests that evaluation, more than passive listening, triggers the reinstantiation of global context and the construction of a rich mental model for the story. Finally, a network previously linked to fluent updating of a knowledge base showed greater activity for locally consistent endings than inconsistent ones, but only during passive listening, suggesting a mode of comprehension that relies on a local scope approach to language processing. Taken together, these results show that consistency evaluation and passive comprehension weigh differently on distal and local information and are implemented, in part, by different brain networks.

Hemispheric asymmetry in event knowledge activation during incremental language comprehension: A visual half-field ERP study

During incremental language comprehension, the brain activates knowledge of described events, including knowledge elements that constitute semantic anomalies in their linguistic context. The present study investigates hemispheric asymmetries in this process, with the aim of advancing our understanding of the neural basis and functional properties of event knowledge activation during incremental comprehension. In a visual half-field event-related brain potential (ERP) experiment, participants read brief discourses in which the third sentence contained a word that was either highly expected, semantically anomalous but related to the described event (Event-Related), or semantically anomalous but unrelated to the described event (Event-Unrelated). For both visual fields of target word presentation, semantically anomalous words elicited N400 ERP components of greater amplitude than did expected words. Crucially, Event-Related anomalous words elicited a reduced N400 relative to Event-Unrelated anomalous words only with left visual field/right hemisphere presentation. This result suggests that right hemisphere processes are critical to the activation of event knowledge elements that violate the linguistic context, and in doing so informs existing theories of hemispheric asymmetries in semantic processing during language comprehension. Additionally, this finding coincides with past research suggesting a crucial role for the right hemisphere in elaborative inference generation, raises interesting questions regarding hemispheric coordination in generating event-specific linguistic expectancies, and more generally highlights the possibility of functional dissociation of event knowledge activation for the generation of elaborative inferences and for linguistic expectancies.

The Processing of Causal and Hierarchical Relations in Semantic Memory as Revealed by N400 and Frontal Negativity

Most current studies investigating semantic memory have focused on associative (ring-emerald) or taxonomic relations (bird-sparrow). Little is known about the question of how causal relations (virus-epidemic) are stored and accessed in semantic memory. The goal of this study was to examine the processing of causally related, general associatively related and hierarchically related word pairs when participants were required to evaluate whether pairs of words were related in any way. The ERP data showed that the N400 amplitude (200-500 ms) elicited by unrelated related words was more negative than all related words. Furthermore, the late frontal distributed negativity (500-700 ms) elicited by causally related words was smaller than hierarchically related words, but not for general associated words. These results suggested the processing of causal relations and hierarchical relations in semantic memory recruited different degrees of cognitive resources, especially for role binding.

Neural correlates of early-closure garden-path processing: Effects of prosody and plausibility

Functional magnetic resonance imaging (fMRI) was used to investigate neural correlates of early-closure garden-path sentence processing and use of extrasyntactic information to resolve temporary syntactic ambiguities. Sixteen participants performed an auditory picture verification task on sentences presented with natural versus flat intonation. Stimuli included sentences in which the garden-path interpretation was plausible, implausible because of a late pragmatic cue, or implausible because of a semantic mismatch between an optionally transitive verb and the following noun. Natural sentence intonation was correlated with left-hemisphere temporal activation, but also with activation that suggests the allocation of more resources to interpretation when natural prosody is provided. Garden-path processing was associated with upregulation in bilateral inferior parietal and right-hemisphere dorsolateral prefrontal and inferior frontal cortex, while differences between the strength and type of plausibility cues were also reflected in activation patterns. Region of interest (ROI) analyses in regions associated with complex syntactic processing are consistent with a role for posterior temporal cortex supporting access to verb argument structure. Furthermore, ROI analyses within left-hemisphere inferior frontal gyrus suggest a division of labour, with the anterior-ventral part primarily involved in syntactic-semantic mismatch detection, the central part supporting structural reanalysis, and the posterior-dorsal part showing a general structural complexity effect.

Physics instruction induces changes in neural knowledge representation during successive stages of learning

Incremental instruction on the workings of a set of mechanical systems induced a progression of changes in the neural representations of the systems. The neural representations of four mechanical systems were assessed before, during, and after three phases of incremental instruction (which first provided information about the system components, then provided partial causal information, and finally provided full functional information). In 14 participants, the neural representations of four systems (a bathroom scale, a fire extinguisher, an automobile braking system, and a trumpet) were assessed using three recently developed techniques: (1) machine learning and classification of multi-voxel patterns; (2) localization of consistently responding voxels; and (3) representational similarity analysis (RSA). The neural representations of the systems progressed through four stages, or states, involving spatially and temporally distinct multi-voxel patterns: (1) initially, the representation was primarily visual (occipital cortex); (2) it subsequently included a large parietal component; (3) it eventually became cortically diverse (frontal, parietal, temporal, and medial frontal regions); and (4) at the end, it demonstrated a strong frontal cortex weighting (frontal and motor regions). At each stage of knowledge, it was possible for a classifier to identify which one of four mechanical systems a participant was thinking about, based on their brain activation patterns. The progression of representational states was suggestive of progressive stages of learning: (1) encoding information from the display; (2) mental animation, possibly involving imagining the components moving; (3) generating causal hypotheses associated with mental animation; and finally (4) determining how a person (probably oneself) would interact with the system. This interpretation yields an initial, cortically-grounded, theory of learning of physical systems that potentially can be related to cognitive learning theories by suggesting links between cortical representations, stages of learning, and the understanding of simple systems.

Word-to-text integration: Message level and lexical level influences in ERPs

Although the reading of connected text proceeds in a largely incremental fashion, the relative degree to which message level and lexical level factors contribute to integration processes across sentences remains an open question. We examined the influence of both factors on single words using event-related potentials (ERPs). Word pairs with either strong or weak forward association strength were critical items: embedded as coreferential words within two-sentence passages in a text comprehension task, and as isolated word pairs in a word meaning judgment task. While the N400 ERP component reflected an effect of forward association strength on lexico-semantic processing in the word task (i.e., reduced N400 amplitudes were seen for strongly associated pairs relative to weakly associated pairs), in the comprehension task, passages embedded with any associated word pairs elicited reduced N400 amplitudes relative to coherent baseline passages lacking one of the critical words. These comprehension effects reflect responses from the highest skilled comprehenders. The results demonstrate the effects of message level factors, and reading abilities, on the processing of single words.

Mood-dependent integration in discourse comprehension: happy and sad moods affect consistency processing via different brain networks

According to recent research on language comprehension, the semantic features of a text are not the only determinants of whether incoming information is understood as consistent. Listeners' pre-existing affective states play a crucial role as well. The current fMRI experiment examines the effects of happy and sad moods during comprehension of consistent and inconsistent story endings, focusing on brain regions previously linked to two integration processes: inconsistency detection, evident in stronger responses to inconsistent endings, and fluent processing (accumulation), evident in stronger responses to consistent endings. The analysis evaluated whether differences in the BOLD response for consistent and inconsistent story endings correlated with self-reported mood scores after a mood induction procedure. Mood strongly affected regions previously associated with inconsistency detection. Happy mood increased sensitivity to inconsistency in regions specific for inconsistency detection (e.g., left IFG, left STS), whereas sad mood increased sensitivity to inconsistency in regions less specific for language processing (e.g., right med FG, right SFG). Mood affected more weakly regions involved in accumulation of information. These results show that mood can influence activity in areas mediating well-defined language processes, and highlight that integration is the result of context-dependent mechanisms. The finding that language comprehension can involve different networks depending on people's mood highlights the brain's ability to reorganize its functions.

The Dorsomedial Prefrontal Cortex Plays a Causal Role in Integrating Social Impressions from Faces and Verbal Descriptions

Several neuroimaging studies point to a key role of the dorsomedial prefrontal cortex (dmPFC) in the formation of socially relevant impressions. In 3 different experiments, participants were required to form socially relevant impressions about other individuals on the basis of text descriptions of their social behaviors, and to decide whether a face alone, a trait adjective (e.g., "selfish"), or a face presented with a trait adjective was consistent or inconsistent with the impression they had formed. Before deciding whether the target stimulus matched the impression they had previously formed, participants received transcranial magnetic stimulation (TMS) over the dmPFC, the inferior frontal gyrus (IFG, also implicated in social impression formation), or over a control site (vertex). Results from the 3 experiments converged in showing that interfering with dmPFC activity significantly delayed participants in responding whether a face-adjective pair was consistent with the impression they had formed. No effects of TMS were observed following stimulation of the IFG or when evaluations had to be made on faces or trait adjectives presented alone. Our findings critically extend previous neuroimaging evidence by indicating a causal role of the dmPFC in creating coherent impressions based on the integration of face and verbal description of social behaviors.

The role of ventromedial prefrontal cortex in text comprehension inferences: semantic coherence or socio-emotional perspective?

Two hypotheses about the role of the ventromedial prefrontal cortex (vmPFC) in narrative comprehension inferences, global semantic coherence versus socio-emotional perspective, were tested. Seven patients with vmPFC lesions and seven demographically matched healthy comparison participants read short narratives. Using the consistency paradigm, narratives required participants to make either an emotional or visuo-spatial inference, in which a target sentence provided consistent or inconsistent information with a previous emotional state of a character or a visuo-spatial location of an object. Healthy comparison participants made the inferences both for spatial and emotional stories, as shown by longer reading times for inconsistent critical sentences. For patients with vmPFC lesions, inconsistent sentences were read slower in the spatial stories, but not in the emotional ones. This pattern of results is compatible with the hypothesis that vmPFC contributes to narrative comprehension by supporting inferences about socio-emotional aspects of verbally described situations.

The contribution of fronto-parietal regions to sentence comprehension: insights from the Moses illusion

To interpret a sentence, the reader must not only process the linguistic input, but many times has also to draw inferences about what is implicitly stated. In some cases, the generation and integration of inferred information may lead to semantic illusions. In these sentences, subjects fail to detect errors such as in "It was two animals of each kind that Moses took on the ark" despite knowing that the correct answer is Noah, not Moses. The relative inability to notice these errors raises questions about how people establish and integrate inferences and which conditions improve error detection. To unravel the neural processes underlying inference and error detection in language comprehension, we carried out an fMRI study in which participants read sentences containing true or false statements. The false statements either took the form of more obvious (i.e., clearly false) or subtle (i.e., semantic illusions) inconsistent relations. Participants had to decide if each statement was true or false. Processing semantic illusions relative to true and clearly false sentences significantly engaged the right inferior parietal lobule, suggesting higher demands in establishing coherence. Successful versus unsuccessful error detection revealed a network of regions, including right dorsolateral prefrontal cortex, orbitofrontal, insula/putamen and anterior cingulate cortex. Such activation was significantly correlated with overall response accuracy to the illusions. These results suggest that to detect the semantic conflict, people must inhibit the tendency to draw pragmatic inferences. These findings demonstrate that fronto-parietal areas are involved in inference and inhibition processes necessary for establishing semantic coherence.

Neurobiological bases of reading comprehension: Insights from neuroimaging studies of word level and text level processing in skilled and impaired readers

For accurate reading comprehension, readers must first learn to map letters to their corresponding speech sounds and meaning and then they must string the meanings of many words together to form a representation of the text. Furthermore, readers must master the complexities involved in parsing the relevant syntactic and pragmatic information necessary for accurate interpretation. Failure in this process can occur at multiple levels and cognitive neuroscience has been helpful in identifying the underlying causes of success and failure in reading single words and in reading comprehension. In general, neurobiological studies of skilled reading comprehension indicate a highly overlapping language circuit for single word reading, reading comprehension and listening comprehension with largely quantitative differences in a number of reading and language related areas. This paper reviews relevant research from studies employing neuroimaging techniques to study reading with a focus on the relationship between reading skill, single word reading, and text comprehension.

Effects of working memory span on processing of lexical associations and congruence in spoken discourse

The goal of this study was to determine whether variability in working memory (WM) capacity and cognitive control affects the processing of global discourse congruence and local associations among words when participants listened to short discourse passages. The final, critical word of each passage was either associated or unassociated with a preceding prime word (e.g., “He was not prepared for the fame and fortune/praise”). These critical words were also either congruent or incongruent with respect to the preceding discourse context [e.g., a context in which a prestigious prize was won (congruent) or in which the protagonist had been arrested (incongruent)]. We used multiple regression to assess the unique contribution of suppression ability (our measure of cognitive control) and WM capacity on the amplitude of individual N400 effects of congruence and association. Our measure of suppression ability did not predict the size of the N400 effects of association or congruence. However, as expected, the results showed that high WM capacity individuals were less sensitive to the presence of lexical associations (showed smaller N400 association effects). Furthermore, differences in WM capacity were related to differences in the topographic distribution of the N400 effects of discourse congruence. The topographic differences in the global congruence effects indicate differences in the underlying neural generators of the N400 effects, as a function of WM. This suggests additional, or at a minimum, distinct, processing on the part of higher capacity individuals when tasked with integrating incoming words into the developing discourse representation.

Separable processes before, during, and after the N400 elicited by previously inferred and new information: evidence from time-frequency decompositions

Successful comprehension during reading often requires inferring information not explicitly presented. This information is readily accessible when subsequently encountered, and a neural correlate of this is an attenuation of the N400 event-related potential (ERP). We used ERPs and time-frequency (TF) analysis to investigate neural correlates of processing inferred information after a causal coherence inference had been generated during text comprehension. Participants read short texts, some of which promoted inference generation. After each text, they performed lexical decisions to target words that were unrelated or inference-related to the preceding text. Consistent with previous findings, inference-related words elicited an attenuated N400 relative to unrelated words. TF analyses revealed unique contributions to the N400 from activity occurring at 1-6 Hz (theta) and 0-2 Hz (delta), supporting the view that multiple, sequential processes underlie the N400.

Hemispheric differences in the organization of memory for text ideas

The goal of this study was to examine hemispheric asymmetries in episodic memory for discourse. Access to previously comprehended information is essential for mapping incoming information to representations of "who did what to whom" in memory. An item-priming-in-recognition paradigm was used to examine differences in how the hemispheres represent discourse. Both hemispheres retained accurate information about concepts from short passages, but the information was organized differently. The left hemisphere was sensitive to the structural relations among concepts in a text, whereas the right hemisphere differentiated information that appeared in one passage from information that appeared in another. Moreover, the right hemisphere, but not the left hemisphere, retained information about the spatial/temporal proximity among concepts in a passage. Implications of these results for the roles of the right and left hemispheres in comprehending connected discourse are discussed.

The role of the right hemisphere in metaphor comprehension: a meta-analysis of functional magnetic resonance imaging studies

The role of the right hemisphere (RH) in metaphor comprehension is still controversial. Numerous neuroimaging studies have found that conventionality, sentential context, and task demand can influence the involvement of the RH in metaphor processing. The current meta-analysis used foci from 17 original functional magnetic resonance imaging studies to identify what factors modulate the involvement of the RH in metaphor processing. Activation likelihood estimation was used for quantification. We focused on the contrast of metaphorical meaning processing versus literal meaning processing and calculated the meta-analysis effects when (1) metaphorical meaning is conventional, (2) metaphorical meaning is novel, (3) metaphorical and literal meaning are presented in words, (4) metaphorical and literal meaning are presented in sentential context, (5) task is valence judgment, and (6) task is semantic relatedness judgment. The results indicated that the RH only showed significant effects in metaphor processing when the metaphorical meaning is novel, when metaphorical meaning is presented in sentential context, and when the task is semantic relatedness judgment. The effects were located in right fronto-temporal regions, including inferior frontal gyrus, middle frontal gyrus, insula, superior temporal gyrus, and middle temporal gyrus. These results suggest that conventionality, contextual complexity, and task demand can modulate the effect of figurativeness and influence the involvement of RH in metaphor comprehension. The main role of the RH in metaphor processing is related with activating broad semantic fields and integrating concepts that may have distant semantic relations, and hence provide support for the view that the RH is responsible for processing coarse semantic information in language comprehension.

Neural correlates of bridging inferences and coherence processing

We explored the neural correlates of bridging inferences and coherence processing during story comprehension using Positron Emission Tomography (PET). Ten healthy right-handed volunteers were visually presented three types of stories (Strong Coherence, Weak Coherence, and Control) consisted of three sentences. The causal connectedness among sentences in the Strong Coherence story was strong that readers would not have to generate bridging inferences, whereas the causal antecedent of the last sentence in the Weak Coherence story was not explicitly stated so that readers should draw bridging inferences to fill the gap between sentences. It was found that the left middle temporal gyrus was activated while participants read the Weak Coherence stories. In contrast, the dorsomedial prefrontal cortex (dmPFC) and posterior cingulate cortex were activated only in the Strong Coherence condition. This suggests that the dmPFC was involved in coherence processing whereas bridging inference was mediated by the left middle temporal gyrus. It was also found that anterior temporal pole and the temporo-parietal junction mediated general semantic processing.

Not all analogies are created equal: Associative and categorical analogy processing following brain damage

Current research on analogy processing assumes that different conceptual relations are treated similarly. However, just as words and concepts are related in distinct ways, different kinds of analogies may employ distinct types of relationships. An important distinction in how words are related is the difference between associative (dog-bone) and categorical (dog-cat) relations. To test the hypothesis that analogical mapping of different types of relations would have different neural instantiations, we tested patients with left and right hemisphere lesions on their ability to understand two types of analogies, ones expressing an associative relationship and others expressing a categorical relationship. Voxel-based lesion-symptom mapping (VLSM) and behavioral analyses revealed that associative analogies relied on a large left-lateralized language network while categorical analogies relied on both left and right hemispheres. The verbal nature of the task could account for the left hemisphere findings. We argue that categorical relations additionally rely on the right hemisphere because they are more difficult, abstract, and fragile, and contain more distant relationships.

From reference to sense: how the brain encodes meaning for speaking

In speaking, semantic encoding is the conversion of a non-verbal mental representation (the reference) into a semantic structure suitable for expression (the sense). In this fMRI study on sentence production we investigate how the speaking brain accomplishes this transition from non-verbal to verbal representations. In an overt picture description task, we manipulated repetition of sense (the semantic structure of the sentence) and reference (the described situation) separately. By investigating brain areas showing response adaptation to repetition of each of these sentence properties, we disentangle the neuronal infrastructure for these two components of semantic encoding. We also performed a control experiment with the same stimuli and design but without any linguistic task to identify areas involved in perception of the stimuli per se. The bilateral inferior parietal lobes were selectively sensitive to repetition of reference, while left inferior frontal gyrus showed selective suppression to repetition of sense. Strikingly, a widespread network of areas associated with language processing (left middle frontal gyrus, bilateral superior parietal lobes and bilateral posterior temporal gyri) all showed repetition suppression to both sense and reference processing. These areas are probably involved in mapping reference onto sense, the crucial step in semantic encoding. These results enable us to track the transition from non-verbal to verbal representations in our brains.

False Belief vs. False Photographs: A Test of Theory of Mind or Working Memory?

Theory of mind (ToM), the ability to reason about other people’s thoughts and beliefs, has been traditionally studied in behavioral and neuroimaging experiments by comparing performance in “false belief” and “false photograph” (control) stories. However, some evidence suggests that these stories are not matched in difficulty, complicating the interpretation of results. Here, we more fully evaluated the relative difficulty of comprehending these stories and drawing inferences from them. Subjects read false belief and false photograph stories followed by comprehension questions that probed true (“reality” questions) or false beliefs (“representation” questions) appropriate to the stories. Stories and comprehension questions were read and answered, respectively, more slowly in the false photograph than false belief conditions, indicating their greater difficulty. Interestingly, accuracy on representation questions for false photograph stories was significantly lower than for all other conditions and correlated positively with participants’ working memory span scores. These results suggest that drawing representational inferences from false photo stories is particularly difficult and places heavy demands on working memory. Extensive naturalistic practice with ToM reasoning may enable a more flexible and efficient mental representation of false belief stories, resulting in lower memory load requirements. An important implication of these results is that the differential modulation of right temporal–parietal junction (RTPJ) during ToM and “false photo” control conditions may reflect the documented negative correlation of RTPJ activity with working memory load rather than a specialized involvement in ToM processes.

The influence of context on hemispheric recruitment during metaphor processing

Although the left hemisphere's prominence in language is well established, less emphasis has been placed on possible roles for the right hemisphere. Behavioral, patient, and neuroimaging research suggests that the right hemisphere may be involved in processing figurative language. Additionally, research has demonstrated that context can modify language processes and facilitate comprehension. Here we investigated how figurativeness and context influenced brain activation, with a specific interest in right hemisphere function. Previous work in our laboratory indicated that novel stimuli engaged right inferior frontal gyrus (IFG) and that both novel and familiar metaphors engaged right IFG and right temporal pole. The graded salience hypothesis proposes that context may lessen integration demands, increase the salience of metaphors, and thereby reduce right hemisphere recruitment for metaphors. In the present study, fMRI was used to investigate brain function, whereas participants read literal and metaphoric sentences that were preceded by either a congruent or an incongruent literal sentence. Consistent with prior research, all sentences engaged traditional left hemisphere regions. Differences between metaphors and literal sentences were observed, but only in the left hemisphere. In contrast, a main effect of congruence was found in the right IFG, the right temporal pole, and the dorsal medial pFC. Partially consistent with the graded salience hypothesis, our results highlight the strong influence of context on language, demonstrate the importance of the right hemisphere in discourse, and suggest that, in a wider discourse context, congruence has a greater influence on right hemisphere recruitment than figurativeness.

Deconstructing events: the neural bases for space, time, and causality

Space, time, and causality provide a natural structure for organizing our experience. These abstract categories allow us to think relationally in the most basic sense; understanding simple events requires one to represent the spatial relations among objects, the relative durations of actions or movements, and the links between causes and effects. The present fMRI study investigates the extent to which the brain distinguishes between these fundamental conceptual domains. Participants performed a 1-back task with three conditions of interest (space, time, and causality). Each condition required comparing relations between events in a simple verbal narrative. Depending on the condition, participants were instructed to either attend to the spatial, temporal, or causal characteristics of events, but between participants each particular event relation appeared in all three conditions. Contrasts compared neural activity during each condition against the remaining two and revealed how thinking about events is deconstructed neurally. Space trials recruited neural areas traditionally associated with visuospatial processing, primarily bilateral frontal and occipitoparietal networks. Causality trials activated areas previously found to underlie causal thinking and thematic role assignment, such as left medial frontal and left middle temporal gyri, respectively. Causality trials also produced activations in SMA, caudate, and cerebellum; cortical and subcortical regions associated with the perception of time at different timescales. The time contrast, however, produced no significant effects. This pattern, indicating negative results for time trials but positive effects for causality trials in areas important for time perception, motivated additional overlap analyses to further probe relations between domains. The results of these analyses suggest a closer correspondence between time and causality than between time and space.

The neural correlates of strategic reading comprehension: cognitive control and discourse comprehension

Neuroimaging studies of text comprehension conducted thus far have shed little light on the brain mechanisms underlying strategic learning from text. Thus, the present study was designed to answer the question of what brain areas are active during performance of complex reading strategies. Reading comprehension strategies are designed to improve a reader's comprehension of a text. For example, self-explanation is a complex reading strategy that enhances existing comprehension processes. It was hypothesized that reading strategies would involve areas of the brain that are normally involved in reading comprehension along with areas that are involved in strategic control processes because the readers are intentionally using a complex reading strategy. Subjects were asked to reread, paraphrase, and self-explain three different texts in a block design fMRI study. Activation was found in both executive control and comprehension areas, and furthermore, learning from text was associated with activation in the anterior prefrontal cortex (aPFC). The authors speculate that the aPFC may play a role in coordinating the internal and external modes of thought that are necessary for integrating new knowledge from texts with prior knowledge.

Causation From Perception

Beginning with the research of Albert Michotte, investigators have identified simple perceptual events that observers report as causal. For example, suppose a square moves across a screen and comes to a halt when it makes contact with a second square. If the second square then begins moving in the same direction, observers sometimes report that the first square “pushed” the second or “caused it to move.” Based on such reports, Michotte claimed that people perceive causality, and a number of psychologists and philosophers have followed his lead. This article examines Michotte’s hypothesis by comparing it with its chief rival: Observers possess representations of pushings, pullings, and other events in long-term memory. A Michottean display triggers one of these representations, and the representation classifies the display as an instance of pushing (or pulling, etc.). According to this second explanation, recognizing an event as a pushing is similar to classifying an object as a cup or a dog. Data relevant to this debate come from infant and animal studies, cognitive and neuropsychological dissociation experiments, and studies of context effects and individual differences. However, a review of research in these paradigms finds no reason to prefer Michotte’s theory over its competitor.

Differentiable cortical networks for inferences concerning people's intentions versus physical causality

Cortical activity associated with generating an inference was measured using fMRI. Participants read three-sentence passages that differed in whether or not an inference needed to be drawn to understand them. The inference was based on either a protagonist's intention or a physical consequence of a character's action. Activation was expected in Theory of Mind brain regions for the passages based on protagonists' intentions but not for the physical consequence passages. The activation measured in the right temporo-parietal junction was greater in the intentional passages than in the consequence passages, consistent with predictions from a Theory of Mind perspective. In contrast, there was increased occipital activation in the physical inference passages. For both types of passage, the cortical activity related to the reading of the critical inference sentence demonstrated a recruitment of a common inference cortical network. This general inference-related activation appeared bilaterally in the language processing areas (the inferior frontal gyrus, the temporal gyrus, and the angular gyrus), as well as in the medial to superior frontal gyrus, which has been found to be active in Theory of Mind tasks. These findings are consistent with the hypothesis that component areas of the discourse processing network are recruited as needed based on the nature of the inference. A Protagonist monitoring and synthesis network is proposed as a more accurate account for Theory of Mind activation during narrative comprehension.

Neural correlates of language comprehension in autism spectrum disorders: when language conflicts with world knowledge

In individuals with ASD, difficulties with language comprehension are most evident when higher-level semantic-pragmatic language processing is required, for instance when context has to be used to interpret the meaning of an utterance. Until now, it is unclear at what level of processing and for what type of context these difficulties in language comprehension occur. Therefore, in the current fMRI study, we investigated the neural correlates of the integration of contextual information during auditory language comprehension in 24 adults with ASD and 24 matched control participants. Different levels of context processing were manipulated by using spoken sentences that were correct or contained either a semantic or world knowledge anomaly. Our findings demonstrated significant differences between the groups in inferior frontal cortex that were only present for sentences with a world knowledge anomaly. Relative to the ASD group, the control group showed significantly increased activation in left inferior frontal gyrus (LIFG) for sentences with a world knowledge anomaly compared to correct sentences. This effect possibly indicates reduced integrative capacities of the ASD group. Furthermore, world knowledge anomalies elicited significantly stronger activation in right inferior frontal gyrus (RIFG) in the control group compared to the ASD group. This additional RIFG activation probably reflects revision of the situation model after new, conflicting information. The lack of recruitment of RIFG is possibly related to difficulties with exception handling in the ASD group.

Individual differences in the neural basis of causal inferencing

This study used fMRI to examine individual differences in the neural basis of causal inferencing. Participants with varying language skill levels, as indexed by scores on the vocabulary portion of the Nelson-Denny Reading Test, read four types of two-sentence passages in which causal relatedness (moderate and distant) and presence or absence of explicit clause connectives were orthogonally varied to manipulate coherence and cohesion during inference generation. Skilled readers showed better neural efficiency (less activation) during all context sentences and during all inference conditions. Increased activation in less-skilled readers was most extensively distributed in the right hemisphere (RH) homologues of left hemisphere (LH) language areas, especially in the most difficult passage types. Skilled readers also showed greater sensitivity to coherence (greater activation and synchronization in moderately related than distantly related passages) whereas less-skilled readers showed sensitivity to cohesion (greater activation and synchronization when clause connectives were present than when they were not). These finding support the hypothesis that skilled reading comprehension requires recruitment of the RH on an "as needed" basis. We describe the dynamic spillover hypothesis, a new theoretical framework that outlines the conditions under which RH language contributions are most likely evoked.

The influence of sentence novelty and figurativeness on brain activity

The predominance of the left hemisphere in language comprehension and production is well established. More recently, the right hemisphere's contribution to language has been examined. Clinical, behavioral, and neuroimaging research support the right hemisphere's involvement in metaphor processing. But, there is disagreement about whether metaphors, in and of themselves, engage the right hemisphere or if other factors that vary between metaphors and literal language elicit right hemisphere engagement. It is important to disambiguate these issues to improve our basic knowledge of figurative language processing, to more precisely define how the right hemisphere supports language, and to facilitate our ability to understand and treat language impairments. Here we investigated the role of the right hemisphere in language comprehension with functional magnetic resonance imaging (fMRI) by manipulating familiarity in both literal and metaphoric sentences. In an event-related design, participants viewed English sentences that appeared every 4.5-9s, and to which they made a pleasantness judgment. All sentences elicited activation in traditional language brain regions including left inferior frontal gyrus, left anterior inferior temporal and left posterior middle temporal gyri. Overall, metaphors and novel stimuli elicited activation in bilateral inferior frontal gyri and left temporal regions. Additionally, metaphors elicited greater activation than literal sentences in right temporal pole. Although our results are partially consistent with the graded salience hypothesis and the coarse coding hypothesis, the right hemisphere's sensitivity to familiar metaphors suggests that right hemisphere recruitment is most influenced by semantic integration demands.