Event-related brain potentials reveal age-related changes in parafoveal-foveal integration during sentence processing

Early parafoveal semantic integration in natural reading

Humans can read and comprehend text rapidly, implying that readers might process multiple words per fixation. However, the extent to which parafoveal words are previewed and integrated into the evolving sentence context remains disputed. We investigated parafoveal processing during natural reading by recording brain activity and eye movements using MEG and an eye tracker while participants silently read one-line sentences. The sentences contained an unpredictable target word that was either congruent or incongruent with the sentence context. To measure parafoveal processing, we flickered the target words at 60 Hz and measured the resulting brain responses (i.e. Rapid Invisible Frequency Tagging, RIFT) during fixations on the pre-target words. Our results revealed a significantly weaker tagging response for target words that were incongruent with the previous context compared to congruent ones, even within 100ms of fixating the word immediately preceding the target. This reduction in the RIFT response was also found to be predictive of individual reading speed. We conclude that semantic information is not only extracted from the parafovea but can also be integrated with the previous context before the word is fixated. This early and extensive parafoveal processing supports the rapid word processing required for natural reading. Our study suggests that theoretical frameworks of natural reading should incorporate the concept of deep parafoveal processing.

General cognitive processing for orthographic discrepancy engages foveal attention during sentence comprehension

Words are processed in the parafovea and fovea in succession during natural reading, but the classic rapid serial visual presentation (RSVP) paradigm presents words only in the fovea. Unlike the RSVP paradigm, the RSVP with flanker (RSVP-flanker) paradigm is similar to natural text reading. Previous studies using the RSVP-flanker paradigm have suggested that high-level semantic/syntactic integration engages foveal fixation after parafoveal semantic access. However, it is less clear how general cognitive processing, such as discrepancy monitoring and error correction, unfolds across the parafoveal and foveal visual fields. In the current study, Chinese sentences were presented with the RSVP-flanker paradigm. Critical words were manipulated so that they were expected (EXP), semantically violated (VIO), or orthographically similar (ORT). Because of the nuanced differences between the EXP and ORT conditions, the processing of ORT critical words required more general cognitive processing, such as discrepancy monitoring and error correction. In contrast, the processing of VIO words may require more semantic integration. The ERP results showed more positive foveal late positive component (LPC) in ORT versus VIO. Moreover, there was no parafoveal LPC effect, but a robust foveal LPC effect, in the contrasts of VIO/ORT versus EXP, replicating previous results. Together, the results provide substantial evidence that general cognitive processing for orthographic discrepancy occurs at the foveal perception.

Aging-Related Dissociation of Spatial and Temporal N400 in Sentence-Level Semantic Processing: Evidence From Source Analyses

Age-related differences in sentence-level lexical-semantic processes have been extensively studied, based on the N400 component of event-related potential (ERP). However, there is still a lack of understanding in this regard at the brain-region level. This study explores aging effects on sentence-level semantic processing by comparing the characteristics of the N400 ERP component and brain engagement patterns within individual N400 time windows for two age groups (16 younger adults aged 24.38 ± 3.88 years and 15 older adults aged 67.00 ± 5.04 years) during sentence processing with different plausibility conditions. Our results demonstrated that the N400 effect according to the plausibility condition occurred in different temporal windows in the two age groups, with a delay in the older group. Moreover, it was identified that there was a distinct difference between the groups in terms of the source location of the condition-dependent N400 effect even though no significant difference was derived in its magnitude itself at the sensor-level. Interestingly, the source analysis results indicated that the two groups involved different functional networks to resolve the same semantic violations: the younger group activated the regions corresponding to the typical lexical-semantic network more, whereas the older group recruited the regions belonging to the multiple-demand network more. The findings of this study could be used as a basis for understanding the aging brain in a linguistic context.

Connecting and considering: Electrophysiology provides insights into comprehension

The ability to rapidly and systematically access knowledge stored in long-term memory in response to incoming sensory information-that is, to derive meaning from the world-lies at the core of human cognition. Research using methods that can precisely track brain activity over time has begun to reveal the multiple cognitive and neural mechanisms that make this possible. In this article, I delineate how a process of connecting affords an effortless, continuous infusion of meaning into human perception. In a relatively invariant time window, uncovered through studies using the N400 component of the event-related potential, incoming sensory information naturally induces a graded landscape of activation across long-term semantic memory, creating what might be called "proto-concepts". Connecting can be (but is not always) followed by a process of further considering those activations, wherein a set of more attentionally demanding "active comprehension" mechanisms mediate the selection, augmentation, and transformation of the initial semantic representations. The result is a limited set of more stable bindings that can be arranged in time or space, revised as needed, and brought to awareness. With this research, we are coming closer to understanding how the human brain is able to fluidly link sensation to experience, to appreciate language sequences and event structures, and, sometimes, to even predict what might be coming up next.

The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study

There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words ("The prisoners were planning their escape/party") or were low-constraint sentences with unexpected sentence-final words ("All day she thought about the party"). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory.

Dissociable electrophysiological measures of natural language processing reveal differences in speech comprehension strategy in healthy ageing

Healthy ageing leads to changes in the brain that impact upon sensory and cognitive processing. It is not fully clear how these changes affect the processing of everyday spoken language. Prediction is thought to play an important role in language comprehension, where information about upcoming words is pre-activated across multiple representational levels. However, evidence from electrophysiology suggests differences in how older and younger adults use context-based predictions, particularly at the level of semantic representation. We investigate these differences during natural speech comprehension by presenting older and younger subjects with continuous, narrative speech while recording their electroencephalogram. We use time-lagged linear regression to test how distinct computational measures of (1) semantic dissimilarity and (2) lexical surprisal are processed in the brains of both groups. Our results reveal dissociable neural correlates of these two measures that suggest differences in how younger and older adults successfully comprehend speech. Specifically, our results suggest that, while younger and older subjects both employ context-based lexical predictions, older subjects are significantly less likely to pre-activate the semantic features relating to upcoming words. Furthermore, across our group of older adults, we show that the weaker the neural signature of this semantic pre-activation mechanism, the lower a subject’s semantic verbal fluency score. We interpret these findings as prediction playing a generally reduced role at a semantic level in the brains of older listeners during speech comprehension and that these changes may be part of an overall strategy to successfully comprehend speech with reduced cognitive resources.

Semantic Processing in Healthy Aging and Alzheimer's Disease: A Systematic Review of the N400 Differences

Semantic deficits are common in individuals with Alzheimer’s disease (AD). These deficits notably impact the ability to understand words. In healthy aging, semantic knowledge increases but semantic processing (i.e., the ability to use this knowledge) may be impaired. This systematic review aimed to investigate semantic processing in healthy aging and AD through behavioral responses and the N400 brain event-related potential. The results of the quantitative and qualitative analyses suggested an overall decrease in accuracy and increase in response times in healthy elderly as compared to young adults, as well as in individuals with AD as compared to age-matched controls. The influence of semantic association, as measured by N400 effect amplitudes, appears smaller in healthy aging and even more so in AD patients. Thus, semantic processing differences may occur in both healthy and pathological aging. The establishment of norms of healthy aging for these outcomes that vary between normal and pathological aging could eventually help early detection of AD.

What's "left"? Hemispheric sensitivity to predictability and congruity during sentence reading by older adults

A number of studies have found that older adults' sentence processing tends not to be characterized by the prediction-related effects attested for young adults. Here, we further probed older adults' sensitivity to predictability and congruity by recording event-related brain potentials (ERPs) as adults over age 60 read pairs of sentences, which ended with either the expected word, an unexpected word from the same semantic category, or an unexpected word from a different category. Half of the contexts were highly constraining. Consistent with patterns attested when older adults listened to these same materials (Federmeier et al., 2002), N400s, on average, were smaller to expected than to unexpected words, but did not show constraint-related reductions for unexpected words that shared features with the most predictable completion (an effect well-attested in young adults). This pattern resembles that seen in young adults for right-hemisphere-biased processing. To assess whether older adults retain young-like hemispheric asymmetries but recruit right hemisphere mechanisms more, we examined responses to the target words using visual half-field presentation. Whereas young adults show an asymmetric pattern, with prediction-related N400 amplitude reductions for left- but not right-hemisphere-initiated processing (Federmeier and Kutas, 1999b), older adults showed no reliable processing asymmetries and no evidence for prediction with left hemisphere-initiated presentation. The results suggest that left hemisphere mechanisms important for prediction during language processing are less efficacious in older adulthood.