1
|
Pan Y, Frisson S, Federmeier KD, Jensen O. Early parafoveal semantic integration in natural reading. eLife 2024; 12:RP91327. [PMID: 38968325 PMCID: PMC11226228 DOI: 10.7554/elife.91327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/07/2024] Open
Abstract
Humans can read and comprehend text rapidly, implying that readers might process multiple words per fixation. However, the extent to which parafoveal words are previewed and integrated into the evolving sentence context remains disputed. We investigated parafoveal processing during natural reading by recording brain activity and eye movements using MEG and an eye tracker while participants silently read one-line sentences. The sentences contained an unpredictable target word that was either congruent or incongruent with the sentence context. To measure parafoveal processing, we flickered the target words at 60 Hz and measured the resulting brain responses (i.e. Rapid Invisible Frequency Tagging, RIFT) during fixations on the pre-target words. Our results revealed a significantly weaker tagging response for target words that were incongruent with the previous context compared to congruent ones, even within 100ms of fixating the word immediately preceding the target. This reduction in the RIFT response was also found to be predictive of individual reading speed. We conclude that semantic information is not only extracted from the parafovea but can also be integrated with the previous context before the word is fixated. This early and extensive parafoveal processing supports the rapid word processing required for natural reading. Our study suggests that theoretical frameworks of natural reading should incorporate the concept of deep parafoveal processing.
Collapse
Affiliation(s)
- Yali Pan
- Centre for Human Brain Health, School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - Steven Frisson
- Centre for Human Brain Health, School of Psychology, University of BirminghamBirminghamUnited Kingdom
| | - Kara D Federmeier
- Department of Psychology, Program in Neuroscience, and the Beckman Institute for Advanced Science and Technology, University of IllinoisChampaignUnited States
| | - Ole Jensen
- Centre for Human Brain Health, School of Psychology, University of BirminghamBirminghamUnited Kingdom
| |
Collapse
|
2
|
Zhang W, Dong J, Li Y, Zhen A, Yan H. General cognitive processing for orthographic discrepancy engages foveal attention during sentence comprehension. Atten Percept Psychophys 2023; 85:2056-2064. [PMID: 37442894 DOI: 10.3758/s13414-023-02759-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/26/2023] [Indexed: 07/15/2023]
Abstract
Words are processed in the parafovea and fovea in succession during natural reading, but the classic rapid serial visual presentation (RSVP) paradigm presents words only in the fovea. Unlike the RSVP paradigm, the RSVP with flanker (RSVP-flanker) paradigm is similar to natural text reading. Previous studies using the RSVP-flanker paradigm have suggested that high-level semantic/syntactic integration engages foveal fixation after parafoveal semantic access. However, it is less clear how general cognitive processing, such as discrepancy monitoring and error correction, unfolds across the parafoveal and foveal visual fields. In the current study, Chinese sentences were presented with the RSVP-flanker paradigm. Critical words were manipulated so that they were expected (EXP), semantically violated (VIO), or orthographically similar (ORT). Because of the nuanced differences between the EXP and ORT conditions, the processing of ORT critical words required more general cognitive processing, such as discrepancy monitoring and error correction. In contrast, the processing of VIO words may require more semantic integration. The ERP results showed more positive foveal late positive component (LPC) in ORT versus VIO. Moreover, there was no parafoveal LPC effect, but a robust foveal LPC effect, in the contrasts of VIO/ORT versus EXP, replicating previous results. Together, the results provide substantial evidence that general cognitive processing for orthographic discrepancy occurs at the foveal perception.
Collapse
Affiliation(s)
- Wenjia Zhang
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Xi'an, China
| | - Jie Dong
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Xi'an, China
| | - Yongbin Li
- Department of Radiology, The First Hospital of Xi'an, Xi'an, 710002, Shaanxi, China
| | - Anna Zhen
- Department of Psychology, St. John's University, 8000 Utopia Parkway, Queens, NY, 11439, USA
| | - Hao Yan
- Key Laboratory for Artificial Intelligence and Cognitive Neuroscience of Language, Xi'an International Studies University, Xi'an, China.
| |
Collapse
|
3
|
An S, Oh SJ, Jun SB, Sung JE. Aging-Related Dissociation of Spatial and Temporal N400 in Sentence-Level Semantic Processing: Evidence From Source Analyses. Front Aging Neurosci 2022; 14:877235. [PMID: 35754967 PMCID: PMC9226558 DOI: 10.3389/fnagi.2022.877235] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 05/05/2022] [Indexed: 11/13/2022] Open
Abstract
Age-related differences in sentence-level lexical-semantic processes have been extensively studied, based on the N400 component of event-related potential (ERP). However, there is still a lack of understanding in this regard at the brain-region level. This study explores aging effects on sentence-level semantic processing by comparing the characteristics of the N400 ERP component and brain engagement patterns within individual N400 time windows for two age groups (16 younger adults aged 24.38 ± 3.88 years and 15 older adults aged 67.00 ± 5.04 years) during sentence processing with different plausibility conditions. Our results demonstrated that the N400 effect according to the plausibility condition occurred in different temporal windows in the two age groups, with a delay in the older group. Moreover, it was identified that there was a distinct difference between the groups in terms of the source location of the condition-dependent N400 effect even though no significant difference was derived in its magnitude itself at the sensor-level. Interestingly, the source analysis results indicated that the two groups involved different functional networks to resolve the same semantic violations: the younger group activated the regions corresponding to the typical lexical-semantic network more, whereas the older group recruited the regions belonging to the multiple-demand network more. The findings of this study could be used as a basis for understanding the aging brain in a linguistic context.
Collapse
Affiliation(s)
- Sora An
- Department of Communication Disorders, Ewha Womans University, Seoul, South Korea
| | - Se Jin Oh
- Department of Communication Disorders, Ewha Womans University, Seoul, South Korea
| | - Sang Beom Jun
- Department of Electronic and Electrical Engineering, Ewha Womans University, Seoul, South Korea.,Graduate Program in Smart Factory, Ewha Womans University, Seoul, South Korea.,Department of Brain and Cognitive Sciences, Ewha Womans University, Seoul, South Korea
| | - Jee Eun Sung
- Department of Communication Disorders, Ewha Womans University, Seoul, South Korea
| |
Collapse
|
4
|
Federmeier KD. Connecting and considering: Electrophysiology provides insights into comprehension. Psychophysiology 2022; 59:e13940. [PMID: 34520568 PMCID: PMC9009268 DOI: 10.1111/psyp.13940] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/27/2021] [Accepted: 08/30/2021] [Indexed: 11/29/2022]
Abstract
The ability to rapidly and systematically access knowledge stored in long-term memory in response to incoming sensory information-that is, to derive meaning from the world-lies at the core of human cognition. Research using methods that can precisely track brain activity over time has begun to reveal the multiple cognitive and neural mechanisms that make this possible. In this article, I delineate how a process of connecting affords an effortless, continuous infusion of meaning into human perception. In a relatively invariant time window, uncovered through studies using the N400 component of the event-related potential, incoming sensory information naturally induces a graded landscape of activation across long-term semantic memory, creating what might be called "proto-concepts". Connecting can be (but is not always) followed by a process of further considering those activations, wherein a set of more attentionally demanding "active comprehension" mechanisms mediate the selection, augmentation, and transformation of the initial semantic representations. The result is a limited set of more stable bindings that can be arranged in time or space, revised as needed, and brought to awareness. With this research, we are coming closer to understanding how the human brain is able to fluidly link sensation to experience, to appreciate language sequences and event structures, and, sometimes, to even predict what might be coming up next.
Collapse
Affiliation(s)
- Kara D Federmeier
- Department of Psychology, Program in Neuroscience, and the Beckman Institute for Advanced Science and Technology, University of Illinois, Champaign, Illinois, USA
| |
Collapse
|
5
|
Silcox JW, Payne BR. The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study. Cortex 2021; 142:296-316. [PMID: 34332197 DOI: 10.1016/j.cortex.2021.06.007] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 04/02/2021] [Accepted: 06/10/2021] [Indexed: 11/24/2022]
Abstract
There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words ("The prisoners were planning their escape/party") or were low-constraint sentences with unexpected sentence-final words ("All day she thought about the party"). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory.
Collapse
Affiliation(s)
| | - Brennan R Payne
- Department of Psychology, University of Utah, USA; Interdepartmental Neuroscience Program, University of Utah, USA
| |
Collapse
|
6
|
Broderick MP, Di Liberto GM, Anderson AJ, Rofes A, Lalor EC. Dissociable electrophysiological measures of natural language processing reveal differences in speech comprehension strategy in healthy ageing. Sci Rep 2021; 11:4963. [PMID: 33654202 PMCID: PMC7925601 DOI: 10.1038/s41598-021-84597-9] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2020] [Accepted: 02/08/2021] [Indexed: 12/17/2022] Open
Abstract
Healthy ageing leads to changes in the brain that impact upon sensory and cognitive processing. It is not fully clear how these changes affect the processing of everyday spoken language. Prediction is thought to play an important role in language comprehension, where information about upcoming words is pre-activated across multiple representational levels. However, evidence from electrophysiology suggests differences in how older and younger adults use context-based predictions, particularly at the level of semantic representation. We investigate these differences during natural speech comprehension by presenting older and younger subjects with continuous, narrative speech while recording their electroencephalogram. We use time-lagged linear regression to test how distinct computational measures of (1) semantic dissimilarity and (2) lexical surprisal are processed in the brains of both groups. Our results reveal dissociable neural correlates of these two measures that suggest differences in how younger and older adults successfully comprehend speech. Specifically, our results suggest that, while younger and older subjects both employ context-based lexical predictions, older subjects are significantly less likely to pre-activate the semantic features relating to upcoming words. Furthermore, across our group of older adults, we show that the weaker the neural signature of this semantic pre-activation mechanism, the lower a subject’s semantic verbal fluency score. We interpret these findings as prediction playing a generally reduced role at a semantic level in the brains of older listeners during speech comprehension and that these changes may be part of an overall strategy to successfully comprehend speech with reduced cognitive resources.
Collapse
Affiliation(s)
- Michael P Broderick
- School of Engineering, Trinity Centre for Bioengineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland.
| | - Giovanni M Di Liberto
- Laboratoire des Systèmes Perceptifs, Département d'études Cognitives, École Normale Supérieure, PSL University, CNRS, 75005, Paris, France
| | - Andrew J Anderson
- Department of Biomedical Engineering, University of Rochester, Rochester, NY, 14627, USA.,Department of Neuroscience, and Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY, 14627, USA
| | - Adrià Rofes
- Department of Neurolinguistics and Language Development, University of Groningen, Oude Kijk in Het Jatstraat 26, 9712 EK, Groningen, The Netherlands
| | - Edmund C Lalor
- School of Engineering, Trinity Centre for Bioengineering and Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin 2, Ireland.,Department of Biomedical Engineering, University of Rochester, Rochester, NY, 14627, USA.,Department of Neuroscience, and Del Monte Institute for Neuroscience, University of Rochester, Rochester, NY, 14627, USA
| |
Collapse
|
7
|
Semantic Processing in Healthy Aging and Alzheimer's Disease: A Systematic Review of the N400 Differences. Brain Sci 2020; 10:brainsci10110770. [PMID: 33114051 PMCID: PMC7690742 DOI: 10.3390/brainsci10110770] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Revised: 10/21/2020] [Accepted: 10/21/2020] [Indexed: 01/18/2023] Open
Abstract
Semantic deficits are common in individuals with Alzheimer’s disease (AD). These deficits notably impact the ability to understand words. In healthy aging, semantic knowledge increases but semantic processing (i.e., the ability to use this knowledge) may be impaired. This systematic review aimed to investigate semantic processing in healthy aging and AD through behavioral responses and the N400 brain event-related potential. The results of the quantitative and qualitative analyses suggested an overall decrease in accuracy and increase in response times in healthy elderly as compared to young adults, as well as in individuals with AD as compared to age-matched controls. The influence of semantic association, as measured by N400 effect amplitudes, appears smaller in healthy aging and even more so in AD patients. Thus, semantic processing differences may occur in both healthy and pathological aging. The establishment of norms of healthy aging for these outcomes that vary between normal and pathological aging could eventually help early detection of AD.
Collapse
|
8
|
What's "left"? Hemispheric sensitivity to predictability and congruity during sentence reading by older adults. Neuropsychologia 2019; 133:107173. [PMID: 31430444 DOI: 10.1016/j.neuropsychologia.2019.107173] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2019] [Revised: 08/15/2019] [Accepted: 08/16/2019] [Indexed: 11/23/2022]
Abstract
A number of studies have found that older adults' sentence processing tends not to be characterized by the prediction-related effects attested for young adults. Here, we further probed older adults' sensitivity to predictability and congruity by recording event-related brain potentials (ERPs) as adults over age 60 read pairs of sentences, which ended with either the expected word, an unexpected word from the same semantic category, or an unexpected word from a different category. Half of the contexts were highly constraining. Consistent with patterns attested when older adults listened to these same materials (Federmeier et al., 2002), N400s, on average, were smaller to expected than to unexpected words, but did not show constraint-related reductions for unexpected words that shared features with the most predictable completion (an effect well-attested in young adults). This pattern resembles that seen in young adults for right-hemisphere-biased processing. To assess whether older adults retain young-like hemispheric asymmetries but recruit right hemisphere mechanisms more, we examined responses to the target words using visual half-field presentation. Whereas young adults show an asymmetric pattern, with prediction-related N400 amplitude reductions for left- but not right-hemisphere-initiated processing (Federmeier and Kutas, 1999b), older adults showed no reliable processing asymmetries and no evidence for prediction with left hemisphere-initiated presentation. The results suggest that left hemisphere mechanisms important for prediction during language processing are less efficacious in older adulthood.
Collapse
|
9
|
Payne BR, Silcox JW. Aging, context processing, and comprehension. PSYCHOLOGY OF LEARNING AND MOTIVATION 2019. [DOI: 10.1016/bs.plm.2019.07.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/28/2022]
|