1
|
Barthel M, Tomasello R, Liu M. Conditionals in context: Brain signatures of prediction in discourse processing. Cognition 2024; 242:105635. [PMID: 37883821 DOI: 10.1016/j.cognition.2023.105635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 10/28/2023]
Abstract
Comprehenders are known to generate expectations about upcoming linguistic input at the sentence and discourse level. However, most previous studies on prediction focused mainly on word-induced brain activity rather than examining neural activity preceding a critical stimulus in discourse processing, where prediction actually takes place. In this EEG study, participants were presented with multiple sentences resembling a discourse including conditional sentences with either only if or if, which are characterized by different semantics, triggering stronger or weaker predictions about the possible continuation of the presented discourses, respectively. Results revealed that discourses including only if, as compared to discourses with bare if, triggered an increased predictive neural activity before the expected critical word, resembling the readiness potential. Moreover, word-induced P300 brain responses were found to be enhanced by unpredictable discourse continuations and reduced in predictable discourse continuations. Intriguingly, brain responses preceding and following the critical word were found to be correlated, which yields evidence for predictive activity modulating word-induced processing on the discourse level. These findings shed light on the predictive nature of neural processes at the discourse level, critically advancing our understanding of the functional interconnection between discourse understanding and prediction processes in brain and mind.
Collapse
Affiliation(s)
- Mathias Barthel
- Leibniz Institute for the German Language, Mannheim, Germany; Department of English and American Studies, Humboldt-Universität zu Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt-Universität zu Berlin, Germany.
| | - Mingya Liu
- Department of English and American Studies, Humboldt-Universität zu Berlin, Germany
| |
Collapse
|
2
|
Proverbio AM, Cerri A, Gallotta C. Facemasks selectively impair the recognition of facial expressions that stimulate empathy: An ERP study. Psychophysiology 2023:e14280. [PMID: 36847283 DOI: 10.1111/psyp.14280] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 12/21/2022] [Accepted: 02/06/2023] [Indexed: 03/01/2023]
Abstract
Previous research suggests that masks disrupt expression recognition, but the neurophysiological implications of this phenomenon are poorly understood. In this study, 26 participants underwent EEG/ERP recording during the recognition of six masked/unmasked facial expressions. An emotion/word congruence paradigm was used. Face-specific N170 was significantly larger to masked than unmasked faces. The N400 component was larger for incongruent faces, but differences were more substantial for positive emotions (especially happiness). Anterior P300 (reflecting workload) was larger to masked than unmasked faces, while posterior P300 (reflecting categorization certainty) was larger to unmasked than masked faces, and to angry faces. Face masking was more detrimental to sadness, fear, and disgust than positive emotions, such as happiness. In addition, mask covering did not impair the recognition of angry faces, as the wrinkled forehead and frowning eyebrows remained visible. Overall, facial masking polarized nonverbal communication toward the happiness/anger dimension, while minimizing emotions that stimulate an empathic response.
Collapse
Affiliation(s)
- Alice Mado Proverbio
- Cognitive Electrophysiology Laboratory, Department of Psychology, University of Milano-Bicocca, Milan, Italy
| | - Alice Cerri
- Cognitive Electrophysiology Laboratory, Department of Psychology, University of Milano-Bicocca, Milan, Italy
| | - Cristina Gallotta
- Cognitive Electrophysiology Laboratory, Department of Psychology, University of Milano-Bicocca, Milan, Italy
| |
Collapse
|
3
|
Gulyaev SA. Neurophysiological Solution of the Inverse Problem of EEG Research at Rest and under Conditions of Auditory-Speech Load. J EVOL BIOCHEM PHYS+ 2022. [DOI: 10.1134/s0022093022020259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
4
|
Larionova EV, Martynova OV. Frequency Effects on Spelling Error Recognition: An ERP Study. Front Psychol 2022; 13:834852. [PMID: 35496180 PMCID: PMC9046601 DOI: 10.3389/fpsyg.2022.834852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 03/30/2022] [Indexed: 11/24/2022] Open
Abstract
Spelling errors are ubiquitous in all writing systems. Most studies exploring spelling errors focused on the phonological plausibility of errors. However, unlike typical pseudohomophones, spelling errors occur in naturally produced written language. We investigated the time course of recognition of the most frequent orthographic errors in Russian (error in an unstressed vowel in the root) and the effect of word frequency on this process. During event-related potentials (ERP) recording, 26 native Russian speakers silently read high-frequency correctly spelled words, low-frequency correctly spelled words, high-frequency words with errors, and low-frequency words with errors. The amplitude of P200 was more positive for correctly spelled words than for misspelled words and did not depend on the frequency of the words. In addition, in the 350–500-ms time window, we found a more negative response for misspelled words than for correctly spelled words in parietal–temporal-occipital regions regardless of word frequency. Considering our results in the context of a dual-route model, we concluded that recognizing misspelled high-frequency and low-frequency words involves common orthographic and phonological processes associated with P200 and N400 components such as whole word orthography processing and activation of phonological representations correspondingly. However, at the 500–700 ms stage (associated with lexical-semantic access in our study), error recognition depends on the word frequency. One possible explanation for these differences could be that at the 500–700 ms stage recognition of high-frequency misspelled and correctly spelled words shifts from phonological to orthographic processes, while low-frequency misspelled words are accompanied by more prolonged phonological activation. We believe these processes may be associated with different ERP components P300 and N400, reflecting a temporal overlap between categorization processes based on orthographic properties for high-frequency words and phonological processes for low-frequency words. Therefore, our results complement existing reading models and demonstrate that the neuronal underpinnings of spelling error recognition during reading may depend on word frequency.
Collapse
Affiliation(s)
- Ekaterina V. Larionova
- Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Moscow, Russia
- *Correspondence: Ekaterina V. Larionova,
| | - Olga V. Martynova
- Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Moscow, Russia
- Centre for Cognition and Decision Making, National Research University Higher School of Economics, Moscow, Russia
| |
Collapse
|
5
|
Wu G, Tang X, Gan R, Zeng J, Hu Y, Xu L, Wei Y, Tang Y, Chen T, Li C, Wang J, Zhang T. Temporal and time-frequency features of auditory oddball response in distinct subtypes of patients at clinical high risk for psychosis. Eur Arch Psychiatry Clin Neurosci 2022; 272:449-459. [PMID: 34333669 DOI: 10.1007/s00406-021-01316-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/02/2021] [Accepted: 07/26/2021] [Indexed: 01/10/2023]
Abstract
Individuals at clinical high risk (CHR) for psychosis exhibit a reduced P300 oddball response, which indicates deficits in attention and working memory processes. Previous studies have mainly researched these responses in the temporal domain; hence, non-phase-locked or induced neural activities may have been ignored. Event-related potential (ERP) and time-frequency (TF) information, combined with clinical and cognitive profiles, may provide an insight into the pathophysiology and psychopathology of the CHR stage. The 104 CHR individuals who completed cognitive assessments and ERP tests were recruited and followed up between 2016 and 2018. Individuals with CHR were classified by three clinical subtypes demonstrated before, specifically 32 from Cluster-1 (characterized by extensive negative symptoms and cognitive deficits, at the highest risk for conversion to psychosis), 34 from Cluster-2 (characterized by thought and behavioral disorganization, with moderate cognitive impairment), and 38 from Cluster-3 (characterized by the mildest symptoms and cognitive deficits). Electroencephalograms were recorded during the auditory oddball paradigm. The P300 ERPs were analyzed in the temporal domain. The event-related spectral perturbation (ERSP) and inter-trial coherence (ITC) were acquired by TF analysis. A reduced P300 response to target tones was noted in Cluster-1 relative to the other two clusters. Moreover, the P300 amplitude of Cluster-1 was associated with speed of processing (SoP) scores. Furthermore, the P300 amplitude of Cluster-3 was significantly correlated with verbal and visual learning scores. In the TF analysis, decreased delta ERSP and ITC were observed in Cluster-1; delta ITC was associated with SoP scores in Cluster-3. The results indicate relatively disrupted oddball responses in a certain CHR subtype and a close affinity between these electrophysiological indexes and attention, working memory, and declarative memory within different CHR clusters. These findings suggest that the auditory oddball response is a potential neurophysiological marker for distinct clinical subtypes of CHR.
Collapse
Affiliation(s)
- GuiSen Wu
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - XiaoChen Tang
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - RanPiao Gan
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - JiaHui Zeng
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - YeGang Hu
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - LiHua Xu
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - YanYan Wei
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - YingYing Tang
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - Tao Chen
- Big Data Research Lab, University of Waterloo, Waterloo, ON, Canada.,Senior Research Fellow, Labor and Worklife Program, Harvard University, Cambridge, MA, USA.,Niacin (Shanghai) Technology Co., Ltd., Shanghai, People's Republic of China
| | - ChunBo Li
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China
| | - JiJun Wang
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China. .,Center for Excellence in Brain Science and Intelligence Technology (CEBSIT), Chinese Academy of Science, Shanghai, People's Republic of China. .,Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University, Shanghai, People's Republic of China. .,Key Laboratory for the Genetics of Developmental and Neuropsychiatric Disorders (Ministry of Education), Bio-X Institutes, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China.
| | - TianHong Zhang
- Shanghai Key Laboratory of Psychotic Disorders (No.13dz2260500), Shanghai Mental Health Center, Shanghai Jiaotong University School of Medicine, 600 Wanping Nan Road, Shanghai, 200030, People's Republic of China.
| |
Collapse
|
6
|
Impairment of semantic composition in schizophrenia: An ERP study with lexical stimuli. Neuropsychologia 2022; 171:108241. [DOI: 10.1016/j.neuropsychologia.2022.108241] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 04/12/2022] [Accepted: 04/19/2022] [Indexed: 11/24/2022]
|
7
|
Brilmayer I, Schumacher PB. Referential Chains Reveal Predictive Processes and Form-to-Function Mapping: An Electroencephalographic Study Using Naturalistic Story Stimuli. Front Psychol 2021; 12:623648. [PMID: 34489770 PMCID: PMC8417467 DOI: 10.3389/fpsyg.2021.623648] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 07/12/2021] [Indexed: 11/13/2022] Open
Abstract
In discourse pragmatics, different referential forms are claimed to be indicative of the cognitive status of a referent in the current discourse. Referential expressions thereby possess a double function: They point back to an (existing) referent (form-to-function mapping), and they are used to derive predictions about a referent’s subsequent recurrence in discourse. Existing event-related potential (ERP) research has mainly focused on the form-to-function mapping of referential expression. In the present ERP study, we explore the relationship of form-to-function mapping and prediction derived from the antecedent of referential expressions in naturalistic auditory language comprehension. Specifically, the study investigates the relationship between the form of a referential expression (pronoun vs. noun) and the form of its antecedent (pronoun vs. noun); i.e., it examines the influence of the interplay of predictions derived from an antecedent (forward-looking function) and the form-to-function mapping of an anaphor (backward-looking function) on the ERPs time-locked to anaphoric expressions. The results in the time range of the P300 and N400 allow for a dissociation of these two functions during online language comprehension.
Collapse
Affiliation(s)
- Ingmar Brilmayer
- Department of German Language and Literature I-Linguistics, University of Cologne, Cologne, Germany
| | - Petra B Schumacher
- Department of German Language and Literature I-Linguistics, University of Cologne, Cologne, Germany
| |
Collapse
|
8
|
Li F, Xu X. Electrophysiological evidence for the coexistence of expectancy fulfillment and semantic integration during the processing of binding and compound nouns. Int J Psychophysiol 2021; 166:25-37. [PMID: 33984365 DOI: 10.1016/j.ijpsycho.2021.05.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Revised: 05/06/2021] [Accepted: 05/07/2021] [Indexed: 11/30/2022]
Abstract
This study employed electrophysiological measures to investigate the processes of expectancy fulfillment and semantic integration during the processing of binding and compound nouns in Chinese. Sequential expectancy and cloze probability between the two constituents of a two-character noun were manipulated in two experiments, resulting in four types of target characters (i.e., the final characters of two-character nouns): (i) high-cloze, binding character (HB); (ii) high-cloze, compound character (HC); (iii) low-cloze, binding character (LB); (iv) low-cloze, compound character (LC). Participants were asked to judge as quickly and accurately as possible whether the two characters, presented sequentially, formed a real word. The two experiments varied in stimulus onset asynchrony (SOA) between the initial and the target characters: 1000 ms and 300 ms. ERPs acquired at the target characters revealed a significant semantic integration effect in both experiments whereby low-cloze target characters elicited more negative-going activities than high-cloze target characters (L > H) with both long and short SOAs. Importantly, there was a graded N400 effect (LC = LB > HC > HB) at the central region: a clearly visible positive deflection for HB relative to HC in synchrony with an equivalence in negativity for LB and LC. This graded pattern was observed with an SOA of 1000 ms but not 300 ms. These results are discussed in terms of the possible coexistence of an expectancy fulfillment mechanism indexed by the P300 that monitors incoming information for realization of expectancies based on stored mental representations and a semantic integration mechanism indexed by the N400 that incorporates incoming information into the preceding context based on semantic-pragmatic knowledge. Manifestation of this coexistence appears sensitive to SOA-modulated attention orientation.
Collapse
Affiliation(s)
- Fei Li
- School of Foreign Languages, Shanghai Jiao Tong University, China.
| | - Xu Xu
- School of Foreign Languages, Shanghai Jiao Tong University, China.
| |
Collapse
|
9
|
Misersky J, Slivac K, Hagoort P, Flecken M. The state of the onion: Grammatical aspect modulates object representation during event comprehension. Cognition 2021; 214:104744. [PMID: 33962314 DOI: 10.1016/j.cognition.2021.104744] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2020] [Revised: 03/30/2021] [Accepted: 04/21/2021] [Indexed: 10/21/2022]
Abstract
The present ERP study assessed whether grammatical aspect is used as a cue in online event comprehension, in particular when reading about events in which an object is visually changed. While perfective aspect cues holistic event representations, including an event's endpoint, progressive aspect highlights intermediate phases of an event. In a 2 × 3 design, participants read SVO sentences describing a change-of-state event (e.g., to chop an onion), with grammatical Aspect manipulated (perfective "chopped" vs progressive "was chopping"). Thereafter, they saw a Picture of an object either having undergone substantial state-change (SC; a chopped onion), no state-change (NSC; an onion in its original state) or an unrelated object (U; a cactus, acting as control condition). Their task was to decide whether the object in the Picture was mentioned in the sentence. We focused on N400 modulation, with ERPs time-locked to picture onset. U pictures elicited an N400 response as expected, suggesting detection of categorical mismatches in object type. For SC and NSC pictures, a whole-head follow-up analysis revealed a P300, implying people were engaged in detailed evaluation of pictures of matching objects. SC pictures received most positive responses overall. Crucially, there was an interaction of Aspect and Picture: SC pictures resulted in a higher amplitude P300 after sentences in the perfective compared to the progressive. Thus, while the perfective cued for a holistic event representation, including the resultant state of the affected object (i.e., the chopped onion) constraining object representations online, the progressive defocused event completion and object-state change. Grammatical aspect thus guided online event comprehension by cueing the visual representation(s) of an object's state.
Collapse
Affiliation(s)
- Julia Misersky
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; International Max Planck Research School for Language Sciences, the Netherlands.
| | - Ksenija Slivac
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; International Max Planck Research School for Language Sciences, the Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute, Radboud University Nijmegen, the Netherlands
| | - Monique Flecken
- Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; University of Amsterdam, the Netherlands
| |
Collapse
|
10
|
Bornkessel-Schlesewsky I, Roehm D, Mailhammer R, Schlesewsky M. Language Processing as a Precursor to Language Change: Evidence From Icelandic. Front Psychol 2020; 10:3013. [PMID: 32010032 PMCID: PMC6978737 DOI: 10.3389/fpsyg.2019.03013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Accepted: 12/19/2019] [Indexed: 11/30/2022] Open
Abstract
One of the main characteristics of human languages is that they are subject to fundamental changes over time. However, because of the long transitional periods involved, the internal dynamics of such changes are typically inaccessible. Here, we present a new approach to examining language change via its connection to language comprehension. By means of an EEG experiment on Icelandic, a prominent current example of a language in transition, we show that the neurophysiological responses of native speakers already reflect projected changes that are not yet apparent in their overt behavior. Neurocognitive measures thus offer a means of predicting, rather than only retracing, language change.
Collapse
Affiliation(s)
- Ina Bornkessel-Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia.,School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, SA, Australia
| | - Dietmar Roehm
- Centre for Cognitive Neuroscience, University of Salzburg, Salzburg, Austria.,Department of Linguistics, University of Salzburg, Salzburg, Austria
| | - Robert Mailhammer
- School of Humanities and Communication Arts, Western Sydney University, Penrith, NSW, Australia.,The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, Australia
| | - Matthias Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia.,School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, SA, Australia
| |
Collapse
|