1
|
Kwon J, Roll M. Neural semantic effects of tone accents. Neuroreport 2024; 35:868-872. [PMID: 39101373 PMCID: PMC11323759 DOI: 10.1097/wnr.0000000000002077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2024] [Accepted: 06/25/2024] [Indexed: 08/06/2024]
Abstract
This study investigated whether the brain utilizes morphologically induced tones for semantic processing during online speech perception. An auditory comprehension task was conducted while measuring event-related potentials (ERPs). The study tested whether a discrepancy between contextual expectations and the tonal realizations of the target word would yield an N400 effect, indicative of semantic processing difficulty. An N400 effect was observed, reflecting integration difficulty due to semantic anomalies caused by incongruent tones. Additionally, the ERPs in the congruent conditions were modulated by the cohort entropy of the target word indicating lexical competition. The late negativity observed in this study encompasses both the N400 and preactivation negativity. This overlap underscores the brain's potential for rapidly connecting form and meaning from different sources within the word, relying on statistically based prediction in semantic processing.
Collapse
Affiliation(s)
- Jinhee Kwon
- Centre for Languages and Literature, Lund University, Lund, Sweden
| | - Mikael Roll
- Centre for Languages and Literature, Lund University, Lund, Sweden
| |
Collapse
|
2
|
Jano S, Cross ZR, Chatburn A, Schlesewsky M, Bornkessel-Schlesewsky I. Prior Context and Individual Alpha Frequency Influence Predictive Processing during Language Comprehension. J Cogn Neurosci 2024; 36:1898-1936. [PMID: 38820550 DOI: 10.1162/jocn_a_02196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/02/2024]
Abstract
The extent to which the brain predicts upcoming information during language processing remains controversial. To shed light on this debate, the present study reanalyzed Nieuwland and colleagues' (2018) [Nieuwland, M. S., Politzer-Ahles, S., Heyselaar, E., Segaert, K., Darley, E., Kazanina, N., et al. Large-scale replication study reveals a limit on probabilistic prediction in language comprehension. eLife, 7, e33468, 2018] replication of DeLong and colleagues (2015) [DeLong, K. A., Urbach, T. P., & Kutas, M. Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nature Neuroscience, 8, 1117-1121, 2005]. Participants (n = 356) viewed sentences containing articles and nouns of varying predictability, while their EEG was recorded. We measured ERPs preceding the critical words (namely, the semantic prediction potential), in conjunction with postword N400 patterns and individual neural metrics. ERP activity was compared with two measures of word predictability: cloze probability and lexical surprisal. In contrast to prior literature, semantic prediction potential amplitudes did not increase as cloze probability increased, suggesting that the component may not reflect prediction during natural language processing. Initial N400 results at the article provided evidence against phonological prediction in language, in line with Nieuwland and colleagues' findings. Strikingly, however, when the surprisal of the prior words in the sentence was included in the analysis, increases in article surprisal were associated with increased N400 amplitudes, consistent with prediction accounts. This relationship between surprisal and N400 amplitude was not observed when the surprisal of the two prior words was low, suggesting that expectation violations at the article may be overlooked under highly predictable conditions. Individual alpha frequency also modulated the relationship between article surprisal and the N400, emphasizing the importance of individual neural factors for prediction. The present study extends upon existing neurocognitive models of language and prediction more generally, by illuminating the flexible and subject-specific nature of predictive processing.
Collapse
|
3
|
Antoine S, Grisoni L, Tomasello R, Pulvermüller F. The prediction potential indexes the meaning and communicative function of upcoming utterances. Cortex 2024; 177:346-362. [PMID: 38917725 DOI: 10.1016/j.cortex.2024.05.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 03/15/2024] [Accepted: 05/03/2024] [Indexed: 06/27/2024]
Abstract
Prediction has a fundamental role in language processing. However, predictions can be made at different levels, and it is not always clear whether speech sounds, morphemes, words, meanings, or communicative functions are anticipated during dialogues. Previous studies reported specific brain signatures of communicative pragmatic function, in particular enhanced brain responses immediately after encountering an utterance used to request an object from a partner, but relatively smaller ones when the same utterance was used for naming the object. The present experiment now investigates whether similar neuropragmatic signatures emerge in recipients before the onset of upcoming utterances carrying different predictable communicative functions. Trials started with a context question and object pictures displayed on the screen, raising the participant's expectation that words from a specific semantic category (food or tool) would subsequently be used to either name or request one of the objects. Already 600 msec before utterance onset, a larger prediction potential was observed when a request was anticipated relative to naming expectation. As this result is congruent with the neurophysiological difference previously observed right after the critical utterance, the anticipatory brain activity may index predictions about the social-communicative function of upcoming utterances. In addition, we also found that the predictable semantic category of the upcoming word was likewise reflected in the anticipatory brain potential. Thus, the neurophysiological characteristics of the prediction potential can capture different types of upcoming linguistic information, including semantic and pragmatic aspects of an upcoming utterance and communicative action.
Collapse
Affiliation(s)
- Salomé Antoine
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany.
| | - Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany.
| |
Collapse
|
4
|
Kobo O, Yeshurun Y, Schonberg T. Reward-related regions play a role in natural story comprehension. iScience 2024; 27:109844. [PMID: 38832026 PMCID: PMC11145344 DOI: 10.1016/j.isci.2024.109844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 02/18/2024] [Accepted: 04/25/2024] [Indexed: 06/05/2024] Open
Abstract
The reward system was shown to be involved in a wide array of processes. Nevertheless, the exploration of the involvement of the reward system during language processing has not yet been directly tested. We investigated the role of reward-processing regions while listening to a natural story. We utilized a published dataset in which half of the participants listened to a natural story and the others listened to a scrambled version of it to compare the functional MRI signals in the reward system between these conditions and discovered a distinct pattern between conditions. This suggests that the reward system is activated during the comprehension of natural stories. We also show evidence that the fMRI signals in reward-related areas might potentially correlate with the predictability level of processed sentences. Further research is needed to determine the nature of the involvement and the way the activity interacts with various aspects of the sentences.
Collapse
Affiliation(s)
- Oren Kobo
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Yaara Yeshurun
- School of Neurobiology, Biochemistry and Biophysics, The George S. Wise Faculty of Life Sciences and Sagol School of Neuroscience, Tel Aviv University, Tel Aviv, Israel
| | - Tom Schonberg
- School of Psychological Science and Sagol School of Neuroscience, Tel Aviv, Israel
| |
Collapse
|
5
|
León-Cabrera P, Hjortdal A, Berthelsen SG, Rodríguez-Fornells A, Roll M. Neurophysiological signatures of prediction in language: A critical review of anticipatory negativities. Neurosci Biobehav Rev 2024; 160:105624. [PMID: 38492763 DOI: 10.1016/j.neubiorev.2024.105624] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 02/09/2024] [Accepted: 03/13/2024] [Indexed: 03/18/2024]
Abstract
Recent event-related potential (ERP) studies in language comprehension converge in finding anticipatory negativities preceding words or word segments that can be pre-activated based on either sentence contexts or phonological cues. We review these findings from different paradigms in the light of evidence from other cognitive domains in which slow negative potentials have long been associated with anticipatory processes and discuss their potential underlying mechanisms. We propose that this family of anticipatory negativities captures common mechanisms associated with the pre-activation of linguistic information both within words and within sentences. Future studies could utilize these anticipatory negativities in combination with other, well-established ERPs, to simultaneously track prediction-related processes emerging at different time intervals (before and after the perception of pre-activated input) and with distinct time courses (shorter-lived and longer-lived cognitive operations).
Collapse
Affiliation(s)
- Patricia León-Cabrera
- Cognition and Brain Plasticity Unit, Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain; Department of Basic Sciences, Universitat Internacional de Catalunya, Sant Cugat del Vallès, Barcelona, Spain.
| | - Anna Hjortdal
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden
| | - Sabine Gosselke Berthelsen
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden; Department of Nordic Studies and Linguistics (NorS), University of Copenhagen, Copenhagen, Denmark
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Unit, Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain; Institut d'Investigació Biomèdica de Bellvitge (IDIBELL), Hospitalet de Llobregat, Barcelona, Spain; Catalan Institution for Research and Advanced Studies (ICREA), Barcelona, Spain
| | - Mikael Roll
- Centre for Languages and Literature (SOL), Lund University, Lund, Sweden.
| |
Collapse
|
6
|
Ono K, Mizuochi R, Yamamoto K, Sasaoka T, Ymawaki S. Exploring the neural underpinnings of chord prediction uncertainty: an electroencephalography (EEG) study. Sci Rep 2024; 14:4586. [PMID: 38403782 PMCID: PMC10894873 DOI: 10.1038/s41598-024-55366-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Accepted: 02/22/2024] [Indexed: 02/27/2024] Open
Abstract
Predictive processing in the brain, involving interaction between interoceptive (bodily signal) and exteroceptive (sensory) processing, is essential for understanding music as it encompasses musical temporality dynamics and affective responses. This study explores the relationship between neural correlates and subjective certainty of chord prediction, focusing on the alignment between predicted and actual chord progressions in both musically appropriate chord sequences and random chord sequences. Participants were asked to predict the final chord in sequences while their brain activity was measured using electroencephalography (EEG). We found that the stimulus preceding negativity (SPN), an EEG component associated with predictive processing of sensory stimuli, was larger for non-harmonic chord sequences than for harmonic chord progressions. Additionally, the heartbeat evoked potential (HEP), an EEG component related to interoceptive processing, was larger for random chord sequences and correlated with prediction certainty ratings. HEP also correlated with the N5 component, found while listening to the final chord. Our findings suggest that HEP more directly reflects the subjective prediction certainty than SPN. These findings offer new insights into the neural mechanisms underlying music perception and prediction, emphasizing the importance of considering auditory prediction certainty when examining the neural basis of music cognition.
Collapse
Affiliation(s)
- Kentaro Ono
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan.
| | - Ryohei Mizuochi
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| | - Kazuki Yamamoto
- Graduate School of Humanities and Social Sciences, Hiroshima University, Higashihiroshima, Japan
| | - Takafumi Sasaoka
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| | - Shigeto Ymawaki
- Center for Brain, Mind and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| |
Collapse
|
7
|
Hjortdal A, Frid J, Novén M, Roll M. Swift Prosodic Modulation of Lexical Access: Brain Potentials From Three North Germanic Language Varieties. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:400-414. [PMID: 38306498 DOI: 10.1044/2023_jslhr-23-00193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/04/2024]
Abstract
PURPOSE According to most models of spoken word recognition, listeners probabilistically activate a set of lexical candidates, which is incrementally updated as the speech signal unfolds. Speech carries segmental (speech sound) as well as suprasegmental (prosodic) information. The role of the latter in spoken word recognition is less clear. We investigated how suprasegments (tone and voice quality) in three North Germanic language varieties affected lexical access by scrutinizing temporally fine-grained neurophysiological effects of lexical uncertainty and information gain. METHOD Three event-related potential (ERP) studies were reanalyzed. In all varieties investigated, suprasegments are associated with specific word endings. Swedish has two lexical "word accents" realized as pitch falls with different timings across dialects. In Danish, the distinction is in voice quality. We combined pronunciation lexica and frequency lists to calculate estimates of lexical uncertainty about an unfolding word and information gain upon hearing a suprasegmental cue and the segment upon which it manifests. We used single-trial mixed-effects regression models run every 4 ms. RESULTS Only lexical uncertainty showed solid results: a frontal effect at 150-400 ms after suprasegmental cue onset and a later posterior effect after 200 ms. While a model including only segmental information mostly performed better, it was outperformed by the suprasegmental model at 200-330 ms at frontal sites. CONCLUSIONS The study points to suprasegmental cues contributing to lexical access over and beyond segments after around 200 ms in the North Germanic varieties investigated. Furthermore, the findings indicate that a previously reported "pre-activation negativity" predominantly reflects forward-looking processing. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25016486.
Collapse
Affiliation(s)
- Anna Hjortdal
- Centre for Languages and Literature, Lund University, Sweden
| | - Johan Frid
- Lund University Humanities Lab, Lund University, Sweden
| | - Mikael Novén
- Department of Nutrition, Exercise and Sports, University of Copenhagen, Denmark
| | - Mikael Roll
- Centre for Languages and Literature, Lund University, Sweden
| |
Collapse
|
8
|
Barthel M, Tomasello R, Liu M. Conditionals in context: Brain signatures of prediction in discourse processing. Cognition 2024; 242:105635. [PMID: 37883821 DOI: 10.1016/j.cognition.2023.105635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2022] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 10/28/2023]
Abstract
Comprehenders are known to generate expectations about upcoming linguistic input at the sentence and discourse level. However, most previous studies on prediction focused mainly on word-induced brain activity rather than examining neural activity preceding a critical stimulus in discourse processing, where prediction actually takes place. In this EEG study, participants were presented with multiple sentences resembling a discourse including conditional sentences with either only if or if, which are characterized by different semantics, triggering stronger or weaker predictions about the possible continuation of the presented discourses, respectively. Results revealed that discourses including only if, as compared to discourses with bare if, triggered an increased predictive neural activity before the expected critical word, resembling the readiness potential. Moreover, word-induced P300 brain responses were found to be enhanced by unpredictable discourse continuations and reduced in predictable discourse continuations. Intriguingly, brain responses preceding and following the critical word were found to be correlated, which yields evidence for predictive activity modulating word-induced processing on the discourse level. These findings shed light on the predictive nature of neural processes at the discourse level, critically advancing our understanding of the functional interconnection between discourse understanding and prediction processes in brain and mind.
Collapse
Affiliation(s)
- Mathias Barthel
- Leibniz Institute for the German Language, Mannheim, Germany; Department of English and American Studies, Humboldt-Universität zu Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt-Universität zu Berlin, Germany.
| | - Mingya Liu
- Department of English and American Studies, Humboldt-Universität zu Berlin, Germany
| |
Collapse
|
9
|
Wei W, Huang Z, Feng C, Qu Q. Predicting phonological information in language comprehension: evidence from ERP representational similarity analysis and Chinese idioms. Cereb Cortex 2023; 33:9367-9375. [PMID: 37317031 PMCID: PMC10786090 DOI: 10.1093/cercor/bhad209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 05/22/2023] [Accepted: 05/23/2023] [Indexed: 06/16/2023] Open
Abstract
Do comprehenders predict the meaning and even the phonological form of upcoming words during language comprehension? With a growing body of evidence suggesting that semantic representations may be predicted, the evidence for phonological prediction is less clear and largely derived from studies conducted in languages utilizing an alphabetic script. In this research, we aim to examine the prediction of phonological information in the processing of Chinese idioms through the use of ERP representational similarity analysis (RSA). The study utilizes four-character Chinese idioms, and phonological overlap was manipulated by varying the syllable at the idiom-final part between idiom pairs so that pairs of idioms share a syllable (i.e. within-pairs) or not (between-pairs). We quantified the similarity between patterns of neural activity of idioms for within- and between-pairs. RSA results revealed greater similarity in neural activity patterns for idioms within-pairs, compared with between-pairs, and critically this similarity effect was observed prior to the presentation of the phonological similarity, providing evidence for the pre-activation of upcoming phonological information, under circumstances that encourage predictive processing.
Collapse
Affiliation(s)
- Wei Wei
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
- Sino-Danish College, University of Chinese Academy of Sciences, Beijing 100040, China
| | - Zirui Huang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
| | - Chen Feng
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing 100040, China
| | - Qingqing Qu
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing 100040, China
| |
Collapse
|
10
|
Aveni K, Ahmed J, Borovsky A, McRae K, Jenkins ME, Sprengel K, Fraser JA, Orange JB, Knowles T, Roberts AC. Predictive language comprehension in Parkinson's disease. PLoS One 2023; 18:e0262504. [PMID: 36753529 PMCID: PMC9907838 DOI: 10.1371/journal.pone.0262504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Accepted: 12/27/2021] [Indexed: 02/09/2023] Open
Abstract
Verb and action knowledge deficits are reported in persons with Parkinson's disease (PD), even in the absence of dementia or mild cognitive impairment. However, the impact of these deficits on combinatorial semantic processing is less well understood. Following on previous verb and action knowledge findings, we tested the hypothesis that PD impairs the ability to integrate event-based thematic fit information during online sentence processing. Specifically, we anticipated persons with PD with age-typical cognitive abilities would perform more poorly than healthy controls during a visual world paradigm task requiring participants to predict a target object constrained by the thematic fit of the agent-verb combination. Twenty-four PD and 24 healthy age-matched participants completed comprehensive neuropsychological assessments. We recorded participants' eye movements as they heard predictive sentences (The fisherman rocks the boat) alongside target, agent-related, verb-related, and unrelated images. We tested effects of group (PD/control) on gaze using growth curve models. There were no significant differences between PD and control participants, suggesting that PD participants successfully and rapidly use combinatory thematic fit information to predict upcoming language. Baseline sentences with no predictive information (e.g., Look at the drum) confirmed that groups showed equivalent sentence processing and eye movement patterns. Additionally, we conducted an exploratory analysis contrasting PD and controls' performance on low-motion-content versus high-motion-content verbs. This analysis revealed fewer predictive fixations in high-motion sentences only for healthy older adults. PD participants may adapt to their disease by relying on spared, non-action-simulation-based language processing mechanisms, although this conclusion is speculative, as the analyses of high- vs. low-motion items was highly limited by the study design. These findings provide novel evidence that individuals with PD match healthy adults in their ability to use verb meaning to predict upcoming nouns despite previous findings of verb semantic impairment in PD across a variety of tasks.
Collapse
Affiliation(s)
- Katharine Aveni
- Roxelyn and Richard Pepper Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States of America
| | - Juweiriya Ahmed
- Department of Psychology, Western University, London, ON, Canada
| | - Arielle Borovsky
- Department of Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, IN, United States of America
| | - Ken McRae
- Department of Psychology, Western University, London, ON, Canada
| | - Mary E. Jenkins
- Department of Clinical Neurological Sciences, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Katherine Sprengel
- Roxelyn and Richard Pepper Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States of America
| | - J. Alexander Fraser
- Department of Clinical Neurological Sciences, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
- Department of Ophthalmology, Western University, St. Jo122seph’s Health Care, London, ON, Canada
| | - Joseph B. Orange
- School of Communication Sciences and Disorders, Western University, London, ON, Canada
- Canadian Centre for Activity and Aging, Western University, London, ON, Canada
| | - Thea Knowles
- Department of Psychology, Western University, London, ON, Canada
| | - Angela C. Roberts
- Roxelyn and Richard Pepper Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States of America
- School of Communication Sciences and Disorders, Western University, London, ON, Canada
| |
Collapse
|
11
|
Grisoni L. Predictions built upon belongings. Front Psychol 2022; 13:994098. [PMID: 36353084 PMCID: PMC9638126 DOI: 10.3389/fpsyg.2022.994098] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2022] [Accepted: 10/10/2022] [Indexed: 11/22/2022] Open
Affiliation(s)
- Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Berlin, Germany
- Cluster of Excellence “Matters of Activity. Image Space Material”, Humboldt Universität zu Berlin, Berlin, Germany
- *Correspondence: Luigi Grisoni
| |
Collapse
|
12
|
Elmer S, Besson M, Rodríguez-Fornells A. The electrophysiological correlates of word pre-activation during associative word learning. Int J Psychophysiol 2022; 182:12-22. [PMID: 36167179 DOI: 10.1016/j.ijpsycho.2022.09.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 09/14/2022] [Accepted: 09/21/2022] [Indexed: 10/14/2022]
Abstract
Human beings continuously make use of learned associations to generate predictions about future occurrences in the environment. Such memory-related predictive processes provide a scaffold for learning in that mental representations of foreseeable events can be adjusted or strengthened based on a specific outcome. Learning the meaning of novel words through picture-word associations constitutes a prime example of associative learning because pictures preceding words can trigger word prediction through the pre-activation of the related mnemonic representations. In the present electroencephalography (EEG) study, we used event-related potentials (ERPs) to compare neural indices of word pre-activation between a word learning condition with maximal prediction likelihood and a non-learning control condition with low prediction. Results revealed that prediction-related N400 amplitudes in response to pictures decreased over time at central electrodes as a function of word learning, whereas late positive component (LPC) amplitudes increased. Notably, N400 but not LPC changes were also predictive of word learning performance, suggesting that the N400 component constitutes a sensitive marker of word pre-activation during associative word learning.
Collapse
Affiliation(s)
- Stefan Elmer
- Computational Neuroscience of Speech & Hearing, Department of Computational Linguistics, University of Zurich, Switzerland; Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, 08097 Barcelona, Spain.
| | - Mireille Besson
- Université Publique de France, CNRS & Aix-Marseille University, Laboratoire de Neurosciences Cognitives (LNC, UMR 7291) & Institute for Language and Communication in the Brain (ILCB), Marseille, France.
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, 08097 Barcelona, Spain; Department of Cognition, Development and Educational Psychology, Campus Bellvitge, University of Barcelona, L'Hospitalet de Llobregat, 08097 Barcelona, Spain; Institució Catalana de Recerca i Estudis Avançats, ICREA, 08010 Barcelona, Spain.
| |
Collapse
|
13
|
Grisoni L, Pulvermüller F. Predictive and perceptual phonemic processing in articulatory motor areas: A prediction potential & mismatch negativity study. Cortex 2022; 155:357-372. [DOI: 10.1016/j.cortex.2022.06.017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Revised: 03/29/2022] [Accepted: 06/27/2022] [Indexed: 11/15/2022]
|
14
|
Alpha power decreases associated with prediction in written and spoken sentence comprehension. Neuropsychologia 2022; 173:108286. [DOI: 10.1016/j.neuropsychologia.2022.108286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2022] [Revised: 05/16/2022] [Accepted: 06/01/2022] [Indexed: 11/24/2022]
|
15
|
Höltje G, Mecklinger A. Benefits and costs of predictive processing: How sentential constraint and word expectedness affect memory formation. Brain Res 2022; 1788:147942. [PMID: 35562077 DOI: 10.1016/j.brainres.2022.147942] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2021] [Revised: 01/07/2022] [Accepted: 05/06/2022] [Indexed: 11/02/2022]
Abstract
This study investigated how the strength of schema support provided by strongly (SC) and weakly constraining (WC) sentences affects the encoding of expected and unexpected words, and how this is reflected in event-related potentials (ERPs). In a surprise recognition memory test, words studied on the previous day were presented together with new words and lures that were expected but not presented in the study phase. ERPs recorded in the study phase were compared for subsequently remembered and forgotten words. Better memory performance for expected over unexpected words was electrophysiologically supported by a parietal subsequent memory effect (SME) reflecting enhanced item-specific encoding of contextually expected words. SC sentences not only facilitated the semantic integration of sentence-ending words, as reflected in reduced N400 amplitudes, but also enabled the rapid successful encoding of these words into memory, which is evidenced by an SC > WC pattern in memory performance and correlations between pre- and post-stimulus SMEs for SC sentences. In contrast, words processed in WC sentence contexts necessitated sustained elaborative encoding processes as reflected in a late frontal slow wave SME. Expected but not presented words were associated with high rates of false positive memory decisions, indicating that these words remained in a state of high accessibility in memory even one day after the study phase. These mnemonic costs of predictive processing were more pronounced for expected words from SC sentences than from WC sentences and could reflect the lingering of strong semantic predictions which were associated with the pre-updating of sentence representations.
Collapse
Affiliation(s)
- Gerrit Höltje
- Experimental Neuropsychology Unit, Department of Psychology, Saarland University, Saarbrücken, Germany.
| | - Axel Mecklinger
- Experimental Neuropsychology Unit, Department of Psychology, Saarland University, Saarbrücken, Germany
| |
Collapse
|
16
|
Pell MD, Sethi S, Rigoulot S, Rothermich K, Liu P, Jiang X. Emotional voices modulate perception and predictions about an upcoming face. Cortex 2022; 149:148-164. [DOI: 10.1016/j.cortex.2021.12.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 09/15/2021] [Accepted: 01/05/2022] [Indexed: 11/26/2022]
|
17
|
León-Cabrera P, Pagonabarraga J, Morís J, Martínez-Horta S, Marín-Lahoz J, Horta-Barba A, Bejr-Kasem H, Kulisevsky J, Rodríguez-Fornells A. Neural signatures of predictive language processing in Parkinson's disease with and without mild cognitive impairment. Cortex 2021; 141:112-127. [PMID: 34049254 DOI: 10.1016/j.cortex.2021.03.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 03/04/2021] [Accepted: 03/31/2021] [Indexed: 11/19/2022]
Abstract
Cognitive deficits are common in Parkinson's disease (PD), with some PD patients meeting criteria for mild cognitive impairment (MCI). An unaddressed question is whether linguistic prediction is preserved in PD. This ability is nowadays deemed crucial for achieving fast and efficient comprehension, and it may be negatively impacted by cognitive deterioration in PD. To fill this gap of knowledge, we used event-related potentials (ERPs) to evaluate mechanisms of linguistic prediction in a sample of PD patients (on dopamine compensation) with and without MCI. To this end, participants read sentence contexts that were predictive or not about a sentence-final word. The final word appeared after one sec, matching or mismatching the prediction. The introduction of the interval allowed to capture neural responses both before and after sentence-final words, reflecting semantic anticipation and semantic processing. PD patients with normal cognition (N = 58) showed ERP responses comparable to those of matched controls. Specifically, in predictive contexts, a slow negative potential developed prior to sentence-final words, reflecting semantic anticipation. Later, expected words elicited reduced N400 responses (compared to unexpected words), indicating facilitated semantic processing. PD patients with MCI (N = 20) showed, in addition, a prolongation of the N400 congruency effect (compared to matched PD patients without MCI), indicating that further cognitive decline impacts semantic processing. Finally, lower verbal fluency scores correlated with prolonged N400 congruency effects and with reduced pre-word differences in all PD patients (N = 78). This relevantly points to a role of deficits in temporal-dependent mechanisms in PD, besides prototypical frontal dysfunction, in altered semantic anticipation and semantic processing during sentence comprehension.
Collapse
Affiliation(s)
- Patricia León-Cabrera
- Cognition and Brain Plasticity Unit (CBPU), Department of Cognition, Development and Educational Psychology, Institute of Neuroscience, University of Barcelona and Bellvitge Biomedical Research Institute (IDIBELL), Barcelona, Spain
| | - Javier Pagonabarraga
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain.
| | - Joaquín Morís
- Department of Educational and Evolutive Psychology, University of Granada, Granada, Spain
| | - Saül Martínez-Horta
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Juan Marín-Lahoz
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Andrea Horta-Barba
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Helena Bejr-Kasem
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Jaime Kulisevsky
- Movement Disorders Unit, Neurology Department, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; Biomedical Research Institute (IIB-Sant Pau), Barcelona, Spain; Universitat Autònoma de Barcelona (UAB), Spain; Centro de Investigación en Red-Enfermedades Neurodegenerativas (CIBERNED), Spain
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Unit (CBPU), Department of Cognition, Development and Educational Psychology, Institute of Neuroscience, University of Barcelona and Bellvitge Biomedical Research Institute (IDIBELL), Barcelona, Spain; Catalan Institution for Research and Advanced Studies (ICREA), Barcelona, Spain.
| |
Collapse
|
18
|
Ono K, Hashimoto J, Hiramoto R, Sasaoka T, Yamawaki S. Modulatory Effects of Prediction Accuracy on Electroencephalographic Brain Activity During Prediction. Front Hum Neurosci 2021; 15:630288. [PMID: 33716697 PMCID: PMC7947806 DOI: 10.3389/fnhum.2021.630288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Accepted: 02/04/2021] [Indexed: 11/16/2022] Open
Abstract
Prediction is essential for the efficiency of many cognitive processes; however, this process is not always perfect. Predictive coding theory suggests that the brain generates and updates a prediction to respond to an upcoming event. Although an electrophysiological index of prediction, the stimulus preceding negativity (SPN), has been reported, it remains unknown whether the SPN reflects the prediction accuracy, or whether it is associated with the prediction error, which corresponds to a mismatch between a prediction and an actual input. Thus, the present study aimed to investigate this question using electroencephalography (EEG). Participants were asked to predict the original pictures from pictures that had undergone different levels of pixelation. The SPN amplitude was affected by the level of pixelation and correlated with the subjective evaluation of the prediction accuracy. Furthermore, late positive components (LPC) were negatively correlated with SPN. These results suggest that the amplitude of SPN reflects the prediction accuracy; more accurate prediction increases the SPN and reduces the prediction error, resulting in reduced LPC amplitudes.
Collapse
Affiliation(s)
- Kentaro Ono
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan.,Graduate School of Education, Hiroshima University, Hiroshima, Japan
| | - Junya Hashimoto
- Center of Kansei Innovation, Hiroshima University, Hiroshima, Japan
| | - Ryosuke Hiramoto
- Center of Kansei Innovation, Hiroshima University, Hiroshima, Japan
| | - Takafumi Sasaoka
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan.,Graduate School of Education, Hiroshima University, Hiroshima, Japan
| | - Shigeto Yamawaki
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan.,Graduate School of Education, Hiroshima University, Hiroshima, Japan
| |
Collapse
|
19
|
Boux I, Tomasello R, Grisoni L, Pulvermüller F. Brain signatures predict communicative function of speech production in interaction. Cortex 2020; 135:127-145. [PMID: 33360757 DOI: 10.1016/j.cortex.2020.11.008] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2020] [Revised: 11/05/2020] [Accepted: 11/18/2020] [Indexed: 10/22/2022]
Abstract
People normally know what they want to communicate before they start speaking. However, brain indicators of communication are typically observed only after speech act onset, and it is unclear when any anticipatory brain activity prior to speaking might first emerge, along with the communicative intentions it possibly reflects. Here, we investigated brain activity prior to the production of different speech act types, request and naming actions performed by uttering single words embedded into language games with a partner, similar to natural communication. Starting ca. 600 msec before speech onset, an event-related potential maximal at fronto-central electrodes, which resembled the Readiness Potential, was larger when preparing requests compared to naming actions. Analysis of the cortical sources of this anticipatory brain potential suggests a relatively stronger involvement of fronto-central motor regions for requests, which may reflect the speaker's expectation of the partner actions typically following requests, e.g., the handing over of a requested object. Our results indicate that different neuronal circuits underlying the processing of different speech act types activate already before speaking. Results are discussed in light of previous work addressing the neural basis of speech act understanding and predictive brain indexes of language comprehension.
Collapse
Affiliation(s)
- Isabella Boux
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany.
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany.
| | - Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4 Freie Universität Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| |
Collapse
|
20
|
Grisoni L, Tomasello R, Pulvermüller F. Correlated Brain Indexes of Semantic Prediction and Prediction Error: Brain Localization and Category Specificity. Cereb Cortex 2020; 31:1553-1568. [PMID: 33108460 PMCID: PMC7869099 DOI: 10.1093/cercor/bhaa308] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 08/11/2020] [Accepted: 09/17/2020] [Indexed: 11/12/2022] Open
Abstract
With strong and valid predictions, grasping a message is easy, whereas more demanding processing is required in the absence of robust expectations. We here demonstrate that brain correlates of the interplay between prediction and perception mechanisms in the understanding of meaningful sentences. Sentence fragments that strongly predict subsequent words induced anticipatory brain activity preceding the expected words; this potential was absent if context did not strongly predict subsequent words. Subjective reports of certainty about upcoming words and objective corpus-based measures correlated with the size of the anticipatory signal, thus establishing its status as a semantic prediction potential (SPP). Crucially, there was an inverse correlation between the SPP and the N400 brain response. The main cortical generators of SPP and N400 were found in inferior prefrontal cortex and posterior temporal cortex, respectively. Interestingly, sentence meaning was reflected by both measures, with additional category-specific sources of SPPs and N400s falling into parieto-temporo-occipital (visual) and frontocentral (sensorimotor) areas for animal- and tool-related words, respectively. These results show that the well-known brain index of semantic comprehension, N400, has an antecedent with different brain localization but similar semantic discriminatory function. We discuss whether N400 dynamics may causally depend on mechanisms underlying SPP size and sources.
Collapse
Affiliation(s)
- Luigi Grisoni
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany
| | - Rosario Tomasello
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany
| | - Friedemann Pulvermüller
- Freie Universität Berlin, Brain Language Laboratory, Department of Philosophy and Humanities, 14195 Berlin, Germany.,Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10117 Berlin, Germany.,Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, 10099 Berlin, Germany.,Einstein Center for Neurosciences, 10117 Berlin, Germany
| |
Collapse
|
21
|
Pulvermüller F, Grisoni L. Semantic Prediction in Brain and Mind. Trends Cogn Sci 2020; 24:781-784. [DOI: 10.1016/j.tics.2020.07.002] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 07/07/2020] [Accepted: 07/08/2020] [Indexed: 10/23/2022]
|
22
|
He had it Comin': ERPs Reveal a Facilitation for the Processing of Misfortunes to Antisocial Characters. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2020; 20:356-370. [PMID: 32048200 DOI: 10.3758/s13415-020-00773-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Human sociality and prosociality rely on social and moral feelings of empathy, compassion, envy, schadenfreude, as well as on the preference for prosocial over antisocial others. We examined the neural underpinnings of the processing of lexical input designed to tap into these type of social feelings. Brainwave responses from 20 participants were measured as they read sentences comprising a randomly delivered ending outcome (fortunate or unfortunate) to social agents previously profiled as prosocial or antisocial individuals. Fortunate outcomes delivered to prosocial and antisocial agents aimed to tap into empathy and envy/annoying feelings, respectively, whereas unfortunate ones into compassion for prosocial agents and schadenfreude for antisocial ones. ERP modulations in early attention-capture (100-200 ms), semantic fit (400 ms), and late reanalysis processes (600 ms) were analyzed. According to the functional interpretation of each of these event-related electrophysiological effects, we conclude that: 1) a higher capture of attention is initially obtained in response to any type of outcome delivered to a prosocial versus an antisocial agent (frontal P2); 2) a facilitated semantic processing occurs for unfortunate outcomes delivered to antisocial agents (N400); and 3) regardless of the protagonist's social profile, an increased later reevaluation for overall unfortunate versus fortunate outcomes takes place (Late Positive Potential). Thus, neural online measures capture a stepwise unfolding impact of social factors during language comprehension, which include a facilitated processing of misfortunes when they happen to occur to antisocial peers (i.e., schadenfreude).
Collapse
|