1
|
Song B, Sommer W, Maurer U. Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials. J Cogn Neurosci 2024; 36:872-887. [PMID: 38261395 DOI: 10.1162/jocn_a_02111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.
Collapse
Affiliation(s)
- Bingbing Song
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universitaet zu Berlin, Berlin, Germany
- Department of Physics, Hong Kong Baptist University, Hong Kong, China
| | - Urs Maurer
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Centre for Developmental Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Brain and Mind Institute, The Chinese University of Hong Kong, Hong Kong, China
| |
Collapse
|
2
|
Volfart A, Rossion B, Yan X, Angelini L, Maillard L, Colnat-Coulbois S, Jonas J. Intracerebral electrical stimulation of the face-selective right lateral fusiform gyrus transiently impairs face identity recognition. Neuropsychologia 2023; 190:108705. [PMID: 37839512 DOI: 10.1016/j.neuropsychologia.2023.108705] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Revised: 09/14/2023] [Accepted: 10/10/2023] [Indexed: 10/17/2023]
Abstract
Neuroimaging and intracranial electrophysiological studies have consistently shown the largest and most consistent face-selective neural activity in the middle portion of the human right lateral fusiform gyrus ('fusiform face area(s)', FFA). Yet, direct evidence for the critical role of this region in face identity recognition (FIR) is still lacking. Here we report the first evidence of transient behavioral impairment of FIR during focal electrical stimulation of the right FFA. Upon stimulation of an electrode contact within this region, subject CJ, who shows typical FIR ability outside of stimulation, was transiently unable to point to pictures of famous faces among strangers and to match pictures of famous or unfamiliar faces presented simultaneously for their identity. Her performance at comparable tasks with other visual materials (written names, pictures of buildings) remained unaffected by stimulation at the same location. During right FFA stimulation, CJ consistently reported that simultaneously presented faces appeared as being the same identity, with little or no distortion of the spatial face configuration. Independent electrophysiological recordings showed the largest neural face-selective and face identity activity at the critical electrode contacts. Altogether, this extensive multimodal case report supports the causal role of the right FFA in FIR.
Collapse
Affiliation(s)
- Angélique Volfart
- Université de Lorraine, CNRS, F-54000, Nancy, France; University of Louvain, Psychological Sciences Research Institute, B-1348, Louvain-La-Neuve, Belgium; Queensland University of Technology, Faculty of Health, School of Psychology & Counselling, 4059, Brisbane, Australia
| | - Bruno Rossion
- Université de Lorraine, CNRS, F-54000, Nancy, France; University of Louvain, Psychological Sciences Research Institute, B-1348, Louvain-La-Neuve, Belgium; Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000, Nancy, France.
| | - Xiaoqian Yan
- Université de Lorraine, CNRS, F-54000, Nancy, France; University of Louvain, Psychological Sciences Research Institute, B-1348, Louvain-La-Neuve, Belgium; Fudan University, Institute of Science and Technology for Brain-Inspired Intelligence, 200433, Shanghai, China
| | - Luna Angelini
- Université de Lorraine, CNRS, F-54000, Nancy, France
| | - Louis Maillard
- Université de Lorraine, CNRS, F-54000, Nancy, France; Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000, Nancy, France
| | - Sophie Colnat-Coulbois
- Université de Lorraine, CNRS, F-54000, Nancy, France; Université de Lorraine, CHRU-Nancy, Service de Neurochirurgie, F-54000, Nancy, France
| | - Jacques Jonas
- Université de Lorraine, CNRS, F-54000, Nancy, France; Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000, Nancy, France
| |
Collapse
|
3
|
den Ouden C, Zhou A, Mepani V, Kovács G, Vogels R, Feuerriegel D. Stimulus expectations do not modulate visual event-related potentials in probabilistic cueing designs. Neuroimage 2023; 280:120347. [PMID: 37648120 DOI: 10.1016/j.neuroimage.2023.120347] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 08/10/2023] [Accepted: 08/23/2023] [Indexed: 09/01/2023] Open
Abstract
Humans and other animals can learn and exploit repeating patterns that occur within their environments. These learned patterns can be used to form expectations about future sensory events. Several influential predictive coding models have been proposed to explain how learned expectations influence the activity of stimulus-selective neurons in the visual system. These models specify reductions in neural response measures when expectations are fulfilled (termed expectation suppression) and increases following surprising sensory events. However, there is currently scant evidence for expectation suppression in the visual system when confounding factors are taken into account. Effects of surprise have been observed in blood oxygen level dependent (BOLD) signals, but not when using electrophysiological measures. To provide a strong test for expectation suppression and surprise effects we performed a predictive cueing experiment while recording electroencephalographic (EEG) data. Participants (n=48) learned cue-face associations during a training session and were then exposed to these cue-face pairs in a subsequent experiment. Using univariate analyses of face-evoked event-related potentials (ERPs) we did not observe any differences across expected (90% probability), neutral (50%) and surprising (10%) face conditions. Across these comparisons, Bayes factors consistently favoured the null hypothesis throughout the time-course of the stimulus-evoked response. When using multivariate pattern analysis we did not observe above-chance classification of expected and surprising face-evoked ERPs. By contrast, we found robust within- and across-trial stimulus repetition effects. Our findings do not support predictive coding-based accounts that specify reduced prediction error signalling when perceptual expectations are fulfilled. They instead highlight the utility of other types of predictive processing models that describe expectation-related phenomena in the visual system without recourse to prediction error signalling.
Collapse
Affiliation(s)
- Carla den Ouden
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Andong Zhou
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Vinay Mepani
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| |
Collapse
|
4
|
Li C, Kovács G. The effect of short-term training on repetition probability effects for non-face objects. Biol Psychol 2022; 175:108452. [DOI: 10.1016/j.biopsycho.2022.108452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 11/01/2022] [Accepted: 11/02/2022] [Indexed: 11/06/2022]
|
5
|
Expectations attenuate the negative influence of neural adaptation on the processing of novel stimuli: ERP evidence. Neuroscience 2022; 492:58-66. [DOI: 10.1016/j.neuroscience.2022.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 04/02/2022] [Accepted: 04/04/2022] [Indexed: 11/20/2022]
|
6
|
Li C, Kovács G, Trapp S. Visual short-term memory load modulates repetition related fMRI signal adaptation. Biol Psychol 2021; 166:108199. [PMID: 34634432 DOI: 10.1016/j.biopsycho.2021.108199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 10/02/2021] [Accepted: 10/04/2021] [Indexed: 10/20/2022]
Abstract
While several computational models have suggested how predictive coding could be implemented on an algorithmic level, reference to cognitive processes remains rather sparse. A crucial process might be elevating relevant prior information from long-term memory to render it highly accessible for subsequent comparison with sensory input. In many models, visual short-term memory (VSTM) is considered as information from long-term memory in a state of elevated activity. We measured the BOLD signal in face-specific cortical areas using repetition suppression (RS) paradigm. RS has been associated with predictive processing in previous studies. We show that RS within the fusiform face area is significantly attenuated when VSTM is loaded with other, non-facial visual information. Although an unequivocal inference is not possible, the data indicate a role of VSTM for predictive processes as indexed by expectation-related RS.
Collapse
Affiliation(s)
- Chenglin Li
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, University of Jena, Jena, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, University of Jena, Jena, Germany
| | - Sabrina Trapp
- Department of Sport Science, University of Bielefeld, Bielefeld, Germany; Department of Psychology, University of Leipzig, Leipzig, Germany.
| |
Collapse
|
7
|
Feuerriegel D, Vogels R, Kovács G. Evaluating the evidence for expectation suppression in the visual system. Neurosci Biobehav Rev 2021; 126:368-381. [PMID: 33836212 DOI: 10.1016/j.neubiorev.2021.04.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 02/16/2021] [Accepted: 04/02/2021] [Indexed: 01/25/2023]
Abstract
Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
8
|
Feuerriegel D, Yook J, Quek GL, Hogendoorn H, Bode S. Visual mismatch responses index surprise signalling but not expectation suppression. Cortex 2020; 134:16-29. [PMID: 33249297 DOI: 10.1016/j.cortex.2020.10.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 09/04/2020] [Accepted: 10/13/2020] [Indexed: 01/17/2023]
Abstract
The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| | - Jane Yook
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Genevieve L Quek
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, the Netherlands
| | - Hinze Hogendoorn
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia; Department of Psychology, University of Cologne, Germany
| |
Collapse
|