1
|
Feuerriegel D. Adaptation in the visual system: Networked fatigue or suppressed prediction error signalling? Cortex 2024; 177:302-320. [PMID: 38905873 DOI: 10.1016/j.cortex.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 05/10/2024] [Accepted: 06/04/2024] [Indexed: 06/23/2024]
Abstract
Our brains are constantly adapting to changes in our visual environments. Neural adaptation exerts a persistent influence on the activity of sensory neurons and our perceptual experience, however there is a lack of consensus regarding how adaptation is implemented in the visual system. One account describes fatigue-based mechanisms embedded within local networks of stimulus-selective neurons (networked fatigue models). Another depicts adaptation as a product of stimulus expectations (predictive coding models). In this review, I evaluate neuroimaging and psychophysical evidence that poses fundamental problems for predictive coding models of neural adaptation. Specifically, I discuss observations of distinct repetition and expectation effects, as well as incorrect predictions of repulsive adaptation aftereffects made by predictive coding accounts. Based on this evidence, I argue that networked fatigue models provide a more parsimonious account of adaptation effects in the visual system. Although stimulus expectations can be formed based on recent stimulation history, any consequences of these expectations are likely to co-occur (or interact) with effects of fatigue-based adaptation. I conclude by proposing novel, testable hypotheses relating to interactions between fatigue-based adaptation and other predictive processes, focusing on stimulus feature extrapolation phenomena.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| |
Collapse
|
2
|
Stan PL, Smith MA. Recent visual experience reshapes V4 neuronal activity and improves perceptual performance. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.27.555026. [PMID: 37693510 PMCID: PMC10491105 DOI: 10.1101/2023.08.27.555026] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/12/2023]
Abstract
Recent visual experience heavily influences our visual perception, but how this is mediated by the reshaping of neuronal activity to alter and improve perceptual discrimination remains unknown. We recorded from populations of neurons in visual cortical area V4 while monkeys performed a natural image change detection task under different experience conditions. We found that maximizing the recent experience with a particular image led to an improvement in the ability to detect a change in that image. This improvement was associated with decreased neural responses to the image, consistent with neuronal changes previously seen in studies of adaptation and expectation. We found that the magnitude of behavioral improvement was correlated with the magnitude of response suppression. Furthermore, this suppression of activity led to an increase in signal separation, providing evidence that a reduction in activity can improve stimulus encoding. Within populations of neurons, greater recent experience was associated with decreased trial-to-trial shared variability, indicating that a reduction in variability is a key means by which experience influences perception. Taken together, the results of our study contribute to an understanding of how recent visual experience can shape our perception and behavior through modulating activity patterns in mid-level visual cortex.
Collapse
|
3
|
Sarodo A, Yamamoto K, Watanabe K. The role of perceptual processing in the oddball effect revealed by the Thatcher illusion. Vision Res 2024; 220:108399. [PMID: 38603924 DOI: 10.1016/j.visres.2024.108399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 03/23/2024] [Accepted: 03/24/2024] [Indexed: 04/13/2024]
Abstract
When a novel stimulus (oddball) appears after repeated presentation of an identical stimulus, the oddball is perceived to last longer than the repeated stimuli, a phenomenon known as the oddball effect. We investigated whether the perceptual or physical differences between the repeated and oddball stimuli are more important for the oddball effect. To manipulate the perceptual difference while keeping their physical visual features constant, we used the Thatcher illusion, in which an inversion of a face hinders recognition of distortion in its facial features. We found that the Thatcherized face presented after repeated presentation of an intact face induced a stronger oddball effect when the faces were upright than when they were inverted (Experiment 1). However, the difference in the oddball effect between face orientations was not observed when the intact face was presented as the oddball after repeated presentation of a Thatcherized face (Experiment 2). These results were replicated when participants performed both the intact-repeated and Thatcherized-repeated conditions in a single experiment (Experiment 3). Two control experiments confirmed that the repeated presentation of the preceding stimuli is necessary for the difference in duration distortion to occur (Experiments 4 and 5). The results suggest the considerable role of perceptual processing in the oddball effect. We discuss the discrepancy in the results between the intact-repeated and Thatcherized-repeated conditions in terms of predictive coding.
Collapse
Affiliation(s)
- Akira Sarodo
- Faculty of Science and Engineering, Waseda University, 3-4-1 Ohkubo, Shinjuku, Tokyo 169-8555, Japan.
| | - Kentaro Yamamoto
- Faculty of Human-Environment Studies, Kyushu University, Fukuoka, Japan
| | - Katsumi Watanabe
- Faculty of Science and Engineering, Waseda University, 3-4-1 Ohkubo, Shinjuku, Tokyo 169-8555, Japan
| |
Collapse
|
4
|
Song B, Sommer W, Maurer U. Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials. J Cogn Neurosci 2024; 36:872-887. [PMID: 38261395 DOI: 10.1162/jocn_a_02111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.
Collapse
Affiliation(s)
- Bingbing Song
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universitaet zu Berlin, Berlin, Germany
- Department of Physics, Hong Kong Baptist University, Hong Kong, China
| | - Urs Maurer
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Centre for Developmental Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Brain and Mind Institute, The Chinese University of Hong Kong, Hong Kong, China
| |
Collapse
|
5
|
Garlichs A, Blank H. Prediction error processing and sharpening of expected information across the face-processing hierarchy. Nat Commun 2024; 15:3407. [PMID: 38649694 PMCID: PMC11035707 DOI: 10.1038/s41467-024-47749-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 04/10/2024] [Indexed: 04/25/2024] Open
Abstract
The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.
Collapse
Affiliation(s)
- Annika Garlichs
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
| |
Collapse
|
6
|
Walsh K, McGovern DP, Dully J, Kelly SP, O'Connell RG. Prior probability cues bias sensory encoding with increasing task exposure. eLife 2024; 12:RP91135. [PMID: 38564237 PMCID: PMC10987094 DOI: 10.7554/elife.91135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024] Open
Abstract
When observers have prior knowledge about the likely outcome of their perceptual decisions, they exhibit robust behavioural biases in reaction time and choice accuracy. Computational modelling typically attributes these effects to strategic adjustments in the criterion amount of evidence required to commit to a choice alternative - usually implemented by a starting point shift - but recent work suggests that expectations may also fundamentally bias the encoding of the sensory evidence itself. Here, we recorded neural activity with EEG while participants performed a contrast discrimination task with valid, invalid, or neutral probabilistic cues across multiple testing sessions. We measured sensory evidence encoding via contrast-dependent steady-state visual-evoked potentials (SSVEP), while a read-out of criterion adjustments was provided by effector-selective mu-beta band activity over motor cortex. In keeping with prior modelling and neural recording studies, cues evoked substantial biases in motor preparation consistent with criterion adjustments, but we additionally found that the cues produced a significant modulation of the SSVEP during evidence presentation. While motor preparation adjustments were observed in the earliest trials, the sensory-level effects only emerged with extended task exposure. Our results suggest that, in addition to strategic adjustments to the decision process, probabilistic information can also induce subtle biases in the encoding of the evidence itself.
Collapse
Affiliation(s)
- Kevin Walsh
- School of Psychological Sciences, Monash UniversityMelbourneAustralia
| | | | - Jessica Dully
- Institute of Psychiatry, Psychology & Neuroscience, King's College LondonLondonUnited Kingdom
| | - Simon P Kelly
- School of Electrical Engineering, University College DublinDublinIreland
- Trinity College Institute of Neuroscience, Trinity College DublinDublinIreland
| | - Redmond G O'Connell
- Trinity College Institute of Neuroscience, Trinity College DublinDublinIreland
- School of Psychology, Trinity College DublinDublinIreland
| |
Collapse
|
7
|
Arnold DH, Electricity F, Saurels BW. Enhanced electrophysiological responses to explicitly predicted and pre-imagined inputs, with confirmation from online decoding with neuro-feedback. Proc Biol Sci 2024; 291:20232908. [PMID: 38351803 PMCID: PMC10865004 DOI: 10.1098/rspb.2023.2908] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2023] [Accepted: 01/15/2024] [Indexed: 02/16/2024] Open
Abstract
Neural responses to sensory inputs can scale with the likelihood of encountering the input. This is consistent with the predictive coding framework, in that the human brain is expected to be less responsive to predicted inputs. Typically, however, prediction is not explicitly measured. It is inferred from the probability of encountering an event. When an input is explicitly predicted, responses to predicted inputs can be enhanced. Here, we ask if this effect can be ascribed to a generic priming effect, from pre-cogitating about one of two possible inputs. Consistent with this, we find that P300s (a relatively late event-related potential measured with electroencephalography) are greater for explicitly predicted audio and visual inputs, and that this effect cannot be distinguished from a priming effect from pre-imagining audio or visual presentations. Evidence indicates that participants engaged in pre-imagining presentations, as we were able to decode online what type of presentation (audio or visual) they were imagining with a high success rate (approx. 73%), and we encouraged compliance with neuro-feedback regarding this success rate. Our data confirm that human cortex can be more responsive to inputs that have been subject to pre-cogitation-including explicit predictions. This highlights that while anticipatory processes can reduce responding to likely inputs, they can also enhance responding to explicitly predicted inputs.
Collapse
Affiliation(s)
- Derek H. Arnold
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| | - Felicity Electricity
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| | - Blake W. Saurels
- Perception Lab, School of Psychology, University of Queensland, Brisbane, Queensland, Australia
| |
Collapse
|
8
|
Hodson R, Mehta M, Smith R. The empirical status of predictive coding and active inference. Neurosci Biobehav Rev 2024; 157:105473. [PMID: 38030100 DOI: 10.1016/j.neubiorev.2023.105473] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 10/27/2023] [Accepted: 11/16/2023] [Indexed: 12/01/2023]
Abstract
Research on predictive processing models has focused largely on two specific algorithmic theories: Predictive Coding for perception and Active Inference for decision-making. While these interconnected theories possess broad explanatory potential, they have only recently begun to receive direct empirical evaluation. Here, we review recent studies of Predictive Coding and Active Inference with a focus on evaluating the degree to which they are empirically supported. For Predictive Coding, we find that existing empirical evidence offers modest support. However, some positive results can also be explained by alternative feedforward (e.g., feature detection-based) models. For Active Inference, most empirical studies have focused on fitting these models to behavior as a means of identifying and explaining individual or group differences. While Active Inference models tend to explain behavioral data reasonably well, there has not been a focus on testing empirical validity of active inference theory per se, which would require formal comparison to other models (e.g., non-Bayesian or model-free reinforcement learning models). This review suggests that, while promising, a number of specific research directions are still necessary to evaluate the empirical adequacy and explanatory power of these algorithms.
Collapse
Affiliation(s)
| | | | - Ryan Smith
- Laureate Institute for Brain Research, USA.
| |
Collapse
|
9
|
den Ouden C, Zhou A, Mepani V, Kovács G, Vogels R, Feuerriegel D. Stimulus expectations do not modulate visual event-related potentials in probabilistic cueing designs. Neuroimage 2023; 280:120347. [PMID: 37648120 DOI: 10.1016/j.neuroimage.2023.120347] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 08/10/2023] [Accepted: 08/23/2023] [Indexed: 09/01/2023] Open
Abstract
Humans and other animals can learn and exploit repeating patterns that occur within their environments. These learned patterns can be used to form expectations about future sensory events. Several influential predictive coding models have been proposed to explain how learned expectations influence the activity of stimulus-selective neurons in the visual system. These models specify reductions in neural response measures when expectations are fulfilled (termed expectation suppression) and increases following surprising sensory events. However, there is currently scant evidence for expectation suppression in the visual system when confounding factors are taken into account. Effects of surprise have been observed in blood oxygen level dependent (BOLD) signals, but not when using electrophysiological measures. To provide a strong test for expectation suppression and surprise effects we performed a predictive cueing experiment while recording electroencephalographic (EEG) data. Participants (n=48) learned cue-face associations during a training session and were then exposed to these cue-face pairs in a subsequent experiment. Using univariate analyses of face-evoked event-related potentials (ERPs) we did not observe any differences across expected (90% probability), neutral (50%) and surprising (10%) face conditions. Across these comparisons, Bayes factors consistently favoured the null hypothesis throughout the time-course of the stimulus-evoked response. When using multivariate pattern analysis we did not observe above-chance classification of expected and surprising face-evoked ERPs. By contrast, we found robust within- and across-trial stimulus repetition effects. Our findings do not support predictive coding-based accounts that specify reduced prediction error signalling when perceptual expectations are fulfilled. They instead highlight the utility of other types of predictive processing models that describe expectation-related phenomena in the visual system without recourse to prediction error signalling.
Collapse
Affiliation(s)
- Carla den Ouden
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Andong Zhou
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Vinay Mepani
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| |
Collapse
|
10
|
Lee SM, Tibon R, Zeidman P, Yadav PS, Henson R. Effects of face repetition on ventral visual stream connectivity using dynamic causal modelling of fMRI data. Neuroimage 2022; 264:119708. [PMID: 36280098 DOI: 10.1016/j.neuroimage.2022.119708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 10/20/2022] [Accepted: 10/20/2022] [Indexed: 11/06/2022] Open
Abstract
Stimulus repetition normally causes reduced neural activity in brain regions that process that stimulus. Some theories claim that this "repetition suppression" reflects local mechanisms such as neuronal fatigue or sharpening within a region, whereas other theories claim that it results from changed connectivity between regions, following changes in synchrony or top-down predictions. In this study, we applied dynamic causal modeling (DCM) on a public fMRI dataset involving repeated presentations of faces and scrambled faces to test whether repetition affected local (self-connections) and/or between-region connectivity in left and right early visual cortex (EVC), occipital face area (OFA) and fusiform face area (FFA). Face "perception" (faces versus scrambled faces) modulated nearly all connections, within and between regions, including direct connections from EVC to FFA, supporting a non-hierarchical view of face processing. Face "recognition" (familiar versus unfamiliar faces) modulated connections between EVC and OFA/FFA, particularly in the left hemisphere. Most importantly, immediate and delayed repetition of stimuli were also best captured by modulations of connections between EVC and OFA/FFA, but not self-connections of OFA/FFA, consistent with synchronization or predictive coding theories, though also possibly reflecting local mechanisms like synaptic depression.
Collapse
Affiliation(s)
- Sung-Mu Lee
- Taiwan International Graduate Program in Interdisciplinary Neuroscience, National Cheng Kung University and Academia Sinica, Taipei, Taiwan; MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| | - Roni Tibon
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom; School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Peter Zeidman
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom
| | - Pranay S Yadav
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| | - Richard Henson
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom; Department of Psychiatry, University of Cambridge, Cambridge, United Kingdom.
| |
Collapse
|
11
|
Sarodo A, Yamamoto K, Watanabe K. Changes in face category induce stronger duration distortion in the temporal oddball paradigm. Vision Res 2022; 200:108116. [PMID: 36088849 DOI: 10.1016/j.visres.2022.108116] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Revised: 08/06/2022] [Accepted: 08/11/2022] [Indexed: 01/25/2023]
Abstract
A novel stimulus embedded in a sequence of repeated stimuli is often perceived to be longer in duration. Studies have indicated the involvement of repetition suppression in this duration distortion, but it remains unclear which processing stages are important. The present study examined whether high-level visual category processing contributes to the oddball's duration distortion. In Experiment 1, we presented a novel face image in either human, monkey, or cat category after a repetition of an identical human face image in the temporal oddball paradigm. We found that the duration distortion of the last stimulus increased when the face changed across different categories, than when it changed within the same category. However, the effect of category change disappeared when globally scrambled and locally scrambled face images were used in Experiments 2 and 3, respectively, suggesting that the difference in duration distortion cannot be attributed to low-level visual properties of the images. Furthermore, in Experiment 4, we again used intact face images and found that category changes can influence the duration distortion even when a series of different human faces was presented before the last stimulus. These findings indicate that high-level visual category processing plays an important role in the duration distortion of oddballs. This study supports the idea that visual processing at higher visual stages is involved in duration perception. (219 words).
Collapse
Affiliation(s)
- Akira Sarodo
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan.
| | - Kentaro Yamamoto
- Faculty of Human-Environment Studies, Kyushu University, Fukuoka, Japan
| | - Katsumi Watanabe
- Waseda Research Institute for Science and Engineering, Faculty of Science and Engineering, Waseda University, Tokyo, Japan
| |
Collapse
|
12
|
He T, Richter D, Wang Z, de Lange FP. Spatial and Temporal Context Jointly Modulate the Sensory Response within the Ventral Visual Stream. J Cogn Neurosci 2021; 34:332-347. [PMID: 34964889 DOI: 10.1162/jocn_a_01792] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Both spatial and temporal context play an important role in visual perception and behavior. Humans can extract statistical regularities from both forms of context to help process the present and to construct expectations about the future. Numerous studies have found reduced neural responses to expected stimuli compared with unexpected stimuli, for both spatial and temporal regularities. However, it is largely unclear whether and how these forms of context interact. In the current fMRI study, 33 human volunteers were exposed to pairs of object stimuli that could be expected or surprising in terms of their spatial and temporal context. We found reliable independent contributions of both spatial and temporal context in modulating the neural response. Specifically, neural responses to stimuli in expected compared with unexpected contexts were suppressed throughout the ventral visual stream. These results suggest that both spatial and temporal context may aid sensory processing in a similar fashion, providing evidence on how different types of context jointly modulate perceptual processing.
Collapse
|
13
|
Heurteloup C, Merchie A, Roux S, Bonnet-Brilhault F, Escera C, Gomot M. Neural repetition suppression to vocal and non-vocal sounds. Cortex 2021; 148:1-13. [DOI: 10.1016/j.cortex.2021.11.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 03/02/2021] [Accepted: 11/19/2021] [Indexed: 11/29/2022]
|
14
|
Li C, Kovács G, Trapp S. Visual short-term memory load modulates repetition related fMRI signal adaptation. Biol Psychol 2021; 166:108199. [PMID: 34634432 DOI: 10.1016/j.biopsycho.2021.108199] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 10/02/2021] [Accepted: 10/04/2021] [Indexed: 10/20/2022]
Abstract
While several computational models have suggested how predictive coding could be implemented on an algorithmic level, reference to cognitive processes remains rather sparse. A crucial process might be elevating relevant prior information from long-term memory to render it highly accessible for subsequent comparison with sensory input. In many models, visual short-term memory (VSTM) is considered as information from long-term memory in a state of elevated activity. We measured the BOLD signal in face-specific cortical areas using repetition suppression (RS) paradigm. RS has been associated with predictive processing in previous studies. We show that RS within the fusiform face area is significantly attenuated when VSTM is loaded with other, non-facial visual information. Although an unequivocal inference is not possible, the data indicate a role of VSTM for predictive processes as indexed by expectation-related RS.
Collapse
Affiliation(s)
- Chenglin Li
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, University of Jena, Jena, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, University of Jena, Jena, Germany
| | - Sabrina Trapp
- Department of Sport Science, University of Bielefeld, Bielefeld, Germany; Department of Psychology, University of Leipzig, Leipzig, Germany.
| |
Collapse
|
15
|
Feuerriegel D, Vogels R, Kovács G. Evaluating the evidence for expectation suppression in the visual system. Neurosci Biobehav Rev 2021; 126:368-381. [PMID: 33836212 DOI: 10.1016/j.neubiorev.2021.04.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 02/16/2021] [Accepted: 04/02/2021] [Indexed: 01/25/2023]
Abstract
Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
16
|
Kirwan CB, Bjornn DK, Anderson BB, Vance A, Eargle D, Jenkins JL. Repetition of Computer Security Warnings Results in Differential Repetition Suppression Effects as Revealed With Functional MRI. Front Psychol 2020; 11:528079. [PMID: 33364992 PMCID: PMC7751389 DOI: 10.3389/fpsyg.2020.528079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2020] [Accepted: 11/11/2020] [Indexed: 11/27/2022] Open
Abstract
Computer users are often the last line of defense in computer security. However, with repeated exposures to system messages and computer security warnings, neural and behavioral responses show evidence of habituation. Habituation has been demonstrated at a neural level as repetition suppression where responses are attenuated with subsequent repetitions. In the brain, repetition suppression to visual stimuli has been demonstrated in multiple cortical areas, including the occipital lobe and medial temporal lobe. Prior research into the repetition suppression effect has generally focused on a single repetition and has not examined the pattern of signal suppression with repeated exposures. We used complex, everyday stimuli, in the form of images of computer programs or security warning messages, to examine the repetition suppression effect across repeated exposures. The use of computer warnings as stimuli also allowed us to examine the activation of learned fearful stimuli. We observed widespread linear decreases in activation with repeated exposures, suggesting that repetition suppression continues after the first repetition. Further, we found greater activation for warning messages compared to neutral images in the anterior insula, pre-supplemental motor area, and inferior frontal gyrus, suggesting differential processing of security warning messages. However, the repetition suppression effect was similar in these regions for both warning messages and neutral images. Additionally, we observed an increase of activation in the default mode network with repeated exposures, suggestive of increased mind wandering with continuing habituation.
Collapse
Affiliation(s)
- C Brock Kirwan
- Neuroscience Center, Brigham Young University, Provo, UT, United States.,Department of Psychology, Brigham Young University, Provo, UT, United States
| | - Daniel K Bjornn
- Department of Psychology, Brigham Young University, Provo, UT, United States
| | | | - Anthony Vance
- Department of Management Information Systems, Fox School of Business, Temple University, Philadelphia, PA, United States
| | - David Eargle
- Leeds School of Business, University of Colorado Boulder, Boulder, CO, United States
| | - Jeffrey L Jenkins
- Department of Information Systems, Brigham Young University, Provo, UT, United States
| |
Collapse
|
17
|
Feuerriegel D, Yook J, Quek GL, Hogendoorn H, Bode S. Visual mismatch responses index surprise signalling but not expectation suppression. Cortex 2020; 134:16-29. [PMID: 33249297 DOI: 10.1016/j.cortex.2020.10.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 09/04/2020] [Accepted: 10/13/2020] [Indexed: 01/17/2023]
Abstract
The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| | - Jane Yook
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Genevieve L Quek
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, the Netherlands
| | - Hinze Hogendoorn
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia; Department of Psychology, University of Cologne, Germany
| |
Collapse
|
18
|
Rostalski SM, Amado C, Kovács G, Feuerriegel D. Measures of repetition suppression in the fusiform face area are inflated by co-occurring effects of statistically learned visual associations. Cortex 2020; 131:123-136. [DOI: 10.1016/j.cortex.2020.07.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 03/20/2020] [Accepted: 07/03/2020] [Indexed: 12/12/2022]
|
19
|
Rossion B, Retter TL, Liu‐Shuang J. Understanding human individuation of unfamiliar faces with oddball fast periodic visual stimulation and electroencephalography. Eur J Neurosci 2020; 52:4283-4344. [DOI: 10.1111/ejn.14865] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 05/19/2020] [Accepted: 05/30/2020] [Indexed: 01/08/2023]
Affiliation(s)
- Bruno Rossion
- CNRS, CRAN UMR7039 Université de Lorraine F‐54000Nancy France
- Service de Neurologie, CHRU‐Nancy Université de Lorraine F‐54000Nancy France
| | - Talia L. Retter
- Department of Behavioural and Cognitive Sciences Faculty of Language and Literature Humanities, Arts and Education University of Luxembourg Luxembourg Luxembourg
| | - Joan Liu‐Shuang
- Institute of Research in Psychological Science Institute of Neuroscience Université de Louvain Louvain‐la‐Neuve Belgium
| |
Collapse
|
20
|
Reichardt R, Polner B, Simor P. Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness. Front Hum Neurosci 2020; 14:152. [PMID: 32410975 PMCID: PMC7201021 DOI: 10.3389/fnhum.2020.00152] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2020] [Accepted: 04/06/2020] [Indexed: 12/15/2022] Open
Abstract
Novelty is central to the study of memory, but the wide range of experimental manipulations aimed to reveal its effects on learning produced inconsistent results. The novelty/encoding hypothesis suggests that novel information undergoes enhanced encoding and thus leads to benefits in memory, especially in recognition performance; however, recent studies cast doubts on this assumption. On the other hand, data from animal studies provided evidence on the robust effects of novelty manipulations on the neurophysiological correlates of memory processes. Conceptualizations and operationalizations of novelty are remarkably variable and were categorized into different subtypes, such as stimulus, context, associative or spatial novelty. Here, we summarize previous findings about the effects of novelty on memory and suggest that predictive coding theories provide a framework that could shed light on the differential influence of novelty manipulations on memory performance. In line with predictive coding theories, we emphasize the role of unexpectedness as a crucial property mediating the behavioral and neural effects of novelty manipulations.
Collapse
Affiliation(s)
- Richárd Reichardt
- Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary.,Institute of Psychology, Eötvös Lóránd University, Budapest, Hungary
| | - Bertalan Polner
- Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary
| | - Péter Simor
- Institute of Psychology, Eötvös Lóránd University, Budapest, Hungary.,Institute of Behavioural Sciences, Semmelweis University, Budapest, Hungary.,UR2NF, Neuropsychology and Functional Neuroimaging Research Unit, CRCN-Center for Research in Cognition and Neurosciences and UNI-ULB Neurosciences Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium
| |
Collapse
|
21
|
Walsh KS, McGovern DP, Clark A, O'Connell RG. Evaluating the neurophysiological evidence for predictive processing as a model of perception. Ann N Y Acad Sci 2020; 1464:242-268. [PMID: 32147856 PMCID: PMC7187369 DOI: 10.1111/nyas.14321] [Citation(s) in RCA: 109] [Impact Index Per Article: 27.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 01/21/2020] [Accepted: 02/03/2020] [Indexed: 12/12/2022]
Abstract
For many years, the dominant theoretical framework guiding research into the neural origins of perceptual experience has been provided by hierarchical feedforward models, in which sensory inputs are passed through a series of increasingly complex feature detectors. However, the long-standing orthodoxy of these accounts has recently been challenged by a radically different set of theories that contend that perception arises from a purely inferential process supported by two distinct classes of neurons: those that transmit predictions about sensory states and those that signal sensory information that deviates from those predictions. Although these predictive processing (PP) models have become increasingly influential in cognitive neuroscience, they are also criticized for lacking the empirical support to justify their status. This limited evidence base partly reflects the considerable methodological challenges that are presented when trying to test the unique predictions of these models. However, a confluence of technological and theoretical advances has prompted a recent surge in human and nonhuman neurophysiological research seeking to fill this empirical gap. Here, we will review this new research and evaluate the degree to which its findings support the key claims of PP.
Collapse
Affiliation(s)
- Kevin S. Walsh
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
| | - David P. McGovern
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
- School of PsychologyDublin City UniversityDublinIreland
| | - Andy Clark
- Department of PhilosophyUniversity of SussexBrightonUK
- Department of InformaticsUniversity of SussexBrightonUK
| | - Redmond G. O'Connell
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
| |
Collapse
|
22
|
Amado C, Rostalski SM, Grotheer M, Wanke N, Kovács G. Similar Expectation Effects for Immediate and Delayed Stimulus Repetitions. Front Neurosci 2020; 13:1379. [PMID: 31920527 PMCID: PMC6933499 DOI: 10.3389/fnins.2019.01379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 12/05/2019] [Indexed: 11/24/2022] Open
Abstract
A prior cue or stimulus allows prediction of the future occurrence of an event and therefore reduces the associated neural activity in several cortical areas. This phenomenon is labeled expectation suppression (ES) and has recently been shown to be independent of the generally observed effects of stimulus repetitions (repetition suppression, RS: reduced neuronal response after the repetition of a given stimulus). While it has been shown that attentional cueing is strongly affected by the length of the cue-target delay, we have no information on the temporal dynamics of expectation effects, as in most prior studies of ES the delay between the predictive cue and the target (i.e., the inter-stimulus interval, ISI) was in the range of a few hundred milliseconds. Hence, we presented participants with pairs of faces where the first face could be used to build expectations regarding the second one, in the sense that one gender indicated repetition of the same face while the other gender predicted the occurrence of novel faces. In addition, we presented the stimulus pairs with two different ISIs (0.5 s for Immediate and 1.75 or 3.75 s for Delayed ISIs). We found significant RS as well as a reduced response for correctly predicted when compared to surprising trials in the fusiform face area. Importantly, the effects of repetition and expectation were both independent of the length of the ISI period. This implies that Immediate and Delayed cue-target stimulus arrangements lead to similar expectation effects in the face sensitive-visual cortex.
Collapse
Affiliation(s)
- Catarina Amado
- Experimental Cognitive Science, Eberhard Karls Universität Tübingen, Tübingen, Germany
| | - Sophie-Marie Rostalski
- Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Mareike Grotheer
- Department of Psychology, Stanford University, Stanford, CA, United States
| | - Nadine Wanke
- Institute of Psychology, University of Hamburg, Hamburg, Germany
| | - Gyula Kovács
- Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
23
|
Kovács G, Grotheer M, Münke L, Kéri S, Nenadić I. Significant repetition probability effects in schizophrenia. Psychiatry Res Neuroimaging 2019; 290:22-29. [PMID: 31254800 DOI: 10.1016/j.pscychresns.2019.05.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2019] [Revised: 05/30/2019] [Accepted: 05/31/2019] [Indexed: 11/30/2022]
Abstract
BACKGROUND A growing body of evidence suggests that the comparison of expected and incoming sensory stimuli (the prediction-error (ε) processing) is impaired in schizophrenia patients (SZ). For example, in studies of mismatch negativity, an ERP component that signals ε, SZ patients show deficits in the auditory and visual modalities. To test the role of impaired ε processing further in SZ, using neuroimaging methods, we applied a repetition-suppression (RS) paradigm. METHODS Patients diagnosed with SZ (n = 17) as well as age- and sex- matched healthy control subjects (HC, n = 17) were presented with pairs of faces, which could either repeat or alternate. Additionally, the likelihood of repetition/alternation trials was modulated in individual blocks of fMRI recordings, testing the effects of repetition probability (P(rep)) on RS. RESULTS We found a significant RS in the fusiform and occipital face areas as well as in the lateral occipital cortex that was similar in healthy controls and SZ patients SZ. More importantly, we observed similar P(rep) effects (larger RS in blocks with high frequency of repetitions than in blocks with low repetition likelihood) in both the control and the patient group. CONCLUSION Our findings suggest that repetition_probability modulations affect the neural responses in schizophrenia patients and healthy participants similarly. This suggests that the neural mechanisms determining perceptual inferences based on stimulus probabilities remain unimpaired in schizophrenia.
Collapse
Affiliation(s)
- Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, 07743 Jena, Germany
| | - Mareike Grotheer
- Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, 07743 Jena, Germany
| | - Lisa Münke
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany
| | - Szabolcs Kéri
- Department of Cognitive Science, Budapest University of Technology and Economics, 1111 Budapest, Hungary
| | - Igor Nenadić
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany; Department of Psychiatry and Psychotherapy, Philipps-Universität Marburg / Marburg University Hospital - UKGM, Rudolf-Bultmann-Str. 8, 35037 Marburg, Germany.
| |
Collapse
|
24
|
Rostalski SM, Amado C, Kovács G. Repetition Suppression for Noisy and Intact Faces in the Occipito-Temporal Cortex. Front Psychol 2019; 10:1348. [PMID: 31258501 PMCID: PMC6587110 DOI: 10.3389/fpsyg.2019.01348] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Accepted: 05/23/2019] [Indexed: 11/13/2022] Open
Abstract
Repetition suppression (RS), the relative lower neural response magnitude to repeated as compared to non-repeated stimuli, is often explained within the predictive coding framework. According to this theory, precise predictions (priors) together with less precise sensory evidences lead to decisions that are determined largely by the predictions and the other way around. In other words, the prediction error, namely the magnitude of RS, should depend on the precision of predictions and sensory inputs. In the current study, we aimed at testing this idea by manipulating the clarity and thereby the precision of the incoming sensory data by adding noise to the images. This resulted in an fMRI adaptation design with repeated or alternating trials showing clear or noisy face stimuli. Our results show a noise effect on the activity in the fusiform face area (FFA), namely less activation for noisy than for clear trials, which supports previous findings. No such effects could be found in OFA or LO. Data also showed reliable RS in the FFA (bilateral) and unilaterally in OFA (right) and LO (left). Interestingly, the noise added to the stimuli did not affect the magnitude of RS in any of the tested cortical areas. This suggests that the clarity of the sensory input is not crucial in determining the magnitude of RS.
Collapse
Affiliation(s)
- Sophie-Marie Rostalski
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Catarina Amado
- Department of Computer Science, Experimental Cognitive Science Research Group, Eberhard Karls Universität Tübingen, Tübingen, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
25
|
Stefanics G, Stephan KE, Heinzle J. Feature-specific prediction errors for visual mismatch. Neuroimage 2019; 196:142-151. [PMID: 30978499 DOI: 10.1016/j.neuroimage.2019.04.020] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2018] [Revised: 03/30/2019] [Accepted: 04/04/2019] [Indexed: 01/08/2023] Open
Abstract
Predictive coding (PC) theory posits that our brain employs a predictive model of the environment to infer the causes of its sensory inputs. A fundamental but untested prediction of this theory is that the same stimulus should elicit distinct precision weighted prediction errors (pwPEs) when different (feature-specific) predictions are violated, even in the absence of attention. Here, we tested this hypothesis using functional magnetic resonance imaging (fMRI) and a multi-feature roving visual mismatch paradigm where rare changes in either color (red, green), or emotional expression (happy, fearful) of faces elicited pwPE responses in human participants. Using a computational model of learning and inference, we simulated pwPE and prediction trajectories of a Bayes-optimal observer and used these to analyze changes in blood oxygen level dependent (BOLD) responses to changes in color and emotional expression of faces while participants engaged in a distractor task. Controlling for visual attention by eye-tracking, we found pwPE responses to unexpected color changes in the fusiform gyrus. Conversely, unexpected changes of facial emotions elicited pwPE responses in cortico-thalamo-cerebellar structures associated with emotion and theory of mind processing. Predictions pertaining to emotions activated fusiform, occipital and temporal areas. Our results are consistent with a general role of PC across perception, from low-level to complex and socially relevant object features, and suggest that monitoring of the social environment occurs continuously and automatically, even in the absence of attention.
Collapse
Affiliation(s)
- Gabor Stefanics
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wilfriedstrasse 6, 8032, Zurich, Switzerland; Laboratory for Social and Neural Systems Research, Department of Economics, University of Zurich, Blümlisalpstrasse 10, 8006, Zurich, Switzerland.
| | - Klaas Enno Stephan
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wilfriedstrasse 6, 8032, Zurich, Switzerland; Laboratory for Social and Neural Systems Research, Department of Economics, University of Zurich, Blümlisalpstrasse 10, 8006, Zurich, Switzerland; Max Planck Institute for Metabolism Research, Cologne, Germany
| | - Jakob Heinzle
- Translational Neuromodeling Unit (TNU), Institute for Biomedical Engineering, University of Zurich & ETH Zurich, Wilfriedstrasse 6, 8032, Zurich, Switzerland
| |
Collapse
|
26
|
Maheu M, Dehaene S, Meyniel F. Brain signatures of a multiscale process of sequence learning in humans. eLife 2019; 8:41541. [PMID: 30714904 PMCID: PMC6361584 DOI: 10.7554/elife.41541] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2018] [Accepted: 01/18/2019] [Indexed: 01/08/2023] Open
Abstract
Extracting the temporal structure of sequences of events is crucial for perception, decision-making, and language processing. Here, we investigate the mechanisms by which the brain acquires knowledge of sequences and the possibility that successive brain responses reflect the progressive extraction of sequence statistics at different timescales. We measured brain activity using magnetoencephalography in humans exposed to auditory sequences with various statistical regularities, and we modeled this activity as theoretical surprise levels using several learning models. Successive brain waves related to different types of statistical inferences. Early post-stimulus brain waves denoted a sensitivity to a simple statistic, the frequency of items estimated over a long timescale (habituation). Mid-latency and late brain waves conformed qualitatively and quantitatively to the computational properties of a more complex inference: the learning of recent transition probabilities. Our findings thus support the existence of multiple computational systems for sequence processing involving statistical inferences at multiple scales.
Collapse
Affiliation(s)
- Maxime Maheu
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France.,Université Paris Descartes, Sorbonne Paris Cité, Paris, France
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France.,Collège de France, Paris, France
| | - Florent Meyniel
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France
| |
Collapse
|
27
|
Feuerriegel D, Churches O, Coussens S, Keage HA. Temporal expectations modulate face image repetition suppression of early stimulus evoked event-related potentials. Neuropsychologia 2019; 122:76-87. [DOI: 10.1016/j.neuropsychologia.2018.11.010] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 10/24/2018] [Accepted: 11/17/2018] [Indexed: 01/11/2023]
|
28
|
Feuerriegel D, Keage HA, Rossion B, Quek GL. Immediate stimulus repetition abolishes stimulus expectation and surprise effects in fast periodic visual oddball designs. Biol Psychol 2018; 138:110-125. [DOI: 10.1016/j.biopsycho.2018.09.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2018] [Revised: 08/01/2018] [Accepted: 09/03/2018] [Indexed: 12/22/2022]
|
29
|
Adolescents with autism show typical fMRI repetition suppression, but atypical surprise response. Cortex 2018; 109:25-34. [PMID: 30286304 DOI: 10.1016/j.cortex.2018.08.019] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 06/15/2018] [Accepted: 08/27/2018] [Indexed: 11/20/2022]
Abstract
Recent theoretical frameworks have hypothesized that autism spectrum disorder (ASD) may be marked by an altered balance between sensory inputs and prior knowledge-the so-called hypoprior hypothesis. Yet evidence regarding such an altered balance is mixed. Here, we aimed to test this hypothesis within the domain of visual perception, by examining how neural activity in the visual system was modulated by stimulus repetition and stimulus expectation in healthy and ASD participants. We presented 22 adolescents with ASD and 22 typically developing (TD) adolescents with pairs of object stimuli, while measuring brain activity using functional magnetic resonance imaging (fMRI). Stimulus pairs could be stimulus repetitions or not and could be expected or not. We examined neural activity in early (V1) and object-selective (LOC) visual cortex. Both ASD and TD individuals showed robust and equal repetition suppression in LOC. By contrast, ASD and TD groups showed a different response to expected versus unexpected stimuli, specifically in V1. Thereby, our results suggest that while the more automatic modulation of activity by repetition is unaffected in ASD, there is some evidence that the balance between sensory evidence and prior knowledge may indeed be altered in early visual cortex of ASD.
Collapse
|
30
|
Kronbichler L, Said-Yürekli S, Kronbichler M. Perceptual Expectations of Object Stimuli Modulate Repetition Suppression in a Delayed Repetition Design. Sci Rep 2018; 8:12526. [PMID: 30131582 PMCID: PMC6104074 DOI: 10.1038/s41598-018-31091-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Accepted: 08/07/2018] [Indexed: 11/30/2022] Open
Abstract
Several fMRI and EEG/MEG studies show that repetition suppression (RS) effects are stronger when a stimulus repetition is expected compared to when a stimulus repetition is less expected. To date, the prevalent way to assess the influence of expectations on RS is via immediate stimulus repetition designs, that is, no intervening stimuli appear between the initial and repeated presentation of a stimulus. Since there is evidence that repetition lag may alter RS effects in a qualitative manner, the current study investigated how perceptual expectations modify RS effects on object stimuli when repetition lag is relatively long. Region of interest analyses in the left occipital cortex revealed a similar activation pattern as identified in previous studies on immediate lag: RS effects were strongest when repetitions were expected compared to decreased RS effects when repetitions were less expected. Therefore, the current study expands previous research in two ways: First, we replicate prior studies showing that perceptual expectation effects can be observed in object-sensitive occipital areas. Second, the finding that expectation effects can be found even for several-minute lags proposes that Bayesian inference processes are a relatively robust component in visual stimulus processing.
Collapse
Affiliation(s)
- Lisa Kronbichler
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria.
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria.
| | - Sarah Said-Yürekli
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| | - Martin Kronbichler
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| |
Collapse
|
31
|
Face Repetition Probability Does Not Affect Repetition Suppression in Macaque Inferotemporal Cortex. J Neurosci 2018; 38:7492-7504. [PMID: 30030399 DOI: 10.1523/jneurosci.0462-18.2018] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Revised: 06/06/2018] [Accepted: 07/06/2018] [Indexed: 12/20/2022] Open
Abstract
Repetition suppression, which refers to reduced neural activity for repeated stimuli, is typically explained by bottom-up or local adaptation mechanisms. However, recent theories have emphasized the role of top-down processes, suggesting that this response reduction reflects the fulfillment of perceptual expectations. To support this, an influential human fMRI study showed that the magnitude of suppression is modulated by the probability of a repetition. No such repetition probability effect was found in macaque inferior temporal (IT) cortex for spiking activity despite the presence of repetition suppression. Contrary to the human fMRI studies that showed an effect of repetition probability, the macaque single-unit study used a large variety of unfamiliar stimuli and the monkeys were not required to attend the stimuli. Here, as in the human fMRI studies, we used faces as stimuli and made the monkeys attend to the stimulus content. We simultaneously recorded spiking activity and local field potentials (LFPs) in the middle lateral face patch (ML) of one monkey (male) and a face-responsive region of another (female). Although we observed significant repetition suppression of spiking activity and high gamma-band LFPs in both animals, there were no effects of repetition probability even when repetitions were task relevant and repetition probability affected behavioral decisions. In conclusion, despite the use of face stimuli and a stimulus-related task, no neural signature of repetition probability was present for faces in a face responsive patch of macaque IT. This further challenges a general perceptual expectation account of repetition suppression.SIGNIFICANCE STATEMENT Repetition suppression is a reduced brain activity for repeated stimuli commonly observed across species. In the predictive coding framework, such suppression is thought to reflect fulfilled perceptual expectations. Although this hypothesis is supported by several human fMRI studies reporting an effect of repetition probability on repetition suppression, this could not be replicated in single-cell recordings in monkey inferior temporal (IT) cortex. Subsequent studies narrowed down the conditions for the effect to requiring attention and being limited to particular stimulus categories such as faces. Here, we show that, even under these conditions, repetition suppression in monkey IT neurons is still unaffected by repetition probability, even in a task with a behavioral effect, challenging the perceptual expectation account of repetition suppression.
Collapse
|
32
|
Neuroimaging results suggest the role of prediction in cross-domain priming. Sci Rep 2018; 8:10356. [PMID: 29985455 PMCID: PMC6037787 DOI: 10.1038/s41598-018-28696-0] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Accepted: 06/25/2018] [Indexed: 12/03/2022] Open
Abstract
The repetition of a stimulus leads to shorter reaction times as well as to the reduction of neural activity. Previous encounters with closely related stimuli (primes) also lead to faster and often to more accurate processing of subsequent stimuli (targets). For instance, if the prime is a name, and the target is a face, the recognition of a persons’ face is facilitated by prior presentation of his/her name. A possible explanation for this phenomenon is that the prime allows predicting the occurrence of the target. To the best of our knowledge, so far, no study tested the neural correlates of such cross-domain priming with fMRI. To fill this gap, here we used names of famous persons as primes, and congruent or incongruent faces as targets. We found that congruent primes not only reduced RT, but also lowered the BOLD signal in bilateral fusiform (FFA) and occipital (OFA) face areas. This suggests that semantic information affects not only behavioral performance, but also neural responses in relatively early processing stages of the occipito-temporal cortex. We interpret our results in the framework of predictive coding theories.
Collapse
|
33
|
Hall MG, Naughtin CK, Mattingley JB, Dux PE. Distributed and opposing effects of incidental learning in the human brain. Neuroimage 2018. [DOI: 10.1016/j.neuroimage.2018.02.068] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
|
34
|
Feuerriegel D, Churches O, Coussens S, Keage HA. Evidence for spatiotemporally distinct effects of image repetition and perceptual expectations as measured by event-related potentials. Neuroimage 2018; 169:94-105. [DOI: 10.1016/j.neuroimage.2017.12.029] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2017] [Revised: 11/21/2017] [Accepted: 12/11/2017] [Indexed: 12/20/2022] Open
|
35
|
Skylark WJ, Gheorghiu AI. Further Evidence That the Effects of Repetition on Subjective Time Depend on Repetition Probability. Front Psychol 2017; 8:1915. [PMID: 29163292 PMCID: PMC5672414 DOI: 10.3389/fpsyg.2017.01915] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2017] [Accepted: 10/16/2017] [Indexed: 11/30/2022] Open
Abstract
Repeated stimuli typically have shorter apparent duration than novel stimuli. Most explanations for this effect have attributed it to the repeated stimuli being more expected or predictable than the novel items, but an emerging body of work suggests that repetition and expectation exert distinct effects on time perception. The present experiment replicated a recent study in which the probability of repetition was varied between blocks of trials. As in the previous work, the repetition effect was smaller when repeats were common (and therefore more expected) than when they were rare. These results add to growing evidence that, contrary to traditional accounts, expectation increases apparent duration whereas repetition compresses subjective time, perhaps via a low-level process like adaptation. These opposing processes can be seen as instances of a more general “processing principle,” according to which subjective time is a function of the perceptual strength of the stimulus representation, and therefore depends on a confluence of “bottom-up” and “top-down” variables.
Collapse
Affiliation(s)
- William J Skylark
- Department of Psychology, University of Cambridge, Cambridge, United Kingdom
| | - Ana I Gheorghiu
- Department of Psychology, University of Essex, Colchester, United Kingdom
| |
Collapse
|
36
|
Repetition suppression to objects is modulated by stimulus-specific expectations. Sci Rep 2017; 7:8781. [PMID: 28821808 PMCID: PMC5562860 DOI: 10.1038/s41598-017-09374-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2016] [Accepted: 07/25/2017] [Indexed: 01/01/2023] Open
Abstract
Repeated exposure to the same stimulus results in an attenuated brain response in cortical regions that are activated during the processing of that stimulus. This phenomenon, called repetition suppression (RS), has been shown to be modulated by expectation. Typically, this is achieved by varying the probability of stimulus repetitions (Prep) between blocks of an experiment, generating an abstract expectation that ‘things will repeat’. Here, we examined whether stimulus-specific expectations also modulate RS. We designed a task where expectation and repetition are manipulated independently, using stimulus-specific expectations. We investigated to which extent such stimulus-specific expectations modulated the visual evoked response to objects in lateral occipital cortex (LOC) and primary visual cortex (V1), using functional magnetic resonance imaging (fMRI). In LOC, we found that RS interacted with expectation, such that repetition suppression was more pronounced for unexpected relative to expected stimuli. Additionally, we found that the response of stimulus-preferring voxels in V1 was generally decreased when stimuli were expected. These results suggest that stimulus-specific expectations about objects modulate LOC and propagate back to the earliest cortical station processing visual input.
Collapse
|
37
|
Trapp S, Kotz SA. Predicting Affective Information - An Evaluation of Repetition Suppression Effects. Front Psychol 2016; 7:1365. [PMID: 27667980 PMCID: PMC5016514 DOI: 10.3389/fpsyg.2016.01365] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 08/26/2016] [Indexed: 11/30/2022] Open
Abstract
Both theoretical proposals and empirical studies suggest that the brain interprets sensory input based on expectations to mitigate computational burden. However, as social beings, much of sensory input is affectively loaded – e.g., the smile of a partner, the critical voice of a boss, or the welcoming gesture of a friend. Given that affective information is highly complex and often ambiguous, building up expectations of upcoming affective sensory input may greatly contribute to its rapid and efficient processing. This review points to the role of affective information in the context of the ‘predictive brain’. It particularly focuses on repetition suppression (RS) effects that have recently been linked to prediction processes. The findings are interpreted as evidence for more pronounced prediction processes with affective material. Importantly, it is argued that bottom-up attention inflates the neural RS effect, and because affective stimuli tend to attract more bottom-up attention, it thereby particularly overshadows the magnitude of RS effects for this information. Finally, anxiety disorders, such as social phobia, are briefly discussed as manifestations of modulations in affective prediction.
Collapse
Affiliation(s)
- Sabrina Trapp
- Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan Israel
| | - Sonja A Kotz
- Max Planck Institute for Human Cognitive and Brain Sciences, LeipzigGermany; Faculty of Psychology and Neuroscience, Maastricht University, MaastrichtNetherlands
| |
Collapse
|
38
|
Timm J, Schönwiesner M, Schröger E, SanMiguel I. Sensory suppression of brain responses to self-generated sounds is observed with and without the perception of agency. Cortex 2016; 80:5-20. [DOI: 10.1016/j.cortex.2016.03.018] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2015] [Revised: 11/30/2015] [Accepted: 03/24/2016] [Indexed: 10/22/2022]
|
39
|
Kremláček J, Kreegipuu K, Tales A, Astikainen P, Põldver N, Näätänen R, Stefanics G. Visual mismatch negativity (vMMN): A review and meta-analysis of studies in psychiatric and neurological disorders. Cortex 2016; 80:76-112. [DOI: 10.1016/j.cortex.2016.03.017] [Citation(s) in RCA: 85] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2015] [Revised: 01/31/2016] [Accepted: 03/17/2016] [Indexed: 12/18/2022]
|
40
|
The contribution of surprise to the prediction based modulation of fMRI responses. Neuropsychologia 2016; 84:105-12. [DOI: 10.1016/j.neuropsychologia.2016.02.003] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2015] [Revised: 02/04/2016] [Accepted: 02/08/2016] [Indexed: 11/22/2022]
|
41
|
|
42
|
Grotheer M, Kovács G. Can predictive coding explain repetition suppression? Cortex 2016; 80:113-24. [PMID: 26861559 DOI: 10.1016/j.cortex.2015.11.027] [Citation(s) in RCA: 72] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2015] [Revised: 11/13/2015] [Accepted: 11/13/2015] [Indexed: 11/19/2022]
Abstract
While in earlier work various local or bottom-up neural mechanisms were proposed to give rise to repetition suppression (RS), current theories suggest that top-down processes play a role in determining the repetition related reduction of the neural responses. In the current review we summarise those results, which support the role of these top-down processes, concentrating on the Bayesian models of predictive coding (PC). Such models assume that RS is related to the statistical probabilities of prior stimulus occurrences and to the future predictability of these stimuli. Here we review the current results that support or argue against this explanation. We point out that the heterogeneity of experimental manipulations that are thought to reflect predictive processes are likely to measure different processing steps, making their direct comparison difficult. In addition we emphasize the importance of identifying these sub-processes and clarifying their role in explaining RS. Finally, we propose a two-stage model for explaining the relationships of repetition and expectation phenomena in the human cortex.
Collapse
Affiliation(s)
- Mareike Grotheer
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, Jena, Germany.
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, Jena, Germany.
| |
Collapse
|
43
|
Selecting appropriate designs and comparison conditions in repetition paradigms. Cortex 2015; 80:196-205. [PMID: 26654854 DOI: 10.1016/j.cortex.2015.10.022] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2015] [Revised: 08/22/2015] [Accepted: 10/29/2015] [Indexed: 01/21/2023]
Abstract
The studies described by Vogels (this issue) demonstrate the complexity of repetition effects in the visual processing stream. In addition to signal suppression, findings of inherited effects from earlier processing, and discrepancies between the stimulus selectivity of cells before and after repetition, have informed the inferences that can be drawn from measures over larger scales such as functional magnetic resonance imaging (fMRI) or electroencephalography (EEG). This work also demonstrates that integration of evidence across recording methods is vital for understanding repetition effects in the brain. It is however difficult to integrate evidence across different recording methods and repetition paradigms. At the crux of this difficulty is the selection of comparison or unrepeated stimulus conditions within paradigms, which influence the observed strength, selectivity and even direction of repetition effects. This viewpoint highlights prevalent methodological issues with regard to repeated-unrepeated stimulus comparisons: inherited adaptation, stimulus specific expectations, concurrent memory retrieval, stimulus novelty and familiarity, attention, and changes in neuronal selectivity with repetition. The extent to which current conflicting and uncertain findings are due to selection of unrepeated stimulus conditions is unknown, but needs to be addressed to develop models of repetition spanning recording methods and repetition paradigms.
Collapse
|
44
|
Freud E, Ganel T, Avidan G. Impossible expectations: fMRI adaptation in the lateral occipital complex (LOC) is modulated by the statistical regularities of 3D structural information. Neuroimage 2015; 122:188-94. [PMID: 26254586 DOI: 10.1016/j.neuroimage.2015.07.085] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2015] [Revised: 07/06/2015] [Accepted: 07/31/2015] [Indexed: 11/19/2022] Open
Abstract
fMRI adaptation (fMRIa), the attenuation of fMRI signal which follows repeated presentation of a stimulus, is a well-documented phenomenon. Yet, the underlying neural mechanisms supporting this effect are not fully understood. Recently, short-term perceptual expectations, induced by specific experimental settings, were shown to play an important modulating role in fMRIa. Here we examined the role of long-term expectations, based on 3D structural statistical regularities, in the modulation of fMRIa. To this end, human participants underwent fMRI scanning while performing a same-different task on pairs of possible (regular, expected) objects and spatially impossible (irregular, unexpected) objects. We hypothesized that given the spatial irregularity of impossible objects in relation to real-world visual experience, the visual system would always generate a prediction which is biased to the possible version of the objects. Consistently, fMRIa effects in the lateral occipital cortex (LOC) were found for possible, but not for impossible objects. Additionally, in alternating trials the order of stimulus presentation modulated LOC activity. That is, reduced activation was observed in trials in which the impossible version of the object served as the prime object (i.e. first object) and was followed by the possible version compared to the reverse order. These results were also supported by the behavioral advantage observed for trials that were primed by possible objects. Together, these findings strongly emphasize the importance of perceptual expectations in object representation and provide novel evidence for the role of real-world statistical regularities in eliciting fMRIa.
Collapse
Affiliation(s)
- Erez Freud
- Department of Psychology, Ben-Gurion University of the Negev, Beer Sheva, Israel; Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer Sheva, Israel.
| | - Tzvi Ganel
- Department of Psychology, Ben-Gurion University of the Negev, Beer Sheva, Israel; Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer Sheva, Israel.
| | - Galia Avidan
- Department of Psychology, Ben-Gurion University of the Negev, Beer Sheva, Israel; Zlotowski Center for Neuroscience, Ben-Gurion University of the Negev, Beer Sheva, Israel.
| |
Collapse
|