1
|
Feuerriegel D. Adaptation in the visual system: Networked fatigue or suppressed prediction error signalling? Cortex 2024; 177:302-320. [PMID: 38905873 DOI: 10.1016/j.cortex.2024.06.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Revised: 05/10/2024] [Accepted: 06/04/2024] [Indexed: 06/23/2024]
Abstract
Our brains are constantly adapting to changes in our visual environments. Neural adaptation exerts a persistent influence on the activity of sensory neurons and our perceptual experience, however there is a lack of consensus regarding how adaptation is implemented in the visual system. One account describes fatigue-based mechanisms embedded within local networks of stimulus-selective neurons (networked fatigue models). Another depicts adaptation as a product of stimulus expectations (predictive coding models). In this review, I evaluate neuroimaging and psychophysical evidence that poses fundamental problems for predictive coding models of neural adaptation. Specifically, I discuss observations of distinct repetition and expectation effects, as well as incorrect predictions of repulsive adaptation aftereffects made by predictive coding accounts. Based on this evidence, I argue that networked fatigue models provide a more parsimonious account of adaptation effects in the visual system. Although stimulus expectations can be formed based on recent stimulation history, any consequences of these expectations are likely to co-occur (or interact) with effects of fatigue-based adaptation. I conclude by proposing novel, testable hypotheses relating to interactions between fatigue-based adaptation and other predictive processes, focusing on stimulus feature extrapolation phenomena.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| |
Collapse
|
2
|
Greco A, D'Alessandro M, Gallitto G, Rastelli C, Braun C, Caria A. Statistical Learning of Incidental Perceptual Regularities Induces Sensory Conditioned Cortical Responses. BIOLOGY 2024; 13:576. [PMID: 39194514 DOI: 10.3390/biology13080576] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 07/24/2024] [Accepted: 07/29/2024] [Indexed: 08/29/2024]
Abstract
Statistical learning of sensory patterns can lead to predictive neural processes enhancing stimulus perception and enabling fast deviancy detection. Predictive processes have been extensively demonstrated when environmental statistical regularities are relevant to task execution. Preliminary evidence indicates that statistical learning can even occur independently of task relevance and top-down attention, although the temporal profile and neural mechanisms underlying sensory predictions and error signals induced by statistical learning of incidental sensory regularities remain unclear. In our study, we adopted an implicit sensory conditioning paradigm that elicited the generation of specific perceptual priors in relation to task-irrelevant audio-visual associations, while recording Electroencephalography (EEG). Our results showed that learning task-irrelevant associations between audio-visual stimuli resulted in anticipatory neural responses to predictive auditory stimuli conveying anticipatory signals of expected visual stimulus presence or absence. Moreover, we observed specific modulation of cortical responses to probabilistic visual stimulus presentation or omission. Pattern similarity analysis indicated that predictive auditory stimuli tended to resemble the response to expected visual stimulus presence or absence. Remarkably, Hierarchical Gaussian filter modeling estimating dynamic changes of prediction error signals in relation to differential probabilistic occurrences of audio-visual stimuli further demonstrated instantiation of predictive neural signals by showing distinct neural processing of prediction error in relation to violation of expected visual stimulus presence or absence. Overall, our findings indicated that statistical learning of non-salient and task-irrelevant perceptual regularities could induce the generation of neural priors at the time of predictive stimulus presentation, possibly conveying sensory-specific information about the predicted consecutive stimulus.
Collapse
Affiliation(s)
- Antonino Greco
- Department of Neural Dynamics and Magnetoencephalography, Hertie Institute for Clinical Brain Research, University of Tübingen, 72076 Tübingen, Germany
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, 72076 Tübingen, Germany
- MEG Center, University of Tübingen, 72076 Tübingen, Germany
| | - Marco D'Alessandro
- Institute of Cognitive Sciences and Technologies, National Research Council, 00185 Rome, Italy
| | - Giuseppe Gallitto
- Department of Neurology, University Hospital Essen, 45147 Essen, Germany
| | - Clara Rastelli
- MEG Center, University of Tübingen, 72076 Tübingen, Germany
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy
| | - Christoph Braun
- Department of Neural Dynamics and Magnetoencephalography, Hertie Institute for Clinical Brain Research, University of Tübingen, 72076 Tübingen, Germany
- Werner Reichardt Centre for Integrative Neuroscience, University of Tübingen, 72076 Tübingen, Germany
- MEG Center, University of Tübingen, 72076 Tübingen, Germany
| | - Andrea Caria
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy
| |
Collapse
|
3
|
Song B, Sommer W, Maurer U. Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials. J Cogn Neurosci 2024; 36:872-887. [PMID: 38261395 DOI: 10.1162/jocn_a_02111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2024]
Abstract
Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.
Collapse
Affiliation(s)
- Bingbing Song
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universitaet zu Berlin, Berlin, Germany
- Department of Physics, Hong Kong Baptist University, Hong Kong, China
| | - Urs Maurer
- Department of Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Centre for Developmental Psychology, The Chinese University of Hong Kong, Hong Kong, China
- Brain and Mind Institute, The Chinese University of Hong Kong, Hong Kong, China
| |
Collapse
|
4
|
Garlichs A, Blank H. Prediction error processing and sharpening of expected information across the face-processing hierarchy. Nat Commun 2024; 15:3407. [PMID: 38649694 PMCID: PMC11035707 DOI: 10.1038/s41467-024-47749-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 04/10/2024] [Indexed: 04/25/2024] Open
Abstract
The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.
Collapse
Affiliation(s)
- Annika Garlichs
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
| | - Helen Blank
- Department of Systems Neuroscience, University Medical Center Hamburg-Eppendorf, 20246, Hamburg, Germany.
| |
Collapse
|
5
|
Seignette K, Jamann N, Papale P, Terra H, Porneso RO, de Kraker L, van der Togt C, van der Aa M, Neering P, Ruimschotel E, Roelfsema PR, Montijn JS, Self MW, Kole MHP, Levelt CN. Experience shapes chandelier cell function and structure in the visual cortex. eLife 2024; 12:RP91153. [PMID: 38192196 PMCID: PMC10963032 DOI: 10.7554/elife.91153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2024] Open
Abstract
Detailed characterization of interneuron types in primary visual cortex (V1) has greatly contributed to understanding visual perception, yet the role of chandelier cells (ChCs) in visual processing remains poorly characterized. Using viral tracing we found that V1 ChCs predominantly receive monosynaptic input from local layer 5 pyramidal cells and higher-order cortical regions. Two-photon calcium imaging and convolutional neural network modeling revealed that ChCs are visually responsive but weakly selective for stimulus content. In mice running in a virtual tunnel, ChCs respond strongly to events known to elicit arousal, including locomotion and visuomotor mismatch. Repeated exposure of the mice to the virtual tunnel was accompanied by reduced visual responses of ChCs and structural plasticity of ChC boutons and axon initial segment length. Finally, ChCs only weakly inhibited pyramidal cells. These findings suggest that ChCs provide an arousal-related signal to layer 2/3 pyramidal cells that may modulate their activity and/or gate plasticity of their axon initial segments during behaviorally relevant events.
Collapse
Affiliation(s)
- Koen Seignette
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Nora Jamann
- Department of Axonal Signaling, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Biology Cell Biology, Neurobiology and Biophysics, Faculty of Science, Utrecht UniversityUtrechtNetherlands
| | - Paolo Papale
- Department of Vision & Cognition, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Huub Terra
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Ralph O Porneso
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Leander de Kraker
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Chris van der Togt
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Vision & Cognition, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Maaike van der Aa
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Paul Neering
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Vision & Cognition, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Emma Ruimschotel
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Pieter R Roelfsema
- Department of Vision & Cognition, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Laboratory of Visual Brain Therapy, Sorbonne Université, Institut National de la Santé et de la Recherche Médicale, Centre National de la Recherche Scientifique, Institut de la VisionParisFrance
- Department of Integrative Neurophysiology, Centre for Neurogenomics and Cognitive Research, VU UniversityAmsterdamNetherlands
- Department of Psychiatry, Academic Medical Center, University of AmsterdamAmsterdamNetherlands
| | - Jorrit S Montijn
- Department of Cortical Structure & Function, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Matthew W Self
- Department of Vision & Cognition, Netherlands Institute for NeuroscienceAmsterdamNetherlands
| | - Maarten HP Kole
- Department of Axonal Signaling, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Biology Cell Biology, Neurobiology and Biophysics, Faculty of Science, Utrecht UniversityUtrechtNetherlands
| | - Christiaan N Levelt
- Department of Molecular Visual Plasticity, Netherlands Institute for NeuroscienceAmsterdamNetherlands
- Department of Molecular and Cellular Neurobiology, Center for Neurogenomics and Cognitive Research, VU University AmsterdamAmsterdamNetherlands
| |
Collapse
|
6
|
Saurels BW, Johnston A, Yarrow K, Arnold DH. Event Probabilities Have a Different Impact on Early and Late Electroencephalographic Measures Regarded as Metrics of Prediction. J Cogn Neurosci 2024; 36:187-199. [PMID: 37902587 DOI: 10.1162/jocn_a_02076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2023]
Abstract
The oddball protocol has been used to study the neural and perceptual consequences of implicit predictions in the human brain. The protocol involves presenting a sequence of identical repeated events that are eventually broken by a novel "oddball" presentation. Oddball presentations have been linked to increased neural responding and to an exaggeration of perceived duration relative to repeated events. Because the number of repeated events in such protocols is circumscribed, as more repeats are encountered, the conditional probability of a further repeat decreases-whereas the conditional probability of an oddball increases. These facts have not been appreciated in many analyses of oddballs; repeats and oddballs have rather been treated as binary event categories. Here, we show that the human brain is sensitive to conditional event probabilities in an active, visual oddball paradigm. P300 responses (a relatively late component of visually evoked potentials measured with EEG) tended to be greater for less likely oddballs and repeats. By contrast, P1 responses (an earlier component) increased for repeats as a goal-relevant target presentation neared, but this effect occurred even when repeat probabilities were held constant, and oddball P1 responses were invariant. We also found that later, more likely oddballs seemed to last longer, and this effect was largely independent of the number of preceding repeats. These findings speak against a repetition suppression account of the temporal oddball effect. Overall, our data highlight an impact of event probability on later, rather than earlier, electroencephalographic measures previously related to predictive processes-and the importance of considering conditional probabilities in sequential presentation paradigms.
Collapse
|
7
|
den Ouden C, Zhou A, Mepani V, Kovács G, Vogels R, Feuerriegel D. Stimulus expectations do not modulate visual event-related potentials in probabilistic cueing designs. Neuroimage 2023; 280:120347. [PMID: 37648120 DOI: 10.1016/j.neuroimage.2023.120347] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 08/10/2023] [Accepted: 08/23/2023] [Indexed: 09/01/2023] Open
Abstract
Humans and other animals can learn and exploit repeating patterns that occur within their environments. These learned patterns can be used to form expectations about future sensory events. Several influential predictive coding models have been proposed to explain how learned expectations influence the activity of stimulus-selective neurons in the visual system. These models specify reductions in neural response measures when expectations are fulfilled (termed expectation suppression) and increases following surprising sensory events. However, there is currently scant evidence for expectation suppression in the visual system when confounding factors are taken into account. Effects of surprise have been observed in blood oxygen level dependent (BOLD) signals, but not when using electrophysiological measures. To provide a strong test for expectation suppression and surprise effects we performed a predictive cueing experiment while recording electroencephalographic (EEG) data. Participants (n=48) learned cue-face associations during a training session and were then exposed to these cue-face pairs in a subsequent experiment. Using univariate analyses of face-evoked event-related potentials (ERPs) we did not observe any differences across expected (90% probability), neutral (50%) and surprising (10%) face conditions. Across these comparisons, Bayes factors consistently favoured the null hypothesis throughout the time-course of the stimulus-evoked response. When using multivariate pattern analysis we did not observe above-chance classification of expected and surprising face-evoked ERPs. By contrast, we found robust within- and across-trial stimulus repetition effects. Our findings do not support predictive coding-based accounts that specify reduced prediction error signalling when perceptual expectations are fulfilled. They instead highlight the utility of other types of predictive processing models that describe expectation-related phenomena in the visual system without recourse to prediction error signalling.
Collapse
Affiliation(s)
- Carla den Ouden
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Andong Zhou
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Vinay Mepani
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| |
Collapse
|
8
|
Noonan MP, Von Lautz AH, Bauer Y, Summerfield C, Stokes MS. Differential modulation of visual responses by distractor or target expectations. Atten Percept Psychophys 2023; 85:845-862. [PMID: 36460926 PMCID: PMC10066164 DOI: 10.3758/s13414-022-02617-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/01/2022] [Indexed: 12/03/2022]
Abstract
Discriminating relevant from irrelevant information in a busy visual scene is supported by statistical regularities in the environment. However, it is unclear to what extent immediate stimulus repetitions and higher order expectations (whether a repetition is statistically probable or not) are supported by the same neural mechanisms. Moreover, it is also unclear whether target and distractor-related processing are mediated by the same or different underlying neural mechanisms. Using a speeded target discrimination task, the present study implicitly cued subjects to the location of the target or the distractor via manipulations in the underlying stimulus predictability. In separate studies, we collected EEG and MEG alongside behavioural data. Results showed that reaction times were reduced with increased expectations for both types of stimuli and that these effects were driven by expected repetitions in both cases. Despite the similar behavioural pattern across target and distractors, neurophysiological measures distinguished the two stimuli. Specifically, the amplitude of the P1 was modulated by stimulus relevance, being reduced for repeated distractors and increased for repeated targets. The P1 was not, however, modulated by higher order stimulus expectations. These expectations were instead reflected in modulations in ERP amplitude and theta power in frontocentral electrodes. Finally, we observed that a single repetition of a distractor was sufficient to reduce decodability of stimulus spatial location and was also accompanied by diminished representation of stimulus features. Our results highlight the unique mechanisms involved in distractor expectation and suppression and underline the importance of studying these processes distinctly from target-related attentional control.
Collapse
Affiliation(s)
- M P Noonan
- Department of Experimental Psychology, University of Oxford, Oxford, UK.
| | - A H Von Lautz
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - Y Bauer
- Division of Neurobiology, Faculty of Biology, LMU Munich, 82152, Munich, Germany
- Graduate School of Systemic Neurosciences (GSN), LMU Munich, 82152, Munich, Germany
| | - C Summerfield
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| | - M S Stokes
- Department of Experimental Psychology, University of Oxford, Oxford, UK
| |
Collapse
|
9
|
Gert AL, Ehinger BV, Timm S, Kietzmann TC, König P. WildLab: A naturalistic free viewing experiment reveals previously unknown electroencephalography signatures of face processing. Eur J Neurosci 2022; 56:6022-6038. [PMID: 36113866 DOI: 10.1111/ejn.15824] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 08/26/2022] [Accepted: 08/30/2022] [Indexed: 12/29/2022]
Abstract
Neural mechanisms of face perception are predominantly studied in well-controlled experimental settings that involve random stimulus sequences and fixed eye positions. Although powerful, the employed paradigms are far from what constitutes natural vision. Here, we demonstrate the feasibility of ecologically more valid experimental paradigms using natural viewing behaviour, by combining a free viewing paradigm on natural scenes, free of photographer bias, with advanced data processing techniques that correct for overlap effects and co-varying non-linear dependencies of multiple eye movement parameters. We validate this approach by replicating classic N170 effects in neural responses, triggered by fixation onsets (fixation event-related potentials [fERPs]). Importantly, besides finding a strong correlation between both experiments, our more natural stimulus paradigm yielded smaller variability between subjects than the classic setup. Moving beyond classic temporal and spatial effect locations, our experiment furthermore revealed previously unknown signatures of face processing: This includes category-specific modulation of the event-related potential (ERP)'s amplitude even before fixation onset, as well as adaptation effects across subsequent fixations depending on their history.
Collapse
Affiliation(s)
- Anna L Gert
- Institute of Cognitive Science, Osnabrück University, Osnabrück, Germany
| | - Benedikt V Ehinger
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.,Stuttgart Center for Simulation Science, University of Stuttgart, Stuttgart, Germany
| | - Silja Timm
- Institute of Cognitive Science, Osnabrück University, Osnabrück, Germany
| | - Tim C Kietzmann
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands.,MRC Cognition and Brain Sciences Unit, Cambridge University, Cambridge, UK
| | - Peter König
- Institute of Cognitive Science, Osnabrück University, Osnabrück, Germany.,Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
10
|
Ali A, Ahmad N, de Groot E, Johannes van Gerven MA, Kietzmann TC. Predictive coding is a consequence of energy efficiency in recurrent neural networks. PATTERNS (NEW YORK, N.Y.) 2022; 3:100639. [PMID: 36569556 PMCID: PMC9768680 DOI: 10.1016/j.patter.2022.100639] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 12/24/2021] [Accepted: 10/27/2022] [Indexed: 11/24/2022]
Abstract
Predictive coding is a promising framework for understanding brain function. It postulates that the brain continuously inhibits predictable sensory input, ensuring preferential processing of surprising elements. A central aspect of this view is its hierarchical connectivity, involving recurrent message passing between excitatory bottom-up signals and inhibitory top-down feedback. Here we use computational modeling to demonstrate that such architectural hardwiring is not necessary. Rather, predictive coding is shown to emerge as a consequence of energy efficiency. When training recurrent neural networks to minimize their energy consumption while operating in predictive environments, the networks self-organize into prediction and error units with appropriate inhibitory and excitatory interconnections and learn to inhibit predictable sensory input. Moving beyond the view of purely top-down-driven predictions, we demonstrate, via virtual lesioning experiments, that networks perform predictions on two timescales: fast lateral predictions among sensory units and slower prediction cycles that integrate evidence over time.
Collapse
Affiliation(s)
- Abdullahi Ali
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands,Corresponding author
| | - Nasir Ahmad
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands
| | - Elgar de Groot
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands,Department of Experimental Psychology, Utrecht University, Utrecht, the Netherlands
| | | | - Tim Christian Kietzmann
- Institute of Cognitive Science, University of Osnabrück, Osnabrück, Germany,Corresponding author
| |
Collapse
|
11
|
Expectations attenuate the negative influence of neural adaptation on the processing of novel stimuli: ERP evidence. Neuroscience 2022; 492:58-66. [DOI: 10.1016/j.neuroscience.2022.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2021] [Revised: 04/02/2022] [Accepted: 04/04/2022] [Indexed: 11/20/2022]
|
12
|
Marshall AC, Gentsch-Ebrahimzadeh A, Schütz-Bosbach S. From the inside out: Interoceptive feedback facilitates the integration of visceral signals for efficient sensory processing. Neuroimage 2022; 251:119011. [PMID: 35182753 DOI: 10.1016/j.neuroimage.2022.119011] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 02/14/2022] [Accepted: 02/15/2022] [Indexed: 11/30/2022] Open
Abstract
Neuroscientific studies have mainly focused on the way humans perceive and interact with the external world. Recent work in the interoceptive domain indicates that the brain predictively models information from inside the body such as the heartbeat and that the efficiency with which this is executed can have implications for exteroceptive processing. However, to date direct evidence underpinning these hypotheses is lacking. Here, we show how the brain predictively refines neural resources to process afferent cardiac feedback and uses these interoceptive cues to enable more efficient processing of external sensory information. Participants completed a repetition-suppression paradigm consisting of a neutral repeating face. During the first face presentation, they heard auditory feedback of their heartbeat which either coincided with the systole of the cardiac cycle, the time at which cardiac events are registered by the brain or the diastole during which the brain receives no internal cardiac feedback. We used electroencephalography to measure the heartbeat evoked potential (HEP) as well as auditory (AEP) and visual evoked potentials (VEP). Exteroceptive cardiac feedback which coincided with the systole produced significantly higher HEP amplitudes relative to feedback timed to the diastole. Elevation of the HEP in this condition was followed by significant suppression of the VEP in response to the repeated neutral face and a stepwise decrease of AEP amplitude to repeated heartbeat feedback. Our results hereby show that exteroceptive heartbeat feedback coinciding with interoceptive signals at systole enhanced interoceptive cardiac processing. Furthermore, the same cue facilitating interoceptive integration enabled efficient suppression of a visual stimulus, as well as repetition suppression of the AEP across successive auditory heartbeat feedback. Our findings provide evidence that the alignment of external to internal signals can enhance the efficiency of interoceptive processing and that cues facilitating this process in either domain have beneficial effects for internal as well as external sensory processing.
Collapse
Affiliation(s)
- Amanda C Marshall
- Department of Psychology, General and Experimental Psychology Unit, LMU Munich, Germany.
| | | | - Simone Schütz-Bosbach
- Department of Psychology, General and Experimental Psychology Unit, LMU Munich, Germany
| |
Collapse
|
13
|
Beach SD, Lim SJ, Cardenas-Iniguez C, Eddy MD, Gabrieli JDE, Perrachione TK. Electrophysiological correlates of perceptual prediction error are attenuated in dyslexia. Neuropsychologia 2022; 165:108091. [PMID: 34801517 PMCID: PMC8807066 DOI: 10.1016/j.neuropsychologia.2021.108091] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2021] [Revised: 10/09/2021] [Accepted: 11/17/2021] [Indexed: 01/30/2023]
Abstract
A perceptual adaptation deficit often accompanies reading difficulty in dyslexia, manifesting in poor perceptual learning of consistent stimuli and reduced neurophysiological adaptation to stimulus repetition. However, it is not known how adaptation deficits relate to differences in feedforward or feedback processes in the brain. Here we used electroencephalography (EEG) to interrogate the feedforward and feedback contributions to neural adaptation as adults with and without dyslexia viewed pairs of faces and words in a paradigm that manipulated whether there was a high probability of stimulus repetition versus a high probability of stimulus change. We measured three neural dependent variables: expectation (the difference between prestimulus EEG power with and without the expectation of stimulus repetition), feedforward repetition (the difference between event-related potentials (ERPs) evoked by an expected change and an unexpected repetition), and feedback-mediated prediction error (the difference between ERPs evoked by an unexpected change and an expected repetition). Expectation significantly modulated prestimulus theta- and alpha-band EEG in both groups. Unexpected repetitions of words, but not faces, also led to significant feedforward repetition effects in the ERPs of both groups. However, neural prediction error when an unexpected change occurred instead of an expected repetition was significantly weaker in dyslexia than the control group for both faces and words. These results suggest that the neural and perceptual adaptation deficits observed in dyslexia reflect the failure to effectively integrate perceptual predictions with feedforward sensory processing. In addition to reducing perceptual efficiency, the attenuation of neural prediction error signals would also be deleterious to the wide range of perceptual and procedural learning abilities that are critical for developing accurate and fluent reading skills.
Collapse
Affiliation(s)
- Sara D. Beach
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A.,Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A.,Program in Speech and Hearing Bioscience and Technology, Harvard University, 260 Longwood Avenue, Boston, MA 02115 U.S.A
| | - Sung-Joo Lim
- Department of Speech, Language, and Hearing Sciences, Boston University, 635 Commonwealth Avenue, Boston, MA 02215 U.S.A
| | - Carlos Cardenas-Iniguez
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A
| | - Marianna D. Eddy
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A
| | - John D. E. Gabrieli
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A.,Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A
| | - Tyler K. Perrachione
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, 77 Massachusetts Avenue, Cambridge, MA 02139 U.S.A.,Department of Speech, Language, and Hearing Sciences, Boston University, 635 Commonwealth Avenue, Boston, MA 02215 U.S.A.,Correspondence: Tyler K. Perrachione, Ph.D., Department of Speech, Language, and Hearing Sciences, Boston University, 635 Commonwealth Ave., Boston, MA 02215, Phone: +1.617.358.7410,
| |
Collapse
|
14
|
Heurteloup C, Merchie A, Roux S, Bonnet-Brilhault F, Escera C, Gomot M. Neural repetition suppression to vocal and non-vocal sounds. Cortex 2021; 148:1-13. [DOI: 10.1016/j.cortex.2021.11.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 03/02/2021] [Accepted: 11/19/2021] [Indexed: 11/29/2022]
|
15
|
Smoking as a Common Modulator of Sensory Gating and Reward Learning in Individuals with Psychotic Disorders. Brain Sci 2021; 11:brainsci11121581. [PMID: 34942883 PMCID: PMC8699526 DOI: 10.3390/brainsci11121581] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Revised: 11/23/2021] [Accepted: 11/26/2021] [Indexed: 02/07/2023] Open
Abstract
Motivational and perceptual disturbances co-occur in psychosis and have been linked to aberrations in reward learning and sensory gating, respectively. Although traditionally studied independently, when viewed through a predictive coding framework, these processes can both be linked to dysfunction in striatal dopaminergic prediction error signaling. This study examined whether reward learning and sensory gating are correlated in individuals with psychotic disorders, and whether nicotine—a psychostimulant that amplifies phasic striatal dopamine firing—is a common modulator of these two processes. We recruited 183 patients with psychotic disorders (79 schizophrenia, 104 psychotic bipolar disorder) and 129 controls and assessed reward learning (behavioral probabilistic reward task), sensory gating (P50 event-related potential), and smoking history. Reward learning and sensory gating were correlated across the sample. Smoking influenced reward learning and sensory gating in both patient groups; however, the effects were in opposite directions. Specifically, smoking was associated with improved performance in individuals with schizophrenia but impaired performance in individuals with psychotic bipolar disorder. These findings suggest that reward learning and sensory gating are linked and modulated by smoking. However, disorder-specific associations with smoking suggest that nicotine may expose pathophysiological differences in the architecture and function of prediction error circuitry in these overlapping yet distinct psychotic disorders.
Collapse
|
16
|
Sensory-Motor Modulations of EEG Event-Related Potentials Reflect Walking-Related Macro-Affordances. Brain Sci 2021; 11:brainsci11111506. [PMID: 34827505 PMCID: PMC8615990 DOI: 10.3390/brainsci11111506] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 11/11/2021] [Accepted: 11/11/2021] [Indexed: 11/21/2022] Open
Abstract
One fundamental principle of the brain functional organization is the elaboration of sensory information for the specification of action plans that are most appropriate for interaction with the environment. Using an incidental go/no-go priming paradigm, we have previously shown a facilitation effect for the execution of a walking-related action in response to far vs. near objects/locations in the extrapersonal space, and this effect has been called “macro-affordance” to reflect the role of locomotion in the coverage of extrapersonal distance. Here, we investigated the neurophysiological underpinnings of such an effect by recording scalp electroencephalography (EEG) from 30 human participants during the same paradigm. The results of a whole-brain analysis indicated a significant modulation of the event-related potentials (ERPs) both during prime and target stimulus presentation. Specifically, consistent with a mechanism of action anticipation and automatic activation of affordances, a stronger ERP was observed in response to prime images framing the environment from a far vs. near distance, and this modulation was localized in dorso-medial motor regions. In addition, an inversion of polarity for far vs. near conditions was observed during the subsequent target period in dorso-medial parietal regions associated with spatially directed foot-related actions. These findings were interpreted within the framework of embodied models of brain functioning as arising from a mechanism of motor-anticipation and subsequent prediction error which was guided by the preferential affordance relationship between the distant large-scale environment and locomotion. More in general, our findings reveal a sensory-motor mechanism for the processing of walking-related environmental affordances.
Collapse
|
17
|
Kornmeier J, Bhatia K, Joos E. Top-down resolution of visual ambiguity - knowledge from the future or footprints from the past? PLoS One 2021; 16:e0258667. [PMID: 34673791 PMCID: PMC8530352 DOI: 10.1371/journal.pone.0258667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 10/01/2021] [Indexed: 11/18/2022] Open
Abstract
Current theories about visual perception assume that our perceptual system weights the a priori incomplete, noisy and ambiguous sensory information with previous, memorized perceptual experiences in order to construct stable and reliable percepts. These theories are supported by numerous experimental findings. Theories about precognition have an opposite point of view. They assume that information from the future can have influence on perception, thoughts, and behavior. Several experimental studies provide evidence for precognition effects, other studies found no such effects. One problem may be that the vast majority of precognition paradigms did not systematically control for potential effects from the perceptual history. In the present study, we presented ambiguous Necker cube stimuli and disambiguated cube variants and systematically tested in two separate experiments whether perception of a currently observed ambiguous Necker cube stimulus can be influenced by a disambiguated cube variant, presented in the immediate perceptual past (perceptual history effects) and/or in the immediate perceptual future (precognition effects). We found perceptual history effects, which partly depended on the length of the perceptual history trace but were independent of the perceptual future. Results from some individual participants suggest on the first glance a precognition pattern, but results from our second experiment make a perceptual history explanation more probable. On the group level, no precognition effects were statistically indicated. The perceptual history effects found in the present study are in confirmation with related studies from the literature. The precognition analysis revealed some interesting individual patterns, which however did not allow for general conclusions. Overall, the present study demonstrates that any future experiment about sensory or extrasensory perception urgently needs to control for potential perceptual history effects and that temporal aspects of stimulus presentation are of high relevance.
Collapse
Affiliation(s)
- Jürgen Kornmeier
- Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Department of Psychiatry and Psychotherapy, Medical Center, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, Freiburg, Germany
| | - Kriti Bhatia
- Experimental Cognitive Science, Eberhard Karls University Tübingen, Tübingen, Germany
| | - Ellen Joos
- INSERM U1114, Cognitive Neuropsychology and Pathophysiology of Schizophrenia, University of Strasbourg, Strasbourg, France
| |
Collapse
|
18
|
Bednaya E, Pavani F, Ricciardi E, Pietrini P, Bottari D. Oscillatory signatures of Repetition Suppression and Novelty Detection reveal altered induced visual responses in early deafness. Cortex 2021; 142:138-153. [PMID: 34265736 DOI: 10.1016/j.cortex.2021.05.017] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2020] [Revised: 04/01/2021] [Accepted: 05/17/2021] [Indexed: 12/26/2022]
Abstract
The ability to differentiate between repeated and novel events represents a fundamental property of the visual system. Neural responses are typically reduced upon stimulus repetition, a phenomenon called Repetition Suppression (RS). On the contrary, following a novel visual stimulus, the neural response is generally enhanced, a phenomenon referred to as Novelty Detection (ND). Here, we aimed to investigate the impact of early deafness on the oscillatory signatures of RS and ND brain responses. To this aim, electrophysiological data were acquired in early deaf and hearing control individuals during processing of repeated and novel visual events unattended by participants. By studying evoked and induced oscillatory brain activities, as well as inter-trial phase coherence, we linked response modulations to feedback and/or feedforward processes. Results revealed selective experience-dependent changes on both RS and ND mechanisms. Compared to hearing controls, early deaf individuals displayed: (i) greater attenuation of the response following stimulus repetition, selectively in the induced theta-band (4-7 Hz); (ii) reduced desynchronization following the onset of novel visual stimuli, in the induced alpha and beta bands (8-12 and 13-25 Hz); (iii) comparable modulation of evoked responses and inter-trial phase coherence. The selectivity of the effects in the induced responses parallels findings observed in the auditory cortex of deaf animal models following intracochlear electric stimulation. The present results support the idea that early deafness alters induced oscillatory activity and the functional tuning of basic visual processing.
Collapse
Affiliation(s)
- Evgenia Bednaya
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy
| | - Francesco Pavani
- Center for Mind/Brain Sciences - CIMeC, University of Trento, Italy; Department of Psychology and Cognitive Science, University of Trento, Italy
| | | | - Pietro Pietrini
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy
| | - Davide Bottari
- Molecular Mind Laboratory, IMT School for Advanced Studies Lucca, Italy.
| |
Collapse
|
19
|
Hsu YF, Darriba Á, Waszak F. Attention modulates repetition effects in a context of low periodicity. Brain Res 2021; 1767:147559. [PMID: 34118219 DOI: 10.1016/j.brainres.2021.147559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 06/04/2021] [Accepted: 06/07/2021] [Indexed: 10/21/2022]
Abstract
Stimulus repetition can result in a reduction in neural responses (i.e., repetition suppression) in neuroimaging studies. Predictive coding models of perception postulate that this phenomenon largely reflects the top-down attenuation of prediction errors. Electroencephalography research further demonstrated that repetition effects consist of sequentially ordered attention-independent and attention-dependent components in a context of high periodicity. However, the statistical structure of our auditory environment is richer than that of a fixed pattern. It remains unclear if the attentional modulation of repetition effects can be generalised to a setting which better represents the nature of our auditory environment. Here we used electroencephalography to investigate whether the attention-independent and attention-dependent components of repetition effects previously described in the auditory modality remain in a context of low periodicity where temporary disruption might be absent/present. Participants were presented with repetition trains of various lengths, with/without temporary disruptions. We found attention-independent and attention-dependent repetition effects on, respectively, the P2 and P3a event-related potential components. This pattern of results is in line with previous research, confirming that the attenuation of prediction errors upon stimulus repetition is first registered regardless of attentional state before further attenuation of attended but not unattended prediction errors takes place. However, unlike previous reports, these effects manifested on later components. This divergence from previous studies is discussed in terms of the possible contribution of contextual factors.
Collapse
Affiliation(s)
- Yi-Fang Hsu
- Department of Educational Psychology and Counselling, National Taiwan Normal University, 10610 Taipei, Taiwan; Institute for Research Excellence in Learning Sciences, National Taiwan Normal University, 10610 Taipei, Taiwan.
| | - Álvaro Darriba
- Centre National de la Recherche Scientifique (CNRS), Integrative Neuroscience and Cognition Center (INCC), Unité Mixte de Recherche, 8002 75006 Paris, France; Université de Paris, 75006 Paris, France.
| | - Florian Waszak
- Centre National de la Recherche Scientifique (CNRS), Integrative Neuroscience and Cognition Center (INCC), Unité Mixte de Recherche, 8002 75006 Paris, France; Université de Paris, 75006 Paris, France; Fondation Ophtalmologique Rothschild, Paris, France.
| |
Collapse
|
20
|
Feuerriegel D, Vogels R, Kovács G. Evaluating the evidence for expectation suppression in the visual system. Neurosci Biobehav Rev 2021; 126:368-381. [PMID: 33836212 DOI: 10.1016/j.neubiorev.2021.04.002] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 02/16/2021] [Accepted: 04/02/2021] [Indexed: 01/25/2023]
Abstract
Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
21
|
Kirwan CB, Bjornn DK, Anderson BB, Vance A, Eargle D, Jenkins JL. Repetition of Computer Security Warnings Results in Differential Repetition Suppression Effects as Revealed With Functional MRI. Front Psychol 2020; 11:528079. [PMID: 33364992 PMCID: PMC7751389 DOI: 10.3389/fpsyg.2020.528079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2020] [Accepted: 11/11/2020] [Indexed: 11/27/2022] Open
Abstract
Computer users are often the last line of defense in computer security. However, with repeated exposures to system messages and computer security warnings, neural and behavioral responses show evidence of habituation. Habituation has been demonstrated at a neural level as repetition suppression where responses are attenuated with subsequent repetitions. In the brain, repetition suppression to visual stimuli has been demonstrated in multiple cortical areas, including the occipital lobe and medial temporal lobe. Prior research into the repetition suppression effect has generally focused on a single repetition and has not examined the pattern of signal suppression with repeated exposures. We used complex, everyday stimuli, in the form of images of computer programs or security warning messages, to examine the repetition suppression effect across repeated exposures. The use of computer warnings as stimuli also allowed us to examine the activation of learned fearful stimuli. We observed widespread linear decreases in activation with repeated exposures, suggesting that repetition suppression continues after the first repetition. Further, we found greater activation for warning messages compared to neutral images in the anterior insula, pre-supplemental motor area, and inferior frontal gyrus, suggesting differential processing of security warning messages. However, the repetition suppression effect was similar in these regions for both warning messages and neutral images. Additionally, we observed an increase of activation in the default mode network with repeated exposures, suggestive of increased mind wandering with continuing habituation.
Collapse
Affiliation(s)
- C Brock Kirwan
- Neuroscience Center, Brigham Young University, Provo, UT, United States.,Department of Psychology, Brigham Young University, Provo, UT, United States
| | - Daniel K Bjornn
- Department of Psychology, Brigham Young University, Provo, UT, United States
| | | | - Anthony Vance
- Department of Management Information Systems, Fox School of Business, Temple University, Philadelphia, PA, United States
| | - David Eargle
- Leeds School of Business, University of Colorado Boulder, Boulder, CO, United States
| | - Jeffrey L Jenkins
- Department of Information Systems, Brigham Young University, Provo, UT, United States
| |
Collapse
|
22
|
Hsu YF, Hämäläinen JA. Both contextual regularity and selective attention affect the reduction of precision-weighted prediction errors but in distinct manners. Psychophysiology 2020; 58:e13753. [PMID: 33340115 DOI: 10.1111/psyp.13753] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2020] [Revised: 12/02/2020] [Accepted: 12/02/2020] [Indexed: 10/22/2022]
Abstract
Predictive coding model of perception postulates that the primary objective of the brain is to infer the causes of sensory inputs by reducing prediction errors (i.e., the discrepancy between expected and actual information). Moreover, prediction errors are weighted by their precision (i.e., inverse variance), which quantifies the degree of certainty about the variables. There is accumulating evidence that the reduction of precision-weighted prediction errors can be affected by contextual regularity (as an external factor) and selective attention (as an internal factor). However, it is unclear whether the two factors function together or separately. Here we used electroencephalography (EEG) to examine the putative interaction of contextual regularity and selective attention on this reduction process. Participants were presented with pairs of regular and irregular quartets in attended and unattended conditions. We found that contextual regularity and selective attention independently modulated the N1/MMN where the repetition effect was absent. On the P2, the two factors respectively interacted with the repetition effect without interacting with each other. The results showed that contextual regularity and selective attention likely affect the reduction of precision-weighted prediction errors in distinct manners. While contextual regularity finetunes our efficiency at reducing precision-weighted prediction errors, selective attention seems to modulate the reduction process following the Matthew effect of accumulated advantage.
Collapse
Affiliation(s)
- Yi-Fang Hsu
- Department of Educational Psychology and Counselling, National Taiwan Normal University, Taipei, Taiwan.,Institute for Research Excellence in Learning Sciences, National Taiwan Normal University, Taipei, Taiwan
| | - Jarmo A Hämäläinen
- Jyväskylä Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
23
|
Feuerriegel D, Yook J, Quek GL, Hogendoorn H, Bode S. Visual mismatch responses index surprise signalling but not expectation suppression. Cortex 2020; 134:16-29. [PMID: 33249297 DOI: 10.1016/j.cortex.2020.10.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Revised: 09/04/2020] [Accepted: 10/13/2020] [Indexed: 01/17/2023]
Abstract
The ability to distinguish between commonplace and unusual sensory events is critical for efficient learning and adaptive behaviour. This has been investigated using oddball designs in which sequences of often-appearing (i.e., expected) stimuli are interspersed with rare (i.e., surprising) deviants. Resulting differences in electrophysiological responses following surprising compared to expected stimuli are known as visual mismatch responses (VMRs). VMRs are thought to index co-occurring contributions of stimulus repetition effects, expectation suppression (that occurs when one's expectations are fulfilled), and expectation violation (i.e., surprise) responses; however, these different effects have been conflated in existing oddball designs. To better isolate and quantify effects of expectation suppression and surprise, we adapted an oddball design based on Fast Periodic Visual Stimulation (FPVS) that controls for stimulus repetition effects. We recorded electroencephalography (EEG) while participants (N = 48) viewed stimulation sequences in which a single face identity was periodically presented at 6 Hz. Critically, one of two different face identities (termed oddballs) appeared as every 7th image throughout the sequence. The presentation probabilities of each oddball image within a sequence varied between 10 and 90%, such that participants could form expectations about which oddball face identity was more likely to appear within each sequence. We also included 'expectation neutral' 50% probability sequences, whereby consistently biased expectations would not be formed for either oddball face identity. We found that VMRs indexed surprise responses, and effects of expectation suppression were absent. That is, ERPs were more negative-going at occipitoparietal electrodes for surprising compared to neutral oddballs, but did not differ between expected and neutral oddballs. Surprising oddball-evoked ERPs were also highly similar across the 10-40% appearance probability conditions. Our findings indicate that VMRs which are not accounted for by repetition effects are best described as an all-or-none surprise response, rather than a minimisation of prediction error responses associated with expectation suppression.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia.
| | - Jane Yook
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Genevieve L Quek
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, the Netherlands
| | - Hinze Hogendoorn
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia
| | - Stefan Bode
- Melbourne School of Psychological Sciences, The University of Melbourne, Australia; Department of Psychology, University of Cologne, Germany
| |
Collapse
|
24
|
Rostalski SM, Amado C, Kovács G, Feuerriegel D. Measures of repetition suppression in the fusiform face area are inflated by co-occurring effects of statistically learned visual associations. Cortex 2020; 131:123-136. [DOI: 10.1016/j.cortex.2020.07.010] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Revised: 03/20/2020] [Accepted: 07/03/2020] [Indexed: 12/12/2022]
|
25
|
Using the perceptual past to predict the perceptual future influences the perceived present - A novel ERP paradigm. PLoS One 2020; 15:e0237663. [PMID: 32870908 PMCID: PMC7462302 DOI: 10.1371/journal.pone.0237663] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2020] [Accepted: 07/30/2020] [Indexed: 11/19/2022] Open
Abstract
The information available through our senses is noisy, incomplete, and to varying degrees ambiguous. The perceptual system must create stable and reliable percepts out of this restricted information. It solves this perceptual inference problem by integrating memories of previous percepts and making predictions about the perceptual future. Using ambiguous figures and a new experimental approach, we studied whether generating predictions based on regularities in the past affects processing of the present and how this is done. Event-related potentials (ERPs) were measured to investigate whether a highly regular temporal context of either ambiguous or unambiguous stimulus variants differently affects processing of a current stimulus and/or task execution. Further, we tested whether symbolic announcements about the immediate perceptual future can replace the past experience of regularities as a source for making predictions. Both ERP and reaction time varied as a function of stimulus ambiguity in the temporal context of a present stimulus. No such effects were found with symbolic announcements. Our results indicate that predictions about the future automatically alter processing of the present, even if the predictions are irrelevant for the present percept and task. However, direct experiences of past regularities are necessary for predicting the future whereas symbolic information about the future is not sufficient.
Collapse
|
26
|
Ketamine Affects Prediction Errors about Statistical Regularities: A Computational Single-Trial Analysis of the Mismatch Negativity. J Neurosci 2020; 40:5658-5668. [PMID: 32561673 DOI: 10.1523/jneurosci.3069-19.2020] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 05/12/2020] [Accepted: 06/05/2020] [Indexed: 12/12/2022] Open
Abstract
The auditory mismatch negativity (MMN) is significantly reduced in schizophrenia. Notably, a similar MMN reduction can be achieved with NMDA receptor (NMDAR) antagonists. Both phenomena have been interpreted as reflecting an impairment of predictive coding or, more generally, the "Bayesian brain" notion that the brain continuously updates a hierarchical model to infer the causes of its sensory inputs. Specifically, neurobiological interpretations of predictive coding view perceptual inference as an NMDAR-dependent process of minimizing hierarchical precision-weighted prediction errors (PEs), and disturbances of this putative process play a key role in hierarchical Bayesian theories of schizophrenia. Here, we provide empirical evidence for this theory, demonstrating the existence of multiple, hierarchically related PEs in a "roving MMN" paradigm. We applied a hierarchical Bayesian model to single-trial EEG data from healthy human volunteers of either sex who received the NMDAR antagonist S-ketamine in a placebo-controlled, double-blind, within-subject fashion. Using an unrestricted analysis of the entire time-sensor space, our trial-by-trial analysis indicated that low-level PEs (about stimulus transitions) are expressed early (102-207 ms poststimulus), while high-level PEs (about transition probability) are reflected by later components (152-199 and 215-277 ms) of single-trial responses. Furthermore, we find that ketamine significantly diminished the expression of high-level PE responses, implying that NMDAR antagonism disrupts the inference on abstract statistical regularities. Our findings suggest that NMDAR dysfunction impairs hierarchical Bayesian inference about the world's statistical structure. Beyond the relevance of this finding for schizophrenia, our results illustrate the potential of computational single-trial analyses for assessing potential pathophysiological mechanisms.
Collapse
|
27
|
Korzeniewska A, Wang Y, Benz HL, Fifer MS, Collard M, Milsap G, Cervenka MC, Martin A, Gotts SJ, Crone NE. Changes in human brain dynamics during behavioral priming and repetition suppression. Prog Neurobiol 2020; 189:101788. [PMID: 32198060 DOI: 10.1016/j.pneurobio.2020.101788] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2019] [Revised: 01/13/2020] [Accepted: 03/13/2020] [Indexed: 11/29/2022]
Abstract
Behavioral responses to a perceptual stimulus are typically faster with repeated exposure to the stimulus (behavioral priming). This implicit learning mechanism is critical for survival but impaired in a variety of neurological disorders, including Alzheimer's disease. Many studies of the neural bases for behavioral priming have encountered an interesting paradox: in spite of faster behavioral responses, repeated stimuli usually elicit weaker neural responses (repetition suppression). Several neurophysiological models have been proposed to resolve this paradox, but noninvasive techniques for human studies have had insufficient spatial-temporal precision for testing their predictions. Here, we used the unparalleled precision of electrocorticography (ECoG) to analyze the timing and magnitude of task-related changes in neural activation and propagation while patients named novel vs repeated visual objects. Stimulus repetition was associated with faster verbal responses and decreased neural activation (repetition suppression) in ventral occipito-temporal cortex (VOTC) and left prefrontal cortex (LPFC). Interestingly, we also observed increased neural activation (repetition enhancement) in LPFC and other recording sites. Moreover, with analysis of high gamma propagation we observed increased top-down propagation from LPFC into VOTC, preceding repetition suppression. The latter results indicate that repetition suppression and behavioral priming are associated with strengthening of top-down network influences on perceptual processing, consistent with predictive coding models of repetition suppression, and they support a central role for changes in large-scale cortical dynamics in achieving more efficient and rapid behavioral responses.
Collapse
Affiliation(s)
- Anna Korzeniewska
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA.
| | - Yujing Wang
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Heather L Benz
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Matthew S Fifer
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Max Collard
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Griffin Milsap
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Mackenzie C Cervenka
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| | - Alex Martin
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland, 20852, USA
| | - Stephen J Gotts
- Laboratory of Brain and Cognition, National Institute of Mental Health, Bethesda, Maryland, 20852, USA
| | - Nathan E Crone
- Department of Neurology, Johns Hopkins University, Baltimore, Maryland, 21287, USA
| |
Collapse
|
28
|
Teng X, Ma M, Yang J, Blohm S, Cai Q, Tian X. Constrained Structure of Ancient Chinese Poetry Facilitates Speech Content Grouping. Curr Biol 2020; 30:1299-1305.e7. [PMID: 32142700 DOI: 10.1016/j.cub.2020.01.059] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 11/08/2019] [Accepted: 01/17/2020] [Indexed: 11/19/2022]
Abstract
Ancient Chinese poetry is constituted by structured language that deviates from ordinary language usage [1, 2]; its poetic genres impose unique combinatory constraints on linguistic elements [3]. How does the constrained poetic structure facilitate speech segmentation when common linguistic [4-8] and statistical cues [5, 9] are unreliable to listeners in poems? We generated artificial Jueju, which arguably has the most constrained structure in ancient Chinese poetry, and presented each poem twice as an isochronous sequence of syllables to native Mandarin speakers while conducting magnetoencephalography (MEG) recording. We found that listeners deployed their prior knowledge of Jueju to build the line structure and to establish the conceptual flow of Jueju. Unprecedentedly, we found a phase precession phenomenon indicating predictive processes of speech segmentation-the neural phase advanced faster after listeners acquired knowledge of incoming speech. The statistical co-occurrence of monosyllabic words in Jueju negatively correlated with speech segmentation, which provides an alternative perspective on how statistical cues facilitate speech segmentation. Our findings suggest that constrained poetic structures serve as a temporal map for listeners to group speech contents and to predict incoming speech signals. Listeners can parse speech streams by using not only grammatical and statistical cues but also their prior knowledge of the form of language. VIDEO ABSTRACT.
Collapse
Affiliation(s)
- Xiangbin Teng
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt 60322, Germany
| | - Min Ma
- Google Inc., 111 8th Avenue, New York, NY 10010, United States
| | - Jinbiao Yang
- Division of Arts and Sciences, New York University Shanghai, Shanghai 200122, China; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China; Max Planck Institute for Psycholinguistics, Wundtlaan 1, Nijmegen 6525 XD, the Netherlands; Centre for Language Studies, Radboud University, Erasmusplein 1, Nijmegen 6525 HT, the Netherlands
| | - Stefan Blohm
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt 60322, Germany
| | - Qing Cai
- NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China; Key Laboratory of Brain Functional Genomics (MOE & STCSM), Shanghai Changning-ECNU Mental Health Center, Institute of Cognitive Neuroscience, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
| | - Xing Tian
- Division of Arts and Sciences, New York University Shanghai, Shanghai 200122, China; NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai, Shanghai 200062, China; Key Laboratory of Brain Functional Genomics (MOE & STCSM), Shanghai Changning-ECNU Mental Health Center, Institute of Cognitive Neuroscience, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China.
| |
Collapse
|
29
|
Walsh KS, McGovern DP, Clark A, O'Connell RG. Evaluating the neurophysiological evidence for predictive processing as a model of perception. Ann N Y Acad Sci 2020; 1464:242-268. [PMID: 32147856 PMCID: PMC7187369 DOI: 10.1111/nyas.14321] [Citation(s) in RCA: 109] [Impact Index Per Article: 27.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Revised: 01/21/2020] [Accepted: 02/03/2020] [Indexed: 12/12/2022]
Abstract
For many years, the dominant theoretical framework guiding research into the neural origins of perceptual experience has been provided by hierarchical feedforward models, in which sensory inputs are passed through a series of increasingly complex feature detectors. However, the long-standing orthodoxy of these accounts has recently been challenged by a radically different set of theories that contend that perception arises from a purely inferential process supported by two distinct classes of neurons: those that transmit predictions about sensory states and those that signal sensory information that deviates from those predictions. Although these predictive processing (PP) models have become increasingly influential in cognitive neuroscience, they are also criticized for lacking the empirical support to justify their status. This limited evidence base partly reflects the considerable methodological challenges that are presented when trying to test the unique predictions of these models. However, a confluence of technological and theoretical advances has prompted a recent surge in human and nonhuman neurophysiological research seeking to fill this empirical gap. Here, we will review this new research and evaluate the degree to which its findings support the key claims of PP.
Collapse
Affiliation(s)
- Kevin S. Walsh
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
| | - David P. McGovern
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
- School of PsychologyDublin City UniversityDublinIreland
| | - Andy Clark
- Department of PhilosophyUniversity of SussexBrightonUK
- Department of InformaticsUniversity of SussexBrightonUK
| | - Redmond G. O'Connell
- Trinity College Institute of Neuroscience and School of PsychologyTrinity College DublinDublinIreland
| |
Collapse
|
30
|
Hsu YF, Xu W, Parviainen T, Hämäläinen JA. Context-dependent minimisation of prediction errors involves temporal-frontal activation. Neuroimage 2020; 207:116355. [DOI: 10.1016/j.neuroimage.2019.116355] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Revised: 10/16/2019] [Accepted: 11/11/2019] [Indexed: 10/25/2022] Open
|
31
|
Amado C, Rostalski SM, Grotheer M, Wanke N, Kovács G. Similar Expectation Effects for Immediate and Delayed Stimulus Repetitions. Front Neurosci 2020; 13:1379. [PMID: 31920527 PMCID: PMC6933499 DOI: 10.3389/fnins.2019.01379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Accepted: 12/05/2019] [Indexed: 11/24/2022] Open
Abstract
A prior cue or stimulus allows prediction of the future occurrence of an event and therefore reduces the associated neural activity in several cortical areas. This phenomenon is labeled expectation suppression (ES) and has recently been shown to be independent of the generally observed effects of stimulus repetitions (repetition suppression, RS: reduced neuronal response after the repetition of a given stimulus). While it has been shown that attentional cueing is strongly affected by the length of the cue-target delay, we have no information on the temporal dynamics of expectation effects, as in most prior studies of ES the delay between the predictive cue and the target (i.e., the inter-stimulus interval, ISI) was in the range of a few hundred milliseconds. Hence, we presented participants with pairs of faces where the first face could be used to build expectations regarding the second one, in the sense that one gender indicated repetition of the same face while the other gender predicted the occurrence of novel faces. In addition, we presented the stimulus pairs with two different ISIs (0.5 s for Immediate and 1.75 or 3.75 s for Delayed ISIs). We found significant RS as well as a reduced response for correctly predicted when compared to surprising trials in the fusiform face area. Importantly, the effects of repetition and expectation were both independent of the length of the ISI period. This implies that Immediate and Delayed cue-target stimulus arrangements lead to similar expectation effects in the face sensitive-visual cortex.
Collapse
Affiliation(s)
- Catarina Amado
- Experimental Cognitive Science, Eberhard Karls Universität Tübingen, Tübingen, Germany
| | - Sophie-Marie Rostalski
- Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Mareike Grotheer
- Department of Psychology, Stanford University, Stanford, CA, United States
| | - Nadine Wanke
- Institute of Psychology, University of Hamburg, Hamburg, Germany
| | - Gyula Kovács
- Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
32
|
Thébault-Dagher F, Deguire F, Knoth IS, Lafontaine MP, Barlaam F, Côté V, Agbogba K, Lippé S. Prolonged and unprolonged complex febrile seizures differently affect frontal theta brain activity. Epilepsy Res 2020; 159:106217. [DOI: 10.1016/j.eplepsyres.2019.106217] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Revised: 09/27/2019] [Accepted: 10/13/2019] [Indexed: 01/29/2023]
|
33
|
Choi JY, Perrachione TK. Time and information in perceptual adaptation to speech. Cognition 2019; 192:103982. [PMID: 31229740 PMCID: PMC6732236 DOI: 10.1016/j.cognition.2019.05.019] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2018] [Revised: 05/11/2019] [Accepted: 05/25/2019] [Indexed: 11/18/2022]
Abstract
Perceptual adaptation to a talker enables listeners to efficiently resolve the many-to-many mapping between variable speech acoustics and abstract linguistic representations. However, models of speech perception have not delved into the variety or the quantity of information necessary for successful adaptation, nor how adaptation unfolds over time. In three experiments using speeded classification of spoken words, we explored how the quantity (duration), quality (phonetic detail), and temporal continuity of talker-specific context contribute to facilitating perceptual adaptation to speech. In single- and mixed-talker conditions, listeners identified phonetically-confusable target words in isolation or preceded by carrier phrases of varying lengths and phonetic content, spoken by the same talker as the target word. Word identification was always slower in mixed-talker conditions than single-talker ones. However, interference from talker variability decreased as the duration of preceding speech increased but was not affected by the amount of preceding talker-specific phonetic information. Furthermore, efficiency gains from adaptation depended on temporal continuity between preceding speech and the target word. These results suggest that perceptual adaptation to speech may be understood via models of auditory streaming, where perceptual continuity of an auditory object (e.g., a talker) facilitates allocation of attentional resources, resulting in more efficient perceptual processing.
Collapse
Affiliation(s)
- Ja Young Choi
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA, United States; Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, United States
| | - Tyler K Perrachione
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA, United States.
| |
Collapse
|
34
|
Getting rid of visual distractors: the why, when, how, and where. Curr Opin Psychol 2019; 29:135-147. [DOI: 10.1016/j.copsyc.2019.02.004] [Citation(s) in RCA: 75] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2018] [Revised: 02/01/2019] [Accepted: 02/08/2019] [Indexed: 11/20/2022]
|
35
|
Kovács G, Grotheer M, Münke L, Kéri S, Nenadić I. Significant repetition probability effects in schizophrenia. Psychiatry Res Neuroimaging 2019; 290:22-29. [PMID: 31254800 DOI: 10.1016/j.pscychresns.2019.05.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2019] [Revised: 05/30/2019] [Accepted: 05/31/2019] [Indexed: 11/30/2022]
Abstract
BACKGROUND A growing body of evidence suggests that the comparison of expected and incoming sensory stimuli (the prediction-error (ε) processing) is impaired in schizophrenia patients (SZ). For example, in studies of mismatch negativity, an ERP component that signals ε, SZ patients show deficits in the auditory and visual modalities. To test the role of impaired ε processing further in SZ, using neuroimaging methods, we applied a repetition-suppression (RS) paradigm. METHODS Patients diagnosed with SZ (n = 17) as well as age- and sex- matched healthy control subjects (HC, n = 17) were presented with pairs of faces, which could either repeat or alternate. Additionally, the likelihood of repetition/alternation trials was modulated in individual blocks of fMRI recordings, testing the effects of repetition probability (P(rep)) on RS. RESULTS We found a significant RS in the fusiform and occipital face areas as well as in the lateral occipital cortex that was similar in healthy controls and SZ patients SZ. More importantly, we observed similar P(rep) effects (larger RS in blocks with high frequency of repetitions than in blocks with low repetition likelihood) in both the control and the patient group. CONCLUSION Our findings suggest that repetition_probability modulations affect the neural responses in schizophrenia patients and healthy participants similarly. This suggests that the neural mechanisms determining perceptual inferences based on stimulus probabilities remain unimpaired in schizophrenia.
Collapse
Affiliation(s)
- Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, 07743 Jena, Germany
| | - Mareike Grotheer
- Institute of Psychology, Friedrich Schiller University Jena, 07743 Jena, Germany; DFG Research Unit Person Perception, Friedrich Schiller University Jena, 07743 Jena, Germany
| | - Lisa Münke
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany
| | - Szabolcs Kéri
- Department of Cognitive Science, Budapest University of Technology and Economics, 1111 Budapest, Hungary
| | - Igor Nenadić
- Department of Psychiatry and Psychotherapy, Jena University Hospital, 07743 Jena, Germany; Department of Psychiatry and Psychotherapy, Philipps-Universität Marburg / Marburg University Hospital - UKGM, Rudolf-Bultmann-Str. 8, 35037 Marburg, Germany.
| |
Collapse
|
36
|
Huber-Huber C, Buonocore A, Dimigen O, Hickey C, Melcher D. The peripheral preview effect with faces: Combined EEG and eye-tracking suggests multiple stages of trans-saccadic predictive and non-predictive processing. Neuroimage 2019; 200:344-362. [PMID: 31260837 DOI: 10.1016/j.neuroimage.2019.06.059] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2018] [Revised: 05/23/2019] [Accepted: 06/25/2019] [Indexed: 02/06/2023] Open
Abstract
The world appears stable despite saccadic eye-movements. One possible explanation for this phenomenon is that the visual system predicts upcoming input across saccadic eye-movements based on peripheral preview of the saccadic target. We tested this idea using concurrent electroencephalography (EEG) and eye-tracking. Participants made cued saccades to peripheral upright or inverted face stimuli that changed orientation (invalid preview) or maintained orientation (valid preview) while the saccade was completed. Experiment 1 demonstrated better discrimination performance and a reduced fixation-locked N170 component (fN170) with valid than with invalid preview, demonstrating integration of pre- and post-saccadic information. Moreover, the early fixation-related potentials (FRP) showed a preview face inversion effect suggesting that some pre-saccadic input was represented in the brain until around 170 ms post fixation-onset. Experiment 2 replicated Experiment 1 and manipulated the proportion of valid and invalid trials to test whether the preview effect reflects context-based prediction across trials. A whole-scalp Bayes factor analysis showed that this manipulation did not alter the fN170 preview effect but did influence the face inversion effect before the saccade. The pre-saccadic inversion effect declined earlier in the mostly invalid block than in the mostly valid block, which is consistent with the notion of pre-saccadic expectations. In addition, in both studies, we found strong evidence for an interaction between the pre-saccadic preview stimulus and the post-saccadic target as early as 50 ms (Experiment 2) or 90 ms (Experiment 1) into the new fixation. These findings suggest that visual stability may involve three temporal stages: prediction about the saccadic target, integration of pre-saccadic and post-saccadic information at around 50-90 ms post fixation onset, and post-saccadic facilitation of rapid categorization.
Collapse
Affiliation(s)
- Christoph Huber-Huber
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Corso Bettini 31, Rovereto, TN, 38068, Italy.
| | - Antimo Buonocore
- Werner Reichardt Centre for Integrative Neuroscience, Tuebingen University, Otfried-Müller-Straße 25, Tuebingen, 72076, Germany; Hertie Institute for Clinical Brain Research, Tuebingen University, Tuebingen, 72076, Germany
| | - Olaf Dimigen
- Department of Psychology, Humboldt-Universität zu Berlin, Unter Den Linden 6, 10099, Berlin, Germany
| | - Clayton Hickey
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Corso Bettini 31, Rovereto, TN, 38068, Italy
| | - David Melcher
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Corso Bettini 31, Rovereto, TN, 38068, Italy
| |
Collapse
|
37
|
Rostalski SM, Amado C, Kovács G. Repetition Suppression for Noisy and Intact Faces in the Occipito-Temporal Cortex. Front Psychol 2019; 10:1348. [PMID: 31258501 PMCID: PMC6587110 DOI: 10.3389/fpsyg.2019.01348] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Accepted: 05/23/2019] [Indexed: 11/13/2022] Open
Abstract
Repetition suppression (RS), the relative lower neural response magnitude to repeated as compared to non-repeated stimuli, is often explained within the predictive coding framework. According to this theory, precise predictions (priors) together with less precise sensory evidences lead to decisions that are determined largely by the predictions and the other way around. In other words, the prediction error, namely the magnitude of RS, should depend on the precision of predictions and sensory inputs. In the current study, we aimed at testing this idea by manipulating the clarity and thereby the precision of the incoming sensory data by adding noise to the images. This resulted in an fMRI adaptation design with repeated or alternating trials showing clear or noisy face stimuli. Our results show a noise effect on the activity in the fusiform face area (FFA), namely less activation for noisy than for clear trials, which supports previous findings. No such effects could be found in OFA or LO. Data also showed reliable RS in the FFA (bilateral) and unilaterally in OFA (right) and LO (left). Interestingly, the noise added to the stimuli did not affect the magnitude of RS in any of the tested cortical areas. This suggests that the clarity of the sensory input is not crucial in determining the magnitude of RS.
Collapse
Affiliation(s)
- Sophie-Marie Rostalski
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Catarina Amado
- Department of Computer Science, Experimental Cognitive Science Research Group, Eberhard Karls Universität Tübingen, Tübingen, Germany
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
38
|
Predictive visual search: Role of environmental regularities in the learning of context cues. Atten Percept Psychophys 2019; 80:1096-1109. [PMID: 29600489 DOI: 10.3758/s13414-018-1500-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Repeatedly searching through invariant spatial arrangements in visual search displays leads to the buildup of memory about these displays (contextual-cueing effect). In the present study, we investigate (1) whether contextual cueing is influenced by global statistical properties of the task and, if so, (2) whether these properties increase the overall strength (asymptotic level) or the temporal development (speed) of learning. Experiment 1a served as baseline against which we tested the effects of increased or decreased proportions of repeated relative to nonrepeated displays (Experiments 1b and 1c, respectively), thus manipulating the global statistical properties of search environments. Importantly, probability variations were achieved by manipulating the number of nonrepeated (baseline) displays so as to equate the total number of repeated displays across experiments. In Experiment 1d, repeated and nonrepeated displays were presented in longer streaks of trials, thus establishing a stable environment of sequences of repeated displays. Our results showed that the buildup of contextual cueing was expedited in the statistically rich Experiments 1b and 1d, relative to the baseline Experiment 1a. Further, contextual cueing was entirely absent when repeated displays occurred in the minority of trials (Experiment 1c). Together, these findings suggest that contextual cueing is modulated by observers' assumptions about the reliability of search environments.
Collapse
|
39
|
Maheu M, Dehaene S, Meyniel F. Brain signatures of a multiscale process of sequence learning in humans. eLife 2019; 8:41541. [PMID: 30714904 PMCID: PMC6361584 DOI: 10.7554/elife.41541] [Citation(s) in RCA: 46] [Impact Index Per Article: 9.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2018] [Accepted: 01/18/2019] [Indexed: 01/08/2023] Open
Abstract
Extracting the temporal structure of sequences of events is crucial for perception, decision-making, and language processing. Here, we investigate the mechanisms by which the brain acquires knowledge of sequences and the possibility that successive brain responses reflect the progressive extraction of sequence statistics at different timescales. We measured brain activity using magnetoencephalography in humans exposed to auditory sequences with various statistical regularities, and we modeled this activity as theoretical surprise levels using several learning models. Successive brain waves related to different types of statistical inferences. Early post-stimulus brain waves denoted a sensitivity to a simple statistic, the frequency of items estimated over a long timescale (habituation). Mid-latency and late brain waves conformed qualitatively and quantitatively to the computational properties of a more complex inference: the learning of recent transition probabilities. Our findings thus support the existence of multiple computational systems for sequence processing involving statistical inferences at multiple scales.
Collapse
Affiliation(s)
- Maxime Maheu
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France.,Université Paris Descartes, Sorbonne Paris Cité, Paris, France
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France.,Collège de France, Paris, France
| | - Florent Meyniel
- Cognitive Neuroimaging Unit, CEA DRF/JOLIOT, INSERM, Université Paris-Sud, Université Paris-Saclay, NeuroSpin center, Gif-sur-Yvette, France
| |
Collapse
|
40
|
Feuerriegel D, Churches O, Coussens S, Keage HA. Temporal expectations modulate face image repetition suppression of early stimulus evoked event-related potentials. Neuropsychologia 2019; 122:76-87. [DOI: 10.1016/j.neuropsychologia.2018.11.010] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 10/24/2018] [Accepted: 11/17/2018] [Indexed: 01/11/2023]
|
41
|
Tang MF, Smout CA, Arabzadeh E, Mattingley JB. Prediction error and repetition suppression have distinct effects on neural representations of visual information. eLife 2018; 7:33123. [PMID: 30547881 PMCID: PMC6312401 DOI: 10.7554/elife.33123] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2017] [Accepted: 12/13/2018] [Indexed: 12/28/2022] Open
Abstract
Predictive coding theories argue that recent experience establishes expectations in the brain that generate prediction errors when violated. Prediction errors provide a possible explanation for repetition suppression, where evoked neural activity is attenuated across repeated presentations of the same stimulus. The predictive coding account argues repetition suppression arises because repeated stimuli are expected, whereas non-repeated stimuli are unexpected and thus elicit larger neural responses. Here, we employed electroencephalography in humans to test the predictive coding account of repetition suppression by presenting sequences of visual gratings with orientations that were expected either to repeat or change in separate blocks of trials. We applied multivariate forward modelling to determine how orientation selectivity was affected by repetition and prediction. Unexpected stimuli were associated with significantly enhanced orientation selectivity, whereas selectivity was unaffected for repeated stimuli. Our results suggest that repetition suppression and expectation have separable effects on neural representations of visual feature information.
Collapse
Affiliation(s)
- Matthew F Tang
- Queensland Brain Institute, The University of Queensland, St Lucia, Australia.,Australian Research Council Centre of Excellence for Integrative Brain Function, Victoria, Australia
| | - Cooper A Smout
- Queensland Brain Institute, The University of Queensland, St Lucia, Australia.,Australian Research Council Centre of Excellence for Integrative Brain Function, Victoria, Australia
| | - Ehsan Arabzadeh
- Australian Research Council Centre of Excellence for Integrative Brain Function, Victoria, Australia.,Eccles Institute of Neuroscience, John Curtin School of Medical Research, The Australian National University, Canberra, Australia
| | - Jason B Mattingley
- Queensland Brain Institute, The University of Queensland, St Lucia, Australia.,Australian Research Council Centre of Excellence for Integrative Brain Function, Victoria, Australia.,School of Psychology, The University of Queensland, St Lucia, Australia
| |
Collapse
|
42
|
Noonan MP, Crittenden BM, Jensen O, Stokes MG. Selective inhibition of distracting input. Behav Brain Res 2018; 355:36-47. [DOI: 10.1016/j.bbr.2017.10.010] [Citation(s) in RCA: 72] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2017] [Revised: 09/02/2017] [Accepted: 10/10/2017] [Indexed: 12/22/2022]
|
43
|
Wilton M, Stancak A, Giesbrecht T, Thomas A, Kirkham T. Intensity expectation modifies gustatory evoked potentials to sweet taste: Evidence of bidirectional assimilation in early perceptual processing. Psychophysiology 2018; 56:e13299. [PMID: 30444000 PMCID: PMC6392116 DOI: 10.1111/psyp.13299] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Revised: 07/18/2018] [Accepted: 08/16/2018] [Indexed: 11/26/2022]
Abstract
Expectations can affect subjective sensory and hedonic ratings of tastes, but it is unclear whether they also shape sensory experience at a perceptual level. The neural correlates of the taste‐expectancy relationship were explored through EEG analysis. Using a trial‐by‐trial cueing paradigm, lingual delivery of 0.05 M or 0.3 M sucrose solutions was preceded by congruent or incongruent visual cues designed to promote anticipation of either a low‐sweet or high‐sweet solution. When participants were cued to expect low‐sweet, but received high‐sweet (incongruent cue), intensity ratings for high‐sweet decreased. Likewise, expectation of high‐sweet increased intensity ratings of low‐sweet solutions. Taste‐dependent, right central‐parietal gustatory ERPs were detected, with greater P1 (associated with greater right insula activation) and P2 peak amplitudes for high‐sweet tastes. Valid cue‐taste pairings led to specific reduced right‐lateralized N400 responses (associated with an attenuation in right insula activation) compared with invalid cue‐taste pairings. Finally, P1 amplitudes following invalidly cued low‐sweet tastes closely matched those generated by expected high‐sweet tastes, and P1 amplitudes for invalidly cued high‐sweet tastes resembled those generated by low‐sweet tastes. We conclude that, as well as modifying subjective ratings toward the anticipated intensity level, expectations affect cortical activity in a top‐down manner to induce bidirectional assimilation in the early perceptual processing of sweet taste and modulate N400 ERP components not previously associated with gustatory stimulation.
Collapse
Affiliation(s)
- Moon Wilton
- Department of Psychological Sciences, Eleanor Rathbone Building, University of Liverpool, Liverpool, L69 7ZA, UK
| | - Andrej Stancak
- Department of Psychological Sciences, Eleanor Rathbone Building, University of Liverpool, Liverpool, L69 7ZA, UK
| | - Timo Giesbrecht
- Unilever Research and Development, Port Sunlight, Quarry Road East, Bebington, CH63 3JW, UK
| | - Anna Thomas
- Unilever Research and Development, Port Sunlight, Quarry Road East, Bebington, CH63 3JW, UK
| | - Tim Kirkham
- Department of Psychological Sciences, Eleanor Rathbone Building, University of Liverpool, Liverpool, L69 7ZA, UK
| |
Collapse
|
44
|
Marshall AC, Cooper N, Rosu L, Kennett S. Stress-related deficits of older adults' spatial working memory: an EEG investigation of occipital alpha and frontal-midline theta activities. Neurobiol Aging 2018; 69:239-248. [PMID: 29909181 PMCID: PMC6689422 DOI: 10.1016/j.neurobiolaging.2018.05.025] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2018] [Revised: 05/14/2018] [Accepted: 05/21/2018] [Indexed: 12/09/2022]
Abstract
Studies highlight cumulative life stress as a significant predictor of accelerated cognitive aging. This study paired electrophysiological with behavioral measures to explore how cumulative stress affects attentional and maintenance processes underpinning working memory retention. We collected electroencephalographic recordings from 60 individuals (30 older, 30 younger) reporting high or low levels of cumulative stress during the performance of a spatial Sternberg task. We measured mid-occipital alpha (8-12 Hz) and frontal-midline theta (4-6 Hz) as indicators of attentional and maintenance processes. Older, high-stress participants' behavioral performance lay significantly below than that of younger adults and low-stress older individuals. Impaired task performance coincided with reduced event-related synchronization in alpha and theta frequency ranges during memory maintenance. Electrophysiological findings suggest that older adults' reduced performance results from a stress-related impact on their ability to retain a stimulus in working memory and inhibit extraneous information from interfering with maintenance. Our results demonstrate the wide-ranging impact of cumulative stress on cognitive health and provide insight into the functional mechanisms disrupted by its influence.
Collapse
Affiliation(s)
- Amanda C Marshall
- Department of Psychology, General and Experimental Psychology unit, Ludwig-Maximilians University, Munich, Germany.
| | - Nicholas Cooper
- Centre for Brain Science, University of Essex, Colchester, UK
| | - Livia Rosu
- Centre for Brain Science, University of Essex, Colchester, UK
| | - Steffan Kennett
- Centre for Brain Science, University of Essex, Colchester, UK
| |
Collapse
|
45
|
Gentsch A, Sel A, Marshall AC, Schütz-Bosbach S. Affective interoceptive inference: Evidence from heart-beat evoked brain potentials. Hum Brain Mapp 2018; 40:20-33. [PMID: 30159945 DOI: 10.1002/hbm.24352] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Revised: 07/14/2018] [Accepted: 08/01/2018] [Indexed: 12/18/2022] Open
Abstract
The perception of internal bodily signals (interoception) is central to many theories of emotion and embodied cognition. According to recent theoretical views, the sensory processing of visceral signals such as one's own heartbeat is determined by top-down predictions about the expected interoceptive state of the body (interoceptive inference). In this EEG study we examined neural responses to heartbeats following expected and unexpected emotional stimuli. We used a modified stimulus repetition task in which pairs of facial expressions were presented with repeating or alternating emotional content, and we manipulated the emotional valence and the likelihood of stimulus repetition. We found that affective predictions of external socially relevant information modulated the heartbeat-evoked potential, a marker of cardiac interoception. Crucially, the HEP changes highly relied on the expected emotional content of the facial expression. Thus, expected negative faces led to a decreased HEP amplitude, whereas such an effect was not observed after an expected neutral face. These results suggest that valence-specific affective predictions, and their uniquely associated predicted bodily sensory state, can reduce or amplify cardiac interoceptive responses. In addition, the affective repetition effects were dependent on repetition probability, highlighting the influence of top-down exteroceptive predictions on interoception. Our results are in line with recent models of interoception supporting the idea that predicted bodily states influence sensory processing of salient external information.
Collapse
Affiliation(s)
- Antje Gentsch
- Department of Psychology, General and Experimental Psychology Unit, Ludwig-Maximilians University, Munich, Germany
| | - Alejandra Sel
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
| | - Amanda C Marshall
- Department of Psychology, General and Experimental Psychology Unit, Ludwig-Maximilians University, Munich, Germany
| | - Simone Schütz-Bosbach
- Department of Psychology, General and Experimental Psychology Unit, Ludwig-Maximilians University, Munich, Germany
| |
Collapse
|
46
|
Kronbichler L, Said-Yürekli S, Kronbichler M. Perceptual Expectations of Object Stimuli Modulate Repetition Suppression in a Delayed Repetition Design. Sci Rep 2018; 8:12526. [PMID: 30131582 PMCID: PMC6104074 DOI: 10.1038/s41598-018-31091-4] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Accepted: 08/07/2018] [Indexed: 11/30/2022] Open
Abstract
Several fMRI and EEG/MEG studies show that repetition suppression (RS) effects are stronger when a stimulus repetition is expected compared to when a stimulus repetition is less expected. To date, the prevalent way to assess the influence of expectations on RS is via immediate stimulus repetition designs, that is, no intervening stimuli appear between the initial and repeated presentation of a stimulus. Since there is evidence that repetition lag may alter RS effects in a qualitative manner, the current study investigated how perceptual expectations modify RS effects on object stimuli when repetition lag is relatively long. Region of interest analyses in the left occipital cortex revealed a similar activation pattern as identified in previous studies on immediate lag: RS effects were strongest when repetitions were expected compared to decreased RS effects when repetitions were less expected. Therefore, the current study expands previous research in two ways: First, we replicate prior studies showing that perceptual expectation effects can be observed in object-sensitive occipital areas. Second, the finding that expectation effects can be found even for several-minute lags proposes that Bayesian inference processes are a relatively robust component in visual stimulus processing.
Collapse
Affiliation(s)
- Lisa Kronbichler
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria.
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria.
| | - Sarah Said-Yürekli
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| | - Martin Kronbichler
- Centre for Cognitive Neuroscience and Department of Psychology, University of Salzburg, Salzburg, Austria
- Neuroscience Institute, Christian-Doppler Medical Centre, Paracelsus Medical University, Salzburg, Austria
| |
Collapse
|
47
|
Face Repetition Probability Does Not Affect Repetition Suppression in Macaque Inferotemporal Cortex. J Neurosci 2018; 38:7492-7504. [PMID: 30030399 DOI: 10.1523/jneurosci.0462-18.2018] [Citation(s) in RCA: 31] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2018] [Revised: 06/06/2018] [Accepted: 07/06/2018] [Indexed: 12/20/2022] Open
Abstract
Repetition suppression, which refers to reduced neural activity for repeated stimuli, is typically explained by bottom-up or local adaptation mechanisms. However, recent theories have emphasized the role of top-down processes, suggesting that this response reduction reflects the fulfillment of perceptual expectations. To support this, an influential human fMRI study showed that the magnitude of suppression is modulated by the probability of a repetition. No such repetition probability effect was found in macaque inferior temporal (IT) cortex for spiking activity despite the presence of repetition suppression. Contrary to the human fMRI studies that showed an effect of repetition probability, the macaque single-unit study used a large variety of unfamiliar stimuli and the monkeys were not required to attend the stimuli. Here, as in the human fMRI studies, we used faces as stimuli and made the monkeys attend to the stimulus content. We simultaneously recorded spiking activity and local field potentials (LFPs) in the middle lateral face patch (ML) of one monkey (male) and a face-responsive region of another (female). Although we observed significant repetition suppression of spiking activity and high gamma-band LFPs in both animals, there were no effects of repetition probability even when repetitions were task relevant and repetition probability affected behavioral decisions. In conclusion, despite the use of face stimuli and a stimulus-related task, no neural signature of repetition probability was present for faces in a face responsive patch of macaque IT. This further challenges a general perceptual expectation account of repetition suppression.SIGNIFICANCE STATEMENT Repetition suppression is a reduced brain activity for repeated stimuli commonly observed across species. In the predictive coding framework, such suppression is thought to reflect fulfilled perceptual expectations. Although this hypothesis is supported by several human fMRI studies reporting an effect of repetition probability on repetition suppression, this could not be replicated in single-cell recordings in monkey inferior temporal (IT) cortex. Subsequent studies narrowed down the conditions for the effect to requiring attention and being limited to particular stimulus categories such as faces. Here, we show that, even under these conditions, repetition suppression in monkey IT neurons is still unaffected by repetition probability, even in a task with a behavioral effect, challenging the perceptual expectation account of repetition suppression.
Collapse
|
48
|
Feuerriegel D, Churches O, Coussens S, Keage HA. Evidence for spatiotemporally distinct effects of image repetition and perceptual expectations as measured by event-related potentials. Neuroimage 2018; 169:94-105. [DOI: 10.1016/j.neuroimage.2017.12.029] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2017] [Revised: 11/21/2017] [Accepted: 12/11/2017] [Indexed: 12/20/2022] Open
|
49
|
Prior Expectation Modulates Repetition Suppression without Perceptual Awareness. Sci Rep 2018; 8:5055. [PMID: 29568041 PMCID: PMC5864919 DOI: 10.1038/s41598-018-23467-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Accepted: 03/13/2018] [Indexed: 11/23/2022] Open
Abstract
Stimulus repetition induces attenuated brain responses. This phenomenon, termed repetition suppression (RS), is classically held to stem from bottom-up neuronal adaptation. However, recent studies suggest that RS is driven by top-down predictive mechanisms. It remains controversial whether these top-down mechanisms of RS rely on conscious strategies, or if they represent a more fundamental aspect of perception, coding for physical properties of the repeated feature. The presence of top-down effects in the absence of perceptual awareness would indicate that conscious strategies are not sufficient to explain top-down mechanisms of RS. We combined an unconscious priming paradigm with EEG recordings and tested whether RS can be modulated by the probability of encountering a repetition, even in the absence of awareness. Our results show that both behavioural priming and RS near occipital areas are modulated by repetition probability, regardless of prime awareness. This contradicts previous findings that have argued that RS modulation is a by-product of conscious strategies. In contrast, we found that the increase in theta-band power following unrepeated trials – an index of conflict detection – is modulated only by expectations during conscious primes, implicating the use of conscious strategies. Together, our results suggest that the influence of predictions on RS can be either automatic in sensory brain regions or dependent on conscious strategies.
Collapse
|
50
|
de Boer J, Krumbholz K. Auditory Attention Causes Gain Enhancement and Frequency Sharpening at Successive Stages of Cortical Processing-Evidence from Human Electroencephalography. J Cogn Neurosci 2018; 30:785-798. [PMID: 29488851 DOI: 10.1162/jocn_a_01245] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Previous findings have suggested that auditory attention causes not only enhancement in neural processing gain, but also sharpening in neural frequency tuning in human auditory cortex. The current study was aimed to reexamine these findings. Specifically, we aimed to investigate whether attentional gain enhancement and frequency sharpening emerge at the same or different processing levels and whether they represent independent or cooperative effects. For that, we examined the pattern of attentional modulation effects on early, sensory-driven cortical auditory-evoked potentials occurring at different latencies. Attention was manipulated using a dichotic listening task and was thus not selectively directed to specific frequency values. Possible attention-related changes in frequency tuning selectivity were measured with an adaptation paradigm. Our results show marked disparities in attention effects between the earlier N1 deflection and the subsequent P2 deflection, with the N1 showing a strong gain enhancement effect, but no sharpening, and the P2 showing clear evidence of sharpening, but no independent gain effect. They suggest that gain enhancement and frequency sharpening represent successive stages of a cooperative attentional modulation mechanism that increases the representational bandwidth of attended versus unattended sounds.
Collapse
|