1
|
Nolden S, Turan G, Güler B, Günseli E. Prediction error and event segmentation in episodic memory. Neurosci Biobehav Rev 2024; 157:105533. [PMID: 38184184 DOI: 10.1016/j.neubiorev.2024.105533] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Revised: 12/11/2023] [Accepted: 01/02/2024] [Indexed: 01/08/2024]
Abstract
Organizing the continuous flow of experiences into meaningful events is a crucial prerequisite for episodic memory. Prediction error and event segmentation both play important roles in supporting the genesis of meaningful mnemonic representations of events. We review theoretical contributions discussing the relationship between prediction error and event segmentation, as well as literature on episodic memory related to prediction error and event segmentation. We discuss the extent of overlap of mechanisms underlying memory emergence through prediction error and event segmentation, with a specific focus on attention and working memory. Finally, we identify areas in research that are currently developing and suggest future directions. We provide an overview of mechanisms underlying memory formation through predictions, violations of predictions, and event segmentation.
Collapse
Affiliation(s)
- Sophie Nolden
- Department for Developmental Psychology, Institute of Psychology, Goethe-University Frankfurt am Main, Germany; IDeA-Center for Research on Individual Development and Adaptive Education of Children at Risk, Frankfurt am Main, Germany.
| | - Gözem Turan
- Department for Developmental Psychology, Institute of Psychology, Goethe-University Frankfurt am Main, Germany; IDeA-Center for Research on Individual Development and Adaptive Education of Children at Risk, Frankfurt am Main, Germany
| | - Berna Güler
- Department of Psychology, Sabanci University, Istanbul, Turkey
| | - Eren Günseli
- Department of Psychology, Sabanci University, Istanbul, Turkey
| |
Collapse
|
2
|
Bein O, Gasser C, Amer T, Maril A, Davachi L. Predictions transform memories: How expected versus unexpected events are integrated or separated in memory. Neurosci Biobehav Rev 2023; 153:105368. [PMID: 37619645 PMCID: PMC10591973 DOI: 10.1016/j.neubiorev.2023.105368] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Revised: 08/13/2023] [Accepted: 08/21/2023] [Indexed: 08/26/2023]
Abstract
Our brains constantly generate predictions about the environment based on prior knowledge. Many of the events we experience are consistent with these predictions, while others might be inconsistent with prior knowledge and thus violate our predictions. To guide future behavior, the memory system must be able to strengthen, transform, or add to existing knowledge based on the accuracy of our predictions. We synthesize recent evidence suggesting that when an event is consistent with our predictions, it leads to neural integration between related memories, which is associated with enhanced associative memory, as well as memory biases. Prediction errors, in turn, can promote both neural integration and separation, and lead to multiple mnemonic outcomes. We review these findings and how they interact with factors such as memory reactivation, prediction error strength, and task goals, to offer insight into what determines memory for events that violate our predictions. In doing so, this review brings together recent neural and behavioral research to advance our understanding of how predictions shape memory, and why.
Collapse
Affiliation(s)
- Oded Bein
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, United States.
| | - Camille Gasser
- Department of Psychology, Columbia University, New York, NY, United States.
| | - Tarek Amer
- Department of Psychology, University of Victoria, Victoria, Canada
| | - Anat Maril
- Department of Psychology, The Hebrew University of Jerusalem, Jerusalem, Israel; Department of Cognitive Science, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Lila Davachi
- Center for Clinical Research, The Nathan S. Kline Institute for Psychiatric Research, Orangeburg, NY, United States
| |
Collapse
|
3
|
Chen N, Ai H, Lu X. Context-dependent attentional spotlight in pulvinar-V1 interaction. Neuroimage 2023; 279:120341. [PMID: 37619793 DOI: 10.1016/j.neuroimage.2023.120341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 08/02/2023] [Accepted: 08/21/2023] [Indexed: 08/26/2023] Open
Abstract
Spatial attention is often described as a mental spotlight that enhances information processing at the attended location. Using fMRI, we investigated background connectivity between the pulvinar and V1 in relation to focused versus diffused attention allocation, in weak and strong crowding contexts. Our findings revealed that focused attention led to enhanced correlations between the pulvinar and V1. Notably, this modulation was initiated by the pulvinar, and the strength of the modulation was dependent on the saliency of the target. These findings suggest that the pulvinar initiates information reweighting to V1, which underlies attentional selection in cluttered scenes.
Collapse
Affiliation(s)
- Nihong Chen
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, People's Republic of China; THU-IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing 100084, People's Republic of China.
| | - Hailin Ai
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, People's Republic of China
| | - Xincheng Lu
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, People's Republic of China
| |
Collapse
|
4
|
Schütz A, Bharmauria V, Yan X, Wang H, Bremmer F, Crawford JD. Integration of landmark and saccade target signals in macaque frontal cortex visual responses. Commun Biol 2023; 6:938. [PMID: 37704829 PMCID: PMC10499799 DOI: 10.1038/s42003-023-05291-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Accepted: 08/26/2023] [Indexed: 09/15/2023] Open
Abstract
Visual landmarks influence spatial cognition and behavior, but their influence on visual codes for action is poorly understood. Here, we test landmark influence on the visual response to saccade targets recorded from 312 frontal and 256 supplementary eye field neurons in rhesus macaques. Visual response fields are characterized by recording neural responses to various target-landmark combinations, and then we test against several candidate spatial models. Overall, frontal/supplementary eye fields response fields preferentially code either saccade targets (40%/40%) or landmarks (30%/4.5%) in gaze fixation-centered coordinates, but most cells show multiplexed target-landmark coding within intermediate reference frames (between fixation-centered and landmark-centered). Further, these coding schemes interact: neurons with near-equal target and landmark coding show the biggest shift from fixation-centered toward landmark-centered target coding. These data show that landmark information is preserved and influences target coding in prefrontal visual responses, likely to stabilize movement goals in the presence of noisy egocentric signals.
Collapse
Affiliation(s)
- Adrian Schütz
- Department of Neurophysics, Phillips Universität Marburg, Marburg, Germany
- Center for Mind, Brain, and Behavior - CMBB, Philipps-Universität Marburg, Marburg, Germany & Justus-Liebig-Universität Giessen, Giessen, Germany
| | - Vishal Bharmauria
- York Centre for Vision Research and Vision: Science to Applications Program, York University, Toronto, Canada
| | - Xiaogang Yan
- York Centre for Vision Research and Vision: Science to Applications Program, York University, Toronto, Canada
| | - Hongying Wang
- York Centre for Vision Research and Vision: Science to Applications Program, York University, Toronto, Canada
| | - Frank Bremmer
- Department of Neurophysics, Phillips Universität Marburg, Marburg, Germany
- Center for Mind, Brain, and Behavior - CMBB, Philipps-Universität Marburg, Marburg, Germany & Justus-Liebig-Universität Giessen, Giessen, Germany
| | - J Douglas Crawford
- York Centre for Vision Research and Vision: Science to Applications Program, York University, Toronto, Canada.
- Departments of Psychology, Biology, Kinesiology & Health Sciences, York University, Toronto, Canada.
| |
Collapse
|
5
|
Thomas ER, Rittershofer K, Press C. Updating perceptual expectations as certainty diminishes. Cognition 2023; 232:105356. [PMID: 36502600 DOI: 10.1016/j.cognition.2022.105356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 11/29/2022] [Accepted: 11/30/2022] [Indexed: 12/13/2022]
Abstract
Forming expectations about what we are likely to perceive often facilitates perception. We forge such expectations on the basis of strong statistical relationships between events in our environment. However, due to our ever-changing world these relationships often subsequently degrade or even disappear, yet it is unclear how these altered statistics influence perceptual expectations. We examined this question across two studies by training participants in perfect relationships between actions (index or little finger abductions) and outcomes (clockwise or counter-clockwise gratings), before degrading the predictive relationship in a test phase - such that 'expected' events followed actions on 50-75% of trials and 'unexpected' events ensued on the remainder. Perceptual decisions about outcomes were faster and less error prone on expected than unexpected trials when predictive relationships remained high and reduced as the relationship diminished. Drift diffusion modelling indicated that these effects are explained by shifting the starting point in the evidence accumulation process as well as biasing the rate of evidence accumulation - with the former reflecting biases from statistics within the training session and the latter those of the test session. These findings demonstrate how perceptual expectations are updated as statistical certainty diminishes, with interacting influences speculatively dependent upon learning consolidation. We discuss how underlying mechanisms optimise the interaction between learning and perception - allowing our experiences to reflect a nuanced, ever-changing environment.
Collapse
Affiliation(s)
- Emily R Thomas
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London WC1E 7HX, UK; Neuroscience Institute, New York University School of Medicine, 550 1(st) Ave, New York, NY 10016, USA
| | - Kirsten Rittershofer
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London WC1E 7HX, UK.
| | - Clare Press
- Department of Psychological Sciences, Birkbeck, University of London, Malet Street, London WC1E 7HX, UK; Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square, London WC1N 3AR, UK
| |
Collapse
|
6
|
Schwarzlose RF, Tillman R, Hoyniak CP, Luby JL, Barch DM. Sensory Over-responsivity: A Feature of Childhood Psychiatric Illness Associated With Altered Functional Connectivity of Sensory Networks. Biol Psychiatry 2023; 93:92-101. [PMID: 36357217 PMCID: PMC10308431 DOI: 10.1016/j.biopsych.2022.09.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Revised: 08/20/2022] [Accepted: 09/21/2022] [Indexed: 11/02/2022]
Abstract
BACKGROUND Sensory over-responsivity (SOR) is recognized as a common feature of autism spectrum disorder. However, SOR is also common among typically developing children, in whom it is associated with elevated levels of psychiatric symptoms. The clinical significance and neurocognitive bases of SOR in these children remain poorly understood and actively debated. METHODS This study used linear mixed-effects models to identify psychiatric symptoms and network-level functional connectivity (FC) differences associated with parent-reported SOR in the Adolescent Brain Cognitive Development (ABCD) Study, a large community sample (9 to 12 years of age) (N = 11,210). RESULTS Children with SOR constituted 18% of the overall sample but comprised more than half of the children with internalizing or externalizing scores in the clinical range. Controlling for autistic traits, both mild and severe SOR were associated with greater concurrent symptoms of depression, anxiety, obsessive-compulsive disorder, and attention-deficit/hyperactivity disorder. Controlling for psychiatric symptoms and autistic traits, SOR predicted increased anxiety, attention-deficit/hyperactivity disorder, and prodromal psychosis symptoms 1 year later and was associated with FC differences in brain networks supporting sensory and salience processing in datasets collected 2 years apart. Differences included reduced FC within and between sensorimotor networks, enhanced sensorimotor-salience FC, and altered FC between sensory networks and bilateral hippocampi. CONCLUSIONS SOR is a common, clinically relevant feature of childhood psychiatric illness that provides unique predictive information about risk. It is associated with differences in brain networks that subserve tactile processing, implicating a neural basis for sensory differences in affected children.
Collapse
Affiliation(s)
- Rebecca F Schwarzlose
- Department of Psychiatry, Washington University School of Medicine, St. Louis, Missouri.
| | - Rebecca Tillman
- Department of Psychiatry, Washington University School of Medicine, St. Louis, Missouri
| | - Caroline P Hoyniak
- Department of Psychiatry, Washington University School of Medicine, St. Louis, Missouri
| | - Joan L Luby
- Department of Psychiatry, Washington University School of Medicine, St. Louis, Missouri
| | - Deanna M Barch
- Department of Psychiatry, Washington University School of Medicine, St. Louis, Missouri; Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, Missouri
| |
Collapse
|
7
|
Lee J, Jo J, Lee B, Lee JH, Yoon S. Brain-inspired Predictive Coding Improves the Performance of Machine Challenging Tasks. Front Comput Neurosci 2022; 16:1062678. [PMID: 36465966 PMCID: PMC9709416 DOI: 10.3389/fncom.2022.1062678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 10/28/2022] [Indexed: 09/19/2023] Open
Abstract
Backpropagation has been regarded as the most favorable algorithm for training artificial neural networks. However, it has been criticized for its biological implausibility because its learning mechanism contradicts the human brain. Although backpropagation has achieved super-human performance in various machine learning applications, it often shows limited performance in specific tasks. We collectively referred to such tasks as machine-challenging tasks (MCTs) and aimed to investigate methods to enhance machine learning for MCTs. Specifically, we start with a natural question: Can a learning mechanism that mimics the human brain lead to the improvement of MCT performances? We hypothesized that a learning mechanism replicating the human brain is effective for tasks where machine intelligence is difficult. Multiple experiments corresponding to specific types of MCTs where machine intelligence has room to improve performance were performed using predictive coding, a more biologically plausible learning algorithm than backpropagation. This study regarded incremental learning, long-tailed, and few-shot recognition as representative MCTs. With extensive experiments, we examined the effectiveness of predictive coding that robustly outperformed backpropagation-trained networks for the MCTs. We demonstrated that predictive coding-based incremental learning alleviates the effect of catastrophic forgetting. Next, predictive coding-based learning mitigates the classification bias in long-tailed recognition. Finally, we verified that the network trained with predictive coding could correctly predict corresponding targets with few samples. We analyzed the experimental result by drawing analogies between the properties of predictive coding networks and those of the human brain and discussing the potential of predictive coding networks in general machine learning.
Collapse
Affiliation(s)
- Jangho Lee
- Department of Electrical and Computer Engineering, Seoul National University, Seoul, South Korea
| | - Jeonghee Jo
- Institute of New Media and Communications, Seoul National University, Seoul, South Korea
| | - Byounghwa Lee
- CybreBrain Research Section, Electronics and Telecommunications Research Institute (ETRI), Daejeon, South Korea
| | - Jung-Hoon Lee
- CybreBrain Research Section, Electronics and Telecommunications Research Institute (ETRI), Daejeon, South Korea
| | - Sungroh Yoon
- Department of Electrical and Computer Engineering, Seoul National University, Seoul, South Korea
- Interdisciplinary Program in Artificial Intelligence, Seoul National University, Seoul, South Korea
| |
Collapse
|
8
|
Aitken F, Kok P. Hippocampal representations switch from errors to predictions during acquisition of predictive associations. Nat Commun 2022; 13:3294. [PMID: 35676285 PMCID: PMC9178037 DOI: 10.1038/s41467-022-31040-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Accepted: 05/11/2022] [Indexed: 11/09/2022] Open
Abstract
AbstractWe constantly exploit the statistical regularities in our environment to help guide our perception. The hippocampus has been suggested to play a pivotal role in both learning environmental statistics, as well as exploiting them to generate perceptual predictions. However, it is unclear how the hippocampus balances encoding new predictive associations with the retrieval of existing ones. Here, we present the results of two high resolution human fMRI studies (N = 24 for both experiments) directly investigating this. Participants were exposed to auditory cues that predicted the identity of an upcoming visual shape (with 75% validity). Using multivoxel decoding analysis, we find that the hippocampus initially preferentially represents unexpected shapes (i.e., those that violate the cue regularities), but later switches to representing the cue-predicted shape regardless of which was actually presented. These findings demonstrate that the hippocampus is involved both acquiring and exploiting predictive associations, and is dominated by either errors or predictions depending on whether learning is ongoing or complete.
Collapse
|
9
|
Patt VM, Palombo DJ, Esterman M, Verfaellie M. Hippocampal Contribution to Probabilistic Feedback Learning: Modeling Observation- and Reinforcement-based Processes. J Cogn Neurosci 2022; 34:1429-1446. [PMID: 35604353 DOI: 10.1162/jocn_a_01873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Simple probabilistic reinforcement learning is recognized as a striatum-based learning system, but in recent years, has also been associated with hippocampal involvement. This study examined whether such involvement may be attributed to observation-based learning (OL) processes, running in parallel to striatum-based reinforcement learning. A computational model of OL, mirroring classic models of reinforcement-based learning (RL), was constructed and applied to the neuroimaging data set of Palombo, Hayes, Reid, and Verfaellie (2019). Hippocampal contributions to value-based learning: Converging evidence from fMRI and amnesia. Cognitive, Affective & Behavioral Neuroscience, 19(3), 523-536. Results suggested that OL processes may indeed take place concomitantly to reinforcement learning and involve activation of the hippocampus and central orbitofrontal cortex. However, rather than independent mechanisms running in parallel, the brain correlates of the OL and RL prediction errors indicated collaboration between systems, with direct implication of the hippocampus in computations of the discrepancy between the expected and actual reinforcing values of actions. These findings are consistent with previous accounts of a role for the hippocampus in encoding the strength of observed stimulus-outcome associations, with updating of such associations through striatal reinforcement-based computations. In addition, enhanced negative RL prediction error signaling was found in the anterior insula with greater use of OL over RL processes. This result may suggest an additional mode of collaboration between the OL and RL systems, implicating the error monitoring network.
Collapse
Affiliation(s)
- Virginie M Patt
- VA Boston Healthcare System, MA.,Boston University School of Medicine, MA
| | | | - Michael Esterman
- VA Boston Healthcare System, MA.,Boston University School of Medicine, MA
| | - Mieke Verfaellie
- VA Boston Healthcare System, MA.,Boston University School of Medicine, MA
| |
Collapse
|
10
|
He T, Richter D, Wang Z, de Lange FP. Spatial and Temporal Context Jointly Modulate the Sensory Response within the Ventral Visual Stream. J Cogn Neurosci 2021; 34:332-347. [PMID: 34964889 DOI: 10.1162/jocn_a_01792] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Both spatial and temporal context play an important role in visual perception and behavior. Humans can extract statistical regularities from both forms of context to help process the present and to construct expectations about the future. Numerous studies have found reduced neural responses to expected stimuli compared with unexpected stimuli, for both spatial and temporal regularities. However, it is largely unclear whether and how these forms of context interact. In the current fMRI study, 33 human volunteers were exposed to pairs of object stimuli that could be expected or surprising in terms of their spatial and temporal context. We found reliable independent contributions of both spatial and temporal context in modulating the neural response. Specifically, neural responses to stimuli in expected compared with unexpected contexts were suppressed throughout the ventral visual stream. These results suggest that both spatial and temporal context may aid sensory processing in a similar fashion, providing evidence on how different types of context jointly modulate perceptual processing.
Collapse
|
11
|
Prediction errors disrupt hippocampal representations and update episodic memories. Proc Natl Acad Sci U S A 2021; 118:2117625118. [PMID: 34911768 DOI: 10.1073/pnas.2117625118] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/05/2021] [Indexed: 11/18/2022] Open
Abstract
The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human functional MRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction errors reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we show that univariate activation was insufficient for understanding hippocampal prediction error signals. We explain this surprising finding by tracking both the evolution of hippocampal activation patterns and the connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable.
Collapse
|
12
|
Kragel JE, Schuele S, VanHaerents S, Rosenow JM, Voss JL. Rapid coordination of effective learning by the human hippocampus. SCIENCE ADVANCES 2021; 7:7/25/eabf7144. [PMID: 34144985 PMCID: PMC8213228 DOI: 10.1126/sciadv.abf7144] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Accepted: 05/06/2021] [Indexed: 06/12/2023]
Abstract
Although the human hippocampus is necessary for long-term memory, controversial findings suggest that it may also support short-term memory in the service of guiding effective behaviors during learning. We tested the counterintuitive theory that the hippocampus contributes to long-term memory through remarkably short-term processing, as reflected in eye movements during scene encoding. While viewing scenes for the first time, short-term retrieval operative within the episode over only hundreds of milliseconds was indicated by a specific eye-movement pattern, which was effective in that it enhanced spatiotemporal memory formation. This viewing pattern was predicted by hippocampal theta oscillations recorded from depth electrodes and by shifts toward top-down influence of hippocampal theta on activity within visual perception and attention networks. The hippocampus thus supports short-term memory processing that coordinates behavior in the service of effective spatiotemporal learning.
Collapse
Affiliation(s)
- James E Kragel
- Interdepartmental Neuroscience Program, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA.
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Stephan Schuele
- Ken and Ruth Davee Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Stephen VanHaerents
- Ken and Ruth Davee Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Joshua M Rosenow
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| | - Joel L Voss
- Interdepartmental Neuroscience Program, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
- Ken and Ruth Davee Department of Neurology, Northwestern University Feinberg School of Medicine, Chicago, IL 60611, USA
| |
Collapse
|
13
|
Feuerriegel D, Vogels R, Kovács G. Evaluating the evidence for expectation suppression in the visual system. Neurosci Biobehav Rev 2021; 126:368-381. [PMID: 33836212 DOI: 10.1016/j.neubiorev.2021.04.002] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Revised: 02/16/2021] [Accepted: 04/02/2021] [Indexed: 01/25/2023]
Abstract
Reports of expectation suppression have shaped the development of influential predictive coding-based theories of visual perception. However recent work has highlighted confounding factors that may mimic or inflate expectation suppression effects. In this review, we describe four confounds that are prevalent across experiments that tested for expectation suppression: effects of surprise, attention, stimulus repetition and adaptation, and stimulus novelty. With these confounds in mind we then critically review the evidence for expectation suppression across probabilistic cueing, statistical learning, oddball, action-outcome learning and apparent motion designs. We found evidence for expectation suppression within a specific subset of statistical learning designs that involved weeks of sequence learning prior to neural activity measurement. Across other experimental contexts, whereby stimulus appearance probabilities were learned within one or two testing sessions, there was inconsistent evidence for genuine expectation suppression. We discuss how an absence of expectation suppression could inform models of predictive processing, repetition suppression and perceptual decision-making. We also provide suggestions for designing experiments that may better test for expectation suppression in future work.
Collapse
Affiliation(s)
- Daniel Feuerriegel
- Melbourne School of Psychological Sciences, The University of Melbourne, Melbourne, Australia.
| | - Rufin Vogels
- Laboratorium voor Neuro- en Psychofysiologie, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Gyula Kovács
- Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| |
Collapse
|
14
|
Skora LI, Seth AK, Scott RB. Sensorimotor predictions shape reported conscious visual experience in a breaking continuous flash suppression task. Neurosci Conscious 2021; 2021:niab003. [PMID: 33763234 PMCID: PMC7970722 DOI: 10.1093/nc/niab003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2020] [Revised: 01/04/2021] [Accepted: 01/05/2021] [Indexed: 11/12/2022] Open
Abstract
Accounts of predictive processing propose that conscious experience is influenced not only by passive predictions about the world, but also by predictions encompassing how the world changes in relation to our actions-that is, on predictions about sensorimotor contingencies. We tested whether valid sensorimotor predictions, in particular learned associations between stimuli and actions, shape reports about conscious visual experience. Two experiments used instrumental conditioning to build sensorimotor predictions linking different stimuli with distinct actions. Conditioning was followed by a breaking continuous flash suppression task, measuring the speed of reported breakthrough for different pairings between the stimuli and prepared actions, comparing those congruent and incongruent with the trained sensorimotor predictions. In Experiment 1, counterbalancing of the response actions within the breaking continuous flash suppression task was achieved by repeating the same action within each block but having them differ across the two blocks. Experiment 2 sought to increase the predictive salience of the actions by avoiding the repetition within blocks. In Experiment 1, breakthrough times were numerically shorter for congruent than incongruent pairings, but Bayesian analysis supported the null hypothesis of no influence from the sensorimotor predictions. In Experiment 2, reported conscious perception was significantly faster for congruent than for incongruent pairings. A meta-analytic Bayes factor combining the two experiments confirmed this effect. Altogether, we provide evidence for a key implication of the action-oriented predictive processing approach to conscious perception, namely that sensorimotor predictions shape our conscious experience of the world.
Collapse
Affiliation(s)
- Lina I Skora
- School of Psychology, University of Sussex, Pevensey Building, Falmer, Brighton BN1 9RH, UK
- Sackler Centre for Consciousness Science, University of Sussex, Falmer, Brighton, Brighton BN1 9RH, UK
| | - Anil K Seth
- Sackler Centre for Consciousness Science, University of Sussex, Falmer, Brighton, Brighton BN1 9RH, UK
- School of Engineering and Informatics, University of Sussex, Falmer, Brighton, Brighton BN1 9RH, UK
- Canadian Institute for Advanced Research, Program on Brain, Mind and Consciousness, 661 University Ave, Toronto, ON M5G 1M1, Canada
| | - Ryan B Scott
- School of Psychology, University of Sussex, Pevensey Building, Falmer, Brighton BN1 9RH, UK
- Sackler Centre for Consciousness Science, University of Sussex, Falmer, Brighton, Brighton BN1 9RH, UK
| |
Collapse
|
15
|
Jiang J, Wang SF, Guo W, Fernandez C, Wagner AD. Prefrontal reinstatement of contextual task demand is predicted by separable hippocampal patterns. Nat Commun 2020; 11:2053. [PMID: 32345979 PMCID: PMC7188806 DOI: 10.1038/s41467-020-15928-z] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2019] [Accepted: 04/01/2020] [Indexed: 11/10/2022] Open
Abstract
Goal-directed behavior requires the representation of a task-set that defines the task-relevance of stimuli and guides stimulus-action mappings. Past experience provides one source of knowledge about likely task demands in the present, with learning enabling future predictions about anticipated demands. We examine whether spatial contexts serve to cue retrieval of associated task demands (e.g., context A and B probabilistically cue retrieval of task demands X and Y, respectively), and the role of the hippocampus and dorsolateral prefrontal cortex (dlPFC) in mediating such retrieval. Using 3D virtual environments, we induce context-task demand probabilistic associations and find that learned associations affect goal-directed behavior. Concurrent fMRI data reveal that, upon entering a context, differences between hippocampal representations of contexts (i.e., neural pattern separability) predict proactive retrieval of the probabilistically dominant associated task demand, which is reinstated in dlPFC. These findings reveal how hippocampal-prefrontal interactions support memory-guided cognitive control and adaptive behavior. Spatial contexts are often predictive of the tasks to be performed in them (e.g., a kitchen predicts cooking). Here the authors show that the retrieval of task demand when encountering a spatial context depends on hippocampal-prefrontal interactions.
Collapse
Affiliation(s)
- Jiefeng Jiang
- Department of Psychology, Stanford University, Stanford, CA, 94305, USA.
| | - Shao-Fang Wang
- Department of Psychology, Stanford University, Stanford, CA, 94305, USA
| | - Wanjia Guo
- Psychology Department, University of Oregon, Eugene, OR, 97401, USA
| | - Corey Fernandez
- Neuroscience Program, Stanford University, Stanford, CA, 94305, USA
| | - Anthony D Wagner
- Department of Psychology, Stanford University, Stanford, CA, 94305, USA.,Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, 94305, USA
| |
Collapse
|