1
|
Mynick A, Steel A, Jayaraman A, Botch TL, Burrows A, Robertson CE. Memory-based predictions prime perceptual judgments across head turns in immersive, real-world scenes. Curr Biol 2025; 35:121-130.e6. [PMID: 39694030 DOI: 10.1016/j.cub.2024.11.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 07/23/2024] [Accepted: 11/14/2024] [Indexed: 12/20/2024]
Abstract
Each view of our environment captures only a subset of our immersive surroundings. Yet, our visual experience feels seamless. A puzzle for human neuroscience is to determine what cognitive mechanisms enable us to overcome our limited field of view and efficiently anticipate new views as we sample our visual surroundings. Here, we tested whether memory-based predictions of upcoming scene views facilitate efficient perceptual judgments across head turns. We tested this hypothesis using immersive, head-mounted virtual reality (VR). After learning a set of immersive real-world environments, participants (n = 101 across 4 experiments) were briefly primed with a single view from a studied environment and then turned left or right to make a perceptual judgment about an adjacent scene view. We found that participants' perceptual judgments were faster when they were primed with images from the same (vs. neutral or different) environments. Importantly, priming required memory: it only occurred in learned (vs. novel) environments, where the link between adjacent scene views was known. Further, consistent with a role in supporting active vision, priming only occurred in the direction of planned head turns and only benefited judgments for scene views presented in their learned spatiotopic positions. Taken together, we propose that memory-based predictions facilitate rapid perception across large-scale visual actions, such as head and body movements, and may be critical for efficient behavior in complex immersive environments.
Collapse
Affiliation(s)
- Anna Mynick
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA.
| | - Adam Steel
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA
| | - Adithi Jayaraman
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA
| | - Thomas L Botch
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA
| | - Allie Burrows
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA
| | - Caroline E Robertson
- Department of Psychological and Brain Sciences, Dartmouth College, 3 Maynard Street, Hanover, NH 03755, USA.
| |
Collapse
|
2
|
Terranova S, Botta A, Putzolu M, Bonassi G, Cosentino C, Mezzarobba S, Ravizzotti E, Pelosin E, Avanzino L. Cerebellar Direct Current Stimulation Reveals the Causal Role of the Cerebellum in Temporal Prediction. CEREBELLUM (LONDON, ENGLAND) 2024; 23:1386-1398. [PMID: 38147293 DOI: 10.1007/s12311-023-01649-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 12/08/2023] [Indexed: 12/27/2023]
Abstract
Temporal prediction (TP) influences our perception and cognition. The cerebellum could mediate this multi-level ability in a context-dependent manner. We tested whether a modulation of the cerebellar neural activity, induced by transcranial Direct Current Stimulation (tDCS), changed the TP ability according to the temporal features of the context and the duration of target interval. Fifteen healthy participants received anodal, cathodal, and sham tDCS (15 min × 2 mA intensity) over the right cerebellar hemisphere during a TP task. We recorded reaction times (RTs) to a target during the task in two contextual conditions of temporal anticipation: rhythmic (i.e., interstimulus intervals (ISIs) were constant) and single-interval condition (i.e., the estimation of the timing of the target was based on the prior exposure of the train of stimuli). Two ISIs durations were explored: 600 ms (short trials) and 900 ms (long trials). Cathodal tDCS improved the performance during the TP task (shorter RTs) specifically in the rhythmic condition only for the short trials and in the single-interval condition only for the long trials. Our results suggest that the inhibition of cerebellar activity induced a different improvement in the TP ability according to the temporal features of the context. In the rhythmic context, the cerebellum could integrate the temporal estimation with the anticipatory motor responses critically for the short target interval. In the single-interval context, for the long trials, the cerebellum could play a main role in integrating representation of time interval in memory with the elapsed time providing an accurate temporal prediction.
Collapse
Affiliation(s)
- Sara Terranova
- Department of Experimental Medicine, Section of Human Physiology, University of Genoa, 16132, Genoa, Italy
| | | | - Martina Putzolu
- Department of Experimental Medicine, Section of Human Physiology, University of Genoa, 16132, Genoa, Italy
| | - Gaia Bonassi
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Largo Paolo Daneo 3, 16132, Genoa, Italy
| | - Carola Cosentino
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Largo Paolo Daneo 3, 16132, Genoa, Italy
| | - Susanna Mezzarobba
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Largo Paolo Daneo 3, 16132, Genoa, Italy
| | - Elisa Ravizzotti
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Largo Paolo Daneo 3, 16132, Genoa, Italy
| | - Elisa Pelosin
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy.
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genoa, Largo Paolo Daneo 3, 16132, Genoa, Italy.
| | - Laura Avanzino
- Department of Experimental Medicine, Section of Human Physiology, University of Genoa, 16132, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| |
Collapse
|
3
|
Marrero K, Aruljothi K, Delgadillo C, Kabbara S, Swatch L, Zagha E. Goal-Directed Learning is Multidimensional and Accompanied by Diverse and Widespread Changes in Neocortical Signaling. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.02.13.528412. [PMID: 36824924 PMCID: PMC9948952 DOI: 10.1101/2023.02.13.528412] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/17/2023]
Abstract
New tasks are often learned in stages with each stage reflecting a different learning challenge. Accordingly, each learning stage is likely mediated by distinct neuronal processes. And yet, most rodent studies of the neuronal correlates of goal-directed learning focus on individual outcome measures and individual brain regions. Here, we longitudinally studied mice from naïve to expert performance in a head-fixed, operant conditioning whisker discrimination task. In addition to tracking the primary behavioral outcome of stimulus discrimination, we tracked and compared an array of object-based and temporal-based behavioral measures. These behavioral analyses identify multiple, partially overlapping learning stages in this task, consistent with initial response implementation, early stimulus-response generalization, and late response inhibition. To begin to understand the neuronal foundations of these learning processes, we performed widefield Ca2+ imaging of dorsal neocortex throughout learning and correlated behavioral measures with neuronal activity. We found distinct and widespread correlations between neocortical activation patterns and various behavioral measures. For example, improvements in sensory discrimination correlated with target stimulus evoked activations of licking-related cortices along with distractor stimulus evoked global cortical suppression. Our study reveals multidimensional learning for a simple goal-directed learning task and generates hypotheses for the neuronal modulations underlying these various learning processes.
Collapse
Affiliation(s)
- Krista Marrero
- Neuroscience Graduate Program, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| | - Krithiga Aruljothi
- Department of Psychology, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| | - Christian Delgadillo
- Division of Biomedical Sciences, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| | - Sarah Kabbara
- Neuroscience Graduate Program, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| | - Lovleen Swatch
- College of Natural & Agricultural Sciences, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| | - Edward Zagha
- Neuroscience Graduate Program, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
- Department of Psychology, University of California, Riverside 900 University Avenue, Riverside CA 92521 USA
| |
Collapse
|
4
|
Ten Oever S, Martin AE. Interdependence of "What" and "When" in the Brain. J Cogn Neurosci 2024; 36:167-186. [PMID: 37847823 DOI: 10.1162/jocn_a_02067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2023]
Abstract
From a brain's-eye-view, when a stimulus occurs and what it is are interrelated aspects of interpreting the perceptual world. Yet in practice, the putative perceptual inferences about sensory content and timing are often dichotomized and not investigated as an integrated process. We here argue that neural temporal dynamics can influence what is perceived, and in turn, stimulus content can influence the time at which perception is achieved. This computational principle results from the highly interdependent relationship of what and when in the environment. Both brain processes and perceptual events display strong temporal variability that is not always modeled; we argue that understanding-and, minimally, modeling-this temporal variability is key for theories of how the brain generates unified and consistent neural representations and that we ignore temporal variability in our analysis practice at the peril of both data interpretation and theory-building. Here, we review what and when interactions in the brain, demonstrate via simulations how temporal variability can result in misguided interpretations and conclusions, and outline how to integrate and synthesize what and when in theories and models of brain computation.
Collapse
Affiliation(s)
- Sanne Ten Oever
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Centre for Cognitive Neuroimaging, Nijmegen, The Netherlands
- Maastricht University, The Netherlands
| | - Andrea E Martin
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Centre for Cognitive Neuroimaging, Nijmegen, The Netherlands
| |
Collapse
|
5
|
Ezzedini S, Ben Jebara S, Abidi M, de Marco G. Influence of Mental Training of Attentional Control on Autonomic Arousal Within the Framework of the Temporal Preparation of a Force Task. Cogn Sci 2023; 47:e13391. [PMID: 38043098 DOI: 10.1111/cogs.13391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Revised: 09/11/2023] [Accepted: 11/21/2023] [Indexed: 12/05/2023]
Abstract
While temporal preparation has frequently been examined through the manipulation of foreperiods, the role of force level during temporal preparation remains underexplored. In our study, we propose to manipulate mental training of attentional control in order to shed light on the role of the force level and autonomic nervous system in the temporal preparation of an action. Forty subjects, divided into mental training group (n = 20) and without mental training group (n = 20), participated in this study. The influence of the attentional control and force levels on the autonomic nervous system were measured using the skin conductance response and the heart rate variability; the accuracy of the motor responses was measured using a method derived from machine learning. Behaviorally, only the mental training group reinforced its motor and attentional control. When using short foreperiod durations and high force level, motor and attentional control decreased, consistent with the dominant sympathetic system. This resulted in an increased anticipation rate of responses with a higher reaction time compared to the long foreperiods duration and low force level, in which the reaction time significantly decreased, with enhancement of the expected force level, showing consistency with the dominant parasympathetic system. Interestingly, results revealed a predictive relationship between the sympathovagal balance and motor and attentional control during the long foreperiods and low force level. Finally, results demonstrate that attentional mental training leads to the reinforcement of interactions between the autonomic nervous system and attentional processes which are involved in the temporal preparation of a force task.
Collapse
Affiliation(s)
| | - Sofia Ben Jebara
- Carthage University, Higher School of Communications of Tunis COSIM Laboratory, Tunisia
| | - Malek Abidi
- Laboratory LINP2, UPL, Paris Nanterre University
- COMUE Paris Lumières University
| | - Giovanni de Marco
- Laboratory LINP2, UPL, Paris Nanterre University
- COMUE Paris Lumières University
| |
Collapse
|
6
|
Buonomano DV, Buzsáki G, Davachi L, Nobre AC. Time for Memories. J Neurosci 2023; 43:7565-7574. [PMID: 37940593 PMCID: PMC10634580 DOI: 10.1523/jneurosci.1430-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/22/2023] [Accepted: 08/25/2023] [Indexed: 11/10/2023] Open
Abstract
The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.
Collapse
Affiliation(s)
- Dean V Buonomano
- Department of Neurobiology, University of California, Los Angeles, California 90095
- Department of Psychology, University of California, Los Angeles, Los Angeles, California 90095
- Integrative Center for Learning and Memory, UCLA, Los Angeles, California 90025
| | - György Buzsáki
- Neuroscience Institute and Department of Neurology, NYU Grossman School of Medicine, New York University, New York, New York 10016
- Center for Neural Science, New York University, New York, New York 10003
| | - Lila Davachi
- Department of Psychology, Columbia University, New York, New York 10027
- Center for Clinical Research, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York 10962
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
- Department of Psychology, Yale University, New Haven, Connecticut 06510
- Wu Tsai Center for Neurocognition and Behavior, Wu Tsai Institute, Yale University, New Haven, Connecticut 06510
| |
Collapse
|
7
|
Nandi B, Ostrand A, Johnson V, Ford TJ, Gazzaley A, Zanto TP. Musical Training Facilitates Exogenous Temporal Attention via Delta Phase Entrainment within a Sensorimotor Network. J Neurosci 2023; 43:3365-3378. [PMID: 36977585 PMCID: PMC10162458 DOI: 10.1523/jneurosci.0220-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2022] [Revised: 01/24/2023] [Accepted: 01/28/2023] [Indexed: 03/30/2023] Open
Abstract
Temporal orienting of attention plays an important role in our day-to-day lives and can use timing information from exogenous or endogenous sources. Yet, it is unclear what neural mechanisms give rise to temporal attention, and it is debated whether both exogenous and endogenous forms of temporal attention share a common neural source. Here, older adult nonmusicians (N = 47, 24 female) were randomized to undergo 8 weeks of either rhythm training, which places demands on exogenous temporal attention, or word search training as a control. The goal was to assess (1) the neural basis of exogenous temporal attention and (2) whether training-induced improvements in exogenous temporal attention can transfer to enhanced endogenous temporal attention abilities, thereby providing support for a common neural mechanism of temporal attention. Before and after training, exogenous temporal attention was assessed using a rhythmic synchronization paradigm, whereas endogenous temporal attention was evaluated via a temporally cued visual discrimination task. Results showed that rhythm training improved performance on the exogenous temporal attention task, which was associated with increased intertrial coherence within the δ (1-4 Hz) band as assessed by EEG recordings. Source localization revealed increased δ-band intertrial coherence arose from a sensorimotor network, including premotor cortex, anterior cingulate cortex, postcentral gyrus, and the inferior parietal lobule. Despite these improvements in exogenous temporal attention, such benefits were not transferred to endogenous attentional ability. These results support the notion that exogenous and endogenous temporal attention uses independent neural sources, with exogenous temporal attention relying on the precise timing of δ band oscillations within a sensorimotor network.SIGNIFICANCE STATEMENT Allocating attention to specific points in time is known as temporal attention, and may arise from external (exogenous) or internal (endogenous) sources. Despite its importance to our daily lives, it is unclear how the brain gives rise to temporal attention and whether exogenous- or endogenous-based sources for temporal attention rely on shared brain regions. Here, we demonstrate that musical rhythm training improves exogenous temporal attention, which was associated with more consistent timing of neural activity in sensory and motor processing brain regions. However, these benefits did not extend to endogenous temporal attention, indicating that temporal attention relies on different brain regions depending on the source of timing information.
Collapse
Affiliation(s)
- Bijurika Nandi
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
| | - Avery Ostrand
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
| | - Vinith Johnson
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
| | - Tiffany J Ford
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
| | - Adam Gazzaley
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
- Departments of Physiology and Psychiatry, University of California-San Francisco, San Francisco, California 94158
| | - Theodore P Zanto
- Department of Neurology, University of California-San Francisco, San Francisco, California 94158
- Neuroscape, University of California-San Francisco, San Francisco, California 94158
| |
Collapse
|
8
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
9
|
Dissociating Hippocampal and Cortical Contributions to Predictive Processing. J Neurosci 2023; 43:184-186. [PMID: 36646458 PMCID: PMC9838692 DOI: 10.1523/jneurosci.1840-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Revised: 11/07/2022] [Accepted: 11/11/2022] [Indexed: 01/13/2023] Open
|
10
|
Chen FW, Li CH, Kuo BC. Temporal expectation based on the duration variability modulates alpha oscillations during working memory retention. Neuroimage 2023; 265:119789. [PMID: 36481414 DOI: 10.1016/j.neuroimage.2022.119789] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Revised: 11/22/2022] [Accepted: 12/03/2022] [Indexed: 12/12/2022] Open
Abstract
While maintaining information over a delay of time, working memory (WM) also allows individuals to prepare the mnemonic contents for prospective utilisation. However, it remains unclear whether the expectation of the time of WM test could modulate neural responses during the retention interval of WM and subsequent performance. Here, we investigated whether temporal expectations based on the variability of delay duration can modulate 9-13 Hz alpha oscillations during WM retention and whether the expectation-induced alpha activity was associated with WM performance. Participants performed a retro-cueing WM task with magnetoencephalography (MEG) (Experiment 1) and a standard WM task with electroencephalography (EEG) (Experiment 2). The expectation of the timing of the WM test was manipulated by the temporal structure of the tasks with small or large variability in the delay durations. We showed that alpha oscillations during retention interval and WM performance varied with duration variability in both of the MEG and EEG experiments. The novel finding was greater alpha-power attenuation over the left frontal and parietal regions during WM retention when the duration variability was small and the test onset was predictable, compared to when the duration variability was large and the test onset was less predictable. Importantly, we observed a positive relationship in variability difference between the response benefit and alpha-power attenuation in the left posterior parietal regions at both MEG-source and EEG-electrode levels. Finally, we confirmed the behavioural benefit when a condition with a fixed delay-duration was included in a behavioural experiment (Experiment 3). When conjoined, the delay duration enables individuals to anticipate when the relevant information would be put to work, and alpha oscillations track the anticipatory states during WM maintenance.
Collapse
Affiliation(s)
- Fang-Wen Chen
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan
| | - Chun-Hui Li
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan
| | - Bo-Cheng Kuo
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan.
| |
Collapse
|
11
|
Chinoy RB, Tanwar A, Buonomano DV. A Recurrent Neural Network Model Accounts for Both Timing and Working Memory Components of an Interval Discrimination Task. TIMING & TIME PERCEPTION 2022. [DOI: 10.1163/22134468-bja10058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Abstract
Interval discrimination is of fundamental importance to many forms of sensory processing, including speech and music. Standard interval discrimination tasks require comparing two intervals separated in time, and thus include both working memory (WM) and timing components. Models of interval discrimination invoke separate circuits for the timing and WM components. Here we examine if, in principle, the same recurrent neural network can implement both. Using human psychophysics, we first explored the role of the WM component by varying the interstimulus delay. Consistent with previous studies, discrimination was significantly worse for a 250 ms delay, compared to 750 and 1500 ms delays, suggesting that the first interval is stably stored in WM for longer delays. We next successfully trained a recurrent neural network (RNN) on the task, demonstrating that the same network can implement both the timing and WM components. Many units in the RNN were tuned to specific intervals during the sensory epoch, and others encoded the first interval during the delay period. Overall, the encoding strategy was consistent with the notion of mixed selectivity. Units generally encoded more interval information during the sensory epoch than in the delay period, reflecting categorical encoding of short versus long in WM, rather than encoding of the specific interval. Our results demonstrate that, in contrast to standard models of interval discrimination that invoke a separate memory module, the same network can, in principle, solve the timing, WM, and comparison components of an interval discrimination task.
Collapse
Affiliation(s)
- Rehan B. Chinoy
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| | - Ashita Tanwar
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| | - Dean V. Buonomano
- Departments of Neurobiology and Psychology, Brain Research Institute, and Integrative Center for Learning and Memory, University of California, Los Angeles, CA 90095–1763, USA
| |
Collapse
|
12
|
Foerster FR, Chidharom M, Bonnefond A, Giersch A. Neurocognitive analyses reveal that video game players exhibit enhanced implicit temporal processing. Commun Biol 2022; 5:1082. [PMID: 36221032 PMCID: PMC9553938 DOI: 10.1038/s42003-022-04033-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 09/26/2022] [Indexed: 11/25/2022] Open
Abstract
Winning in action video games requires to predict timed events in order to react fast enough. In these games, repeated waiting for enemies may help to develop implicit (incidental) preparation mechanisms. We compared action video game players and non-video game players in a reaction time task involving both implicit time preparations and explicit (conscious) temporal attention cues. Participants were immersed in virtual reality and instructed to respond to a visual target appearing at variable delays after a warning signal. In half of the trials, an explicit cue indicated when the target would occur after the warning signal. Behavioral, oculomotor and EEG data consistently indicate that, compared with non-video game players, video game players better prepare in time using implicit mechanisms. This sheds light on the neglected role of implicit timing and related electrophysiological mechanisms in gaming research. The results further suggest that game-based interventions may help remediate implicit timing disorders found in psychiatric populations.
Collapse
Affiliation(s)
- Francois R Foerster
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France.
| | - Matthieu Chidharom
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
- Department of Psychology, Lehigh University, Bethlehem, PA, USA
| | - Anne Bonnefond
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
| | - Anne Giersch
- Université de Strasbourg, INSERM U1114, Pôle de Psychiatrie, Centre Hospitalier Régional Universitaire de Strasbourg, Strasbourg, France
| |
Collapse
|
13
|
Consequences of predictable temporal structure in multi-task situations. Cognition 2022; 225:105156. [DOI: 10.1016/j.cognition.2022.105156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 04/26/2022] [Accepted: 04/28/2022] [Indexed: 11/21/2022]
|
14
|
Jones A, Ward EV, Csiszer EL, Szymczak J. Temporal Expectation Improves Recognition Memory for Spatially Attended Objects. J Cogn Neurosci 2022; 34:1616-1629. [PMID: 35604350 DOI: 10.1162/jocn_a_01872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Recent evidence suggests that temporal expectation is beneficial to memory formation. Rhythmic presentation of stimuli during encoding enhances subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, no prior study has examined how temporal expectation interacts with another important form of facilitation-spatial attention-to affect memory. This study systematically manipulated temporal expectation and spatial attention during encoding to examine their combined effect on behavioral recognition and associated ERPs. Participants performed eight experimental blocks consisting of an encoding phase and recognition test, with EEG recorded throughout. During encoding, pairs of objects and checkerboards were presented and participants were cued to attend to the left or right stream and detect targets as quickly as possible. In four blocks, stimulus presentation followed a rhythmic (constant, predictable) temporal structure, and in the other four blocks, stimulus onset was arrhythmic (random, unpredictable). An interaction between temporal expectation and spatial attention emerged, with greater recognition in the rhythmic than the arrhythmic condition for spatially attended items. Analysis of memory-specific ERP components uncovered effects of spatial attention. There were late positive component and FN400 old/new effects in the attended condition for both rhythmic and arrhythmic items, whereas in the unattended condition, there was an FN400 old/new effect and no late positive component effect. The study provides new evidence that memory improvement as a function of temporal expectation is dependent upon spatial attention.
Collapse
Affiliation(s)
| | - Emma V Ward
- Middlesex University, London, United Kingdom
| | | | | |
Collapse
|
15
|
Gresch D, Boettcher SEP, van Ede F, Nobre AC. Shielding working-memory representations from temporally predictable external interference. Cognition 2021; 217:104915. [PMID: 34600356 PMCID: PMC8543071 DOI: 10.1016/j.cognition.2021.104915] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2021] [Revised: 09/01/2021] [Accepted: 09/21/2021] [Indexed: 12/15/2022]
Abstract
Protecting working-memory content from distracting external sensory inputs and intervening tasks is an ubiquitous demand in daily life. Here, we ask whether and how temporal expectations about external events can help mitigate effects of such interference during working-memory retention. We manipulated the temporal predictability of interfering items that occurred during the retention period of a visual working-memory task and report that temporal expectations reduce the detrimental influence of external interference on subsequent memory performance. Moreover, to determine if the protective effects of temporal expectations rely on distractor suppression or involve shielding of internal representations, we compared effects after irrelevant distractors that could be ignored vs. interrupters that required a response. Whereas distractor suppression may be sufficient to confer protection from predictable distractors, any benefits after interruption are likely to involve memory shielding. We found similar benefits of temporal expectations after both types of interference. We conclude that temporal expectations may play an important role in safeguarding behaviour based on working memory - acting through mechanisms that include the shielding of internal content from external interference.
Collapse
Affiliation(s)
- Daniela Gresch
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, The Netherlands
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
16
|
Abstract
There is growing appreciation for the role of long-term memory in guiding temporal preparation in speeded reaction time tasks. In experiments with variable foreperiods between a warning stimulus (S1) and a target stimulus (S2), preparation is affected by foreperiod distributions experienced in the past, long after the distribution has changed. These effects from memory can shape preparation largely implicitly, outside of participants' awareness. Recent studies have demonstrated the associative nature of memory-guided preparation. When distinct S1s predict different foreperiods, they can trigger differential preparation accordingly. Here, we propose that memory-guided preparation allows for another key feature of learning: the ability to generalize across acquired associations and apply them to novel situations. Participants completed a variable foreperiod task where S1 was a unique image of either a face or a scene on each trial. Images of either category were paired with different distributions with predominantly shorter versus predominantly longer foreperiods. Participants displayed differential preparation to never-before seen images of either category, without being aware of the predictive nature of these categories. They continued doing so in a subsequent Transfer phase, after they had been informed that these contingencies no longer held. A novel rolling regression analysis revealed at a fine timescale how category-guided preparation gradually developed throughout the task, and that explicit information about these contingencies only briefly disrupted memory-guided preparation. These results offer new insights into temporal preparation as the product of a largely implicit process governed by associative learning from past experiences.
Collapse
|
17
|
Abstract
We tend to mentally segment a series of events according to perceptual contextual changes, such that items from a shared context are more strongly associated in memory than items from different contexts. It is also known that timing context provides a scaffold to structure experiences in memory, but its role in event segmentation has not been investigated. We adapted a previous paradigm, which was used to investigate event segmentation using visual contexts, to study the effects of changes in timing contexts on event segmentation in associative memory. In two experiments, we presented lists of 36 items in which the interstimulus intervals (ISIs) changed after a series of six items ranging between 0.5 and 4 s in 0.5 s steps. After each list, participants judged which one of two test items were shown first (temporal order judgment) for items that were either drawn from the same context (within an ISI) or from consecutive contexts (across ISIs). Further, participants judged from memory whether the ISI associated to an item lasted longer than a standard interval (2.25 s) that was not previously shown (temporal source memory). Experiment 2 further included a time-item encoding task. Results revealed an effect of timing context changes in temporal order judgments, with faster responses (Experiment 1) or higher accuracy (Experiment 2) when items were drawn from the same context, as opposed to items drawn from across contexts. Further, in both experiments, we found that participants were well able to provide temporal source memory judgments based on recalled durations. Finally, replicated across experiments, we found subjective duration bias, as estimated by psychometric curve fitting parameters of the recalled durations, correlated negatively with within-context temporal order judgments. These findings show that changes in timing context support event segmentation in associative memory.
Collapse
|
18
|
Sosa JLR, Buonomano D, Izquierdo A. The orbitofrontal cortex in temporal cognition. Behav Neurosci 2021; 135:154-164. [PMID: 34060872 DOI: 10.1037/bne0000430] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
One of the most important factors in decision-making is estimating the value of available options. Subregions of the prefrontal cortex, including the orbitofrontal cortex (OFC), have been deemed essential for this process. Value computations require a complex integration across numerous dimensions, including, reward magnitude, effort, internal state, and time. The importance of the temporal dimension is well illustrated by temporal discounting tasks, in which subjects select between smaller-sooner versus larger-later rewards. The specific role of OFC in telling time and integrating temporal information into decision-making remains unclear. Based on the current literature, in this review we reevaluate current theories of OFC function, accounting for the influence of time. Incorporating temporal information into value estimation and decision-making requires distinct, yet interrelated, forms of temporal information including the ability to tell time, represent time, create temporal expectations, and the ability to use this information for optimal decision-making in a wide range of tasks, including temporal discounting and wagering. We use the term "temporal cognition" to refer to the integrated use of these different aspects of temporal information. We suggest that the OFC may be a critical site for the integration of reward magnitude and delay, and thus important for temporal cognition. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
Affiliation(s)
| | - Dean Buonomano
- Department of Psychology, University of California-Los Angeles
| | | |
Collapse
|
19
|
Los SA, Nieuwenstein J, Bouharab A, Stephens DJ, Meeter M, Kruijne W. The warning stimulus as retrieval cue: The role of associative memory in temporal preparation. Cogn Psychol 2021; 125:101378. [PMID: 33524889 DOI: 10.1016/j.cogpsych.2021.101378] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2019] [Revised: 01/04/2021] [Accepted: 01/16/2021] [Indexed: 10/22/2022]
Abstract
In a warned reaction time task, the warning stimulus (S1) initiates a process of temporal preparation, which promotes a speeded response to the impending target stimulus (S2). According to the multiple trace theory of temporal preparation (MTP), participants learn the timing of S2 by storing a memory trace on each trial, which contains a temporal profile of the events on that trial. On each new trial, S1 serves as a retrieval cue that implicitly and associatively activates memory traces created on earlier trials, which jointly drive temporal preparation for S2. The idea that S1 assumes this role as a retrieval cue was tested across eight experiments, in which two different S1s were associated with two different distributions of S1-S2 intervals: one with predominantly short and one with predominantly long intervals. Experiments differed regarding the S1 features that made up a pair, ranging from highly distinct (e.g., tone and flash) to more similar (e.g., red and green flash) and verbal (i.e., "short" vs "long"). Exclusively for pairs of highly distinct S1s, the results showed that the S1 cue modified temporal preparation, even in participants who showed no awareness of the contingency. This cueing effect persisted in a subsequent transfer phase, in which the contingency between S1 and the timing of S2 was broken - a fact participants were informed of in advance. Together, these findings support the role of S1 as an implicit retrieval cue, consistent with MTP.
Collapse
|
20
|
Jin W, Nobre AC, van Ede F. Temporal Expectations Prepare Visual Working Memory for Behavior. J Cogn Neurosci 2020; 32:2320-2332. [PMID: 32897120 PMCID: PMC8357348 DOI: 10.1162/jocn_a_01626] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.
Collapse
Affiliation(s)
- Wen Jin
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,University of Oxford
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,University of Oxford
| | - Freek van Ede
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam
| |
Collapse
|
21
|
van de Ven V, Lee C, Lifanov J, Kochs S, Jansma H, De Weerd P. Hippocampal-striatal functional connectivity supports processing of temporal expectations from associative memory. Hippocampus 2020; 30:926-937. [PMID: 32275344 PMCID: PMC7496232 DOI: 10.1002/hipo.23205] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2019] [Revised: 03/14/2020] [Accepted: 03/20/2020] [Indexed: 12/02/2022]
Abstract
The hippocampus and dorsal striatum are both associated with temporal processing, but they are thought to play distinct roles. The hippocampus has been reported to contribute to storing temporal structure of events in memory, whereas the striatum contributes to temporal motor preparation and reward anticipation. Here, we asked whether the striatum cooperates with the hippocampus in processing the temporal context of memorized visual associations. In our task, participants were trained to implicitly form temporal expectations for one of two possible time intervals associated to specific cue-target associations, and subsequently were scanned using ultra-high-field 7T functional magnetic resonance imaging. During scanning, learned temporal expectations could be violated when the pairs were presented at either the associated or not-associated time intervals. When temporal expectations were met during testing trials, activity in left and right hippocampal subfields and right putamen decreased, compared to when temporal expectations were not met. Further, psycho-physiological interactions showed that functional connectivity between left hippocampal subfields and caudate decreased when temporal expectations were not met. Our results indicate that the hippocampus and striatum cooperate to process implicit temporal expectation from mnemonic associations. Our findings provide further support for a hippocampal-striatal network in temporal associative processing.
Collapse
Affiliation(s)
- Vincent van de Ven
- Department of Cognitive Neuroscience, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| | - Chanju Lee
- Department of Cognitive Neuroscience, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| | | | - Sarah Kochs
- Department of Cognitive Neuroscience, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| | - Henk Jansma
- Department of Cognitive Neuroscience, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| | - Peter De Weerd
- Department of Cognitive Neuroscience, Faculty of Psychology and NeuroscienceMaastricht UniversityMaastrichtThe Netherlands
| |
Collapse
|
22
|
Boettcher SEP, Stokes MG, Nobre AC, van Ede F. One Thing Leads to Another: Anticipating Visual Object Identity Based on Associative-Memory Templates. J Neurosci 2020; 40:4010-4020. [PMID: 32284338 PMCID: PMC7219293 DOI: 10.1523/jneurosci.2751-19.2020] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Revised: 02/19/2020] [Accepted: 03/09/2020] [Indexed: 11/21/2022] Open
Abstract
Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. A great deal of work has examined the behavioral consequences and human electrophysiological substrates of anticipation following probabilistic memory cues that carry spatial or temporal information to guide perception. However, less is understood about the electrophysiological substrates linked to anticipating the sensory content of events based on recurring associations between successive events. Here, we demonstrate behavioral and electrophysiological signatures of using associative-memory templates to guide perception, while equating spatial and temporal anticipation (experiments 1 and 2), as well as target probability and response demands (experiment 2). By recording the electroencephalogram in the two experiments (N = 55; 24 females), we show that two markers in human electrophysiology implicated in spatial and temporal anticipation also contribute to the anticipation of perceptual identity, as follows: attenuation of alpha-band oscillations and the contingent negative variation (CNV). Together, our results show that memory-guided identity templates proactively impact perception and are associated with anticipatory states of attenuated alpha oscillations and the CNV. Furthermore, by isolating object-identity anticipation from spatial and temporal anticipation, our results suggest a role for alpha attenuation and the CNV in specific visual content anticipation beyond general changes in neural excitability or readiness.SIGNIFICANCE STATEMENT Probabilistic associations between stimuli afford memory templates that guide perception through proactive anticipatory mechanisms. The current work isolates the behavioral benefits and electrophysiological signatures of memory-guided identity-based anticipation, while equating anticipation of space, time, motor responses, and task relevance. Our results show that anticipation of the specific identity of a forthcoming percept impacts performance and is associated with states of attenuated alpha oscillations and the contingent negative variation, extending previous work implicating these neural substrates in spatial and temporal preparatory attention. Together, this work bridges fields of attention, memory, and perception, providing new insights into the neural mechanisms that support complex attentional templates.
Collapse
Affiliation(s)
- Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Mark G Stokes
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Freek van Ede
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| |
Collapse
|
23
|
Zhang Q, Li Y, Zhao W, Chen X, Li X, Du B, Deng X, Ji F, Wang C, Xiang YT, Dong Q, Jaeggi SM, Chen C, Song Y, Li J. ERP evidence for the effect of working memory span training on working memory maintenance: A randomized controlled trial. Neurobiol Learn Mem 2019; 167:107129. [PMID: 31783127 DOI: 10.1016/j.nlm.2019.107129] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Revised: 11/05/2019] [Accepted: 11/23/2019] [Indexed: 11/30/2022]
Abstract
There is a lot of debate in the literature with regards to whether the effects of working memory span training generalize to working memory tasks that are different from the trained task, however, there is little evidence to date supporting this idea. The present randomized controlled trial included 80 undergraduate students who were randomly assigned to either the experimental group (N = 40) or the control group (N = 40) in order to receive a working memory span intervention for 20 sessions over the course of 4 weeks. Brain electrophysiological signals during a dot pattern expectancy (DPX) task and a change detection task were recorded both before and after the intervention. The amplitudes of characteristic event-related potential (ERP) components reflecting working memory maintenance capability during the delay period of both tasks (i.e., the contingent negative variation or CNV, derived from the DPX task, and the contralateral delay activity or CDA, derived from the change detection task) were used as the primary outcome measures. Our data indicated that the intervention resulted in specific changes in both, the CNV and the CDA, suggesting that working memory span training generalized to working memory maintenance processes as observed in working memory tasks that were different from the trained task. We conclude that working memory span training might serve as a useful tool to improve working memory maintenance capability. Trial Registration: Chinese Clinical Trial Registry (chiCTR-INR-17011728).
Collapse
Affiliation(s)
- Qiumei Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China; School of Mental Health, Jining Medical University, 45# Jianshe South Road, Jining 272013, Shandong Province, PR China
| | - Yang Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Wan Zhao
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Xiongying Chen
- The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders & the Advanced Innovation Center for Human Brain Protection, Beijing Anding Hospital, School of Mental Health, Capital Medical University, Beijing 100088, PR China
| | - Xiaohong Li
- The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders & the Advanced Innovation Center for Human Brain Protection, Beijing Anding Hospital, School of Mental Health, Capital Medical University, Beijing 100088, PR China
| | - Boqi Du
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Xiaoxiang Deng
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Feng Ji
- School of Mental Health, Jining Medical University, 45# Jianshe South Road, Jining 272013, Shandong Province, PR China
| | - Chuanyue Wang
- The National Clinical Research Center for Mental Disorders & Beijing Key Laboratory of Mental Disorders & the Advanced Innovation Center for Human Brain Protection, Beijing Anding Hospital, School of Mental Health, Capital Medical University, Beijing 100088, PR China
| | - Yu-Tao Xiang
- Faculty of Health Sciences, University of Macau, Avenida da Universidade, Taipa 999078, Macau
| | - Qi Dong
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Susanne M Jaeggi
- School of Education & Department for Cognitive Sciences, University of California, Irvine, CA 92697, United States
| | - Chuansheng Chen
- Department of Psychological Science, University of California, Irvine, CA 92697, United States
| | - Yan Song
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China
| | - Jun Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, PR China.
| |
Collapse
|
24
|
Nobre AC, Stokes MG. Premembering Experience: A Hierarchy of Time-Scales for Proactive Attention. Neuron 2019; 104:132-146. [PMID: 31600510 PMCID: PMC6873797 DOI: 10.1016/j.neuron.2019.08.030] [Citation(s) in RCA: 71] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2019] [Revised: 08/07/2019] [Accepted: 08/20/2019] [Indexed: 12/30/2022]
Abstract
Memories are about the past, but they serve the future. Memory research often emphasizes the former aspect: focusing on the functions that re-constitute (re-member) experience and elucidating the various types of memories and their interrelations, timescales, and neural bases. Here we highlight the prospective nature of memory in guiding selective attention, focusing on functions that use previous experience to anticipate the relevant events about to unfold-to "premember" experience. Memories of various types and timescales play a fundamental role in guiding perception and performance adaptively, proactively, and dynamically. Consonant with this perspective, memories are often recorded according to expected future demands. Using working memory as an example, we consider how mnemonic content is selected and represented for future use. This perspective moves away from the traditional representational account of memory toward a functional account in which forward-looking memory traces are informationally and computationally tuned for interacting with incoming sensory signals to guide adaptive behavior.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Mark G Stokes
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK
| |
Collapse
|
25
|
Panayiotou G, Panteli M, Vlemincx E. Adaptive and maladaptive emotion processing and regulation, and the case of alexithymia. Cogn Emot 2019; 35:488-499. [PMID: 31556808 DOI: 10.1080/02699931.2019.1671322] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
In this conceptual review, we discuss models of emotion and its regulation and identify a spectrum of processes that characterise adaptive adjustment to the affective environment. We describe a dynamic-phasic model of emotion processing and regulation, focusing on five stages: anticipation, response, recovery, habituation and rest as part of a cascade of responses to emotional challenges, as these become progressively expected, proximal, chronic or repeated. We argue for the need to investigate beyond simple reactivity to emotional stimuli, in order to understand mental and physical health conditions where emotional dysregulation plays a role. We propose that a hallmark of an effective and adaptive emotion regulation system is its flexibility, in the service of life goals and values. Consistent with McEwen's model (1998, Stress, adaptation, and disease: Allostasis and allostatic load. Annals of the New York Academy of Sciences, 840(1), 33-44), inflexible emotion regulation can lead to increased allostatic load, from frequent stress, inadequate reactivity, failed shutdown and habituation, which may result in physical and mental illness. Alexithymia exemplifies inflexible emotion regulation, with dysfunctions potentially across all stages of emotion processing, both psychologically and physiologically. These maladaptive processes and their consequence on allostatic load potentially explain the association between alexithymia and physical and mental illness.
Collapse
Affiliation(s)
- Georgia Panayiotou
- Department of Psychology and Center for Applied Neuroscience, University of Cyprus, Nicosia, Cyprus
| | - Maria Panteli
- Department of Psychology and Center for Applied Neuroscience, University of Cyprus, Nicosia, Cyprus
| | - Elke Vlemincx
- School of Biological and Chemical Sciences, Department of Biological and Experimental Psychology, Queen Mary University of London, London, UK
| |
Collapse
|
26
|
Johndro H, Jacobs L, Patel AD, Race E. Temporal predictions provided by musical rhythm influence visual memory encoding. Acta Psychol (Amst) 2019; 200:102923. [PMID: 31759191 DOI: 10.1016/j.actpsy.2019.102923] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 06/14/2019] [Accepted: 08/14/2019] [Indexed: 11/18/2022] Open
Abstract
Selective attention plays a key role in determining what aspects of our environment are encoded into long-term memory. Auditory rhythms with a regular beat provide temporal expectations that entrain attention and facilitate perception of visual stimuli aligned with the beat. The current study investigated whether entrainment to background auditory rhythms also facilitates higher-level cognitive functions such as episodic memory. In a series of experiments, we manipulated temporal attention through the use of rhythmic, instrumental music. In Experiment 1A and 1B, we found that background musical rhythm influenced the encoding of visual targets into memory, evident in enhanced subsequent memory for targets that appeared in-synchrony compared to out-of-synchrony with the background beat. Response times at encoding did not differ for in-synchrony compared to out-of-synchrony stimuli, suggesting that the rhythmic modulation of memory does not simply reflect rhythmic effects on perception and action. Experiment 2 investigated whether rhythmic effects on response times emerge when task procedures more closely match prior studies that have demonstrated significant auditory entrainment effects. Responses were faster for in-synchrony compared to out-of-synchrony stimuli when participants performed a more perceptually-oriented task that did not contain intervening recognition memory tests, suggesting that rhythmic effects on perception and action depend on the nature of the task demands. Together, these results support the hypothesis that rhythmic temporal regularities provided by background music can entrain attention and influence the encoding of visual stimuli into memory.
Collapse
Affiliation(s)
| | | | - Aniruddh D Patel
- Tufts University, United States of America; Azrieli Program in Brain, Mind, and Consciousness, Canadian Institute for Advanced Research (CIFAR), Canada
| | | |
Collapse
|
27
|
Ten Oever S, Sack AT. Interactions Between Rhythmic and Feature Predictions to Create Parallel Time-Content Associations. Front Neurosci 2019; 13:791. [PMID: 31427917 PMCID: PMC6688653 DOI: 10.3389/fnins.2019.00791] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2019] [Accepted: 07/15/2019] [Indexed: 11/13/2022] Open
Abstract
The brain is inherently proactive, constantly predicting the when (moment) and what (content) of future input in order to optimize information processing. Previous research on such predictions has mainly studied the "when" or "what" domain separately, missing to investigate the potential integration of both types of predictive information. In the absence of such integration, temporal cues are assumed to enhance any upcoming content at the predicted moment in time (general temporal predictor). However, if the when and what prediction domain were integrated, a much more flexible neural mechanism may be proposed in which temporal-feature interactions would allow for the creation of multiple concurrent time-content predictions (parallel time-content predictor). Here, we used a temporal association paradigm in two experiments in which sound identity was systematically paired with a specific time delay after the offset of a rhythmic visual input stream. In Experiment 1, we revealed that participants associated the time delay of presentation with the identity of the sound. In Experiment 2, we unexpectedly found that the strength of this temporal association was negatively related to the EEG steady-state evoked responses (SSVEP) in preceding trials, showing that after high neuronal responses participants responded inconsistent with the time-content associations, similar to adaptation mechanisms. In this experiment, time-content associations were only present for low SSVEP responses in previous trials. These results tentatively show that it is possible to represent multiple time-content paired predictions in parallel, however, future research is needed to investigate this interaction further.
Collapse
Affiliation(s)
- Sanne Ten Oever
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Centre, Maastricht, Netherlands
| | - Alexander T Sack
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands.,Maastricht Brain Imaging Centre, Maastricht, Netherlands
| |
Collapse
|
28
|
Marković D, Reiter AMF, Kiebel SJ. Predicting change: Approximate inference under explicit representation of temporal structure in changing environments. PLoS Comput Biol 2019; 15:e1006707. [PMID: 30703108 PMCID: PMC6372216 DOI: 10.1371/journal.pcbi.1006707] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2018] [Revised: 02/12/2019] [Accepted: 12/11/2018] [Indexed: 11/18/2022] Open
Abstract
In our daily lives timing of our actions plays an essential role when we navigate the complex everyday environment. It is an open question though how the representations of the temporal structure of the world influence our behavior. Here we propose a probabilistic model with an explicit representation of state durations which may provide novel insights in how the brain predicts upcoming changes. We illustrate several properties of the behavioral model using a standard reversal learning design and compare its task performance to standard reinforcement learning models. Furthermore, using experimental data, we demonstrate how the model can be applied to identify participants' beliefs about the latent temporal task structure. We found that roughly one quarter of participants seem to have learned the latent temporal structure and used it to anticipate changes, whereas the remaining participants' behavior did not show signs of anticipatory responses, suggesting a lack of precise temporal expectations. We expect that the introduced behavioral model will allow, in future studies, for a systematic investigation of how participants learn the underlying temporal structure of task environments and how these representations shape behavior.
Collapse
Affiliation(s)
- Dimitrije Marković
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | | | - Stefan J. Kiebel
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| |
Collapse
|
29
|
|