1
|
Markov YA, Tiurina NA, Pascucci D. Serial dependence: A matter of memory load. Heliyon 2024; 10:e33977. [PMID: 39071578 PMCID: PMC11283082 DOI: 10.1016/j.heliyon.2024.e33977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 06/24/2024] [Accepted: 07/01/2024] [Indexed: 07/30/2024] Open
Abstract
In serial dependence, perceptual decisions are biased towards stimuli encountered in the recent past. Here, we investigate whether and how serial dependence is affected by the availability of visual working memory (VWM) resources. In two experiments, participants reproduced the orientation of a series of stimuli. On alternating trials, we included an additional VWM task with randomly varying levels of load. Serial dependence was not only affected by the additional load task but also clearly modulated by the level of load: a high load in the previous trial reduced serial dependence while a high load in the present increased it. These results were independent of the effects of VWM load on the precision of reproduction responses. Our findings provide new insights into the mechanisms that may regulate serial dependence, revealing its intimate link with VWM resources. Significance statement Our perception, thoughts, and behavior are continuously influenced by recent events. For instance, the way we process and understand current visual information depends on what we have seen in the preceding seconds, a phenomenon known as serial dependence. The precise mechanisms and factors involved in serial dependence are still unclear. Here, we demonstrated that working memory resources are a crucial component. Specifically, when we are currently experiencing a heavy memory load, the influence of prior stimuli becomes stronger. Conversely, when prior stimuli were shown under a high memory load, their influence was reduced. These findings highlight the importance of working memory resources in shaping our interpretation of the present based on the recent past.
Collapse
Affiliation(s)
- Yuri A. Markov
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
- Department of Psychology, Goethe University Frankfurt, Frankfurt Am Main, Germany
| | - Natalia A. Tiurina
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
- Department of Psychology, TUD Dresden University of Technology, Dresden, Germany
| | - David Pascucci
- Laboratory of Psychophysics, Brain Mind Institute, École Polytechnique Fédérale de Lausanne (EPFL), Switzerland
- The Radiology Department, Lausanne University Hospital and University of Lausanne, Lausanne, Switzerland
- The Sense Innovation and Research Center, Lausanne and Sion, Lausanne, Switzerland
| |
Collapse
|
2
|
Cheng S, Chen S, Glasauer S, Keeser D, Shi Z. Neural mechanisms of sequential dependence in time perception: the impact of prior task and memory processing. Cereb Cortex 2024; 34:bhad453. [PMID: 38037371 DOI: 10.1093/cercor/bhad453] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 11/02/2023] [Accepted: 11/04/2023] [Indexed: 12/02/2023] Open
Abstract
Our perception and decision-making are susceptible to prior context. Such sequential dependence has been extensively studied in the visual domain, but less is known about its impact on time perception. Moreover, there are ongoing debates about whether these sequential biases occur at the perceptual stage or during subsequent post-perceptual processing. Using functional magnetic resonance imaging, we investigated neural mechanisms underlying temporal sequential dependence and the role of action in time judgments across trials. Participants performed a timing task where they had to remember the duration of green coherent motion and were cued to either actively reproduce its duration or simply view it passively. We found that sequential biases in time perception were only evident when the preceding task involved active duration reproduction. Merely encoding a prior duration without reproduction failed to induce such biases. Neurally, we observed activation in networks associated with timing, such as striato-thalamo-cortical circuits, and performance monitoring networks, particularly when a "Response" trial was anticipated. Importantly, the hippocampus showed sensitivity to these sequential biases, and its activation negatively correlated with the individual's sequential bias following active reproduction trials. These findings highlight the significant role of memory networks in shaping time-related sequential biases at the post-perceptual stages.
Collapse
Affiliation(s)
- Si Cheng
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
| | - Siyi Chen
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
| | - Stefan Glasauer
- Computational Neuroscience, Institute of Medical Technology, Brandenburg University of Technology Cottbus-Senftenberg, Lipezker Straße 47, 03048, Cottbus, Germany
| | - Daniel Keeser
- NeuroImaging Core Unit Munich (NICUM), Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-Universität München, Nußbaumstraße 7, 80336, Munich, Germany
| | - Zhuanghua Shi
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Leopoldstraße 13, 80802, Munich, Germany
- NeuroImaging Core Unit Munich (NICUM), Department of Psychiatry and Psychotherapy, Ludwig-Maximilians-Universität München, Nußbaumstraße 7, 80336, Munich, Germany
| |
Collapse
|
3
|
Fulvio JM, Rokers B, Samaha J. Task feedback suggests a post-perceptual component to serial dependence. J Vis 2023; 23:6. [PMID: 37682557 PMCID: PMC10500366 DOI: 10.1167/jov.23.10.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 08/14/2023] [Indexed: 09/09/2023] Open
Abstract
Decisions across a range of perceptual tasks are biased toward past stimuli. Such serial dependence is thought to be an adaptive low-level mechanism that promotes perceptual stability across time. However, recent studies suggest post-perceptual mechanisms may also contribute to serially biased responses, calling into question a single locus of serial dependence and the nature of integration of past and present sensory inputs. We measured serial dependence in the context of a three-dimensional (3D) motion perception task where uncertainty in the sensory information varied substantially from trial to trial. We found that serial dependence varied with stimulus properties that impact sensory uncertainty on the current trial. Reduced stimulus contrast was associated with an increased bias toward the stimulus direction of the previous trial. Critically, performance feedback, which reduced sensory uncertainty, abolished serial dependence. These results provide clear evidence for a post-perceptual locus of serial dependence in 3D motion perception and support the role of serial dependence as a response strategy in the face of substantial sensory uncertainty.
Collapse
Affiliation(s)
| | - Bas Rokers
- Department of Psychology, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- Department of Psychology and Center for Neural Science, New York University, New York, NY, USA
| | - Jason Samaha
- Department of Psychology, University of California, Santa Cruz, Santa Cruz, CA, USA
| |
Collapse
|
4
|
Manassi M, Murai Y, Whitney D. Serial dependence in visual perception: A meta-analysis and review. J Vis 2023; 23:18. [PMID: 37642639 PMCID: PMC10476445 DOI: 10.1167/jov.23.8.18] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 07/12/2023] [Indexed: 08/31/2023] Open
Abstract
Positive sequential dependencies are phenomena in which actions, perception, decisions, and memory of features or objects are systematically biased toward visual experiences from the recent past. Among many labels, serial dependencies have been referred to as priming, sequential dependencies, sequential effects, or serial effects. Despite extensive research on the topic, the field still lacks an operational definition of what counts as serial dependence. In this meta-analysis, we review the vast literature on serial dependence and quantitatively assess its key diagnostic characteristics across several different domains of visual perception. The meta-analyses fully characterize serial dependence in orientation, face, and numerosity perception. They show that serial dependence is defined by four main kinds of tuning: serial dependence decays with time (temporal-tuning), it depends on relative spatial location (spatial-tuning), it occurs only between similar features and objects (feature-tuning), and it is modulated by attention (attentional-tuning). We also review studies of serial dependence that report single observer data, highlighting the importance of individual differences in serial dependence. Finally, we discuss a range of outstanding questions and novel research avenues that are prompted by the meta-analyses. Together, the meta-analyses provide a full characterization of serial dependence as an operationally defined family of visual phenomena, and they outline several of the key diagnostic criteria for serial dependence that should serve as guideposts for future research.
Collapse
Affiliation(s)
- Mauro Manassi
- School of Psychology, University of Aberdeen, King's College, Aberdeen, UK
| | - Yuki Murai
- Center for Information and Neural Networks, National Institute of Information and Communications Technology, Osaka, Japan
| | - David Whitney
- Department of Psychology University of California, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
- Vision Science Group, University of California, Berkeley, CA, USA
| |
Collapse
|
5
|
Bliss DP, Rahnev D, Mackey WE, Curtis CE, D'Esposito M. Stimulation along the anterior-posterior axis of lateral frontal cortex reduces visual serial dependence. J Vis 2023; 23:1. [PMID: 37395704 PMCID: PMC10324416 DOI: 10.1167/jov.23.7.1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2022] [Accepted: 06/07/2023] [Indexed: 07/04/2023] Open
Abstract
Serial dependence is an attractive pull that recent perceptual history exerts on current judgments. Theory suggests that this bias is due to a form of short-term plasticity prevalent specifically in the frontal lobe. We sought to test the importance of the frontal lobe to serial dependence by disrupting neural activity along its lateral surface during two tasks with distinct perceptual and motor demands. In our first experiment, stimulation of the lateral prefrontal cortex (LPFC) during an oculomotor delayed response task decreased serial dependence only in the first saccade to the target, whereas stimulation posterior to the LPFC decreased serial dependence only in adjustments to eye position after the first saccade. In our second experiment, which used an orientation discrimination task, stimulation anterior to, in, and posterior to the LPFC all caused equivalent decreases in serial dependence. In this experiment, serial dependence occurred only between stimuli at the same location; an alternation bias was observed across hemifields. Frontal stimulation had no effect on the alternation bias. Transcranial magnetic stimulation to parietal cortex had no effect on serial dependence in either experiment. In summary, our experiments provide evidence for both functional differentiation (Experiment 1) and redundancy (Experiment 2) in frontal cortex with respect to serial dependence.
Collapse
Affiliation(s)
- Daniel P Bliss
- Citizen Science Program, Bard College, Annandale-on-Hudson, NY, USA
| | - Dobromir Rahnev
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, USA
| | - Wayne E Mackey
- Department of Psychology, New York University, New York, NY, USA
| | - Clayton E Curtis
- Department of Psychology, New York University, New York, NY, USA
- Center for Neural Science, New York University, New York, NY, USA
| | - Mark D'Esposito
- Helen Wills Neuroscience Institute and Department of Psychology, University of California, Berkeley, Berkeley, CA, USA
| |
Collapse
|
6
|
Pascucci D, Tanrikulu ÖD, Ozkirli A, Houborg C, Ceylan G, Zerr P, Rafiei M, Kristjánsson Á. Serial dependence in visual perception: A review. J Vis 2023; 23:9. [PMID: 36648418 PMCID: PMC9871508 DOI: 10.1167/jov.23.1.9] [Citation(s) in RCA: 27] [Impact Index Per Article: 27.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Accepted: 11/18/2022] [Indexed: 01/18/2023] Open
Abstract
How does the visual system represent continuity in the constantly changing visual input? A recent proposal is that vision is serially dependent: Stimuli seen a moment ago influence what we perceive in the present. In line with this, recent frameworks suggest that the visual system anticipates whether an object seen at one moment is the same as the one seen a moment ago, binding visual representations across consecutive perceptual episodes. A growing body of work supports this view, revealing signatures of serial dependence in many diverse visual tasks. Yet, the variety of disparate findings and interpretations calls for a more general picture. Here, we survey the main paradigms and results over the past decade. We also focus on the challenge of finding a relationship between serial dependence and the concept of "object identity," taking centuries-long history of research into account. Among the seemingly contrasting findings on serial dependence, we highlight common patterns that may elucidate the nature of this phenomenon and attempt to identify questions that are unanswered.
Collapse
Affiliation(s)
- David Pascucci
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Ömer Daglar Tanrikulu
- Department of Psychology, University of New Hampshire, Durham, NH, USA
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Ayberk Ozkirli
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Christian Houborg
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Gizay Ceylan
- Laboratory of Psychophysics, Ecole Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
| | - Paul Zerr
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Mohsen Rafiei
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| | - Árni Kristjánsson
- Vision Sciences Laboratory, School of Health Sciences, University of Iceland, Reykjavik, Iceland
| |
Collapse
|
7
|
Tschiersch M. Causal evidence for the higher-order origin of serial dependence suggests a multi-area account. J Neurophysiol 2022; 128:336-338. [PMID: 35822735 DOI: 10.1152/jn.00048.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
There has been recent interest in whether serial dependence, a temporal bias in working memory and perception, is generated by higher-order cognitive or sensory areas. Based on the literature suggesting prefrontal areas combined with a recent article by de Azevedo Neto & Bartels (1), providing causal evidence for serial dependence relying on premotor cortex but not the visual area hV5/MT+, I here argue for a higher-order and multi-area origin of serial dependence.
Collapse
Affiliation(s)
- Melanie Tschiersch
- Brain Circuits and Behavior Lab, Institut D'Investigacions Biomediques August Pi I Sunyer, Barcelona, Spain
| |
Collapse
|
8
|
Barbosa J, Lozano-Soldevilla D, Compte A. Pinging the brain with visual impulses reveals electrically active, not activity-silent, working memories. PLoS Biol 2021; 19:e3001436. [PMID: 34673775 PMCID: PMC8641864 DOI: 10.1371/journal.pbio.3001436] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 12/03/2021] [Accepted: 10/04/2021] [Indexed: 11/18/2022] Open
Abstract
Persistently active neurons during mnemonic periods have been regarded as the mechanism underlying working memory maintenance. Alternatively, neuronal networks could instead store memories in fast synaptic changes, thus avoiding the biological cost of maintaining an active code through persistent neuronal firing. Such "activity-silent" codes have been proposed for specific conditions in which memories are maintained in a nonprioritized state, as for unattended but still relevant short-term memories. A hallmark of this "activity-silent" code is that these memories can be reactivated from silent, synaptic traces. Evidence for "activity-silent" working memory storage has come from human electroencephalography (EEG), in particular from the emergence of decodability (EEG reactivations) induced by visual impulses (termed pinging) during otherwise "silent" periods. Here, we reanalyze EEG data from such pinging studies. We find that the originally reported absence of memory decoding reflects weak statistical power, as decoding is possible based on more powered analyses or reanalysis using alpha power instead of raw voltage. This reveals that visual pinging EEG "reactivations" occur in the presence of an electrically active, not silent, code for unattended memories in these data. This crucial change in the evidence provided by this dataset prompts a reinterpretation of the mechanisms of EEG reactivations. We provide 2 possible explanations backed by computational models, and we discuss the relationship with TMS-induced EEG reactivations.
Collapse
Affiliation(s)
- Joao Barbosa
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Laboratoire de Neurosciences Cognitives et Computationnelles, Département d’Études Cognitives, École Normale Supérieure, PSL University, Paris, France
| | - Diego Lozano-Soldevilla
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
- Centro de Investigación Biomédica en Red de Enfermedades Raras (CIBERER), Madrid, Spain
- Laboratory for Clinical Neuroscience, Centre for Biomedical Technology, Universidad Politécnica de Madrid, Campus de Montegancedo, Pozuelo de Alarcón, Madrid, Spain
| | - Albert Compte
- Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| |
Collapse
|