2
|
Abstract
Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or 'iconic' memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these time scales. Here, we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.
Collapse
Affiliation(s)
- Ivan Tomić
- Department of Psychology, University of CambridgeCambridgeUnited Kingdom
- Department of Psychology, Faculty of Humanities and Social Sciences, University of ZagrebZagrebCroatia
| | - Paul M Bays
- Department of Psychology, University of CambridgeCambridgeUnited Kingdom
| |
Collapse
|
3
|
Haraguchi F, Hisakata R, Kaneko H. Temporal integration characteristics of an image defined by binocular disparity cues. Iperception 2024; 15:20416695231224138. [PMID: 38204517 PMCID: PMC10777792 DOI: 10.1177/20416695231224138] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 12/16/2023] [Indexed: 01/12/2024] Open
Abstract
We can correctly recognize the content of an image by presenting all of the elements within a limited time, such as in a slit view or a divided painting image. It is important to clarify how temporally divided information is integrated and perceived to understand the temporal properties of the information-processing mechanism of visual systems. Previous studies related to this topic have often used two-dimensional pictorial stimuli; however, few have considered the temporal integration of binocular disparity for the recognition of objects defined with disparity. In this study, we examined image recognition properties based on the temporal integration of binocular disparity, by comparing that based on the temporal integration of luminance. The effect of element onset asynchrony (the time lag among presented elements) was somewhat similar between disparity and luminance with respect to randomly divided elements. On the other hand, under slit-vision conditions, the tolerance range of spatiotemporal integration for luminance stimuli was much wider than that for disparity stimuli. These results indicate that the temporal integration mechanism in localized areas is common to disparity and luminance, but that for global motion shows differences between the two mechanisms. Thus, we conclude that global motion has little contribution to the temporal integration of binocular disparity information for image recognition.
Collapse
Affiliation(s)
- Fumiya Haraguchi
- Department of Information and Communications Engineering, Tokyo Institute of Technology, Yokohama, Japan
| | - Rumi Hisakata
- Department of Information and Communications Engineering, Tokyo Institute of Technology, Yokohama, Japan
| | - Hirohiko Kaneko
- Department of Information and Communications Engineering, Tokyo Institute of Technology, Yokohama, Japan
| |
Collapse
|
4
|
Keil J, Kiiski H, Doherty L, Hernandez-Urbina V, Vassiliou C, Dean C, Müschenich M, Bahmani H. Artificial sharp-wave-ripples to support memory and counter neurodegeneration. Brain Res 2024; 1822:148646. [PMID: 37871674 DOI: 10.1016/j.brainres.2023.148646] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 10/11/2023] [Accepted: 10/20/2023] [Indexed: 10/25/2023]
Abstract
Information processed in our sensory neocortical areas is transported to the hippocampus during memory encoding, and between hippocampus and neocortex during memory consolidation, and retrieval. Short bursts of high-frequency oscillations, so called sharp-wave-ripples, have been proposed as a potential mechanism for this information transfer: They can synchronize neural activity to support the formation of local neural networks to store information, and between distant cortical sites to act as a bridge to transfer information between sensory cortical areas and hippocampus. In neurodegenerative diseases like Alzheimer's Disease, different neuropathological processes impair normal neural functioning and neural synchronization as well as sharp-wave-ripples, which impairs consolidation and retrieval of information, and compromises memory. Here, we formulate a new hypothesis, that artificially inducing sharp-wave-ripples with noninvasive high-frequency visual stimulation could potentially support memory functioning, as well as target the neuropathological processes underlying neurodegenerative diseases. We also outline key challenges for empirical tests of the hypothesis.
Collapse
Affiliation(s)
- Julian Keil
- Department of Psychology, Christian-Albrechts-University Kiel, Germany; Ababax Health GmbH, Berlin, Germany; Department of Cognitive Science, University of Potsdam, Germany.
| | - Hanni Kiiski
- Ababax Health GmbH, Berlin, Germany; Department of Cognitive Science, University of Potsdam, Germany
| | | | | | - Chrystalleni Vassiliou
- German Center for Neurodegenerative Diseases, Charité University of Medicine, Berlin, Germany
| | - Camin Dean
- German Center for Neurodegenerative Diseases, Charité University of Medicine, Berlin, Germany
| | | | - Hamed Bahmani
- Ababax Health GmbH, Berlin, Germany; Bernstein Center for Computational Neuroscience, Tuebingen, Germany
| |
Collapse
|
5
|
Westerberg JA, Schall JD, Woodman GF, Maier A. Feedforward attentional selection in sensory cortex. Nat Commun 2023; 14:5993. [PMID: 37752171 PMCID: PMC10522696 DOI: 10.1038/s41467-023-41745-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/15/2023] [Indexed: 09/28/2023] Open
Abstract
Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority.
Collapse
Affiliation(s)
- Jacob A Westerberg
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA.
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA.
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA.
- Department of Vision and Cognition, Netherlands Institute for Neuroscience, Royal Netherlands Academy of Arts and Sciences, 1105 BA, Amsterdam, The Netherlands.
| | - Jeffrey D Schall
- Centre for Vision Research, York University, Toronto, ON, M3J 1P3, Canada
- Vision: Science to Applications Program, York University, Toronto, ON, M3J 1P3, Canada
- Department of Biology, York University, Toronto, ON, M3J 1P3, Canada
- Department of Psychology, York University, Toronto, ON, M3J 1P3, Canada
| | - Geoffrey F Woodman
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA
| | - Alexander Maier
- Department of Psychology, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Brain Institute, Vanderbilt University, Nashville, TN, 37240, USA
- Vanderbilt Vision Research Center, Vanderbilt University, Nashville, TN, 37240, USA
| |
Collapse
|
6
|
Wang D, Tang L, Xi C, Luo D, Liang Y, Huang Q, Wang Z, Chen J, Zhao X, Zhou H, Wang F, Hu S. Targeted visual cortex stimulation (TVCS): a novel neuro-navigated repetitive transcranial magnetic stimulation mode for improving cognitive function in bipolar disorder. Transl Psychiatry 2023; 13:193. [PMID: 37291106 DOI: 10.1038/s41398-023-02498-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 05/15/2023] [Accepted: 05/30/2023] [Indexed: 06/10/2023] Open
Abstract
A more effective and better-tolerated site for repetitive transcranial magnetic stimulation (rTMS) for treating cognitive dysfunction in patients with bipolar disorder (BD) is needed. The primary visual cortex (V1) may represent a suitable site. To investigate the use of the V1, which is functionally linked to the dorsolateral prefrontal cortex (DLPFC) and anterior cingulate cortex (ACC), as a potential site for improving cognitive function in BD. Seed-based functional connectivity (FC) analysis was used to locate targets in the V1 that had significant FC with the DLPFC and ACC. Subjects were randomly assigned to 4 groups, namely, the DLPFC active-sham rTMS (A1), DLPFC sham-active rTMS (A2), ACC active-sham rTMS (B1), and ACC sham-active rTMS groups (B2). The intervention included the rTMS treatment once daily, with five treatments a week for four weeks. The A1 and B1 groups received 10 days of active rTMS treatment followed by 10 days of sham rTMS treatment. The A2 and B2 groups received the opposite. The primary outcomes were changes in the scores of five tests in the THINC-integrated tool (THINC-it) at week 2 (W2) and week 4 (W4). The secondary outcomes were changes in the FC between the DLPFC/ACC and the whole brain at W2 and W4. Of the original 93 patients with BD recruited, 86 were finally included, and 73 finished the trial. Significant interactions between time and intervention type (Active/Sham) were observed in the scores of the accuracy of the Symbol Check in the THINC-it tests at baseline (W0) and W2 in groups B1 and B2 (F = 4.736, p = 0.037) using a repeated-measures analysis of covariance approach. Group B1 scored higher in the accuracy of Symbol Check at W2 compared with W0 (p < 0.001), while the scores of group B2 did not differ significantly between W0 and W2. No significant interactions between time and intervention mode were seen between groups A1 and A2, nor was any within-group significance of FC between DLPFC/ACC and the whole brain observed between baseline (W0) and W2/W4 in any group. One participant in group B1 experienced disease progression after 10 active and 2 sham rTMS sessions. The present study demonstrated that V1, functionally correlated with ACC, is a potentially effective rTMS stimulation target for improving neurocognitive function in BD patients. Further investigation using larger samples is required to confirm the clinical efficacy of TVCS.
Collapse
Affiliation(s)
- Dandan Wang
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China
| | - Lili Tang
- Early Intervention Unit, Department of Psychiatry, Affiliated Nanjing Brain Hospital, Nanjing Medical University, Nanjing, 210000, P.R. China
- Functional Brain Imaging Institute of Nanjing Medical University, Nanjing, 210000, P.R. China
| | - Caixi Xi
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China
| | - Dan Luo
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- Ward Five of The Third People's Hospital of Jiashan County, Jiaxing, 314000, China
| | - Yin Liang
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- Taizhou Second People's Hospital, Taizhou, 318000, China
| | - Qi Huang
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- Nanchong Psychosomatic Hospital, Nanchong, 637000, China
| | - Zhong Wang
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China
| | - Jingkai Chen
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China
| | - Xudong Zhao
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- Huzhou Third municipal hospital, Huzhou, 313000, China
| | - Hetong Zhou
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China
| | - Fei Wang
- Early Intervention Unit, Department of Psychiatry, Affiliated Nanjing Brain Hospital, Nanjing Medical University, Nanjing, 210000, P.R. China.
- Functional Brain Imaging Institute of Nanjing Medical University, Nanjing, 210000, P.R. China.
| | - Shaohua Hu
- Department of Psychiatry, the First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310003, China.
- The Key Laboratory of Mental Disorder's Management in Zhejiang Province, Hangzhou, 310003, China.
- Brain Research Institute of Zhejiang University, Hangzhou, 310003, China.
- Zhejiang Engineering Center for Mathematical Mental Health, Hangzhou, 310003, China.
- MOE Frontier Science Center for Brain Science & Brain-Machine Integration, Zhejiang University, Hangzhou, 310003, China.
| |
Collapse
|
7
|
Shushruth S, Zylberberg A, Shadlen MN. Sequential sampling from memory underlies action selection during abstract decision-making. Curr Biol 2022; 32:1949-1960.e5. [PMID: 35354066 PMCID: PMC9090972 DOI: 10.1016/j.cub.2022.03.014] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 03/02/2022] [Accepted: 03/03/2022] [Indexed: 12/17/2022]
Abstract
The study of perceptual decision-making in monkeys has provided insights into the process by which sensory evidence is integrated toward a decision. When monkeys make decisions with the knowledge of the motor actions the decisions bear upon, the process of evidence integration is instantiated by neurons involved in the selection of said actions. It is less clear how monkeys make decisions when unaware of the actions required to communicate their choice-what we refer to as "abstract" decisions. We investigated this by training monkeys to associate the direction of motion of a noisy random-dot display with the color of two targets. Crucially, the targets were displayed at unpredictable locations after the motion stimulus was extinguished. We found that the monkeys postponed decision formation until the targets were revealed. Neurons in the parietal association area LIP represented the integration of evidence leading to a choice, but as the stimulus was no longer visible, the samples of evidence must have been retrieved from short-term memory. Our results imply that when decisions are temporally unyoked from the motor actions they bear upon, decision formation is protracted until they can be framed in terms of motor actions.
Collapse
Affiliation(s)
- S Shushruth
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Ariel Zylberberg
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA.
| | - Michael N Shadlen
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, New York, NY 10027, USA; Howard Hughes Medical Institute, New York, NY 10027, USA; Kavli Institute, Columbia University, 612 West 130th Street, New York, NY 10027, USA.
| |
Collapse
|