1
|
Cai C, Zhang L, Quan Z, Fang X, Cai S, Zhang J. Search flavor labels in beverages: An electrophysiological investigation of color-flavor congruency and association strength in visual search. Neuropsychologia 2024; 203:108985. [PMID: 39216718 DOI: 10.1016/j.neuropsychologia.2024.108985] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Revised: 08/27/2024] [Accepted: 08/28/2024] [Indexed: 09/04/2024]
Abstract
Individuals are apt to link various characteristics of an object or event through different sensory experiences. We conducted two electrophysiological experiments to investigate the effects of color-flavor congruency and association strength on visual search efficiency and the in-depth cognitive mechanisms underlying multisensory processes. Participants were prompted with a flavor label and asked to identify the primed flavor from four beverage bottle images. Experiment 1 focused on color-flavor congruency and noted faster searches for congruent targets than incongruent ones. EEG data exhibited smaller N2, larger P3 and LPC, and increased parietal-occipital midline (POM) alpha power for incongruent targets than congruent ones. Experiment 2 manipulated color-flavor association strength within each flavor. Behavioral findings showed that searches for targets with weak association strength took longer than those with strong association strength. Moreover, time-frequency analysis displayed that the former evoked greater frontal midline (FM) theta power and higher alpha power than the latter. Altogether, our research indicated that (1) color expectations based on prior experience can automatically guide people's attentional selection, (2) the color-flavor congruency and association strength impact the visual search efficiency via distinct pathways, and (3) theta and alpha activities make a pivotal role in unraveling multisensory information processing. These findings shed some light on the intricate cognitive processes involved in crossmodal visual search and the underlying neurocognitive dynamics.
Collapse
Affiliation(s)
- Chen Cai
- Department of Psychology, Normal College, Qingdao University, Qingdao, 266071, Shandong, China.
| | - Le Zhang
- Department of Psychology, Normal College, Qingdao University, Qingdao, 266071, Shandong, China
| | - Zihan Quan
- Department of Psychology, Normal College, Qingdao University, Qingdao, 266071, Shandong, China
| | - Xin Fang
- Department of Psychology, Normal College, Qingdao University, Qingdao, 266071, Shandong, China
| | - Sisi Cai
- Department of Psychology, Normal College, Qingdao University, Qingdao, 266071, Shandong, China
| | - Jia Zhang
- College of Life Sciences, Yantai University, Yantai, 264005, Shandong, China
| |
Collapse
|
2
|
Hoyer RS, Tewarie PKB, Laureys S. Spatiotemporal dynamics of brain activity in cognition and consciousness: Comment on "Beyond task responsePre-stimulus activity modulates contents of consciousness" by Northoff, Zilio, and Zhang. Phys Life Rev 2024; 50:63-65. [PMID: 38964240 DOI: 10.1016/j.plrev.2024.06.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Accepted: 06/18/2024] [Indexed: 07/06/2024]
Affiliation(s)
- Roxane S Hoyer
- Joint International Research Unit on Consciousness, CERVO Brain Research Centre, Laval University, Canada
| | - Prejaas K B Tewarie
- Joint International Research Unit on Consciousness, CERVO Brain Research Centre, Laval University, Canada; Sir Peter Mansfield Imaging Center, School of Physics, University of Nottingham, United Kingdom; Clinical Neurophysiology Group, University of Twente, Netherlands
| | - Steven Laureys
- Joint International Research Unit on Consciousness, CERVO Brain Research Centre, Laval University, Canada; GIGA Consciousness Research Unit and Coma Science Group, Liège University, Belgium; International Consciousness Science Institute, Hangzhou Normal University, Hangzhou, China
| |
Collapse
|
3
|
Kandemir G, Olivers C. Comparing Neural Correlates of Memory Encoding and Maintenance for Foveal and Peripheral Stimuli. J Cogn Neurosci 2024; 36:1807-1826. [PMID: 38940724 PMCID: PMC11324249 DOI: 10.1162/jocn_a_02203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/29/2024]
Abstract
Visual working memory is believed to rely on top-down attentional mechanisms that sustain active sensory representations in early visual cortex, a mechanism referred to as sensory recruitment. However, both bottom-up sensory input and top-down attentional modulations thereof appear to prioritize the fovea over the periphery, such that initially peripheral percepts may even be assimilated by foveal processes. This raises the question whether and how visual working memory differs for central and peripheral input. To address this, we conducted a delayed orientation recall task in which an orientation was presented either at the center of the screen or at 15° eccentricity to the left or right. Response accuracy, EEG activity, and gaze position were recorded from 30 participants. Accuracy was slightly but significantly higher for foveal versus peripheral memories. Decoding of EEG recordings revealed a clear dissociation between early sensory and later maintenance signals. Although sensory signals were clearly decodable for foveal stimuli, they were not for peripheral input. In contrast, maintenance signals were equally decodable for both foveal and peripheral memories, suggesting comparable top-down components regardless of eccentricity. Moreover, although memory representations were initially spatially specific and reflected in voltage fluctuations, later during the maintenance period, they generalized across locations, as emerged in alpha oscillations, thus revealing a dynamic transformation within memory from separate sensory traces to what we propose are common output-related codes. Furthermore, the combined absence of reliable decoding of sensory signals and robust presence of maintenance decoding indicates that storage activity patterns as measured by EEG reflect signals beyond primary visual cortex. We discuss the implications for the sensory recruitment hypothesis.
Collapse
|
4
|
Tian S, Cheng YA, Luo H. Rhythm Facilitates Auditory Working Memory via Beta-Band Encoding and Theta-Band Maintenance. Neurosci Bull 2024:10.1007/s12264-024-01289-w. [PMID: 39215886 DOI: 10.1007/s12264-024-01289-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 05/04/2024] [Indexed: 09/04/2024] Open
Abstract
Rhythm, as a prominent characteristic of auditory experiences such as speech and music, is known to facilitate attention, yet its contribution to working memory (WM) remains unclear. Here, human participants temporarily retained a 12-tone sequence presented rhythmically or arrhythmically in WM and performed a pitch change-detection task. Behaviorally, while having comparable accuracy, rhythmic tone sequences showed a faster response time and lower response boundaries in decision-making. Electroencephalographic recordings revealed that rhythmic sequences elicited enhanced non-phase-locked beta-band (16 Hz-33 Hz) and theta-band (3 Hz-5 Hz) neural oscillations during sensory encoding and WM retention periods, respectively. Importantly, the two-stage neural signatures were correlated with each other and contributed to behavior. As beta-band and theta-band oscillations denote the engagement of motor systems and WM maintenance, respectively, our findings imply that rhythm facilitates auditory WM through intricate oscillation-based interactions between the motor and auditory systems that facilitate predictive attention to auditory sequences.
Collapse
Affiliation(s)
- Suizi Tian
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China
| | - Yu-Ang Cheng
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, 02912, USA
| | - Huan Luo
- School of Psychological and Cognitive Sciences and Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, 100871, China.
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
| |
Collapse
|
5
|
Korda Ž, Walcher S, Körner C, Benedek M. Internal coupling: Eye behavior coupled to visual imagery. Neurosci Biobehav Rev 2024; 165:105855. [PMID: 39153584 DOI: 10.1016/j.neubiorev.2024.105855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 08/02/2024] [Accepted: 08/13/2024] [Indexed: 08/19/2024]
Abstract
Our eyes do not only respond to visual perception but also to internal cognition involving visual imagery, which can be referred to as internal coupling. This review synthesizes evidence on internal coupling across diverse domains including episodic memory and simulation, visuospatial memory, numerical cognition, object movement, body movement, and brightness imagery. In each domain, eye movements consistently reflect distinct aspects of mental imagery typically akin to those seen in corresponding visual experiences. Several findings further suggest that internal coupling may not only coincide with but also supports internal cognition as evidenced by improved cognitive performance. Available theoretical accounts suggest that internal coupling may serve at least two functional roles in visual imagery: facilitating memory reconstruction and indicating shifts in internal attention. Moreover, recent insights into the neurobiology of internal coupling highlight substantially shared neural pathways in externally and internally directed cognition. The review concludes by identifying open questions and promising avenues for future research such as exploring moderating roles of context and individual differences in internal coupling.
Collapse
Affiliation(s)
- Živa Korda
- Department of Psychology, University of Graz, Graz, Austria.
| | - Sonja Walcher
- Department of Psychology, University of Graz, Graz, Austria
| | | | | |
Collapse
|
6
|
Ji H, Wang K, Kong G, Zhang X, He W, Ding X. The Basic Units of Working Memory Manipulation Are Boolean Maps, Not Objects. Psychol Sci 2024; 35:887-899. [PMID: 38889369 DOI: 10.1177/09567976241257443] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/20/2024] Open
Abstract
Determining the manipulation unit of working memory is one of the fundamental questions in understanding how working memory functions. The prevalent object-based theory in cognitive research predicts that memory manipulation is performed on the level of objects. Here we show instead that the basic units of working memory manipulation are Boolean maps, a data structure describing what can be perceived in an instant. We developed four new manipulation tasks (with data from 80 adults) and showed that manipulation times only increased when the number of Boolean maps manipulated increased. Increasing the number of orientations manipulated did not induce longer manipulation times, consistent with a key prediction of the Boolean map theory. Our results show that Boolean maps are the manipulation unit of working memory.
Collapse
Affiliation(s)
- Huichao Ji
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University
- Department of Psychology, Yale University
| | - Kaiyue Wang
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University
| | - Garry Kong
- Waseda Institute of Advanced Study, Waseda University
| | - Xiaodan Zhang
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University
| | - Wenzhen He
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University
| | - Xiaowei Ding
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University
| |
Collapse
|
7
|
Tseng P, Cheng T. Causal prominence for neuroscience. Nat Rev Neurosci 2024; 25:591. [PMID: 38902513 DOI: 10.1038/s41583-024-00838-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/22/2024]
Affiliation(s)
- Philip Tseng
- Department of Psychology, National Taiwan University, Taipei, Taiwan.
| | - Tony Cheng
- Waseda Institute for Advanced Study, Waseda University, Tokyo, Japan
| |
Collapse
|
8
|
Ishiguro S, Paterson RL, Saito S. Positive correlation between working memory and face-to-face social interaction in everyday life. Acta Psychol (Amst) 2024; 248:104402. [PMID: 39003992 DOI: 10.1016/j.actpsy.2024.104402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2023] [Revised: 07/08/2024] [Accepted: 07/09/2024] [Indexed: 07/16/2024] Open
Abstract
Working memory (WM) plays a crucial role in various cognitive tasks from language comprehension to problem-solving. However, its influence on social activities has remained largely unexplored. The current two studies on individual differences, a pilot (N = 329) and a pre-registered direct replication (N = 338) study, investigated the relationship between WM and outside-the-lab social interaction by using a listening span task and three social network questionnaires (e.g., how many people a participant had contacted in the past month). The consistent patterns in the two studies were (a) WM recall was positively correlated with social network size, (b) WM recall remained positively correlated with social network size even when accounting for online interactions on WhatsApp and Facebook, and (c) WM recall was positively correlated with social network size by face-to-face interaction. These novel findings would suggest connections between WM and face-to-face social interaction. It was, however, acknowledged that the obtained effect sizes were small, and that further investigation is indeed necessary. In light of this, we also clarify future directions for understanding the relationship between WM and social interaction.
Collapse
|
9
|
Almarzouki AF, Alluhaibi W, Salman B, Almuhaiyawi M, Alreemi M, Alsahafi M. The impact of cognitive functions, psychological disorders, and coping strategies on quality of life and disease outcomes in patients with inflammatory bowel diseases: A cross-sectional study. Medicine (Baltimore) 2024; 103:e38982. [PMID: 39058817 PMCID: PMC11272307 DOI: 10.1097/md.0000000000038982] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Accepted: 06/28/2024] [Indexed: 07/28/2024] Open
Abstract
Quality of life (QoL) in patients with inflammatory bowel disease (IBD) is influenced by several factors, many of which may also impact cognitive function. However, the extent of the interaction among these factors, QoL, and disease outcomes in IBD patients remains unknown. We thus aim to characterize the relationships among psychological disorders, coping mechanisms, cognitive function, and the overall impact on QoL and disease outcomes in patients with IBD. This cross-sectional observational study was conducted at an academic care center. QoL was evaluated using the Short Inflammatory Bowel Disease Questionnaire (SIBDQ), and disease severity was evaluated using the Harvey-Bradshaw Index (HBI) for Crohn's disease (CD) and the Simple Clinical Colitis Activity Index (SCCAI) for ulcerative colitis (UC). We also used the Hospital Anxiety and Depression scale (HADS). Regression models were used to test the associations among QoL, number of hospitalizations, disease severity, cognitive functioning (working memory [WM] and reaction time), and coping strategies while controlling for anxiety and depressive symptoms, age, and sex. This study included 41 patients (24 patients with CD and 17 with UC) whose mean age was 28.2 (±8.4) years (23 males) and mean SIBDQ score was 51.5 (±10.0). Patients with more WM errors had lower QoL scores (P = .041), whereas patients with higher anxiety levels had lower QoL and more active UC (P = .008 and P = .016, respectively). The use of avoidant coping mechanisms was associated with a significantly higher number of hospitalizations (P = .038), and patients who adopted more emotion-focused coping strategies had a longer illness duration (P = .021). Finally, patients with higher education levels were found to use more active coping mechanisms than others. These results confirm the impact of cognitive, psychological, and coping factors on QoL and disease outcomes in patients with IBD; however, the mechanisms by which these factors interrelate remain unclear. Therapies aimed at improving both cognitive functions and psychological conditions may thus be effective at improving QoL and disease outcomes in IBD patients, and education may play a positive role in promoting the adoption of more effective coping strategies among IBD patients.
Collapse
Affiliation(s)
- Abeer F. Almarzouki
- Department of Clinical Physiology, Faculty of Medicine, King Abdualziz University, Jeddah, Saudi Arabia
| | - Waad Alluhaibi
- Division of Gastroenterology, Department of Medicine, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Basma Salman
- Division of Gastroenterology, Department of Medicine, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Maha Almuhaiyawi
- College of Medicine, King Saud bin Abdulaziz University for Health Sciences, Jeddah, Saudi Arabia
| | - Maha Alreemi
- Faculty of Pharmacy, King Abdualziz University, Jeddah, Saudi Arabia
| | - Majid Alsahafi
- Division of Gastroenterology, Department of Medicine, Faculty of Medicine, King Abdulaziz University, Jeddah, Saudi Arabia
| |
Collapse
|
10
|
Heled E. Forward versus backward recall: Modality testing. APPLIED NEUROPSYCHOLOGY. ADULT 2024:1-7. [PMID: 38994814 DOI: 10.1080/23279095.2024.2371422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/13/2024]
Abstract
OBJECTIVES One of the most frequently applied paradigms in the clinical and experimental fields for assessing working memory is the simple span task, composed of forward and backward recall conditions. However, the utility of the simple span measures and their relation to working memory modalities has yet to be elucidated. The current study aimed to address which of the span measures is more sensitive to the differentiation between forward and backward recall in the tactile, verbal, and visuo-spatial modalities, and to test if working memory modalities differ in the disparity between the two conditions. METHODS 134 healthy young adults performed the Tactual, Digit, and Visuo-spatial Span tasks, producing Total Correct scores and Longest Sequence score measures. RESULTS There was an interaction effect for condition and modality type, showing better performance for the forward compared to the backward recall in both measures. However, the effect size of the Longest Sequence score was significantly higher than the Total Correct score in all tasks. Furthermore, the Visuo-spatial Span exhibited a larger difference between forward and backward recall compared to the Digit and Tactual Span, whereas no difference was found between the latter two. CONCLUSIONS Forward and backward recall are distinguished in all three modalities, and the Longest Sequence score is more sensitive to differentiate between storage and manipulation components of working memory than the Total Correct score. Additionally, the cognitive demand imposed by manipulation compared to storage is the greatest in the visuo-spatial modality.
Collapse
Affiliation(s)
- Eyal Heled
- Department of Psychology, Ariel University, Ariel, Israel
- Department of Neurological Rehabilitation, Sheba Medical Center, Ramat-Gan, Israel
| |
Collapse
|
11
|
Abstract
Working memory enables us to bridge past sensory information to upcoming future behaviour. Accordingly, by its very nature, working memory is concerned with two components: the past and the future. Yet, in conventional laboratory tasks, these two components are often conflated, such as when sensory information in working memory is encoded and tested at the same location. We developed a task in which we dissociated the past (encoded location) and future (to-be-tested location) attributes of visual contents in working memory. This enabled us to independently track the utilisation of past and future memory attributes through gaze, as observed during mnemonic selection. Our results reveal the joint consideration of past and future locations. This was prevalent even at the single-trial level of individual saccades that were jointly biased to the past and future. This uncovers the rich nature of working memory representations, whereby both past and future memory attributes are retained and can be accessed together when memory contents become relevant for behaviour.
Collapse
Affiliation(s)
- Baiwei Liu
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit AmsterdamAmsterdamNetherlands
| | - Zampeta-Sofia Alexopoulou
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit AmsterdamAmsterdamNetherlands
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit AmsterdamAmsterdamNetherlands
| |
Collapse
|
12
|
van Ede F, Nobre AC. A Neural Decision Signal during Internal Sampling from Working Memory in Humans. J Neurosci 2024; 44:e1475232024. [PMID: 38538144 PMCID: PMC11079964 DOI: 10.1523/jneurosci.1475-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 01/11/2024] [Accepted: 02/16/2024] [Indexed: 05/12/2024] Open
Abstract
How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.
Collapse
Affiliation(s)
- Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, 1081 BT, Amsterdam, The Netherlands
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Wu Tsai Institute and Department of Psychology, Yale University, New Haven, Connecticut 06510
| |
Collapse
|
13
|
Ding Y, Postle BR, van Ede F. Neural Signatures of Competition between Voluntary and Involuntary Influences over the Focus of Attention in Visual Working Memory. J Cogn Neurosci 2024; 36:815-827. [PMID: 38319683 DOI: 10.1162/jocn_a_02123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Adaptive behavior relies on the selection and prioritization of relevant sensory inputs from the external environment as well as from among internal sensory representations held in working memory. Recent behavioral evidence suggests that the classic distinction between voluntary (goal-driven) and involuntary (stimulus-driven) influences over attentional allocation also applies to the selection of internal representations held in working memory. In the current EEG study, we set out to investigate the neural dynamics associated with the competition between voluntary and involuntary control over the focus of attention in visual working memory. We show that when voluntary and involuntary factors compete for the internal focus of attention, prioritization of the appropriate item is delayed-as reflected both in delayed gaze biases that track internal selection and in delayed neural beta (15-25 Hz) dynamics that track the planning for the upcoming memory-guided manual action. We further show how this competition is paralleled-possibly resolved-by an increase in frontal midline theta (4-8 Hz) activity that, moreover, predicts the speed of ensuing memory-guided behavior. Finally, because theta increased following retrocues that effectively reduced working-memory load, our data unveil how frontal theta activity during internal attentional focusing tracks demands on cognitive control over and above working-memory load. Together, these data yield new insight into the neural dynamics that govern the focus of attention in visual working memory, and disentangle the contributions of frontal midline theta activity to the processes of control versus retention in working memory.
Collapse
|
14
|
Palmieri H, Carrasco M. Task demand mediates the interaction of spatial and temporal attention. Sci Rep 2024; 14:9228. [PMID: 38649675 PMCID: PMC11035700 DOI: 10.1038/s41598-024-58209-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2023] [Accepted: 03/26/2024] [Indexed: 04/25/2024] Open
Abstract
Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.
Collapse
Affiliation(s)
- Helena Palmieri
- Department of Psychology, New York University, New York, NY, 10003, USA.
| | - Marisa Carrasco
- Department of Psychology, New York University, New York, NY, 10003, USA
- Center for Neural Science, New York University, New York, NY, 10003, USA
| |
Collapse
|
15
|
Gresch D, Boettcher SEP, van Ede F, Nobre AC. Shifting attention between perception and working memory. Cognition 2024; 245:105731. [PMID: 38278040 DOI: 10.1016/j.cognition.2024.105731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 11/02/2023] [Accepted: 01/18/2024] [Indexed: 01/28/2024]
Abstract
Most everyday tasks require shifting the focus of attention between sensory signals in the external environment and internal contents in working memory. To date, shifts of attention have been investigated within each domain, but shifts between the external and internal domain remain poorly understood. We developed a combined perception and working-memory task to investigate and compare the consequences of shifting spatial attention within and between domains in the service of a common orientation-reproduction task. Participants were sequentially cued to attend to items either in working memory or to an upcoming sensory stimulation. Stay trials provided a baseline condition, while shift trials required participants to shift their attention to another item within the same or different domain. Validating our experimental approach, we found evidence that participants shifted attention effectively in either domain (Experiment 1). In addition, we observed greater costs when transitioning attention between as compared to within domains (Experiments 1, 2). Strikingly, these costs persisted even when participants were given more time to complete the attentional shift (Experiment 2). Biases in fixational gaze behaviour tracked attentional orienting in both domains, but revealed no latency or magnitude difference for within- versus between-domain shifts (Experiment 1). Collectively, the results from Experiments 1 and 2 suggest that shifting between attentional domains might be regulated by a unique control function. Our results break new ground for exploring the ubiquitous act of shifting attention between perception and working memory to guide adaptive behaviour in everyday cognition.
Collapse
Affiliation(s)
- Daniela Gresch
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, the Netherlands.
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, UK; Wu Tsai Institute, Yale University, New Haven, CT, USA; Department of Psychology, Yale University, New Haven, CT, USA.
| |
Collapse
|
16
|
Wu W. We know what attention is! Trends Cogn Sci 2024; 28:304-318. [PMID: 38103983 DOI: 10.1016/j.tics.2023.11.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 11/20/2023] [Accepted: 11/21/2023] [Indexed: 12/19/2023]
Abstract
Attention is one of the most thoroughly investigated psychological phenomena, yet skepticism about attention is widespread: we do not know what it is, it is too many things, there is no such thing. The deficiencies highlighted are not about experimental work but the adequacy of the scientific theory of attention. Combining common scientific claims about attention into a single theory leads to internal inconsistency. This paper demonstrates that a specific functional conception of attention is incorporated into the tasks used in standard experimental paradigms. In accepting these paradigms as valid probes of attention, we commit to this common conception. The conception unifies work at multiple levels of analysis into a coherent scientific explanation of attention. Thus, we all know what attention is.
Collapse
Affiliation(s)
- Wayne Wu
- Italian Academy for Advanced Studies in America, Columbia University, New York, NY, USA; Department of Philosophy and Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
17
|
Gu Q, Zhang Q, Han Y, Li P, Gao Z, Shen M. Microsaccades reflect attention shifts: a mini review of 20 years of microsaccade research. Front Psychol 2024; 15:1364939. [PMID: 38440250 PMCID: PMC10909968 DOI: 10.3389/fpsyg.2024.1364939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Accepted: 02/06/2024] [Indexed: 03/06/2024] Open
Abstract
Microsaccades are small, involuntary eye movements that occur during fixation. Since the 1950s, researchers have conducted extensive research on the role of microsaccades in visual information processing, and found that they also play an important role in human advanced visual cognitive activities. Research over the past 20 years further suggested that there is a close relationship between microsaccades and visual attention, yet lacking a timely review. The current article aims to provide a state-of-the-art review and bring microsaccades studies into the sight of attention research. We firstly introduce basic characteristics about microsaccades, then summarized the empirical evidence supporting the view that microsaccades can reflect both external (perception) and internal (working memory) attention shifts. We finally conclude and highlight three promising avenues for future research.
Collapse
Affiliation(s)
- Quan Gu
- Yongjiang Laboratory, Ningbo, China
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Qikai Zhang
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Yueming Han
- Shanghai Institute of Technical Physics of the Chinese Academy of Sciences, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | | | - Zaifeng Gao
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Mowei Shen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| |
Collapse
|
18
|
Li J, Zhong BL, Zhou D, Fu Y, Huang X, Chen L, Liu H, Zheng J, Tang E, Li Y, Guan C, Shen M, Chen H. The dynamic process of hyperfocusing and hyperfiltering in schizophrenia. NATURE MENTAL HEALTH 2024; 2:367-378. [DOI: 10.1038/s44220-024-00211-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 01/24/2024] [Indexed: 08/01/2024]
|
19
|
Cowan N, Bao C, Bishop-Chrzanowski BM, Costa AN, Greene NR, Guitard D, Li C, Musich ML, Ünal ZE. The Relation Between Attention and Memory. Annu Rev Psychol 2024; 75:183-214. [PMID: 37713810 DOI: 10.1146/annurev-psych-040723-012736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
The relation between attention and memory has long been deemed important for understanding cognition, and it was heavily researched even in the first experimental psychology laboratory by Wilhelm Wundt and his colleagues. Since then, the importance of the relation between attention and memory has been explored in myriad subdisciplines of psychology, and we incorporate a wide range of these diverse fields. Here, we examine some of the practical consequences of this relation and summarize work with various methodologies relating attention to memory in the fields of working memory, long-term memory, individual differences, life-span development, typical brain function, and neuropsychological conditions. We point out strengths and unanswered questions for our own embedded processes view of information processing, which is used to organize a large body of evidence. Last, we briefly consider the relation of the evidence to a range of other theoretical views before drawing conclusions about the state of the field.
Collapse
Affiliation(s)
- Nelson Cowan
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Chenye Bao
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | | | - Amy N Costa
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Nathaniel R Greene
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Dominic Guitard
- School of Psychology, Cardiff University, Cardiff, United Kingdom
| | - Chenyuan Li
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Madison L Musich
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| | - Zehra E Ünal
- Department of Psychological Sciences, University of Missouri, Columbia, Missouri, USA;
| |
Collapse
|
20
|
Wang SY, Gong XM, Zhan LZ, You FH, Sun Q. Attention influences the effects of the previous form orientation on the current motion direction estimation. Sci Rep 2024; 14:1394. [PMID: 38228771 PMCID: PMC10791700 DOI: 10.1038/s41598-024-52069-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 01/12/2024] [Indexed: 01/18/2024] Open
Abstract
Recent studies have found that the estimates of motion directions are biased toward the previous form orientations, showing serial dependence, and the serial dependence does not involve cognitive abilities. In the current study, we conducted two experiments to investigate whether and how attention-a cognitive ability-affected the serial dependence. The results showed that serial dependence was present in the current study, reproducing the previous findings. Importantly, when the attentional load reduced the reliability (i.e., estimation accuracy and precision) of previous form orientations (Experiment 1), the serial dependence decreased, meaning that the biases of motion direction estimates toward previous form orientations were reduced; in contrast, when the attentional load reduced the reliability of current motion directions (Experiment 2), the serial dependence increased, meaning that the biases of motion direction estimates toward previous form orientations were increased. These trends were well consistent with the prediction of the Bayesian inference theory. Therefore, the current study revealed the involvement of attention in the serial dependence of current motion direction estimation on the previous form orientation, demonstrating that the serial dependence was cognitive and the attentional effect can be a Bayesian inference process, initially revealing its computational mechanism.
Collapse
Affiliation(s)
- Si-Yu Wang
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Xiu-Mei Gong
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Lin-Zhe Zhan
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Fan-Huan You
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China
| | - Qi Sun
- School of Psychology, Zhejiang Normal University, Jinhua, People's Republic of China.
- Intelligent Laboratory of Zhejiang Province in Mental Health and Crisis Intervention for Children and Adolescents, Jinhua, People's Republic of China.
- Key Laboratory of Intelligent Education Technology and Application of Zhejiang Province, Zhejiang Normal University, Jinhua, People's Republic of China.
| |
Collapse
|
21
|
Koevoet D, Naber M, Strauch C, Van der Stigchel S. The Intensity of Internal and External Attention Assessed with Pupillometry. J Cogn 2024; 7:8. [PMID: 38223232 PMCID: PMC10786008 DOI: 10.5334/joc.336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 11/30/2023] [Indexed: 01/16/2024] Open
Abstract
Not only is visual attention shifted to objects in the external world, attention can also be directed to objects in memory. We have recently shown that pupil size indexes how strongly items are attended externally, which was reflected in more precise encoding into visual working memory. Using a retro-cuing paradigm, we here replicated this finding by showing that stronger pupil constrictions during encoding were reflective of the depth of encoding. Importantly, we extend this previous work by showing that pupil size also revealed the intensity of internal attention toward content stored in visual working memory. Specifically, pupil dilation during the prioritization of one among multiple internally stored representations predicted the precision of the prioritized item. Furthermore, the dynamics of the pupillary responses revealed that the intensity of internal and external attention independently determined the precision of internalized visual representations. Our results show that both internal and external attention are not all-or-none processes, but should rather be thought of as continuous resources that can be deployed at varying intensities. The employed pupillometric approach allows to unravel the intricate interplay between internal and external attention and their effects on visual working memory.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, The Netherlands
| | | |
Collapse
|
22
|
de Vries E, van Ede F. Microsaccades Track Location-Based Object Rehearsal in Visual Working Memory. eNeuro 2024; 11:ENEURO.0276-23.2023. [PMID: 38176905 PMCID: PMC10849020 DOI: 10.1523/eneuro.0276-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 12/05/2023] [Accepted: 12/09/2023] [Indexed: 01/06/2024] Open
Abstract
Besides controlling eye movements, the brain's oculomotor system has been implicated in the control of covert spatial attention and the rehearsal of spatial information in working memory. We investigated whether the oculomotor system also contributes to rehearsing visual objects in working memory when object location is never asked about. To address this, we tracked the incidental use of locations for mnemonic rehearsal via directional biases in microsaccades while participants maintained two visual objects (colored oriented gratings) in working memory. By varying the stimulus configuration (horizontal, diagonal, and vertical) at encoding, we could quantify whether microsaccades were more aligned with the configurational axis of the memory contents, as opposed to the orthogonal axis. Experiment 1 revealed that microsaccades continued to be biased along the axis of the memory content several seconds into the working memory delay. In Experiment 2, we confirmed that this directional microsaccade bias was specific to memory demands, ruling out lingering effects from passive and attentive encoding of the same visual objects in the same configurations. Thus, by studying microsaccade directions, we uncover oculomotor-driven rehearsal of visual objects in working memory through their associated locations.
Collapse
Affiliation(s)
- Eelke de Vries
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam 1081 HV, The Netherlands
| | - Freek van Ede
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam 1081 HV, The Netherlands
| |
Collapse
|
23
|
de Vries E, Fejer G, van Ede F. No obligatory trade-off between the use of space and time for working memory. COMMUNICATIONS PSYCHOLOGY 2023; 1:41. [PMID: 38665249 PMCID: PMC11041649 DOI: 10.1038/s44271-023-00042-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Accepted: 11/24/2023] [Indexed: 04/28/2024]
Abstract
Space and time can each act as scaffolds for the individuation and selection of visual objects in working memory. Here we ask whether there is a trade-off between the use of space and time for visual working memory: whether observers will rely less on space, when memoranda can additionally be individuated through time. We tracked the use of space through directional biases in microsaccades after attention was directed to memory contents that had been encoded simultaneously or sequentially to the left and right of fixation. We found that spatial gaze biases were preserved when participants could (Experiment 1) and even when they had to (Experiment 2) additionally rely on time for object individuation. Thus, space remains a profound organizing medium for working memory even when other organizing sources are available and utilized, with no evidence for an obligatory trade-off between the use of space and time.
Collapse
Affiliation(s)
- Eelke de Vries
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - George Fejer
- Department of Psychology, Cognitive Psychology, University of Konstanz, Konstanz, Germany
| | - Freek van Ede
- Department of Experimental and Applied Psychology, Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
24
|
Nasrawi R, Boettcher SEP, van Ede F. Prospection of Potential Actions during Visual Working Memory Starts Early, Is Flexible, and Predicts Behavior. J Neurosci 2023; 43:8515-8524. [PMID: 37857486 PMCID: PMC10711698 DOI: 10.1523/jneurosci.0709-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 09/11/2023] [Accepted: 09/11/2023] [Indexed: 10/21/2023] Open
Abstract
For visual working memory to serve upcoming behavior, it is crucial that we prepare for the potential use of working-memory contents ahead of time. Recent studies have demonstrated how the prospection and planning for an upcoming manual action starts early after visual encoding, and occurs alongside visual retention. Here, we address whether such "output planning" in visual working memory flexibly adapts to different visual-motor mappings, and occurs even when an upcoming action will only potentially become relevant for behavior. Human participants (female and male) performed a visual-motor working memory task in which they remembered one or two colored oriented bars for later (potential) use. We linked, and counterbalanced, the tilt of the visual items to specific manual responses. This allowed us to track planning of upcoming behavior through contralateral attenuation of β band activity, a canonical motor-cortical EEG signature of manual-action planning. The results revealed how action encoding and subsequent planning alongside visual working memory (1) reflect anticipated task demands rather than specific visual-motor mappings, (2) occur even for actions that will only potentially become relevant for behavior, and (3) are associated with faster performance for the encoded item, at the expense of performance to other working-memory content. This reveals how the potential prospective use of visual working memory content is flexibly planned early on, with consequences for the speed of memory-guided behavior.SIGNIFICANCE STATEMENT It is increasingly studied how visual working memory helps us to prepare for the future, in addition to how it helps us to hold onto the past. Recent studies have demonstrated that the planning of prospective actions occurs alongside encoding and retention in working memory. We show that such early "output planning" flexibly adapts to varying visual-motor mappings, occurs both for certain and potential actions, and predicts ensuing working-memory guided behavior. These results highlight the flexible and future-oriented nature of visual working memory, and provide insight into the neural basis of the anticipatory dynamics that translate visual representations into adaptive upcoming behavior.
Collapse
Affiliation(s)
- Rose Nasrawi
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Sage E P Boettcher
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| |
Collapse
|
25
|
Fu Y, Guan C, Tam J, O'Donnell RE, Shen M, Wyble B, Chen H. Attention with or without working memory: mnemonic reselection of attended information. Trends Cogn Sci 2023; 27:1111-1122. [PMID: 37689583 DOI: 10.1016/j.tics.2023.08.010] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Revised: 08/10/2023] [Accepted: 08/14/2023] [Indexed: 09/11/2023]
Abstract
Attention has been regarded as the 'gatekeeper' controlling what information gets selected into working memory. However, a new perspective has emerged with the discovery of attribute amnesia, a phenomenon revealing that people are frequently unable to report information they have just attended to moments ago. This report failure is thought to stem from a lack of consolidating the attended information into working memory, indicating a dissociation between attention and working memory. Building on these findings, a new concept called memory reselection is proposed to describe a secondary round of selection among the attended information. These discoveries challenge the conventional view of how attention and working memory are related and shed new light onto modeling attention and memory as dissociable processes.
Collapse
Affiliation(s)
- Yingtao Fu
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zhejiang, China
| | - Chenxiao Guan
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zhejiang, China
| | - Joyce Tam
- Department of Psychology, The Pennsylvania State University, University Park, PA 16802, USA
| | - Ryan E O'Donnell
- Department of Psychology, The Pennsylvania State University, University Park, PA 16802, USA
| | - Mowei Shen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zhejiang, China.
| | - Brad Wyble
- Department of Psychology, The Pennsylvania State University, University Park, PA 16802, USA.
| | - Hui Chen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Zhejiang, China.
| |
Collapse
|
26
|
Ester E, Weese R. Temporally Dissociable Mechanisms of Spatial, Feature, and Motor Selection during Working Memory-guided Behavior. J Cogn Neurosci 2023; 35:2014-2027. [PMID: 37788302 DOI: 10.1162/jocn_a_02061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/05/2023]
Abstract
Working memory (WM) is a capacity- and duration-limited system that forms a temporal bridge between fleeting sensory phenomena and possible actions. But how are the contents of WM used to guide behavior? A recent high-profile study reported evidence for simultaneous access to WM content and linked motor plans during WM-guided behavior, challenging serial models where task-relevant WM content is first selected and then mapped on to a task-relevant motor response. However, the task used in that study was not optimized to distinguish the selection of spatial versus nonspatial visual information stored in memory, nor to distinguish whether or how the chronometry of selecting nonspatial visual information stored in memory might differ from the selection of linked motor plans. Here, we revisited the chronometry of spatial, feature, and motor selection during WM-guided behavior using a task optimized to disentangle these processes. Concurrent EEG and eye position recordings revealed clear evidence for temporally dissociable spatial, feature, and motor selection during this task. Thus, our data reveal the existence of multiple WM selection mechanisms that belie conceptualizations of WM-guided behavior based on purely serial or parallel visuomotor processing.
Collapse
|
27
|
Buonomano DV, Buzsáki G, Davachi L, Nobre AC. Time for Memories. J Neurosci 2023; 43:7565-7574. [PMID: 37940593 PMCID: PMC10634580 DOI: 10.1523/jneurosci.1430-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 08/22/2023] [Accepted: 08/25/2023] [Indexed: 11/10/2023] Open
Abstract
The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.
Collapse
Affiliation(s)
- Dean V Buonomano
- Department of Neurobiology, University of California, Los Angeles, California 90095
- Department of Psychology, University of California, Los Angeles, Los Angeles, California 90095
- Integrative Center for Learning and Memory, UCLA, Los Angeles, California 90025
| | - György Buzsáki
- Neuroscience Institute and Department of Neurology, NYU Grossman School of Medicine, New York University, New York, New York 10016
- Center for Neural Science, New York University, New York, New York 10003
| | - Lila Davachi
- Department of Psychology, Columbia University, New York, New York 10027
- Center for Clinical Research, Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York 10962
| | - Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
- Department of Psychology, Yale University, New Haven, Connecticut 06510
- Wu Tsai Center for Neurocognition and Behavior, Wu Tsai Institute, Yale University, New Haven, Connecticut 06510
| |
Collapse
|
28
|
Verschooren S, Egner T. When the mind's eye prevails: The Internal Dominance over External Attention (IDEA) hypothesis. Psychon Bull Rev 2023; 30:1668-1688. [PMID: 36988893 DOI: 10.3758/s13423-023-02272-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/13/2023] [Indexed: 03/30/2023]
Abstract
Throughout the 20th century, the psychological literature has considered attention as being primarily directed at the outside world. More recent theories conceive attention as also operating on internal information, and mounting evidence suggests a single, shared attentional focus between external and internal information. Such sharing implies a cognitive architecture where attention needs to be continuously shifted between prioritizing either external or internal information, but the fundamental principles underlying this attentional balancing act are currently unknown. Here, we propose and evaluate one such principle in the shape of the Internal Dominance over External Attention (IDEA) hypothesis: Contrary to the traditional view of attention as being primarily externally oriented, IDEA asserts that attention is inherently biased toward internal information. We provide a theoretical account for why such an internal attention bias may have evolved and examine findings from a wide range of literatures speaking to the balancing of external versus internal attention, including research on working memory, attention switching, visual search, mind wandering, sustained attention, and meditation. We argue that major findings in these disparate research lines can be coherently understood under IDEA. Finally, we consider tentative neurocognitive mechanisms contributing to IDEA and examine the practical implications of more deliberate control over this bias in the context of psychopathology. It is hoped that this novel hypothesis motivates cross-talk between the reviewed research lines and future empirical studies directly examining the mechanisms that steer attention either inward or outward on a moment-by-moment basis.
Collapse
Affiliation(s)
- Sam Verschooren
- Center for Cognitive Neuroscience, Duke University, Durham, NC, 27708, USA.
- Department of Experimental Psychology, Ghent University, Ghent, Belgium.
| | - Tobias Egner
- Center for Cognitive Neuroscience, Duke University, Durham, NC, 27708, USA
| |
Collapse
|
29
|
Chawoush B, Draschkow D, van Ede F. Capacity and selection in immersive visual working memory following naturalistic object disappearance. J Vis 2023; 23:9. [PMID: 37548958 PMCID: PMC10411649 DOI: 10.1167/jov.23.8.9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2023] [Accepted: 07/06/2023] [Indexed: 08/08/2023] Open
Abstract
Visual working memory-holding past visual information in mind for upcoming behavior-is commonly studied following the abrupt removal of visual objects from static two-dimensional (2D) displays. In everyday life, visual objects do not typically vanish from the environment in front of us. Rather, visual objects tend to enter working memory following self or object motion: disappearing from view gradually and changing the spatial relation between memoranda and observer. Here, we used virtual reality (VR) to investigate whether two classic findings from visual working memory research-a capacity of around three objects and the reliance on space for object selection-generalize to more naturalistic modes of object disappearance. Our static reference condition mimicked traditional laboratory tasks whereby visual objects were held static in front of the participant and removed from view abruptly. In our critical flow condition, the same visual objects flowed by participants, disappearing from view gradually and behind the observer. We considered visual working memory performance and capacity, as well as space-based mnemonic selection, indexed by directional biases in gaze. Despite vastly distinct modes of object disappearance and altered spatial relations between memoranda and observer, we found comparable capacity and comparable gaze signatures of space-based mnemonic selection. This finding reveals how classic findings from visual working memory research generalize to immersive situations with more naturalistic modes of object disappearance and with dynamic spatial relations between memoranda and observer.
Collapse
Affiliation(s)
- Babak Chawoush
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Dejan Draschkow
- Department of Experimental Psychology, University of Oxford, United Kingdom
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
30
|
Ester EF, Nouri A. Internal selective attention is delayed by competition between endogenous and exogenous factors. iScience 2023; 26:107259. [PMID: 37519902 PMCID: PMC10371823 DOI: 10.1016/j.isci.2023.107259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Revised: 05/18/2023] [Accepted: 06/27/2023] [Indexed: 08/01/2023] Open
Abstract
External attention is mediated by competition between endogenous (goal-driven) and exogenous (stimulus-driven) factors, with the balance of competition determining which stimuli are selected. Occasionally, exogenous factors "win" this competition and drive the selection of task-irrelevant stimuli. Endogenous and exogenous selection mechanisms may also compete to control the selection of internal representations (e.g., those stored in working memory), but whether this competition is resolved in the same way as external attention is unknown. Here, we leveraged the high temporal resolution of human EEG to determine how competition between endogenous and exogenous factors influences the selection of internal representations. Unlike external attention, competition did not prompt the selection of task-irrelevant working memory content. Instead, it delayed the endogenous selection of task-relevant working memory content by several hundred milliseconds. Thus, competition between endogenous and exogenous factors influences internal selective attention, but in a different way than external selective attention.
Collapse
Affiliation(s)
- Edward F. Ester
- Department of Psychology and Integrative Neuroscience Program, University of Nevada, Reno, NV, USA
| | - Asal Nouri
- Center for Complex Systems & Brain Sciences, Florida Atlantic University, 777 Glades Road, Boca Raton, FL, USA
| |
Collapse
|
31
|
Koevoet D, Naber M, Strauch C, Somai RS, Van der Stigchel S. Differential aspects of attention predict the depth of visual working memory encoding: Evidence from pupillometry. J Vis 2023; 23:9. [PMID: 37318440 PMCID: PMC10278550 DOI: 10.1167/jov.23.6.9] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 05/15/2023] [Indexed: 06/16/2023] Open
Abstract
What determines how much one encodes into visual working memory? Traditionally, encoding depth is considered to be indexed by spatiotemporal properties of gaze, such as gaze position and dwell time. Although these properties inform about where and how long one looks, they do not necessarily inform about the current arousal state or how strongly attention is deployed to facilitate encoding. Here, we found that two types of pupillary dynamics predict how much information is encoded during a copy task. The task involved encoding a spatial pattern of multiple items for later reproduction. Results showed that smaller baseline pupil sizes preceding and stronger pupil orienting responses during encoding predicted that more information was encoded into visual working memory. Additionally, we show that pupil size reflects not only how much but also how precisely material is encoded. We argue that a smaller pupil size preceding encoding is related to increased exploitation, whereas larger pupil constrictions signal stronger attentional (re)orienting to the to-be-encoded pattern. Our findings support the notion that the depth of visual working memory encoding is the integrative outcome of differential aspects of attention: how alert one is, how much attention one deploys, and how long it is deployed. Together, these factors determine how much information is encoded into visual working memory.
Collapse
Affiliation(s)
- Damian Koevoet
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Marnix Naber
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, The Netherlands
| | - Rosyl S Somai
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK
| | | |
Collapse
|
32
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
33
|
Li D, Hu Y, Qi M, Zhao C, Jensen O, Huang J, Song Y. Prioritizing flexible working memory representations through retrospective attentional strengthening. Neuroimage 2023; 269:119902. [PMID: 36708973 DOI: 10.1016/j.neuroimage.2023.119902] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 01/14/2023] [Accepted: 01/24/2023] [Indexed: 01/26/2023] Open
Abstract
Previous work has proposed two potential benefits of retrospective attention on working memory (WM): target strengthening and non-target inhibition. It remains unknown which hypothesis contributes to the improved WM performance, yet the neural mechanisms responsible for this attentional benefit are unclear. Here, we recorded electroencephalography (EEG) signals while 33 participants performed a retrospective-cue WM task. Multivariate pattern classification analysis revealed that only representations of target features were enhanced by valid retrospective attention during retention, supporting the target strengthening hypothesis. Further univariate analysis found that mid-frontal theta inter-trial phase coherence (ITPC) and ERP components were modulated by valid retrospective attention and correlated with individual differences and moment-to-moment fluctuations on behavioral outcomes, suggesting that both trait- and state-level variability in attentional preparatory processes influence goal-directed behavior. Furthermore, task-irrelevant target spatial location could be decoded from EEG signals, indicating that enhanced spatial binding of target representation is vital to high WM precision. Importantly, frontoparietal theta-alpha phase-amplitude coupling was increased by valid retrospective attention and predicted the reduced random guessing rates. This long-range connection supported top-down information flow in the engagement of frontoparietal networks, which might organize attentional states to integrate target features. Altogether, these results provide neurophysiological bases that retrospective attention improves WM precision by enhancing flexible target representation and emphasize the critical role of the frontoparietal attentional network in the control of WM representations.
Collapse
Affiliation(s)
- Dongwei Li
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| | - Yiqing Hu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Mengdi Qi
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China
| | - Chenguang Zhao
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Zhuhai, China
| | - Ole Jensen
- Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| | - Jing Huang
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Zhuhai, China.
| | - Yan Song
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Center for Collaboration and Innovation in Brain and Learning Sciences, Beijing Normal University, Beijing, China.
| |
Collapse
|
34
|
Narhi-Martinez W, Dube B, Golomb JD. Attention as a multi-level system of weights and balances. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2023; 14:e1633. [PMID: 36317275 PMCID: PMC9840663 DOI: 10.1002/wcs.1633] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Revised: 10/07/2022] [Accepted: 10/08/2022] [Indexed: 12/29/2022]
Abstract
This opinion piece is part of a collection on the topic: "What is attention?" Despite the word's place in the common vernacular, a satisfying definition for "attention" remains elusive. Part of the challenge is there exist many different types of attention, which may or may not share common mechanisms. Here we review this literature and offer an intuitive definition that draws from aspects of prior theories and models of attention but is broad enough to recognize the various types of attention and modalities it acts upon: attention as a multi-level system of weights and balances. While the specific mechanism(s) governing the weighting/balancing may vary across levels, the fundamental role of attention is to dynamically weigh and balance all signals-both externally-generated and internally-generated-such that the highest weighted signals are selected and enhanced. Top-down, bottom-up, and experience-driven factors dynamically impact this balancing, and competition occurs both within and across multiple levels of processing. This idea of a multi-level system of weights and balances is intended to incorporate both external and internal attention and capture their myriad of constantly interacting processes. We review key findings and open questions related to external attention guidance, internal attention and working memory, and broader attentional control (e.g., ongoing competition between external stimuli and internal thoughts) within the framework of this analogy. We also speculate about the implications of failures of attention in terms of weights and balances, ranging from momentary one-off errors to clinical disorders, as well as attentional development and degradation across the lifespan. This article is categorized under: Psychology > Attention Neuroscience > Cognition.
Collapse
Affiliation(s)
| | - Blaire Dube
- The Ohio State University, Department of Psychology
| | - Julie D. Golomb
- Correspondence concerning this article should be addressed to Julie Golomb, Department of Psychology, The Ohio State University, Columbus, OH, 43210.
| |
Collapse
|
35
|
Abstract
In this reflective piece on visual working memory, I depart from the laboriously honed skills of writing a review. Instead of integrating approaches, synthesizing evidence, and building a cohesive perspective, I scratch my head and share niggles and puzzlements. I expose where my scholarship and understanding are stumped by findings and standard views in the literature.
Collapse
|
36
|
Long-term memory and working memory compete and cooperate to guide attention. Atten Percept Psychophys 2022:10.3758/s13414-022-02593-1. [PMID: 36303020 DOI: 10.3758/s13414-022-02593-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/02/2022] [Indexed: 11/08/2022]
Abstract
Multiple types of memory guide attention: Both long-term memory (LTM) and working memory (WM) effectively guide visual search. Furthermore, both types of memories can capture attention automatically, even when detrimental to performance. It is less clear, however, how LTM and WM cooperate or compete to guide attention in the same task. In a series of behavioral experiments, we show that LTM and WM reliably cooperate to guide attention: Visual search is faster when both memories cue attention to the same spatial location (relative to when only one memory can guide attention). LTM and WM competed to guide attention in more limited circumstances: Competition only occurred when these memories were in different dimensions - particularly when participants searched for a shape and held an accessory color in mind. Finally, we found no evidence for asymmetry in either cooperation or competition: There was no evidence that WM helped (or hindered) LTM-guided search more than the other way around. This lack of asymmetry was found despite differences in LTM-guided and WM-guided search overall, and differences in how two LTMs and two WMs compete or cooperate with each other to guide attention. This work suggests that, even if only one memory is currently task-relevant, WM and LTM can cooperate to guide attention; they can also compete when distracting features are salient enough. This work elucidates interactions between WM and LTM during attentional guidance, adding to the literature on costs and benefits to attention from multiple active memories.
Collapse
|