1
|
Zhu S, Li Y, Fu Y, Yin J, Shen M, Chen H. The object as the unit for state switching in visual working memory. Cognition 2024; 249:105808. [PMID: 38776622 DOI: 10.1016/j.cognition.2024.105808] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Revised: 04/11/2024] [Accepted: 04/26/2024] [Indexed: 05/25/2024]
Abstract
This study aimed to determine the unit for switching representational states in visual working memory (VWM). Two opposing hypotheses were investigated: (a) the unit of switching being a feature (feature-based hypothesis), and (b) the unit of switching being an object (object-based hypothesis). Participants (N = 180) were instructed to hold two features from either one or two objects in their VWM. The memory-driven attentional capture effect, suggesting that actively held information in VWM can cause attention to be drawn towards matched distractors, was employed to assess representational states of the first and second probed colors (indicated by a retro-cue). The results showed that only the feature indicated to be probed first could elicit memory related capture for the condition of separate objects. Importantly, features from an integrated object could guide attention regardless of the probe order. These findings were observed across three experiments involving features of different dimensions, same dimensions, or perceptual objects defined by Gestalt principles. They provide convergent evidence supporting the object-based hypothesis by indicating that features within a single object cannot exist in different states.
Collapse
|
2
|
Xu ZJ, Buetti S, Xia Y, Lleras A. Skills and cautiousness predict performance in difficult search. Atten Percept Psychophys 2024:10.3758/s13414-024-02923-5. [PMID: 38997576 DOI: 10.3758/s13414-024-02923-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/12/2024] [Indexed: 07/14/2024]
Abstract
People differ in how well they search. What are the factors that might contribute to this variability? We tested the contribution of two cognitive abilities: visual working memory (VWM) capacity and object recognition ability. Participants completed three tasks: a difficult inefficient visual search task, where they searched for a target letter T among skewed L distractors; a VWM task, where they memorized a color array and then identified whether a probed color belonged to the previous array; and the Novel Object Memory Test (NOMT), where they learnt complex novel objects and then identified them amongst objects that closely resembled them. Exploratory and confirmatory factor analyses revealed that there are two latent factors that explain the shared variance among these three tasks: a factor indicative of the level of caution participants exercised during the challenging visual search task, and a factor representing their visual cognitive abilities. People who score high on the search cautiousness tend to perform a more accurate but slower search. People who score high on the visual cognitive ability factor tend to have a higher VWM capacity, a better object recognition ability, and a faster search speed. The results reflect two points: (1) Visual search tasks share components with visual working memory and object recognition tasks. (2) Search performance is influenced not only by the search display's properties but also by individual predispositions such as caution and general visual abilities. This study introduces new factors for consideration when interpreting variations in visual search behaviors.
Collapse
|
3
|
Theyer A, Davidson C, Amaireh G, Wijeakumar S. Association between caregiver and infant visual neurocognition. Infant Behav Dev 2024; 76:101975. [PMID: 38986217 DOI: 10.1016/j.infbeh.2024.101975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2024] [Revised: 05/31/2024] [Accepted: 07/02/2024] [Indexed: 07/12/2024]
Abstract
Previous work has shown that caregiver attention shapes visual cognition in infants through dyadic interactions. Is this association measurable when visual cognition is objectively measured in caregivers and infants using comparable experimental paradigms? In the current study, we presented infants (N = 86) and caregivers (N = 78) with age-specific variants of the same preferential looking visual cognition task to investigate whether caregiver visual cognition was associated with their infants' visual cognition. In each trial of the task, two side-by-side flashing displays of coloured shapes were presented. On the 'unchanging' side, the colours of the shapes remained the same. On the 'changing' side, the colour of one shape changed after each flash. Load was varied by changing the number of shapes across trials (low, medium, and high loads). We extracted looking dynamics using video recordings and brain function using functional near-infrared spectroscopy as both infants and caregivers engaged with the task. Change preference (CP) score, which represented the amount of time spent looking at the changing side divided by the total looking duration, showed a load-dependent modulation for both infants and caregivers. Both groups showed the highest CP scores at the low load. Further, higher caregiver CP scores was associated with higher infant CP scores at the low load. Both infants and caregivers engaged canonical regions of the fronto-parietal network involved in visual cognition. Critically, higher caregiver CP scores were associated with greater activation in the left superior parietal lobule in younger infants, a region involved in allocating visuo-spatial attention and working memory maintenance. Further, there was spatial overlap between performance-dependent regions in the right parietal cortex in caregivers and younger infants. Our findings provide first evidence of a heritability-related visual neurocognitive association between caregivers and their children in the first year of life.
Collapse
|
4
|
Sun Y, Wang L, Yu W, Yang X, Song J, Li S. Mechanisms of visual working memory processing task-irrelevant information retrieved from visual long-term memory. Cognition 2024; 250:105871. [PMID: 38968784 DOI: 10.1016/j.cognition.2024.105871] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Revised: 06/26/2024] [Accepted: 07/01/2024] [Indexed: 07/07/2024]
Abstract
Visual working memory (VWM) can selectively filter task-irrelevant information from incoming visual stimuli. However, whether a similar filtering process applies to task-irrelevant information retrieved from visual long-term memory (VLTM) remains elusive. We assume a "resource-limited retrieval mechanism" in VWM in charge of the retrieval of irrelevant VLTM information. To make a comprehensive understanding of this mechanism, we conducted three experiments using both a VLTM learning task and a VWM task combined with pupillometry. The presence of a significant pupil light response (PLR) served as empirical evidence that VLTM information can indeed make its way into VWM. Notably, task-relevant VLTM information induced a sustained PLR, contrasting with the transient PLR observed for task-irrelevant VLTM information. Importantly, the transience of the PLR occurred under conditions of low VWM load, but this effect was absent under conditions of high load. Collectively, these results show that task-irrelevant VLTM information can enter VWM and then fade away only under conditions of low VWM load. This dynamic underscores the resource-limited retrieval mechanism within VWM, exerting control over the entry of VLTM information.
Collapse
|
5
|
Tröndle M, Langer N. Decomposing neurophysiological underpinnings of age-related decline in visual working memory. Neurobiol Aging 2024; 139:30-43. [PMID: 38593526 DOI: 10.1016/j.neurobiolaging.2024.03.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 03/17/2024] [Accepted: 03/17/2024] [Indexed: 04/11/2024]
Abstract
Exploring the neural basis of age-related decline in working memory is vital in our aging society. Previous electroencephalographic studies suggested that the contralateral delay activity (CDA) may be insensitive to age-related decline in lateralized visual working memory (VWM) performance. Instead, recent evidence indicated that task-induced alpha power lateralization decreases in older age. However, the relationship between alpha power lateralization and age-related decline of VWM performance remains unknown, and recent studies have questioned the validity of these findings due to confounding factors of the aperiodic signal. Using a sample of 134 participants, we replicated the age-related decrease of alpha power lateralization after adjusting for the aperiodic signal. Critically, the link between task performance and alpha power lateralization was found only when correcting for aperiodic signal biases. Functionally, these findings suggest that age-related declines in VWM performance may be related to the decreased ability to prioritize relevant over irrelevant information. Conversely, CDA amplitudes were stable across age groups, suggesting a distinct neural mechanism possibly related to preserved VWM encoding or early maintenance.
Collapse
|
6
|
Donenfeld J, Blaser E, Kaldy Z. The resolution of proactive interference in a novel visual working memory task: A behavioral and pupillometric study. Atten Percept Psychophys 2024:10.3758/s13414-024-02888-5. [PMID: 38898344 DOI: 10.3758/s13414-024-02888-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/18/2024] [Indexed: 06/21/2024]
Abstract
Proactive interference (PI) occurs when previously learned information impairs memory for more recently learned information. Most PI studies have employed verbal stimuli, while the role of PI in visual working memory (VWM) has had relatively little attention. In the verbal domain, Johansson and colleagues (2018) found that pupil diameter - a real-time neurophysiological index of cognitive effort - reflects the accumulation and resolution of PI. Here we use a novel, naturalistic paradigm to test the behavioral and pupillary correlates of PI resolution for what-was-where item-location bindings in VWM. Importantly, in our paradigm, trials (PI vs. no-PI condition) are mixed in a block, and participants are naïve to the condition until they are tested. This design sidesteps concerns about differences in encoding strategies or generalized effort differences between conditions. Across three experiments (N = 122 total) we assessed PI's effect on VWM and whether PI resolution during memory retrieval is associated with greater cognitive effort (as indexed by the phasic, task-evoked pupil response). We found strong support for PI's detrimental effect on VWM (even with our spatially distributed stimuli), but no consistent link between interference resolution and effort during memory retrieval (this, even though the pupil was a reliable indicator that higher-performing individuals tried harder during memory encoding). We speculate that when explicit strategies are minimized, and PI resolution relies primarily on implicit processing, the effect may not be sufficient to trigger a robust pupillometric response.
Collapse
|
7
|
Friedman S, Drew T, Luria R. The effect of context on pointer allocation in visual working memory. Cortex 2024; 177:170-179. [PMID: 38865761 DOI: 10.1016/j.cortex.2024.04.019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Revised: 03/21/2024] [Accepted: 04/30/2024] [Indexed: 06/14/2024]
Abstract
Visual working memory (VWM) can hold a limited amount of visual information and manipulate it. It encodes this information and forms representations of each one of the relevant objects. When an object changes, VWM can either update or reset its representation to account for this change. To access a specific representation VWM relies on a pointer system associating each representation with the corresponding object in the environment. While previous studies described these processes as reacting to a change in the object status, this study investigated the adaptability of the pointer system to the task context. We measured the contralateral delay activity (CDA; an electrophysiological marker of VWM) as a marker of updating and resetting. In two experiments we used a shape change detection task (similar to Balaban & Luria, 2017) and manipulated the proportion of the resetting and updating trials to create different task contexts. Experiment 1 indicated that VWM can adapt to a resetting mode in which it performs resetting in conditions that triggered updating in previous studies. However, Experiment 2 revealed that the pointer system cannot adapt to an updating mode and perform updating in conditions that trigger resetting. These results suggest that VWM can strategically perform resetting, but once a pointer is lost, it's impossible to update the representation and a resetting process is mandatory triggered regardless of the context.
Collapse
|
8
|
Thiffault F, Cinq-Mars J, Brisson B, Blanchette I. Hearing fearful prosody impairs visual working memory maintenance. Int J Psychophysiol 2024; 199:112338. [PMID: 38552908 DOI: 10.1016/j.ijpsycho.2024.112338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 03/10/2024] [Accepted: 03/25/2024] [Indexed: 04/06/2024]
Abstract
Interference by distractors has been associated multiple times with diminished visual and auditory working memory (WM) performance. Negative emotional distractors in particular lead to detrimental effects on WM. However, these associations have only been seen when distractors and items to maintain in WM are from the same sensory modality. In this study, we investigate cross-modal interference on WM. We invited 20 participants to complete a visual change-detection task, assessing visual WM (VWM), while hearing emotional (fearful) and neutral auditory distractors. Electrophysiological activity was recorded to measure contralateral delay activity (CDA) and auditory P2 event-related potentials (ERP), indexing WM maintenance and distractor salience respectively. At the behavioral level, fearful prosody didn't decrease significantly working memory accuracy, compared to neutral prosody. Regarding ERPs, fearful distractors evoked a greater P2 amplitude than neutral distractors. Correlations between the two ERP potentials indicated that P2 amplitude difference between the two types of prosody was associated with the difference in CDA amplitude for fearful and neutral trials. This association suggests that cognitive resources required to process fearful prosody detrimentally impact VWM maintenance. That result provides a piece of additional evidence that negative emotional stimuli produce greater interference than neutral stimuli and that the cognitive resources used to process stimuli from different modalities come from a common pool.
Collapse
|
9
|
Chidharom M, Carlisle NB. Distinct mechanisms of attentional suppression: exploration of trait factors underlying cued- and learned-suppression. Cogn Res Princ Implic 2024; 9:26. [PMID: 38691325 PMCID: PMC11063026 DOI: 10.1186/s41235-024-00554-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Accepted: 04/17/2024] [Indexed: 05/03/2024] Open
Abstract
Attention allows us to focus on relevant information while ignoring distractions. Effective suppression of distracting information is crucial for efficient visual search. Recent studies have developed two paradigms to investigate attentional suppression: cued-suppression which is based on top-down control, and learned-suppression which is based on selection history. While both types of suppression reportedly engage proactive control, it remains unclear whether they rely on shared mechanisms. This study aimed to determine the relationship between cued- and learned-suppression. In a within-subjects design, 54 participants performed a cued-suppression task where pre-cues indicated upcoming target or distractor colors, and a learned-suppression task where a salient color distractor was present or absent. No significant correlation emerged between performance in the two tasks, suggesting distinct suppression mechanisms. Cued-suppression correlated with visual working memory capacity, indicating reliance on explicit control. In contrast, learned-suppression correlated with everyday distractibility, suggesting implicit control based on regularities. These results provide evidence for heterogeneous proactive control mechanisms underlying cued- and learned-suppression. While both engage inhibition, cued-suppression relies on deliberate top-down control modulated by working memory, whereas learned-suppression involves implicit suppression shaped by selection history and distractibility traits.
Collapse
|
10
|
Pang C, Chen Y, Zhang Y, Nan W, Fu S. Suppression on the basis of template for rejection is reactive: Evidence from human electrophysiology. Atten Percept Psychophys 2024; 86:1148-1162. [PMID: 38491317 DOI: 10.3758/s13414-024-02873-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2024] [Indexed: 03/18/2024]
Abstract
According to most theories of attention, the selection of task-relevant visual information can be enhanced by holding them in visual working memory (VWM). However, there has been a long-standing debate concerning whether similar optimization can also be achieved for task-irrelevant information, known as a "template for rejection". The present study aimed to explore this issue by examining the consequence of cue distractors before visual search tasks. For this endeavor, we manipulated the display heterogeneity by using two distractor conditions, salient and non-salient, to explore the extent to which holding the distractor color in VWM might affect attentional selection. We measured the reaction times of participants while their EEG activity was recorded. The results showed that WM-matched distractors did not improve reaction times but rather slowed them down in both tasks. Event-related potential (ERP) results showed that the display heterogeneity had no modulatory effect on the degree of distractor suppression. Even in the salient distractor condition, the WM-matched distractor received no greater suppression. Furthermore, the WM-matched distractor but not the neutral distractor elicited an N2pc before the PD in salient distractor conditions. This suggests that the template for rejection operates reactively since suppression occurs after extra attentional processes to the distractor. Moreover, the presence of WM-matched distractors led to a reduction of P3b, indicating a competition between target processing and WM-matched distractor rejection. Our findings provide insights into the mechanisms underlying the optimization of attentional selection, and have implications for future studies aimed at understanding the role of VWM in cognition.
Collapse
|
11
|
Zhao YJ, Zhang X, Ku Y. Divergent roles of early visual cortex and inferior frontal junction in visual working memory. Brain Stimul 2024; 17:713-720. [PMID: 38839040 DOI: 10.1016/j.brs.2024.06.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 05/31/2024] [Accepted: 06/02/2024] [Indexed: 06/07/2024] Open
Abstract
BACKGROUND Recent studies indicate that both prefrontal and visual regions play critical roles in visual working memory (VWM), with prefrontal regions mainly associated with executive functions, and visual cortices linked to representations of memory contents. VWM involves the selective filtering of irrelevant information, yet the specific contributions of the prefrontal regions and visual cortex in this process remain unclear. OBJECTIVE To understand the dynamic causal roles of prefrontal and visual regions in VWM. METHODS The differentiation of VWM components was achieved using a computational model that incorporated a swap rate for non-target stimuli. Single-pulse magnetic transcranial stimulation (spTMS) was delivered to the early visual cortex (EVC) and the inferior frontal junction (IFJ) across different phases of an orientation recall task that with or without distractors. RESULTS Our results indicate that spTMS over the EVC and IFJ influences VWM particularly when distractors are present. VWM precision can be impacted by spTMS applied to either region during the early retention, while spTMS effect is especially prominent when EVC is stimulated during the late retention phase and when directed at the ipsilateral EVC. Conversely, the probability of accurately recalling the target exhibited comparable patterns when spTMS was administered to either the EVC or IFJ. CONCLUSIONS We highlight the "sensory recruitment" of VWM characterized by critical involvement of EVC particularly in the information-filtering process within VWM. The maintenance of memory content representations necessitates ongoing communication between the EVC and IFJ throughout the entirety of the VWM process in a dynamic pattern.
Collapse
|
12
|
Deng H, Yang X, Zhang Y, Li S, Wang C. The independent storage mechanisms of visual and vibrotactile working memory. Psychon Bull Rev 2024:10.3758/s13423-024-02509-0. [PMID: 38653956 DOI: 10.3758/s13423-024-02509-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/21/2024] [Indexed: 04/25/2024]
Abstract
Whether information in working memory (WM) is stored in a domain-independent or domain-specific system is still the subject of intense debate. This study used the delayed match-to-sample paradigm, the dual-task paradigm, and the selective interference paradigm to investigate the mechanism of cross-modal storage in visual and vibrotactile WM. We postulated that WM may store cross-modal data from haptics and vision independently, and we proposed domain-specific WM storage. According to the findings, the WM can store cross-modal information from vision and haptics independently, and the storage of visual and tactile WM may be domain-specific. This study provides early support for the hypothesis that haptic and visuospatial sketchpads are dissociated. In addition, the current study provides evidence to elucidate the mechanisms by which WM stores and processes data from different modalities and content. The results also indicate that a cross-modal approach can broaden the cognitive processing bandwidth of WM.
Collapse
|
13
|
Dawes AJ, Keogh R, Pearson J. Multisensory subtypes of aphantasia: Mental imagery as supramodal perception in reverse. Neurosci Res 2024; 201:50-59. [PMID: 38029861 DOI: 10.1016/j.neures.2023.11.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 11/20/2023] [Indexed: 12/01/2023]
Abstract
Cognitive neuroscience research on mental imagery has largely focused on the visual imagery modality in unimodal task contexts. Recent studies have uncovered striking individual differences in visual imagery capacity, with some individuals reporting a subjective absence of conscious visual imagery ability altogether ("aphantasia"). However, naturalistic mental imagery is often multi-sensory, and preliminary findings suggest that many individuals with aphantasia also report a subjective lack of mental imagery in other sensory domains (such as auditory or olfactory imagery). In this paper, we perform a series of cluster analyses on the multi-sensory imagery questionnaire scores of two large groups of aphantasic subjects, defining latent sub-groups in this sample population. We demonstrate that aphantasia is a heterogenous phenomenon characterised by dominant sub-groups of individuals with visual aphantasia (those who report selective visual imagery absence) and multi-sensory aphantasia (those who report an inability to generate conscious mental imagery in any sensory modality). We replicate our findings in a second large sample and show that more unique aphantasia sub-types also exist, such as individuals with selectively preserved mental imagery in only one sensory modality (e.g. intact auditory imagery). We outline the implications of our findings for network theories of mental imagery, discussing how unique aphantasia aetiologies with distinct self-report patterns might reveal alterations to various levels of the sensory processing hierarchy implicated in mental imagery.
Collapse
|
14
|
Abstract
The body of research on visual working memory (VWM)-the system often described as a limited memory store of visual information in service of ongoing tasks-is growing rapidly. The discovery of numerous related phenomena, and the many subtly different definitions of working memory, signify a challenge to maintain a coherent theoretical framework to discuss concepts, compare models and design studies. A lack of robust theory development has been a noteworthy concern in the psychological sciences, thought to be a precursor to the reproducibility crisis (Oberauer & Lewandowsky, Psychonomic Bulletin & Review, 26, 1596-1618, 2019). I review the theoretical landscape of the VWM field by examining two prominent debates-whether VWM is object-based or feature-based, and whether discrete-slots or variable-precision best describe VWM limits. I share my concerns about the dualistic nature of these debates and the lack of clear model specification that prevents fully determined empirical tests. In hopes of promoting theory development, I provide a working theory map by using the broadly encompassing memory for latent representations model (Hedayati et al., Nature Human Behaviour, 6, 5, 2022) as a scaffold for relevant phenomena and current theories. I illustrate how opposing viewpoints can be brought into accordance, situating leading models of VWM to better identify their differences and improve their comparison. The hope is that the theory map will help VWM researchers get on the same page-clarifying hidden intuitions and aligning varying definitions-and become a useful device for meaningful discussions, development of models, and definitive empirical tests of theories.
Collapse
|
15
|
Brady TF, Störmer VS. Comparing memory capacity across stimuli requires maximally dissimilar foils: Using deep convolutional neural networks to understand visual working memory capacity for real-world objects. Mem Cognit 2024; 52:595-609. [PMID: 37973770 DOI: 10.3758/s13421-023-01485-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/17/2023] [Indexed: 11/19/2023]
Abstract
The capacity of visual working and visual long-term memory plays a critical role in theories of cognitive architecture and the relationship between memory and other cognitive systems. Here, we argue that before asking the question of how capacity varies across different stimuli or what the upper bound of capacity is for a given memory system, it is necessary to establish a methodology that allows a fair comparison between distinct stimulus sets and conditions. One of the most important factors determining performance in a memory task is target/foil dissimilarity. We argue that only by maximizing the dissimilarity of the target and foil in each stimulus set can we provide a fair basis for memory comparisons between stimuli. In the current work we focus on a way to pick such foils objectively for complex, meaningful real-world objects by using deep convolutional neural networks, and we validate this using both memory tests and similarity metrics. Using this method, we then provide evidence that there is a greater capacity for real-world objects relative to simple colors in visual working memory; critically, we also show that this difference can be reduced or eliminated when non-comparable foils are used, potentially explaining why previous work has not always found such a difference. Our study thus demonstrates that working memory capacity depends on the type of information that is remembered and that assessing capacity depends critically on foil dissimilarity, especially when comparing memory performance and other cognitive systems across different stimulus sets.
Collapse
|
16
|
Qian J, Fu B, Gao Z, Tan B. The influence of depth on object selection and manipulation in visual working memory within a 3D context. Psychon Bull Rev 2024:10.3758/s13423-024-02492-6. [PMID: 38519758 DOI: 10.3758/s13423-024-02492-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/08/2024] [Indexed: 03/25/2024]
Abstract
Recent studies have examined whether the internal selection mechanism functions similarly for perception and visual working memory (VWM). However, the process of how we access and manipulate object representations distributed in a 3D space remains unclear. In this study, we utilized a memory search task to investigate the effect of depth on object selection and manipulation within VWM. The memory display consisted of colored items half positioned at the near depth plane and the other half at the far plane. During memory maintenance, the participants were instructed to search for a target representation and update its color. The results showed that under object-based attention (Experiments 1, 3, and 5), the update time was faster for targets at the near plane than for those at the far plane. This effect was absent in VWM when deploying spatial attention (Experiment 2) and in visual search regardless of the type of attention deployed (Experiment 4). The differential effects of depth on spatial and object-based attention in VWM suggest that spatial attention primarily relied on 2D location information irrespective of depth, whereas object-based attention seemed to prioritize memory representations at the front plane before shifting to the back. Our findings shed light on the interaction between depth perception and the selection mechanisms within VWM in a 3D context, emphasizing the importance of ordinal, rather than metric, spatial information in guiding object-based attention in VWM.
Collapse
|
17
|
Davidson C, Theyer A, Amaireh G, Wijeakumar S. The impact of caregiver inhibitory control on infant visual working memory. Infant Behav Dev 2024; 74:101921. [PMID: 38211463 DOI: 10.1016/j.infbeh.2023.101921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/30/2023] [Accepted: 12/31/2023] [Indexed: 01/13/2024]
Abstract
Visual working memory (VWM) emerges in the first year of life and has far-reaching implications for academic and later life outcomes. Given that caregivers play a significant role in shaping cognitive function in children, it is important to understand how they might impact VWM development as early as infancy. The current study investigated whether caregivers' efficiency of regulating inhibitory control was associated with VWM function in their infants. Eighty-eight caregivers were presented with a Go-NoGo task to assess inhibitory control. An efficiency score was calculated using their behavioural responses. Eighty-six 6-to-10-month-old infants were presented with a preferential looking task to assess VWM function. VWM load was manipulated across one (low load), two (medium load) and three (high load) items. Functional near-infrared spectroscopy was used to record brain activation from caregivers and their infants. We found no direct association between caregiver efficiency and infant VWM behaviour. However, we found an indirect association - caregiver efficiency was linked to infant VWM through left-lateralized fronto-parietal engagement. Specifically, infants with low efficiency caregivers showed decreasing left-lateralized parietal engagement with increasing VWM performance at the medium and high loads compared to infants with high efficiency caregivers, who did not show any load- or performance-dependent modulation. Our findings contribute to a growing body of literature examining the role that caregivers play in early neurocognitive development.
Collapse
|
18
|
Thibeault AML, Stojanoski B, Emrich SM. Investigating the effects of perceptual complexity versus conceptual meaning on the object benefit in visual working memory. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2024:10.3758/s13415-024-01158-z. [PMID: 38291307 DOI: 10.3758/s13415-024-01158-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 01/06/2024] [Indexed: 02/01/2024]
Abstract
Previous research has demonstrated greater visual working memory (VWM) performance for real-world objects compared with simple features. Greater amplitudes of the contralateral delay activity (CDA)-a sustained event-related potential measured during the delay period of a VWM task-have also been noted for meaningful stimuli, despite being thought of as a neural marker of a fixed working memory capacity. The current study aimed to elucidate the factors underlying improved memory performance for real-world objects by isolating the relative contributions of perceptual complexity (i.e., number of visual features) and conceptual meaning (i.e., availability of semantic, meaningful features). Participants (N = 22) performed a lateralized VWM task to test their memory of intact real-world objects, scrambled real-world objects and colours. The CDA was measured during both encoding and WM retention intervals (600-1000 ms and 1300-1700 ms poststimulus onset, respectively), and behavioural performance was estimated by using d' (memory strength in a two-alternative forced choice task). Behavioural results revealed significantly better performance within-subjects for real-world objects relative to scrambled objects and colours, with no difference between colours and scrambled objects. The amplitude of the CDA was also largest for intact real-world objects, with no difference in magnitude for scrambled objects and colours, during working memory maintenance. However, during memory encoding, both the colours and intact real-world objects had significantly greater amplitudes than scrambled objects and were comparable in magnitude. Overall, findings suggest that conceptual meaning (semantics) supports the memory benefit for real-world objects.
Collapse
|
19
|
Gillies G, Fukuda K, Cant JS. The role of visual working memory in capacity-limited cross-modal ensemble coding. Neuropsychologia 2024; 192:108745. [PMID: 38096982 DOI: 10.1016/j.neuropsychologia.2023.108745] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 12/01/2023] [Accepted: 12/04/2023] [Indexed: 12/19/2023]
Abstract
Ensemble coding refers to the brain's ability to rapidly extract summary statistics, such as average size and average cost, from a large set of visual stimuli. Although ensemble coding is thought to circumvent a capacity limit of visual working memory, we recently observed a VWM-like capacity limit in an ensemble task where observers extracted the average sweetness of groups of food pictures (i.e., they could only integrate information from four out of six available items), thus suggesting the involvement of VWM in this novel form of cross-modal ensemble coding. Therefore, across two experiments we investigated if this cross-modal ensemble capacity limit could be explained by individual differences in VWM processing. To test this, observers performed both an ensemble task and a VWM task, and we determined 1) how much information they integrated into their ensemble percepts, and 2) how much information they remembered from those displays. Interestingly, we found that individual differences in VWM capacity did not explain differences in performance on the ensemble coding task (i.e., high-capacity individuals did not have significantly higher "ensemble abilities" than low-capacity individuals). While our data cannot definitively state whether or not VWM is necessary to perform the ensemble task, we conclude that it is certainly not sufficient to support this cognitive process. We speculate that the capacity limit may be explained by 1) a bottleneck at the perceptual stage (i.e., a failure to process multiple visual features across multiple items, as there are no singular features that convey taste), or 2) the interaction of multiple cognitive systems (e.g., VWM, gustatory working memory, long term memory). Our results highlight the importance of examining ensemble perception across multiple sensory and cognitive domains to provide a clearer picture of the mechanisms underlying everyday behavior.
Collapse
|
20
|
Koevoet D, Naber M, Strauch C, Van der Stigchel S. The Intensity of Internal and External Attention Assessed with Pupillometry. J Cogn 2024; 7:8. [PMID: 38223232 PMCID: PMC10786008 DOI: 10.5334/joc.336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 11/30/2023] [Indexed: 01/16/2024] Open
Abstract
Not only is visual attention shifted to objects in the external world, attention can also be directed to objects in memory. We have recently shown that pupil size indexes how strongly items are attended externally, which was reflected in more precise encoding into visual working memory. Using a retro-cuing paradigm, we here replicated this finding by showing that stronger pupil constrictions during encoding were reflective of the depth of encoding. Importantly, we extend this previous work by showing that pupil size also revealed the intensity of internal attention toward content stored in visual working memory. Specifically, pupil dilation during the prioritization of one among multiple internally stored representations predicted the precision of the prioritized item. Furthermore, the dynamics of the pupillary responses revealed that the intensity of internal and external attention independently determined the precision of internalized visual representations. Our results show that both internal and external attention are not all-or-none processes, but should rather be thought of as continuous resources that can be deployed at varying intensities. The employed pupillometric approach allows to unravel the intricate interplay between internal and external attention and their effects on visual working memory.
Collapse
|
21
|
Yi X, Xiao Q, Fu Y, Wang X, Shen L, Ding J, Jiang F, Wang J, Zhang Z, Chen BT. Association of white matter microstructural alteration with non-suicidal self-injury behavior and visual working memory in adolescents with borderline personality disorder. Psychiatry Res 2024; 331:115619. [PMID: 38048646 DOI: 10.1016/j.psychres.2023.115619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 11/13/2023] [Accepted: 11/18/2023] [Indexed: 12/06/2023]
Abstract
BACKGROUND Non-suicidal self-injurious behavior (NSSI) is the core characteristic of adolescent borderline personality disorder (BPD) and visual working memory is involved in the pathological processes of BPD. This study aimed to investigate alterations in white matter microstructure and their association with NSSI and visual working memory in adolescents with BPD. METHODS 53 adolescents diagnosed with BPD and 39 healthy controls (HCs) were enrolled. White matter microstructure was assessed with the fractional anisotropy (FA) and mean diffusivity (MD) from diffusion tensor imaging (DTI). Correlation analysis was performed to assess the association between FA/MD and core features of BPD. A mediation analysis was performed to test whether the effects of white matter alterations on NSSI could be mediated by visual working memory. RESULTS Adolescents with BPD showed a reduced FA and an increased MD in the cortical-limbic and cortical-thalamus circuit when compared to the HCs (p < 0.05). Increased MD was positively correlated with NSSI, impulse control and identity disturbance (p < 0.05), and was negatively correlated with the score of visual reproduction. Reserved visual working memory masked the effects of white matter microstructural alterations on NSSI behavior. CONCLUSIONS White matter microstructural deficits in the cortical-limbic and cortical-thalamus circuits may be associated with NSSI and visual working memory in adolescents with BPD. Reserved visual working memory may protect against NSSI.
Collapse
|
22
|
Lockhart HA, Dube B, MacDonald KJ, Al-Aidroos N, Emrich SM. Limitations on flexible allocation of visual short-term memory resources with multiple levels of goal-directed attentional prioritization. Atten Percept Psychophys 2024; 86:159-170. [PMID: 37985598 DOI: 10.3758/s13414-023-02813-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/26/2023] [Indexed: 11/22/2023]
Abstract
Studies suggest that visual short-term memory (VSTM) is a continuous resource that can be flexibly allocated using probabilistic cues that indicate test likelihood (i.e., goal-directed attentional priority to those items). Previous studies using simultaneous cues have not examined this flexible allocation beyond two distinct levels of priority. Moreover, previous studies have not examined whether there are individual differences in the ability to flexibly allocate VSTM resources, as well as whether this ability benefits from practice. The current study used a continuous report procedure to examine whether participants can use up to three levels of attentional priority to allocate VSTM resources via simultaneous probabilistic spatial cues. Three experiments were performed with differing priority levels, cues, and cue presentation times. Group level analysis demonstrated flexible allocation of VSTM resources; however, there was limited evidence that participants could use three goal-directed priority levels. A temporal analysis suggested that task fatigue, rather than practice effects, may interact with item priority. A Bayesian individual-differences analysis revealed that a minority of participants were using three levels of attentional priority, demonstrating that, while possible, it is not the predominant pattern of behaviour. Thus, we provided evidence that flexible allocation to three attention levels is possible under simultaneous cuing conditions for a minority of participants. Flexible allocation to three categories may be interpreted as a skill of high-performing participants akin to high memory capacity.
Collapse
|
23
|
Zhou Z, Geng JJ. Learned associations serve as target proxies during difficult but not easy visual search. Cognition 2024; 242:105648. [PMID: 37897882 DOI: 10.1016/j.cognition.2023.105648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Revised: 10/03/2023] [Accepted: 10/12/2023] [Indexed: 10/30/2023]
Abstract
The target template contains information in memory that is used to guide attention during visual search and is typically thought of as containing features of the actual target object. However, when targets are hard to find, it is advantageous to use other information in the visual environment that is predictive of the target's location to help guide attention. The purpose of these studies was to test if newly learned associations between face and scene category images lead observers to use scene information as a proxy for the face target. Our results showed that scene information was used as a proxy for the target to guide attention but only when the target face was difficult to discriminate from the distractor face; when the faces were easy to distinguish, attention was no longer guided by the scene unless the scene was presented earlier. The results suggest that attention is flexibly guided by both target features as well as features of objects that are predictive of the target location. The degree to which each contributes to guiding attention depends on the efficiency with which that information can be used to decode the location of the target in the current moment. The results contribute to the view that attentional guidance is highly flexible in its use of information to rapidly locate the target.
Collapse
|
24
|
Chung YH, Brady TF, Störmer VS. Sequential encoding aids working memory for meaningful objects' identities but not for their colors. Mem Cognit 2023:10.3758/s13421-023-01486-4. [PMID: 37948024 DOI: 10.3758/s13421-023-01486-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/19/2023] [Indexed: 11/12/2023]
Abstract
Previous studies have found that real-world objects' identities are better remembered than simple features like colored circles, and this effect is particularly pronounced when these stimuli are encoded one by one in a serial, item-based way. Recent work has also demonstrated that memory for simple features like color is improved if these colors are part of real-world objects, suggesting that meaningful objects can serve as a robust memory scaffold for their associated low-level features. However, it is unclear whether the improved color memory that arises from the colors appearing on real-world objects is affected by encoding format, in particular whether items are encoded sequentially or simultaneously. We test this using randomly colored silhouettes of recognizable versus unrecognizable scrambled objects that offer a uniquely controlled set of stimuli to test color working memory of meaningful versus non-meaningful objects. Participants were presented with four stimuli (silhouettes of objects or scrambled shapes) simultaneously or sequentially. After a short delay, they reported either which colors or which shapes they saw in a two-alternative forced-choice task. We replicated previous findings that meaningful stimuli boost working memory performance for colors (Exp. 1). We found that when participants remembered the colors (Exp. 2) there was no difference in performance across the two encoding formats. However, when participants remembered the shapes and thus identity of the objects (Exp. 3), sequential presentation resulted in better performance than simultaneous presentation. Overall, these results show that different encoding formats can flexibly impact visual working memory depending on what the memory-relevant feature is.
Collapse
|
25
|
Han S, Zhou H, Tian Y, Ku Y. Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues. Prog Neurobiol 2023; 230:102521. [PMID: 37673370 DOI: 10.1016/j.pneurobio.2023.102521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 08/17/2023] [Accepted: 08/28/2023] [Indexed: 09/08/2023]
Abstract
Attention can be deployed among external sensory stimuli or internal working memory (WM) representations, and recent primate studies have revealed that these external and internal selections share a common neural basis in the prefrontal cortex (PFC). However, it remains to be elucidated how PFC implements these selections, especially in humans. The present study aimed to further investigate whether PFC responded differentially to the peripheral and central retrospective cues (retro-cues) that induced attention selection among WM representations. To achieve this, we combined magnetoencephalography (MEG, Experiment 1) and transcranial magnetic stimulation (TMS, Experiment 2) with an orientation-recall paradigm. Experiment 1 found that a peripheral retro-cue with 100% reliability had a greater benefit on WM performance than a central retro-cue, while this advantage of peripheral over central cues vanished when the cue reliability dropped to 50% (non-informative). MEG source analysis indicated that the 100% peripheral retro-cue elicited earlier (∼125 ms) PFC responses than the central retro-cue (∼275 ms). Meanwhile, Granger causality analysis showed that PFC had earlier (0-200 ms) top-down signals projecting to the superior parietal lobule (SPL) and the lateral occipital cortex (LOC) after the onset of peripheral retro-cues, while these top-down signals appeared later (300-500 ms) after the onset of central retro-cues. Importantly, PFC activity within this period of 300-500 ms correlated with the peripheral advantage in behavior. Moreover, Experiment 2 applied TMS at different time points to test the causal influence of brain activity on behavior and found that stimulating PFC at 100 ms abolished the behavioral benefit of the peripheral retro-cue, as well as its advantage over the central retro-cue. Taken together, our results suggested that the advantage of peripheral over central retro-cues in the mnemonic domain is realized through faster top-down control from PFC, which challenged traditional opinions that the top-down control of attention on WM required at least 300 ms to appear. The present study highlighted that in addition to the causal role of PFC in attention selection of WM representations, timing was critical as well and faster was better.
Collapse
|