1
|
Chen S, Töllner T, Müller HJ, Conci M. ERPs and alpha oscillations track the encoding and maintenance of object-based representations in visual working memory. Psychophysiology 2024; 61:e14557. [PMID: 38459638 DOI: 10.1111/psyp.14557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/10/2024]
Abstract
When memorizing an integrated object such as a Kanizsa figure, the completion of parts into a coherent whole is attained by grouping processes which render a whole-object representation in visual working memory (VWM). The present study measured event-related potentials (ERPs) and oscillatory amplitudes to track these processes of encoding and representing multiple features of an object in VWM. To this end, a change detection task was performed, which required observers to memorize both the orientations and colors of six "pacman" items while inducing configurations of the pacmen that systematically varied in terms of their grouping strength. The results revealed an effect of object configuration in VWM despite physically constant visual input: change detection for both orientation and color features was more accurate with increased grouping strength. At the electrophysiological level, the lateralized ERPs and alpha activity mirrored this behavioral pattern. Perception of the orientation features gave rise to the encoding of a grouped object as reflected by the amplitudes of the Ppc. The grouped object structure, in turn, modulated attention to both orientation and color features as indicated by the enhanced N1pc and N2pc. Finally, during item retention, the representation of individual objects and the concurrent allocation of attention to these memorized objects were modulated by grouping, as reflected by variations in the CDA amplitude and a concurrent lateralized alpha suppression, respectively. These results indicate that memorizing multiple features of grouped, to-be-integrated objects involves multiple, sequential stages of processing, providing support for a hierarchical model of object representations in VWM.
Collapse
Affiliation(s)
- Siyi Chen
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Thomas Töllner
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Hermann J Müller
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| | - Markus Conci
- Allgemeine und Experimentelle Psychologie, Department Psychologie, Ludwig-Maximilians-Universität München, Munich, Germany
| |
Collapse
|
2
|
Thiffault F, Cinq-Mars J, Brisson B, Blanchette I. Hearing fearful prosody impairs visual working memory maintenance. Int J Psychophysiol 2024; 199:112338. [PMID: 38552908 DOI: 10.1016/j.ijpsycho.2024.112338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 03/10/2024] [Accepted: 03/25/2024] [Indexed: 04/06/2024]
Abstract
Interference by distractors has been associated multiple times with diminished visual and auditory working memory (WM) performance. Negative emotional distractors in particular lead to detrimental effects on WM. However, these associations have only been seen when distractors and items to maintain in WM are from the same sensory modality. In this study, we investigate cross-modal interference on WM. We invited 20 participants to complete a visual change-detection task, assessing visual WM (VWM), while hearing emotional (fearful) and neutral auditory distractors. Electrophysiological activity was recorded to measure contralateral delay activity (CDA) and auditory P2 event-related potentials (ERP), indexing WM maintenance and distractor salience respectively. At the behavioral level, fearful prosody didn't decrease significantly working memory accuracy, compared to neutral prosody. Regarding ERPs, fearful distractors evoked a greater P2 amplitude than neutral distractors. Correlations between the two ERP potentials indicated that P2 amplitude difference between the two types of prosody was associated with the difference in CDA amplitude for fearful and neutral trials. This association suggests that cognitive resources required to process fearful prosody detrimentally impact VWM maintenance. That result provides a piece of additional evidence that negative emotional stimuli produce greater interference than neutral stimuli and that the cognitive resources used to process stimuli from different modalities come from a common pool.
Collapse
Affiliation(s)
- François Thiffault
- CogNAC Research Group (Cognition, Neurosciences, Affect et Comportement), Québec, Canada; Département de Psychologie, Université du Québec à Trois-Rivières, Québec, Canada.
| | - Justine Cinq-Mars
- CogNAC Research Group (Cognition, Neurosciences, Affect et Comportement), Québec, Canada; Département de Psychologie, Université du Québec à Trois-Rivières, Québec, Canada
| | - Benoît Brisson
- CogNAC Research Group (Cognition, Neurosciences, Affect et Comportement), Québec, Canada; Département de Psychologie, Université du Québec à Trois-Rivières, Québec, Canada.
| | - Isabelle Blanchette
- CogNAC Research Group (Cognition, Neurosciences, Affect et Comportement), Québec, Canada; École de Psychologie, Université Laval, Québec, Québec, Canada; CERVO Brain Research Center, Québec, Québec, Canada.
| |
Collapse
|
3
|
Balaban H, Drew T, Luria R. Dissociable online integration processes in visual working memory. Cereb Cortex 2023; 33:11420-11430. [PMID: 37814362 DOI: 10.1093/cercor/bhad378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 09/16/2023] [Accepted: 09/17/2023] [Indexed: 10/11/2023] Open
Abstract
Visual working memory has severe capacity limits, creating a bottleneck for active processing. A key way of mitigating this limitation is by chunking, i.e. compressing several pieces of information into one visual working memory representation. However, despite decades of research, chunking efficiency remains debated because of mixed evidence. We propose that there are actually 2 integration mechanisms: Grouping combines several objects to one representation, and object-unification merges the parts of a single object. Critically, we argue that the fundamental distinction between the 2 processes is their differential use of the pointer system, the indexing process connecting visual working memory representations with perception. In grouping, the objects that are represented together still maintain independent pointers, making integration costly but highly flexible. Conversely, object-unification fuses the pointers as well as the representations, with the single pointer producing highly efficient integration but blocking direct access to individual parts. We manipulated integration cues via task-irrelevant movement, and monitored visual working memory's online electrophysiological marker. Uniquely colored objects were flexibly grouped and ungrouped via independent pointers (experiment 1). If objects turned uniformly black, object-integration could not be undone (experiment 2), requiring visual working memory to reset before re-individuation. This demonstrates 2 integration levels (representational-merging versus pointer-compression) and establishes the dissociation between visual working memory representations and their underlying pointers.
Collapse
Affiliation(s)
- Halely Balaban
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, 02139 MA, United States
- Psychology Department, Harvard University, Cambridge, 02138 MA, United States
| | - Trafton Drew
- Psychology Department, University of Utah, Salt Lake City, 84112 UT, United States
| | - Roy Luria
- Sagol School of Neuroscience, Tel Aviv University, Tel Aviv 6997801, Israel
- The School of Psychological Sciences, Tel Aviv University, Tel Aviv 6997801, Israel
| |
Collapse
|
4
|
Pan T, Zheng Z, Li F, Wang J. Memory matching features bias the ensemble perception of facial identity. Front Psychol 2022; 13:1053358. [DOI: 10.3389/fpsyg.2022.1053358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Accepted: 11/09/2022] [Indexed: 12/04/2022] Open
Abstract
IntroductionHumans have the ability to efficiently extract summary statistics (i.e., mean) from a group of similar objects, referred to as ensemble coding. Recent studies have demonstrated that ensemble perception of simple objects is modulated by the visual working memory (VWM) task through matching features in VWM. However, few studies have examined the extending scope of such a matching feature effect and the influence of the organization mode (i.e., the way of combining memory matching features with ensemble properties) on this effect. Two experiments were done to explore these questions.MethodsWe used a dual-task paradigm for both experiments, which included a VWM task and a mean estimation task. Participants were required to adjust a test face to the mean identity face and report whether the irregular objects in a memory probe were identical or different to the studied objects. In Experiment 1, using identity faces as ensemble stimuli, we compared participants’ performances in trials where a subset color matched that of the studied objects to those of trials without color-matching subsets. In Experiment 2, we combined memory matching colors with ensemble properties in common region cues and compared the effect with that of Experiment 1.ResultsResults of Experiments 1 and 2 showed an effect of the VWM task on high-level ensemble perception that was similar to previous studies using a low-level averaging task. However, the combined analysis of Experiments 1 and 2 revealed that memory matching features had less influence on mean estimations when matching features and ensemble properties combined in the common region than when combined as parts of a complete unit.ConclusionThese findings suggest that the impact of memory matching features is not limited by the level of stimulus feature, but can be impacted by the organization between matching features and ensemble target properties.
Collapse
|
5
|
Kirmsse A, Zimmer HD, Ecker UKH. Task Demands Differentially Affect Processing of Intrinsic and Extrinsic Object Features in Working Memory. Exp Psychol 2022; 69:320-334. [PMID: 36809157 DOI: 10.1027/1618-3169/a000572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/23/2023]
Abstract
Some argue that visual working memory operates on integrated object representations. Here, we contend that obligatory feature integration occurs with intrinsic but not extrinsic object features. Working memory for shapes and colors was assessed using a change-detection task with a central test probe, while recording event-related potentials (ERPs). Color was either an intrinsic surface feature of a shape or connected to the shape via a proximal but spatially disjunct extrinsic frame. There were two types of test: The direct test required memory for shape and color; the indirect test required only shape memory. Study-test changes of color were therefore either task-relevant or task-irrelevant. We assessed performance costs and event-related potential (ERP) effects arising from color changes. In the direct test, performance was poorer for extrinsic than intrinsic stimuli; task-relevant color changes elicited enhanced frontal negativity (N2, FN400) for both intrinsic and extrinsic stimuli. In the indirect test, performance costs and ERP effects associated with irrelevant color change were larger for intrinsic than extrinsic stimuli. This suggests intrinsic information is more readily integrated into the working-memory representation and evaluated against the test probe. Findings imply that feature integration is not obligatory under all conditions but influenced by stimulus-driven and task-related focus of attention.
Collapse
Affiliation(s)
- Alexander Kirmsse
- Department of Psychology, Brain and Cognition Unit, Saarland University
| | - Hubert D Zimmer
- Department of Psychology, Brain and Cognition Unit, Saarland University
| | | |
Collapse
|
6
|
Object-based visual working memory: an object benefit for equidistant memory items presented within simple contours. PSYCHOLOGICAL RESEARCH 2022; 87:1569-1589. [DOI: 10.1007/s00426-022-01757-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2022] [Accepted: 10/19/2022] [Indexed: 11/25/2022]
Abstract
AbstractPrevious research has shown that more information can be stored in visual working memory (VWM) when multiple items belong to the same object. Here, in four experiments, we investigated the object effect on memory for spatially equidistant features by manipulating simple, task-irrelevant contours that combined these features. In Experiments 1, 3, and, 4, three grating orientations, and in Experiment 2, one color and two orientations, were presented simultaneously to be memorized. Mixture modeling was applied to estimate both the precision and the guess rates of recall errors. Overall results showed that two target features were remembered more accurately when both were part of the same object. Further analysis showed that the probability of recall increased in particular when both features were extracted from the same object. In Experiment 2, we found that the object effect was greater for features from orthogonal dimensions, but this came at the cost of lower memory precision. In Experiment 3, when we kept the locations of the features perfectly consistent over trials so that the participants could attend to these locations rather than the contour, we still found object benefits. Finally, in Experiment 4 when we manipulated the temporal order of the object and the memory features presentations, it was confirmed that the object benefit is unlikely to stem from the strategical usage of object information. These results suggested that the object benefit arises automatically, likely at an early perceptual level.
Collapse
|
7
|
He C, Gunalp P, Meyerhoff HS, Rathbun Z, Stieff M, Franconeri SL, Hegarty M. Visual working memory for connected 3D objects: effects of stimulus complexity, dimensionality and connectivity. Cogn Res Princ Implic 2022; 7:19. [PMID: 35182236 PMCID: PMC8857738 DOI: 10.1186/s41235-022-00367-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Accepted: 02/01/2022] [Indexed: 11/20/2022] Open
Abstract
Visual working memory (VWM) is typically measured using arrays of two-dimensional isolated stimuli with simple visual identities (e.g., color or shape), and these studies typically find strong capacity limits. Science, technology, engineering and mathematics (STEM) experts are tasked with reasoning with representations of three-dimensional (3D) connected objects, raising questions about whether those stimuli would be subject to the same limits. Here, we use a color change detection task to examine working memory capacity for 3D objects made up of differently colored cubes. Experiment 1a shows that increasing the number of parts of an object leads to less sensitivity to color changes, while change-irrelevant structural dimensionality (the number of dimensions into which parts of the structure extend) does not. Experiment 1b shows that sensitivity to color changes decreases similarly with increased complexity for multipart 3D connected objects and disconnected 2D squares, while sensitivity is slightly higher with 3D objects. Experiments 2a and 2b find that when other stimulus characteristics, such as size and visual angle, are controlled, change-irrelevant dimensionality and connectivity have no effect on performance. These results suggest that detecting color changes on 3D connected objects and on displays of isolated 2D stimuli are subject to similar set size effects and are not affected by dimensionality and connectivity when these properties are change-irrelevant, ruling out one possible explanation for scientists’ advantages in storing and manipulating representations of complex 3D objects.
Collapse
Affiliation(s)
- Chuanxiuyue He
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, 93106, USA.
| | - Peri Gunalp
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, 93106, USA
| | | | - Zoe Rathbun
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, 93106, USA
| | - Mike Stieff
- University of Illinois, Chicago, Chicago, USA
| | | | - Mary Hegarty
- Department of Psychological and Brain Sciences, University of California, Santa Barbara, Santa Barbara, CA, 93106, USA
| |
Collapse
|
8
|
Brown G, Kasem I, Bays PM, Schneegans S. Mechanisms of feature binding in visual working memory are stable over long delays. J Vis 2021; 21:7. [PMID: 34783831 PMCID: PMC8606872 DOI: 10.1167/jov.21.12.7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 10/15/2021] [Indexed: 11/26/2022] Open
Abstract
The ability to accurately retain the binding between the features of different objects is a critical element of visual working memory. The underlying mechanism can be elucidated by analyzing correlations of response errors in dual-report experiments, in which participants have to report two features of a single item from a previously viewed stimulus array. Results from separate previous studies using different cueing conditions have indicated that location takes a privileged role in mediating binding between other features, in that largely independent response errors have been observed when location was used as a cue, but errors were highly correlated when location was one of the reported features. Earlier results from change detection tasks likewise support such a special role of location, but they also suggest that this role is substantially reduced for longer retention intervals in favor of object-based representation. In the present study, we replicated the findings of previous dual-report tasks with different cueing conditions, using matched stimuli and procedures. Moreover, we show that the observed patterns of error correlations remain qualitatively unchanged with longer retention intervals. Fits with neural population models demonstrate that the behavioral results at long, as well as short, delays are best explained by memory representations in independent feature maps, in which an item's features are bound to each other only via their shared location.
Collapse
Affiliation(s)
- Georgina Brown
- Department of Psychology, University of Cambridge, Downing Street, Cambridge, UK
| | - Iham Kasem
- Department of Psychology, University of Cambridge, Downing Street, Cambridge, UK
| | - Paul M Bays
- Department of Psychology, University of Cambridge, Downing Street, Cambridge, UK
| | - Sebastian Schneegans
- Department of Psychology, University of Cambridge, Downing Street, Cambridge, UK
| |
Collapse
|
9
|
Zhao C, Li X, Failing M, Wang B. Automatically binding relevant and irrelevant features in visual working memory. Q J Exp Psychol (Hove) 2021; 75:1552-1560. [PMID: 34609227 DOI: 10.1177/17470218211053992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
It is generally assumed that, to save storage space, features are stored as integrated objects in visual working memory (VWM). Although such an object-based account does not always hold because features can be processed in parallel, a previous study has shown that different features can be automatically bound with their locations (task-irrelevant feature) into an integrated unit, resulting in improved memory performance. The present study was designed to further explore this phenomenon by investigating whether other features, which are not spatial in origin, can act as the binding cue to form such automatic binding. To test this, we used three different features as binding cues (i.e., colour, spatial frequency, and shape) over multiple separate experiments. The results consistently showed that when two features shared the same binding cue, memory performance was better relative to when each of those features had their own binding cue. We conclude that any task-irrelevant feature can act as a binding cue to automatically bind with task-relevant features even across different objects, resulting in memory enhancement.
Collapse
Affiliation(s)
- Chenxiao Zhao
- Department of Psychology, Zhejiang Normal University, Jinhua, China
| | - Xinyu Li
- Department of Psychology, Zhejiang Normal University, Jinhua, China
| | - Michel Failing
- Charité-Universitätsmedizin Berlin, Berlin, Germany.,Berlin Institute of Health, Berlin, Germany
| | - Benchi Wang
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China.,Institute for Brain Research and Rehabilitation, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| |
Collapse
|
10
|
Markov YA, Utochkin IS, Brady TF. Real-world objects are not stored in holistic representations in visual working memory. J Vis 2021; 21:18. [PMID: 33729452 PMCID: PMC7980051 DOI: 10.1167/jov.21.3.18] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
When storing multiple objects in visual working memory, observers sometimes misattribute perceived features to incorrect locations or objects. These misattributions are called binding errors (or swaps) and have been previously demonstrated mostly in simple objects whose features are easy to encode independently and arbitrarily chosen, like colors and orientations. Here, we tested whether similar swaps can occur with real-world objects, where the connection between features is meaningful rather than arbitrary. In Experiments 1 and 2, observers were simultaneously shown four items from two object categories. Within a category, the two exemplars could be presented in either the same or different states (e.g., open/closed; full/empty). After a delay, both exemplars from one of the categories were probed, and participants had to recognize which exemplar went with which state. We found good memory for state information and exemplar information on their own, but a significant memory decrement for exemplar–state combinations, suggesting that binding was difficult for observers and swap errors occurred even for meaningful real-world objects. In Experiment 3, we used the same task, but in one-half of the trials, the locations of the exemplars were swapped at test. We found that there are more errors in general when the locations of exemplars were swapped. We concluded that the internal features of real-world objects are not perfectly bound in working memory, and location updates impair object and feature representations. Overall, we provide evidence that even real-world objects are not stored in an entirely unitized format in working memory.
Collapse
Affiliation(s)
- Yuri A Markov
- HSE University, Moscow, Russia., https://www.ymarkov.com/
| | | | - Timothy F Brady
- Psychology Department, University of California, San Diego, La Jolla, CA, USA.,
| |
Collapse
|
11
|
A compressibility account of the color-sharing bonus in working memory. Atten Percept Psychophys 2021; 83:1613-1628. [PMID: 33686590 DOI: 10.3758/s13414-020-02231-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/07/2020] [Indexed: 11/08/2022]
Abstract
It has been established that objects sharing color in a visual display can boost working memory. The capacity to encode singletons particularly benefits from the repetition of colors encoded as perceptual groups. We manipulated the algorithmic complexity of visual displays to test whether compressibility of information could account for the color-sharing bonus. This study used a free recall working memory task in which the participants were shown displays of 2 to 8 color items. We examined the influence of set size, complexity, number of same-color clusters and amount of color redundancy. The results showed that the probability of correct recall of the pattern and the proportion of similarity between the pattern and the response decreased with an increase of each manipulated variable, except for color redundancy in terms of probability of correct recall. The model performance of complexity did not differ from that of clusters, but complexity was found more accurate than either set size or color redundancy. The results also showed that similar items were more often recalled adjacently, and complexity correlated strongly with the number of extra color repetitions in the response, suggesting that more complex patterns encouraged the use of information compression. Moreover, color repetitions were more often recalled first and the probability of correct recall for singletons and sub-patterns could be predicted by the compressibility measure. We discuss the potential advantage of using compressibility measures to capture the effects of regularities in visual patterns, in particular to refine analysis of the color-sharing bonus.
Collapse
|
12
|
Sone H, Kang MS, Li AY, Tsubomi H, Fukuda K. Simultaneous estimation procedure reveals the object-based, but not space-based, dependence of visual working memory representations. Cognition 2021; 209:104579. [PMID: 33406461 DOI: 10.1016/j.cognition.2020.104579] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2020] [Revised: 12/23/2020] [Accepted: 12/24/2020] [Indexed: 10/22/2022]
Abstract
Visual working memory (VWM) allows us to actively represent a limited amount of visual information in mind. Although its severe capacity limit is widely accepted, researchers disagree on the nature of its representational unit. Object-based theories argue that VWM organizes feature representations into integrated representations, whereas feature-based theories argue that VWM represents visual features independently. Supporting a feature-based account of VWM, recent studies have demonstrated that features comprising an object can be forgotten independently. Although evidence of feature-based forgetting invalidates a pure object-based account of VWM that assumes perfect integration of feature representations, it is possible that feature representations may be organized in a dependent manner on the basis of objects when they exist in memory. Furthermore, many previous studies prompted participants to recall object features independently by sequentially displaying a response probe for each feature (i.e., sequential estimation procedure), and this task demand might have promoted the independence of feature representations in VWM. To test these possibilities, we created a novel task to simultaneously capture the representational quality of two features of the same object (i.e., simultaneous estimation procedure) and tested their dependence across the entire spectrum of representational quality. Here, we found that the quality of feature representations within the same object covaried reliably in both sequential and simultaneous estimation procedures, but this representational dependence was statistically stronger in the simultaneous estimation procedure than in the sequential estimation procedure. Furthermore, we confirmed that neither the shared spatial location nor simultaneous estimation of two features was sufficient to induce representational dependence in VWM. Thus, our results demonstrate that feature representations in VWM are organized in a dependent manner on the basis of objects, but the degree of dependence can vary based on the current task demand.
Collapse
Affiliation(s)
- Hirotaka Sone
- University of Toronto Mississauga, Canada; University of Toyama, Japan
| | - Min-Suk Kang
- Sungkyunkwan University, Republic of Korea; Center for Neuroscience Imaging Research, Republic of Korea.
| | | | | | - Keisuke Fukuda
- University of Toronto Mississauga, Canada; University of Toronto, Canada.
| |
Collapse
|
13
|
Object-based grouping benefits without integrated feature representations in visual working memory. Atten Percept Psychophys 2020; 83:1357-1374. [PMID: 33073323 PMCID: PMC8049898 DOI: 10.3758/s13414-020-02153-5] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/16/2020] [Indexed: 11/29/2022]
Abstract
Visual working memory (VWM) is typically considered to represent complete objects—that is, separate parts of an object are maintained as bound objects. Yet it remains unclear whether and how the features of disparate parts are integrated into a whole-object memory representation. Using a change detection paradigm, the present study investigated whether VWM performance varies as a function of grouping strength for features that either determine the grouped object (orientation) or that are not directly grouping relevant (color). Our results showed a large grouping benefit for grouping-relevant orientation features and, additionally, a much smaller, albeit reliable, benefit for grouping-irrelevant color features when both were potentially task relevant. By contrast, when color was the only task-relevant feature, no grouping benefit from the orientation feature was revealed both under lower or relatively high demands for precision. Together, these results indicate that different features of an object are stored independently in VWM; and an emerging, higher-order grouping structure does not automatically lead to an integrated representation of all available features of an object. Instead, an object benefit depends on the specific task demands, which may generate a linked, task-dependent representation of independent features.
Collapse
|
14
|
Morimoto T. The Nature of Haptic Working Memory Capacity and Its Relation to Visual Working Memory. Multisens Res 2020; 33:837-864. [PMID: 33706264 DOI: 10.1163/22134808-bja10007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2019] [Accepted: 03/08/2020] [Indexed: 11/19/2022]
Abstract
I conducted three experiments to investigate haptic working memory capacity using a haptic change detection task with 2D stimuli. I adopted a single-task paradigm comprising haptic single-feature (orientation or texture) and haptic multifeature (orientation and texture) conditions in Experiment 1 and a dual-task paradigm with a primary haptic orientation or texture change detection task and a concurrent secondary visual shape or colour change detection task in Experiments 2-3. I observed that in the single-task paradigm, haptic change detection capacity was higher for single features than it was for multiple features. In haptic working memory, unlike in visual working memory, features of two different dimensions within an object cannot be integrated. In the dual-task paradigm, interference was observed when the concurrent visual shape change detection task was combined with the haptic orientation change detection task although interference was not observed when the concurrent visual colour change detection task was combined with it. In addition, the concurrent visual shape or colour change detection task did not interfere with the capacity for haptic texture memory, which was higher than that for haptic orientation memory. These findings demonstrate that geometric properties perhaps retained a common storage system shared between haptic working memory and visual working memory; however, haptic texture might be retained in an independent stable storage system that is haptic-specific.
Collapse
Affiliation(s)
- Taku Morimoto
- Department of Psychology, Hokkaido University, N10W7, Kita-ku, Sapporo, 060-0810, Japan
| |
Collapse
|
15
|
Norton DJ, Parra MA, Sperling RA, Baena A, Guzman-Velez E, Jin DS, Andrea N, Khang J, Schultz A, Rentz DM, Pardilla-Delgado E, Fuller J, Johnson K, Reiman EM, Lopera F, Quiroz YT. Visual short-term memory relates to tau and amyloid burdens in preclinical autosomal dominant Alzheimer's disease. ALZHEIMERS RESEARCH & THERAPY 2020; 12:99. [PMID: 32825838 PMCID: PMC7442980 DOI: 10.1186/s13195-020-00660-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 07/28/2020] [Indexed: 11/15/2022]
Abstract
Background Over the past decade, visual short-term memory (VSTM) binding tests have been shown to be one of the most sensitive behavioral indicators of Alzheimer’s disease (AD), especially when they require the binding of multiple features (e.g., color and shape). Recently, it has become possible to directly measure amyloid and tau levels in vivo via positron emission tomography (PET). To this point, these behavioral and neurochemical markers have not been compared in humans with AD or at risk for it. Methods In a cross-sectional study, we compared VSTM performance to tau and amyloid concentrations, measured by PET, in individuals certain to develop AD by virtue of their inheritance of the presenilin-1 E280A mutation. These included 21 clinically unimpaired subjects and 7 subjects with early mild cognitive impairment (MCI), as well as 30 family members who were not carriers of the mutation. Results We found that VSTM performance correlated strongly with tau in entorhinal cortex and inferior temporal lobe, and also with amyloid when examining asymptomatic carriers only. The condition requiring binding was not preferentially linked to tau—in fact, the non-binding “shape only” condition showed a stronger relationship. Conclusions The results confirm VSTM’s status as an early marker of AD pathology and raise interesting questions as to the course of binding-specific versus non-binding aspects of VSTM in early AD.
Collapse
Affiliation(s)
- Daniel J Norton
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA.,Gordon College, Wenham, MA, USA
| | - Mario A Parra
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, UK.,Autonomous University of the Caribbean, Barranquilla, Colombia
| | - Reisa A Sperling
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA.,Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA.,Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | - Ana Baena
- Grupo de Neurociencias, Universidad de Antioquia, Medellin, Antioquia, Colombia
| | - Edmarie Guzman-Velez
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | - David S Jin
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | - Nicholas Andrea
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | | | - Aaron Schultz
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA.,Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | - Dorene M Rentz
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | - Enmanuelle Pardilla-Delgado
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | - Joshua Fuller
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA
| | - Keith Johnson
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA.,Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA
| | | | - Francisco Lopera
- Grupo de Neurociencias, Universidad de Antioquia, Medellin, Antioquia, Colombia
| | - Yakeel T Quiroz
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA. .,Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, MA, USA. .,Grupo de Neurociencias, Universidad de Antioquia, Medellin, Antioquia, Colombia. .,Departments of Psychiatry and Neurology, Massachusetts General Hospital, Harvard Medical School, 149 13th Street, Rm 10.014, Boston, MA, 02129, USA.
| |
Collapse
|
16
|
The transition from feature to object: Storage unit in visual working memory depends on task difficulty. Mem Cognit 2020; 47:1498-1514. [PMID: 31267436 DOI: 10.3758/s13421-019-00956-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Visual working memory (VWM) is a cognitive memory buffer for temporarily processing and storing visual information. Previous studies suggest that its capacity is severely limited, and there is an ongoing debate on whether the storage capacity is object-based or feature-based in VWM. In this study, a change-detection task was employed to investigate whether and how task difficulty can affect VWM, specifically, its capacity and the unit of storage. Task difficulty was manipulated through the set size of memory items, memory fidelity required by the resolution of representation and the type of feature tested. We examined two types of stimuli: the single-feature type, where each memory item was composed of a single feature (color or shape), and the conjunctive-feature type, where each item was composed of a conjunction of two features (colored shape). Experiment 1 replicated the previous findings that memory capacity for colors was larger than shapes, and decreased with the resolution demand regardless of the type of stimuli. In Experiment 2, we analyzed and compared the results from single-feature items and conjunctive-feature items in the low- and high-resolution conditions while controlling for the number of to-be-remembered features. By directly matching the estimated capacity based on an object-unit and a feature-unit with the theoretical prediction, the results showed that the unit storage in VWM tended to be feature-based with low task difficulty, and to be object-based with high task difficulty. This suggests that VWM is dynamic and flexible, dependent on the load of the current task.
Collapse
|
17
|
The influence of object structure on visual short-term memory for multipart objects. Atten Percept Psychophys 2020; 82:1613-1631. [PMID: 31898076 DOI: 10.3758/s13414-019-01957-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Numerous studies have shown that more visual features can be stored in visual short-term memory (VSTM) when they are encoded from fewer objects (Luck & Vogel, 1997, Nature, 390, 279-281; Olson & Jiang, 2002, Perception & Psychophysics, 64[7], 1055-1067). This finding has been consistent for simple objects with one surface and one boundary contour, but very few experiments have shown a clear performance benefit when features are organized as multipart objects versus spatially dispersed single-feature objects. Some researchers have suggested multipart object integration is not mandatory because of the potential ambiguity of the display (Balaban & Luria, 2015, Cortex, 26(5), 2093-2104; Luria & Vogel, 2014, Journal of Cognitive Neuroscience, 26[8], 1819-1828). For example, a white bar across the middle of a red circle could be interpreted as two objects, a white bar occluding a red circle, or as a single two-colored object. We explore whether an object benefit can be found by disambiguating the figure-ground organization of multipart objects using a luminance gradient and linear perspective to create the appearance of a unified surface. Also, we investigated memory for objects with a visual feature indicated by a hole, rather than an additional surface on the object. Results indicate the organization of multipart objects can influence VSTM performance, but the effect is driven by how the specific organization allows for use of global ensemble statistics of the memory array rather than a memory benefit for local object representations.
Collapse
|
18
|
Loughrey DG, Parra MA, Lawlor BA. Visual short-term memory binding deficit with age-related hearing loss in cognitively normal older adults. Sci Rep 2019; 9:12600. [PMID: 31467387 PMCID: PMC6715732 DOI: 10.1038/s41598-019-49023-1] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2019] [Accepted: 08/19/2019] [Indexed: 01/12/2023] Open
Abstract
Age-related hearing loss (ARHL) has been posited as a possible modifiable risk factor for neurocognitive impairment and dementia. Measures sensitive to early neurocognitive changes associated with ARHL would help to elucidate the mechanisms underpinning this relationship. We hypothesized that ARHL might be associated with decline in visual short-term memory binding (VSTMB), a potential biomarker for preclinical dementia due to Alzheimer’s disease (AD). We examined differences in accuracy between older adults with hearing loss and a control group on the VSTMB task from a single feature (shapes) condition to a feature binding (shapes-colors) condition. Hearing loss was associated with a weaker capacity to process bound features which appeared to be accounted for by a weaker sensitivity for change detection (A’). Our findings give insight into the neural mechanisms underpinning neurocognitive decline with ARHL and its temporal sequence.
Collapse
Affiliation(s)
- David G Loughrey
- Global Brain Health Institute, Trinity College Dublin, Dublin, Ireland/University of California, San Francisco, USA. .,Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland.
| | - Mario A Parra
- School of Psychological Sciences and Health, University of Strathclyde, Glasgow, UK.,Programa de Psicología, Universidad Autónoma del Caribe, Barranquilla, Colombia
| | - Brian A Lawlor
- Global Brain Health Institute, Trinity College Dublin, Dublin, Ireland/University of California, San Francisco, USA.,Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin, Ireland.,School of Medicine, Trinity College Dublin, Dublin, Ireland.,Mercer's Institute for Successful Ageing, St James Hospital, Dublin, Ireland
| |
Collapse
|
19
|
Markov YA, Tiurina NA, Utochkin IS. Different features are stored independently in visual working memory but mediated by object-based representations. Acta Psychol (Amst) 2019; 197:52-63. [PMID: 31100548 DOI: 10.1016/j.actpsy.2019.05.003] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2018] [Revised: 04/04/2019] [Accepted: 05/07/2019] [Indexed: 11/25/2022] Open
Abstract
The question of whether visual working memory (VWM) stores individual features or bound objects as basic units is actively debated. Evidence exists for both feature-based and object-based storages, as well as hierarchically organized representations maintaining both types of information at different levels. One argument for feature-based storage is that features belonging to different dimensions (e.g., color and orientations) can be stored without interference suggesting independent capacities for every dimension. Here, we studied whether the lack of cross-dimensional interference reflects genuinely independent feature storages or mediated by common objects. In three experiments, participants remembered and recalled the colors and orientations of sets of objects. We independently manipulated set sizes within each feature dimension (making colors and orientations either identical or differing across objects). Critically, we assigned to-be-remembered colors and orientations either to same spatially integrated or to different spatially separated objects. We found that the precision and recall probability within each dimension was not affected by set size manipulations in a different dimension when the features belonged to integrated objects. However, manipulations with color set sizes did affect orientation memory when the features were separated. We conclude therefore that different feature dimensions can be encoded and stored independently but the advantage of the independent storages are mediated at the object-based level. This conclusion is consistent with the idea of hierarchically organized VWM.
Collapse
|
20
|
Task-dependent effects of voluntary space-based and involuntary feature-based attention on visual working memory. PSYCHOLOGICAL RESEARCH 2019; 84:1304-1319. [PMID: 30840142 DOI: 10.1007/s00426-019-01161-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2018] [Accepted: 02/26/2019] [Indexed: 10/27/2022]
Abstract
Previous research has shown that visual working memory (VWM) can be modulated by space-based or feature-based attentional selection. However, it remains unclear how the two modes of attention operate jointly to affect VWM, and in particular, if involuntary feature-based attention plays a role in VWM. In this study, a pre-cued change detection paradigm was employed to investigate the concurrent effects of space- and feature-based attention on VWM. Space-based attention was manipulated by informative spatial cueing and by varying the proximity between the test item and the cued (fixated) memory item, while feature-based attention was induced in an involuntary manner by having the test item to share the same color or shape with the cued item on a fraction of trials. The results showed that: (1) the memory performance for the cued items was always better than the uncued items, suggesting a beneficial effect of voluntary spatial attention; (2) with a brief duration of the memory array (250 ms), cue-test proximity benefited VWM in the shape judgment task but not in the color judgment task, whereas with a longer duration (1200 ms), no proximity effect was found for either task; (3) VWM was improved for the same-colored items regardless of the task and duration; (4) VWM was improved for the same-shaped items only in the shape judgment task with the longer duration of the memory array. A discrimination task further showed that the proximity effect associated with VWM reflects a perceptual bottleneck in memory encoding for shape but not for color with a brief display. Our results suggest that involuntary feature-based attention could be triggered by spatial cueing to modulate VWM; involuntary color-based attention facilitates VWM independently of task, whereas shape-based facilitation is task-dependent, i.e., confined only to the shape judgment task, presumably reflecting different attention-guiding potencies of the two features.
Collapse
|
21
|
Liesefeld HR, Müller HJ. Current directions in visual working memory research: An introduction and emerging insights. Br J Psychol 2019; 110:193-206. [PMID: 30737770 DOI: 10.1111/bjop.12377] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Indexed: 12/25/2022]
Abstract
Visual working memory (VWM) is a core construct in the cognitive (neuro-)sciences, assumed to serve as a hub for information exchange and thus supporting a multitude of cognitive functions related to processing visual information. Here, we give an introduction into key terms and paradigms and an overview of ongoing debates in the field, to which the articles collected in this Special Issue on 'Current Directions in Visual Working Memory Research' contribute. Our aim is to extract, from this overview, some 'emerging' theoretical insights concerning questions such as the optimal way to examine VWM, which types of mental representations contribute to performance on VWM tasks, and how VWM keeps features from the same object together and apart from features of concurrently maintained objects (the binding problem).
Collapse
Affiliation(s)
- Heinrich René Liesefeld
- Department Psychologie, Ludwig-Maximilians-Universität, München, Germany.,Graduate School of Systemic Neurosciences, Ludwig-Maximilians-Universität, München, Germany
| | - Hermann J Müller
- Department Psychologie, Ludwig-Maximilians-Universität, München, Germany.,Department of Psychological Sciences, Birkbeck College, University of London, UK
| |
Collapse
|
22
|
Schneegans S, Bays PM. New perspectives on binding in visual working memory. Br J Psychol 2018; 110:207-244. [DOI: 10.1111/bjop.12345] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2018] [Revised: 07/06/2018] [Indexed: 12/01/2022]
Affiliation(s)
| | - Paul M. Bays
- Department of Psychology; University of Cambridge; UK
| |
Collapse
|
23
|
Li J, Qian J, Liang F. Evidence for the beneficial effect of perceptual grouping on visual working memory: an empirical study on illusory contour and a meta-analytic study. Sci Rep 2018; 8:13864. [PMID: 30218056 PMCID: PMC6138684 DOI: 10.1038/s41598-018-32039-4] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2018] [Accepted: 08/31/2018] [Indexed: 11/17/2022] Open
Abstract
The capacity of visual working memory (VWM) is found to be extremely limited. Past research shows that VWM can be facilitated by Gestalt principles of grouping, however, it remains controversial whether factors like the type of Gestalt principles, the characteristics of stimuli and the nature of experimental design could affect the beneficial effect of grouping. In particular, studies have shown that perceptual grouping could improve memory performance for a feature that is relevant for grouping, but it is unclear whether the same improvement exists for a feature that is irrelevant for grouping. In this article, an empirical study and a meta-analytic study were conducted to investigate the effect of perceptual grouping on VWM. In the empirical study, we examined the grouping effect by employing a Kanizsa illusion in which memory items were grouped by illusory contour. We found that the memory performance was improved for the grouped items even though the tested feature was grouping irrelevant, and the improvement was not significantly different from the effect of grouping by physical connectedness or by solid occlusion. In the meta-analytic study, we systematically and quantitatively examined the effect of perceptual grouping on VWM by pulling the results from all eligible studies, and found that the beneficial grouping effect was robust but the magnitude of the effect can be affected by several moderators. Factors like the types of grouping methods, the duration and the layout of the memory display, and the characteristics of the tested feature moderated the grouping effect, whereas whether employing a cue or a verbal suppression task did not. Our study suggests that the underlying mechanism of the grouping benefit may be distinct with regard to grouping relevancy of the to-be-stored feature. The grouping effect on VWM may be independent of attention for a grouping relevant feature, but may rely on attentional prioritization for a grouping irrelevant feature.
Collapse
Affiliation(s)
- Jiaofeng Li
- Sun Yat-Sen University, Department of Psychology, Guangzhou, 510000, China
| | - Jiehui Qian
- Sun Yat-Sen University, Department of Psychology, Guangzhou, 510000, China.
| | - Fan Liang
- Sun Yat-Sen University, Department of Psychology, Guangzhou, 510000, China
| |
Collapse
|
24
|
Grot S, Leclerc ME, Luck D. Examining the neural correlates of active and passive forms of verbal-spatial binding in working memory. Biol Psychol 2018; 136:67-75. [PMID: 29802860 DOI: 10.1016/j.biopsycho.2018.05.011] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Revised: 03/15/2018] [Accepted: 05/17/2018] [Indexed: 11/29/2022]
Abstract
We designed an fMRI study to pinpoint the neural correlates of active and passive binding in working memory. Participants were instructed to memorize three words and three spatial locations. In the passive binding condition, words and spatial locations were directly presented as bound. Conversely, in the active binding condition, words and spatial locations were presented as separated, and participants were directed to intentionally create associations between them. Our results showed that participants performed better on passive binding relative to active binding. FMRI analysis revealed that both binding conditions induced greater activity within the hippocampus. Additionally, our analyses divulged regions specifically engaged in passive and active binding. Altogether, these data allow us to propose the hippocampus as a central candidate for working memory binding. When needed, a frontal-parietal network can contribute to the rearrangement of information. These findings may inform theories of working memory binding.
Collapse
Affiliation(s)
- Stéphanie Grot
- Centre de recherche, Institut universitaire en santé mentale de Montréal, Montreal, Canada; Department of Psychiatry, Faculty of Medicine, Université de Montréal, Montreal, Canada
| | - Marie-Eve Leclerc
- Centre de recherche, Institut universitaire en santé mentale de Montréal, Montreal, Canada; Department of Psychiatry, Faculty of Medicine, Université de Montréal, Montreal, Canada
| | - David Luck
- Centre de recherche, Institut universitaire en santé mentale de Montréal, Montreal, Canada; Department of Psychiatry, Faculty of Medicine, Université de Montréal, Montreal, Canada.
| |
Collapse
|
25
|
Delvenne JF, Bruyer R. A configural effect in visual short-term memory for features from different parts of an object. Q J Exp Psychol (Hove) 2018; 59:1567-80. [PMID: 16873109 DOI: 10.1080/17470210500256763] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Previous studies have shown that change detection performance is improved when the visual display holds features (e.g., a colour and an orientation) that are grouped into different parts of the same object compared to when they are all spatially separated (Xu, 2002a, 2002b). These findings indicate that visual short-term memory (VSTM) encoding can be “object based”. Recently, however, it has been demonstrated that changing the orientation of an item could affect the spatial configuration of the display (Jiang, Chun, & Olson, 2004), which may have an important influence on change detection. The perceptual grouping of features into an object obviously reduces the amount of distinct spatial relations in a display and hence the complexity of the spatial configuration. In the present study, we ask whether the object-based encoding benefit observed in previous studies may reflect the use of configural coding rather than the outcome of a true object-based effect. The results show that when configural cues are removed, the object-based encoding benefit remains for features (i.e., colour and orientation) from different parts of an object, but is significantly reduced. These findings support the view that memory for features from different parts of an object can benefit from object-based encoding, but the use of configural coding significantly helps enlarge this effect.
Collapse
|
26
|
Park YE, Sy JL, Hong SW, Tong F. Reprioritization of Features of Multidimensional Objects Stored in Visual Working Memory. Psychol Sci 2017; 28:1773-1785. [PMID: 28957016 DOI: 10.1177/0956797617719949] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
A prevalent view of visual working memory (VWM) is that visual information is actively maintained in the form of perceptually integrated objects. Such reliance on object-based representations would predict that after an object is fully encoded into VWM, all features of that object would need to be maintained as a coherent unit. Here, we evaluated this idea by testing whether memory resources can be redeployed to a specific feature of an object already stored in VWM. We found that observers can utilize a retrospective cue presented during the maintenance period to attenuate both the gradual deterioration and complete loss of memory for a cued feature over time, but at the cost of accelerated loss of information regarding the uncued feature. Our findings demonstrate that object representations held within VWM can be decomposed into individual features and that having to retain additional features imposes greater demands on active maintenance processes.
Collapse
Affiliation(s)
| | - Jocelyn L Sy
- 1 Department of Psychology, Vanderbilt University
| | | | - Frank Tong
- 1 Department of Psychology, Vanderbilt University
| |
Collapse
|
27
|
Qian J, Li J, Wang K, Liu S, Lei Q. Evidence for the effect of depth on visual working memory. Sci Rep 2017; 7:6408. [PMID: 28744002 PMCID: PMC5526975 DOI: 10.1038/s41598-017-06719-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2017] [Accepted: 06/15/2017] [Indexed: 11/27/2022] Open
Abstract
Visual working memory (VWM) is a cognitive memory buffer for temporarily holding, processing, and manipulating visual information. Previous studies have demonstrated mixed results of the effect of depth perception on VWM, with some showing a beneficial effect while others not. In this study, we employed an adapted change detection paradigm to investigate the effects of two depth cues, binocular disparity and relative size. The memory array consisted of a set of pseudo-randomly positioned colored items, and the task was to judge whether the test item was changed compared to the memory item after a retention interval. We found that presenting the items in stereoscopic depth alone hardly affected VWM performance. When combining the two coherent depth cues, a significant larger VWM capacity of the perceptually closer-in-depth items was observed than that of the farther items, but the capacity for the two-depth-planes condition was not significantly different from that for the one-plane condition. Conflicting the two depth cues resulted in cancelling the beneficial effect of presenting items at a closer depth plane. The results indicate that depth perception could affect VWM, and the visual system may have an advantage in maintaining closer-in-depth objects in working memory.
Collapse
Affiliation(s)
- Jiehui Qian
- Department of Psychology, Sun Yat-Sen University, Guangzhou, 510000, China.
| | - Jiaofeng Li
- Department of Psychology, Sun Yat-Sen University, Guangzhou, 510000, China
| | - Kaiyue Wang
- Department of Psychology, Sun Yat-Sen University, Guangzhou, 510000, China
| | - Shengxi Liu
- Department of Psychology, Sun Yat-Sen University, Guangzhou, 510000, China
| | - Quan Lei
- Department of Psychology, University of Minnesota, Minneapolis, 55455, USA
| |
Collapse
|
28
|
Jeong SK, Xu Y. The impact of top-down spatial attention on laterality and hemispheric asymmetry in the human parietal cortex. J Vis 2017; 16:2. [PMID: 27494544 PMCID: PMC4988815 DOI: 10.1167/16.10.2] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The human parietal cortex exhibits a preference to contralaterally presented visual stimuli (i.e., laterality) as well as an asymmetry between the two hemispheres with the left parietal cortex showing greater laterality than the right. Using visual short-term memory and perceptual tasks and varying target location predictability, this study examined whether hemispheric laterality and asymmetry are fixed characteristics of the human parietal cortex or whether they are dynamic and modulated by the deployment of top-down attention to the target present hemifield. Two parietal regions were examined here that have previously been shown to be involved in visual object individuation and identification and are located in the inferior and superior intraparietal sulcus (IPS), respectively. Across three experiments, significant laterality was found in both parietal regions regardless of attentional modulation with laterality being greater in the inferior than superior IPS, consistent with their roles in object individuation and identification, respectively. Although the deployment of top-down attention had no effect on the superior IPS, it significantly increased laterality in the inferior IPS. The deployment of top-down spatial attention can thus amplify the strength of laterality in the inferior IPS. Hemispheric asymmetry, on the other hand, was absent in both brain regions and only emerged in the inferior but not the superior IPS with the deployment of top-down attention. Interestingly, the strength of hemispheric asymmetry significantly correlated with the strength of laterality in the inferior IPS. Hemispheric asymmetry thus seems to only emerge when there is a sufficient amount of laterality present in a brain region.
Collapse
|
29
|
Neural and Behavioral Evidence for an Online Resetting Process in Visual Working Memory. J Neurosci 2016; 37:1225-1239. [PMID: 28011745 DOI: 10.1523/jneurosci.2789-16.2016] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2016] [Revised: 11/13/2016] [Accepted: 12/12/2016] [Indexed: 11/21/2022] Open
Abstract
Visual working memory (VWM) guides behavior by holding a set of active representations and modifying them according to changes in the environment. This updating process relies on a unique mapping between each VWM representation and an actual object in the environment. Here, we destroyed this mapping by either presenting a coherent object but then breaking it into independent parts or presenting an object but then abruptly replacing it with a different object. This allowed us to introduce the neural marker and behavioral consequence of an online resetting process in humans' VWM. Across seven experiments, we demonstrate that this resetting process involves abandoning the old VWM contents because they no longer correspond to the objects in the environment. Then, VWM encodes the novel information and reestablishes the correspondence between the new representations and the objects. The resetting process was marked by a unique neural signature: a sharp drop in the amplitude of the electrophysiological index of VWM contents (the contralateral delay activity), presumably indicating the loss of the existent object-to-representation mappings. This marker was missing when an updating process occurred. Moreover, when tracking moving items, VWM failed to detect salient changes in the object's shape when these changes occurred during the resetting process. This happened despite the object being fully visible, presumably because the mapping between the object and a VWM representation was lost. Importantly, we show that resetting, its neural marker, and the behavioral cost it entails, are specific to situations that involve a destruction of the objects-to-representations correspondence. SIGNIFICANCE STATEMENT Visual working memory (VWM) maintains task-relevant information in an online state. Previous studies showed that VWM representations are accessed and modified after changes in the environment. Here, we show that this updating process critically depends on an ongoing mapping between the representations and the objects in the environment. When this mapping breaks, VWM cannot access the old representations and instead resets. The novel resetting process that we introduce removes the existing representations instead of modifying them and this process is accompanied by a unique neural marker. During the resetting process, VWM was blind to salient changes in the object's shape. The resetting process highlights the flexibility of our cognitive system in handling the dynamic environment by abruptly abandoning irrelevant schemas.
Collapse
|
30
|
Bettencourt KC, Xu Y. Understanding location- and feature-based processing along the human intraparietal sulcus. J Neurophysiol 2016; 116:1488-97. [PMID: 27440243 DOI: 10.1152/jn.00404.2016] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2016] [Accepted: 07/01/2016] [Indexed: 11/22/2022] Open
Abstract
Based on different cognitive tasks and mapping methods, the human intraparietal sulcus (IPS) has been subdivided according to multiple different organizational schemes. The presence of topographically organized regions throughout IPS indicates a strong location-based processing in this brain region. However, visual short-term memory (VSTM) studies have shown that while a region in the inferior IPS region (inferior IPS) is involved in object individuation and selection based on location, a region in the superior IPS (superior IPS) primarily encodes and stores object featural information. Here, we determined the localization of these two VSTM IPS regions with respect to the topographic IPS regions in individual participants and the role of different IPS regions in location- and feature-based processing. Anatomically, inferior IPS showed an 85.2% overlap with topographic IPS regions, with the greatest overlap seen in V3A and V3B, and superior IPS showed a 73.6% overall overlap, with the greatest overlap seen in IPS0-2. Functionally, there appeared to be a partial overlap between IPS regions involved in location- and feature-based processing, with more inferior and medial regions showing a stronger location-based processing and more superior and lateral regions showing a stronger feature-based processing. Together, these results suggest that understanding the multiplex nature of IPS in visual cognition may not be reduced to examining the functions of the different IPS topographic regions, but rather, it can only be accomplished by understanding how regions identified by different tasks and methods may colocalize with each other.
Collapse
Affiliation(s)
| | - Yaoda Xu
- Department of Psychology, Harvard University, Cambridge, Massachusetts
| |
Collapse
|
31
|
Kristjánsson A. Surface Assignment Modulates Object Formation for Visual Short-Term Memory. Perception 2016; 35:865-81. [PMID: 16970197 DOI: 10.1068/p5526] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Recent results have suggested that the operational units of visual short-term memory (VSTM) are whole objects, rather than features or the total amount of information to be remembered. Here, for the first time, the influence of surface assignment on object formation for VSTM was investigated. The observers had to memorize the features of four briefly presented (300 ms) two-part objects, followed by a mask and a cue indicating which object to report on. The experiments contrasted whether there were any apparent depth differences between the two parts of each object, and whether observers had to report on only one or both features of the post-cued target object. Depth differences induced with stereoscopic disparity, and with a pictorial depth cue (simple interposition of object features), interfered strongly with performance when both features of an object needed to be memorized, but aided performance when only a single feature needed to be remembered. Furthermore, there was considerable within-feature interference consistent with some previous findings, but contradicting others. The potential implications for conceptions of VSTM are discussed in the light of two hypothesized stages: an early feature-based stage, as well as a higher-level object-based stage where the depth manipulations exert their effects. The results argue for a strong modulatory influence of surface assignment on object formation for a VSTM task.
Collapse
|
32
|
Rhodes S, Parra MA, Logie RH. Ageing and Feature Binding in Visual Working Memory: The Role of Presentation Time. Q J Exp Psychol (Hove) 2016; 69:654-68. [DOI: 10.1080/17470218.2015.1038571] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
A large body of research has clearly demonstrated that healthy ageing is accompanied by an associative memory deficit. Older adults exhibit disproportionately poor performance on memory tasks requiring the retention of associations between items (e.g., pairs of unrelated words). In contrast to this robust deficit, older adults’ ability to form and temporarily hold bound representations of an object's surface features, such as colour and shape, appears to be relatively well preserved. However, the findings of one set of experiments suggest that older adults may struggle to form temporary bound representations in visual working memory when given more time to study objects. However, these findings were based on between-participant comparisons across experimental paradigms. The present study directly assesses the role of presentation time in the ability of younger and older adults to bind shape and colour in visual working memory using a within-participant design. We report new evidence that giving older adults longer to study memory objects does not differentially affect their immediate memory for feature combinations relative to individual features. This is in line with a growing body of research suggesting that there is no age-related impairment in immediate memory for colour-shape binding.
Collapse
Affiliation(s)
- Stephen Rhodes
- Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, and Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, UK
| | - Mario A. Parra
- Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, and Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, UK
- Alzheimer Scotland Dementia Research Centre, University of Edinburgh, Edinburgh, UK
- UDP-INECO Foundation Core on Neuroscience (UIFCoN), Diego Portales University, Santiago, Chile
| | - Robert H. Logie
- Department of Psychology, Centre for Cognitive Ageing and Cognitive Epidemiology, and Human Cognitive Neuroscience, University of Edinburgh, Edinburgh, UK
| |
Collapse
|
33
|
Marno H, Davelaar EJ, Csibra G. An object memory bias induced by communicative reference. Acta Psychol (Amst) 2016; 163:88-96. [PMID: 26629673 DOI: 10.1016/j.actpsy.2015.11.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2015] [Revised: 11/10/2015] [Accepted: 11/16/2015] [Indexed: 11/25/2022] Open
Abstract
In humans, a good proportion of knowledge, including knowledge about objects and object kinds, is acquired via social learning by direct communication from others. If communicative signals raise the expectation of social learning about objects, intrinsic (permanent) features that support object recognition are relevant to store into memory, while extrinsic (accidental) object properties can be ignored. We investigated this hypothesis by instructing participants to memorise shape-colour associations that constituted either an extrinsic object property (the colour of the box that contained the object, Experiment 1) or an intrinsic one (the colour of the object, Experiment 2). Compared to a non-communicative context, communicative presentation of the objects impaired participants' performance when they recalled extrinsic object properties, while their incidental memory of the intrinsic shape-colour associations was not affected. Communicative signals had no effect on performance when the task required the memorisation of intrinsic object properties. The negative effect of communicative reference on the memory of extrinsic properties was also confirmed in Experiment 3, where this property was object location. Such a memory bias suggests that referent objects in communication tend to be seen as representatives of their kind rather than as individuals.
Collapse
|
34
|
Zhang Q, Li S, Wang X, Che X. The effects of direction similarity in visual working memory: Behavioural and event-related potential studies. Q J Exp Psychol (Hove) 2015; 69:1812-30. [PMID: 26443895 DOI: 10.1080/17470218.2015.1100206] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
Object similarity can improve visual working memory (VWM) performance in the change-detection task, but impair the recognition performance when it occurs at retrieval of VWM in the recognition task. The effect of direction similarity is an issue that has not been well resolved. Furthermore, electrophysiological evidence in support of the mechanisms that underlie the effects of similarity is still scarce. In the current study, we conducted three behavioural experiments to examine the effects of direction similarity on memory performance with regard to both the encoding and retrieval phases of VWM and one event-related potential (ERP) experiment to explore the neural signatures of direction similarity in VWM. Our behavioural studies indicated that direction similarity improved performance when it occurred at the encoding phase but impaired performance when it occurred at the retrieval phase. Moreover, the ERP experiment showed that the amplitude of the contralateral delay activity (CDA) increased with the increasing set size for similar but not dissimilar directions. In addition, the CDA amplitude for similar directions was lower than that for dissimilar directions at set size 2. Taken together, these findings suggest that direction similarity at encoding has a positive effect on VWM performance and at retrieval has a negative effect. Given that VWM capacity depends on information load and the number of objects, the positive effect of similarity may be attributed to reduced information load of memory objects.
Collapse
Affiliation(s)
- Qian Zhang
- a Department of Psychology , Shandong Normal University, Key Laboratory of Human Cognition and Behavioural Development of Shandong High School , Jinan , China
| | - Shouxin Li
- a Department of Psychology , Shandong Normal University, Key Laboratory of Human Cognition and Behavioural Development of Shandong High School , Jinan , China
| | - Xiusong Wang
- b Key Laboratory of Animal Resistance of Shandong Province, Department of Anatomy and Physiology , College of Life Science, Shandong Normal University , Jinan , China
| | - Xiaowei Che
- a Department of Psychology , Shandong Normal University, Key Laboratory of Human Cognition and Behavioural Development of Shandong High School , Jinan , China
| |
Collapse
|
35
|
Abstract
Performance on visual short-term memory for features has been known to depend on stimulus complexity, spatial layout, and feature context. However, with few exceptions, memory capacity has been measured for abruptly appearing, single-instance displays. In everyday life, objects often have a spatiotemporal history as they or the observer move around. In three experiments, we investigated the effect of spatiotemporal history on explicit memory for color. Observers saw a memory display emerge from behind a wall, after which it disappeared again. The test display then emerged from either the same side as the memory display or the opposite side. In the first two experiments, memory improved for intermediate set sizes when the test display emerged in the same way as the memory display. A third experiment then showed that the benefit was tied to the original motion trajectory and not to the display object per se. The results indicate that memory for color is embedded in a richer episodic context that includes the spatiotemporal history of the display.
Collapse
|
36
|
Matthey L, Bays PM, Dayan P. A probabilistic palimpsest model of visual short-term memory. PLoS Comput Biol 2015; 11:e1004003. [PMID: 25611204 PMCID: PMC4303260 DOI: 10.1371/journal.pcbi.1004003] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2014] [Accepted: 10/27/2014] [Indexed: 11/21/2022] Open
Abstract
Working memory plays a key role in cognition, and yet its mechanisms remain much debated. Human performance on memory tasks is severely limited; however, the two major classes of theory explaining the limits leave open questions about key issues such as how multiple simultaneously-represented items can be distinguished. We propose a palimpsest model, with the occurrent activity of a single population of neurons coding for several multi-featured items. Using a probabilistic approach to storage and recall, we show how this model can account for many qualitative aspects of existing experimental data. In our account, the underlying nature of a memory item depends entirely on the characteristics of the population representation, and we provide analytical and numerical insights into critical issues such as multiplicity and binding. We consider representations in which information about individual feature values is partially separate from the information about binding that creates single items out of multiple features. An appropriate balance between these two types of information is required to capture fully the different types of error seen in human experimental data. Our model provides the first principled account of misbinding errors. We also suggest a specific set of stimuli designed to elucidate the representations that subjects actually employ. Humans can remember several visual items for a few seconds and recall them; however, performance deteriorates surprisingly quickly with the number of items that must be stored. Along with increasingly inaccurate recollection, subjects make association errors, sometimes apparently recalling the wrong item altogether. No current model accounts for these data fully. We discuss a simple model that focuses attention on the population representations that are putatively involved, and thereby on limits to the amount of information that can be stored and recalled. We use theoretical and numerical methods to examine the characteristics and performance of our model.
Collapse
Affiliation(s)
- Loic Matthey
- Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
- * E-mail:
| | - Paul M. Bays
- Sobell Department of Motor Neuroscience and Movement Disorders, UCL Institute of Neurology, London, United Kingdom
- Institute of Cognitive and Brain Sciences, University of California, Berkeley, Berkeley, California, United States of America
| | - Peter Dayan
- Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
| |
Collapse
|
37
|
Abstract
Visual working memory (VWM) is essential for many cognitive processes, yet it is notably limited in capacity. Visual perception processing is facilitated by Gestalt principles of grouping, such as connectedness, similarity, and proximity. This introduces the question, do these perceptual benefits extend to VWM? If so, can this be an approach to enhance VWM function by optimizing the processing of information? Previous findings have demonstrated that several Gestalt principles (connectedness, common region, and spatial proximity) do facilitate VWM performance in change detection tasks (Jiang, Olson, & Chun, 2000; Woodman, Vecera, & Luck, 2003; Xu, 2002, 2006; Xu & Chun, 2007). However, one prevalent Gestalt principle, similarity, has not been examined with regard to facilitating VWM. Here, we investigated whether grouping by similarity benefits VWM. Experiment 1 established the basic finding that VWM performance could benefit from grouping. Experiment 2 replicated and extended this finding by showing that similarity was only effective when the similar stimuli were proximal. In short, the VWM performance benefit derived from similarity was constrained by spatial proximity, such that similar items need to be near each other. Thus, the Gestalt principle of similarity benefits visual perception, but it can provide benefits to VWM as well.
Collapse
|
38
|
|
39
|
Newsome RN, Pun C, Smith VM, Ferber S, Barense MD. Neural correlates of cognitive decline in older adults at-risk for developing MCI: Evidence from the CDA and P300. Cogn Neurosci 2013; 4:152-62. [DOI: 10.1080/17588928.2013.853658] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
Affiliation(s)
| | - Carson Pun
- Department of Psychology, University of Toronto, Toronto, Canada
| | | | - Susanne Ferber
- Department of Psychology, University of Toronto, Toronto, Canada
- Rotman Research Institute, Toronto, Canada
| | - Morgan D. Barense
- Department of Psychology, University of Toronto, Toronto, Canada
- Rotman Research Institute, Toronto, Canada
| |
Collapse
|
40
|
Mance I, Vogel EK. Visual working memory. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2013; 4:179-190. [PMID: 26304194 DOI: 10.1002/wcs.1219] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Visual working memory (VWM), the system of storing, manipulating, and utilizing, visual information is fundamental to many cognitive acts. Exploring the limitations of this system is essential to understand the characteristics of higher-order cognition, since at a basic level, VWM is the interface through which we interact with our environment. Given its important function, this system has become a very active area of research in the recent years. Here, we examine current models of VWM, along with the proposed reasons for what limits its capacity. This is followed by a short description of recent neural findings that have helped constrain models of VWM. In closing, we focus on work exploring individual differences in working memory capacity, and what these findings reveal about the intimate relationship between VWM and attention. WIREs Cogn Sci 2013, 4:179-190. doi: 10.1002/wcs.1219 For further resources related to this article, please visit the WIREs website.
Collapse
Affiliation(s)
- Irida Mance
- Department of Psychology, University of Oregon, Eugene, OR, USA
| | - Edward K Vogel
- Department of Psychology, University of Oregon, Eugene, OR, USA
| |
Collapse
|
41
|
Cowan N, Blume CL, Saults JS. Attention to attributes and objects in working memory. J Exp Psychol Learn Mem Cogn 2012; 39:731-47. [PMID: 22905929 DOI: 10.1037/a0029687] [Citation(s) in RCA: 50] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
It has been debated on the basis of change-detection procedures whether visual working memory is limited by the number of objects, task-relevant attributes within those objects, or bindings between attributes. This debate, however, has been hampered by several limitations, including the use of conditions that vary between studies and the absence of appropriate mathematical models to estimate the number of items in working memory in different stimulus conditions. We reexamined working memory limits in 2 experiments with a wide array of conditions involving color and shape attributes, relying on a set of new models to fit various stimulus situations. In Experiment 2, a new procedure allowed identical retrieval conditions across different conditions of attention at encoding. The results show that multiple attributes compete for attention, but that retaining the binding between attributes is accomplished only by retaining the attributes themselves. We propose a theoretical account in which a fixed object capacity limit contains within it the possibility of the incomplete retention of object attributes, depending on the direction of attention.
Collapse
Affiliation(s)
- Nelson Cowan
- Department of Psychological Sciences, University of Missouri, Columbia, MO 65203, USA.
| | | | | |
Collapse
|
42
|
Allen RJ, Hitch GJ, Mate J, Baddeley AD. Feature binding and attention in working memory: a resolution of previous contradictory findings. Q J Exp Psychol (Hove) 2012; 65:2369-83. [PMID: 22670689 DOI: 10.1080/17470218.2012.687384] [Citation(s) in RCA: 72] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
We aimed to resolve an apparent contradiction between previous experiments from different laboratories, using dual-task methodology to compare effects of a concurrent executive load on immediate recognition memory for colours or shapes of items or their colour-shape combinations. Results of two experiments confirmed previous evidence that an irrelevant attentional load interferes equally with memory for features and memory for feature bindings. Detailed analyses suggested that previous contradictory evidence arose from limitations in the way recognition memory was measured. The present findings are inconsistent with an earlier suggestion that feature binding takes place within a multimodal episodic buffer Baddeley, ( 2000 ) and support a subsequent account in which binding takes place automatically prior to information entering the episodic buffer Baddeley, Allen, & Hitch, ( 2011 ). Methodologically, the results suggest that different measures of recognition memory performance (A', d', corrected recognition) give a converging picture of main effects, but are less consistent in detecting interactions. We suggest that this limitation on the reliability of measuring recognition should be taken into account in future research so as to avoid problems of replication that turn out to be more apparent than real.
Collapse
Affiliation(s)
- Richard J Allen
- Institute of Psychological Sciences, University of Leeds, Leeds, UK.
| | | | | | | |
Collapse
|
43
|
Fougnie D, Alvarez GA. Object features fail independently in visual working memory: evidence for a probabilistic feature-store model. J Vis 2011; 11:3. [PMID: 21980189 PMCID: PMC3279121 DOI: 10.1167/11.12.3] [Citation(s) in RCA: 114] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
The world is composed of features and objects and this structure may influence what is stored in working memory. It is widely believed that the content of memory is object-based: Memory stores integrated objects, not independent features. We asked participants to report the color and orientation of an object and found that memory errors were largely independent: Even when one of the object's features was entirely forgotten, the other feature was often reported. This finding contradicts object-based models and challenges fundamental assumptions about the organization of information in working memory. We propose an alternative framework involving independent self-sustaining representations that may fail probabilistically and independently for each feature. This account predicts that the degree of independence in feature storage is determined by the degree of overlap in neural coding during perception. Consistent with this prediction, we found that errors for jointly encoded dimensions were less independent than errors for independently encoded dimensions.
Collapse
Affiliation(s)
- Daryl Fougnie
- Department of Psychology, Harvard University, Cambridge, MA 02138, USA.
| | | |
Collapse
|
44
|
Visual working memory load-related changes in neural activity and functional connectivity. PLoS One 2011; 6:e22357. [PMID: 21789253 PMCID: PMC3138779 DOI: 10.1371/journal.pone.0022357] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2010] [Accepted: 06/22/2011] [Indexed: 11/19/2022] Open
Abstract
Background Visual working memory (VWM) helps us store visual information to prepare for subsequent behavior. The neuronal mechanisms for sustaining coherent visual information and the mechanisms for limited VWM capacity have remained uncharacterized. Although numerous studies have utilized behavioral accuracy, neural activity, and connectivity to explore the mechanism of VWM retention, little is known about the load-related changes in functional connectivity for hemi-field VWM retention. Methodology/Principal Findings In this study, we recorded electroencephalography (EEG) from 14 normal young adults while they performed a bilateral visual field memory task. Subjects had more rapid and accurate responses to the left visual field (LVF) memory condition. The difference in mean amplitude between the ipsilateral and contralateral event-related potential (ERP) at parietal-occipital electrodes in retention interval period was obtained with six different memory loads. Functional connectivity between 128 scalp regions was measured by EEG phase synchronization in the theta- (4–8 Hz), alpha- (8–12 Hz), beta- (12–32 Hz), and gamma- (32–40 Hz) frequency bands. The resulting matrices were converted to graphs, and mean degree, clustering coefficient and shortest path length was computed as a function of memory load. The results showed that brain networks of theta-, alpha-, beta-, and gamma- frequency bands were load-dependent and visual-field dependent. The networks of theta- and alpha- bands phase synchrony were most predominant in retention period for right visual field (RVF) WM than for LVF WM. Furthermore, only for RVF memory condition, brain network density of theta-band during the retention interval were linked to the delay of behavior reaction time, and the topological property of alpha-band network was negative correlation with behavior accuracy. Conclusions/Significance We suggest that the differences in theta- and alpha- bands between LVF and RVF conditions in functional connectivity and topological properties during retention period may result in the decline of behavioral performance in RVF task.
Collapse
|
45
|
Brady TF, Konkle T, Alvarez GA. A review of visual memory capacity: Beyond individual items and toward structured representations. J Vis 2011; 11:4. [PMID: 21617025 PMCID: PMC3405498 DOI: 10.1167/11.5.4] [Citation(s) in RCA: 245] [Impact Index Per Article: 18.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
Traditional memory research has focused on identifying separate memory systems and exploring different stages of memory processing. This approach has been valuable for establishing a taxonomy of memory systems and characterizing their function but has been less informative about the nature of stored memory representations. Recent research on visual memory has shifted toward a representation-based emphasis, focusing on the contents of memory and attempting to determine the format and structure of remembered information. The main thesis of this review will be that one cannot fully understand memory systems or memory processes without also determining the nature of memory representations. Nowhere is this connection more obvious than in research that attempts to measure the capacity of visual memory. We will review research on the capacity of visual working memory and visual long-term memory, highlighting recent work that emphasizes the contents of memory. This focus impacts not only how we estimate the capacity of the system--going beyond quantifying how many items can be remembered and moving toward structured representations--but how we model memory systems and memory processes.
Collapse
Affiliation(s)
- Timothy F. Brady
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | - Talia Konkle
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | - George A. Alvarez
- Vision Sciences Laboratory, Department of Psychology, Harvard University
| |
Collapse
|
46
|
Visual working memory as visual attention sustained internally over time. Neuropsychologia 2011; 49:1407-9. [DOI: 10.1016/j.neuropsychologia.2011.01.029] [Citation(s) in RCA: 198] [Impact Index Per Article: 15.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2011] [Accepted: 01/14/2011] [Indexed: 11/24/2022]
|
47
|
Episodic retrieval and feature facilitation in intertrial priming of visual search. Atten Percept Psychophys 2011; 73:1350-60. [DOI: 10.3758/s13414-011-0119-5] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
48
|
Hardiess G, Basten K, Mallot HA. Acquisition vs. memorization trade-offs are modulated by walking distance and pattern complexity in a large-scale copying paradigm. PLoS One 2011; 6:e18494. [PMID: 21494620 PMCID: PMC3072986 DOI: 10.1371/journal.pone.0018494] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2010] [Accepted: 03/09/2011] [Indexed: 11/28/2022] Open
Abstract
In a “block-copying paradigm”, subjects were required to copy a configuration of colored blocks from a model area to a distant work area, using additional blocks provided at an equally distant resource area. Experimental conditions varied between the inter-area separation (walking distance) and the complexity of the block patterns to be copied. Two major behavioral strategies were identified: in the memory-intensive strategy, subjects memorize large parts of the pattern and rebuild them without intermediate visits at the model area. In the acquisition-intensive strategy, subjects memorize one block at a time and return to the model after having placed this block. Results show that the frequency of the memory-intensive strategy is increased for larger inter-area separations (larger walking distances) and for simpler block patterns. This strategy-shift can be interpreted as the result of an optimization process or trade-off, minimizing combined, condition-dependent costs of the two strategies. Combined costs correlate with overall response time. We present evidence that for the memory-intensive strategy, costs correlate with model visit duration, while for the acquisition-intensive strategy, costs correlate with inter-area transition (i.e., walking) times.
Collapse
Affiliation(s)
- Gregor Hardiess
- Department of Biology and Werner-Reichardt Center for Integrative Neuroscience, University of Tübingen, Tübingen, Germany.
| | | | | |
Collapse
|
49
|
Oakes LM, Hurley KB, Ross-Sheehy S, Luck SJ. Developmental changes in infants' visual short-term memory for location. Cognition 2010; 118:293-305. [PMID: 21168832 DOI: 10.1016/j.cognition.2010.11.007] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2010] [Revised: 11/05/2010] [Accepted: 11/08/2010] [Indexed: 10/18/2022]
Abstract
To examine the development of visual short-term memory (VSTM) for location, we presented 6- to 12-month-old infants (N=199) with two side-by-side stimulus streams. In each stream, arrays of colored circles continually appeared, disappeared, and reappeared. In the changing stream, the location of one or more items changed in each cycle; in the non-changing streams the locations did not change. Eight- and 12.5-month-old infants showed evidence of memory for multiple locations, whereas 6.5-month-old infants showed evidence of memory only for a single location, and only when that location was easily identified by salient landmarks. In the absence of such landmarks, 6.5-month-old infants showed evidence of memory for the overall configuration or shape. This developmental trajectory for spatial VSTM is similar to that previously observed for color VSTM. These results additionally show that infants' ability to detect changes in location is dependent on their developing sensitivity to spatial reference frames.
Collapse
Affiliation(s)
- Lisa M Oakes
- Center for Mind and Brain, The University of California, Davis, California, United States.
| | | | | | | |
Collapse
|
50
|
Gao Z, Li J, Yin J, Shen M. Dissociated mechanisms of extracting perceptual information into visual working memory. PLoS One 2010; 5:e14273. [PMID: 21170315 PMCID: PMC3000807 DOI: 10.1371/journal.pone.0014273] [Citation(s) in RCA: 26] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2010] [Accepted: 11/18/2010] [Indexed: 11/18/2022] Open
Abstract
Background The processing mechanisms of visual working memory (VWM) have been extensively explored in the recent decade. However, how the perceptual information is extracted into VWM remains largely unclear. The current study investigated this issue by testing whether the perceptual information was extracted into VWM via an integrated-object manner so that all the irrelevant information would be extracted (object hypothesis), or via a feature-based manner so that only the target-relevant information would be extracted (feature hypothesis), or via an analogous processing manner as that in visual perception (analogy hypothesis). Methodology/Principal Findings High-discriminable information which is processed at the parallel stage of visual perception and fine-grained information which is processed via focal attention were selected as the representatives of perceptual information. The analogy hypothesis predicted that whereas high-discriminable information is extracted into VWM automatically, fine-grained information will be extracted only if it is task-relevant. By manipulating the information type of the irrelevant dimension in a change-detection task, we found that the performance was affected and the ERP component N270 was enhanced if a change between the probe and the memorized stimulus consisted of irrelevant high-discriminable information, but not if it consisted of irrelevant fine-grained information. Conclusions/Significance We conclude that dissociated extraction mechanisms exist in VWM for information resolved via dissociated processes in visual perception (at least for the information tested in the current study), supporting the analogy hypothesis.
Collapse
Affiliation(s)
- Zaifeng Gao
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Jie Li
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Jun Yin
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Mowei Shen
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
- * E-mail:
| |
Collapse
|