Binding or prioritization: The role of selective attention in visual short-term memory

Overestimation and contraction biases of depth information stored in working memory depend on spatial configuration

Depth perception is essential for effective interaction with the environment. Although the accuracy of depth perception has been studied extensively, it is unclear how accurate the depth information is stored in working memory. In this study, we investigated the accuracy and systematic biases of depth representation by a delayed estimation task. The memory array consisted of items presented at various stereoscopic depth positions, and the participants were instructed to estimate the depth position of one target item after a retention interval. We examined the effect of spatial configuration by comparing the memory performance in the whole-display condition where non-target memory items were present during retrieval with that in the single-display condition where non-target memory items were absent. In the single-display condition, we found an overestimation bias that the depth estimates were farther than the corresponding depth positions defined by disparity, and a contraction bias that the stored depth positions near the observer were overestimated and those far from the observer were underestimated. The magnitude of these biases increased with the number of to-be-stored items. However, in the whole-display condition, the overestimation bias was corrected and the contraction bias did not increase with the number of to-be-stored items. Our findings suggested that the number of to-be-stored items could affect the accuracy of depth working memory, and its effect depended crucially on whether the information of spatial configuration of memory display was available at the retrieval stage.

Object-based attention in retaining binding in working memory: Influence of activation states of working memory

It has been suggested that retaining bindings in working memory (WM) requires more object-based attention than retaining constituent features. Recent studies have found that when memorized stimuli are presented sequentially, the most recent stimulus is in a highly accessible privileged state such that it is retained in a relatively automatic and resource-free manner, whereas the other stimuli are in a non-privileged state. The current study investigated whether the activation states of WM modulate the role of object-based attention in retaining bindings in WM. To address this question, we presented three colored shapes sequentially and added a transparent-motion task (Experiment 1) or a mental rotation task (Experiment 2) into the WM maintenance phase to consume object-based attention. We consistently found that consuming object-based attention led to a larger impairment to bindings relative to constituent features, which is independent of the WM activation states, suggesting that object-based attention is critical in retaining bindings in WM across activation states of WM.

Aerobic exercise modulates transfer and brain signal complexity following cognitive training

Although recent evidence has demonstrated the potent effect of physical exercise to increase the efficacy of cognitive training, the neural mechanisms underlying this causal relationship remain unclear. Here, we used multiscale entropy (MSE) of electroencephalography (EEG)-a measure of brain signal complexity-to address this issue. Young males were randomly assigned to either a 20-day dual n-back training following aerobic exercise or the same training regimen following a reading. A feature binding working memory task with concurrent EEG recording was used to test for transfer effects. Although results revealed weak-to-moderate evidence for exercise-induced facilitation on cognitive training, the combination of cognitive training with exercise resulted in greater transfer gains on conditions involving greater attentional demanding, together with greater increases in cognitive modulation on MSE, compared with the reading condition. Overall, our findings suggest that the addition of antecedent physical exercise to brain training regimen could enable wider, more robust improvements.

Retrieval from long-term memory reduces working memory representations for visual features and their bindings

The ability to remember feature bindings is an important measure of the ability to maintain objects in working memory (WM). In this study, we investigated whether both object- and feature-based representations are maintained in WM. Specifically, we tested the hypotheses that retaining a greater number of feature representations (i.e., both as individual features and bound representations) results in a more robust representation of individual features than of feature bindings, and that retrieving information from long-term memory (LTM) into WM would cause a greater disruption to feature bindings. In four experiments, we examined the effects of retrieving a word from LTM on shape and color-shape binding change detection performance. We found that binding changes were more difficult to detect than individual-feature changes overall, but that the cost of retrieving a word from LTM was the same for both individual-feature and binding changes.

Attentional effects on orientation judgements are dependent on memory consolidation processes

Are the effects of memory and attention on perception synergistic, antagonistic, or independent? Tested separately, memory and attention have been shown to affect the accuracy of orientation judgements. When multiple stimuli are presented sequentially versus simultaneously, error variance is reduced. When a target is validly cued, precision is increased. What if they are manipulated together? We combined memory and attention manipulations in an orientation judgement task to answer this question. Two circular gratings were presented sequentially or simultaneously. On some trials a brief luminance cue preceded the stimuli. Participants were cued to report the orientation of one of the two gratings by rotating a response grating. We replicated the finding that error variance is reduced on sequential trials. Critically, we found interacting effects of memory and attention. Valid cueing reduced the median, absolute error only when two stimuli appeared together and improved it to the level of performance on uncued sequential trials, whereas invalid cueing always increased error. This effect was not mediated by cue predictiveness; however, predictive cues reduced the standard deviation of the error distribution, whereas nonpredictive cues reduced “guessing”. Our results suggest that, when the demand on memory is greater than a single stimulus, attention is a bottom-up process that prioritizes stimuli for consolidation. Thus attention and memory are synergistic.

Ageing and Feature Binding in Visual Working Memory: The Role of Presentation Time

A large body of research has clearly demonstrated that healthy ageing is accompanied by an associative memory deficit. Older adults exhibit disproportionately poor performance on memory tasks requiring the retention of associations between items (e.g., pairs of unrelated words). In contrast to this robust deficit, older adults’ ability to form and temporarily hold bound representations of an object's surface features, such as colour and shape, appears to be relatively well preserved. However, the findings of one set of experiments suggest that older adults may struggle to form temporary bound representations in visual working memory when given more time to study objects. However, these findings were based on between-participant comparisons across experimental paradigms. The present study directly assesses the role of presentation time in the ability of younger and older adults to bind shape and colour in visual working memory using a within-participant design. We report new evidence that giving older adults longer to study memory objects does not differentially affect their immediate memory for feature combinations relative to individual features. This is in line with a growing body of research suggesting that there is no age-related impairment in immediate memory for colour-shape binding.

Emotional Arousal and Memory Binding: An Object-Based Framework

Binding various features of an event together and maintaining these connections in memory is an essential component of episodic memories. Previous theories make contradictory predictions about the effects of emotional arousal on memory binding. In this article, I review evidence for both arousal-impaired and arousal-enhanced memory binding and explain these contradictory findings using an object-based framework. According to this framework, emotionally arousing objects attract attention that enhances binding of their constituent features. In contrast, the emotional arousal associated with one object either impairs or has no effect on the associations between that object and other distinct objects or background contextual information. After initial encoding, the attention-grabbing nature of emotionally arousing objects can lead to interference in working memory, making it more difficult to maintain other bound representations. These contrasting effects of arousal on memory binding should help predict which aspects of emotional memories are likely to be accurate and which aspects are likely to be misremembered.

Attention is required for maintenance of feature binding in visual working memory

Working memory and attention are intimately connected. However, understanding the relationship between the two is challenging. Currently, there is an important controversy about whether objects in working memory are maintained automatically or require resources that are also deployed for visual or auditory attention. Here we investigated the effects of loading attention resources on precision of visual working memory, specifically on correct maintenance of feature-bound objects, using a dual-task paradigm. Participants were presented with a memory array and were asked to remember either direction of motion of random dot kinematograms of different colour, or orientation of coloured bars. During the maintenance period, they performed a secondary visual or auditory task, with varying levels of load. Following a retention period, they adjusted a coloured probe to match either the motion direction or orientation of stimuli with the same colour in the memory array. This allowed us to examine the effects of an attention-demanding task performed during maintenance on precision of recall on the concurrent working memory task. Systematic increase in attention load during maintenance resulted in a significant decrease in overall working memory performance. Changes in overall performance were specifically accompanied by an increase in feature misbinding errors: erroneous reporting of nontarget motion or orientation. Thus in trials where attention resources were taxed, participants were more likely to respond with nontarget values rather than simply making random responses. Our findings suggest that resources used during attention-demanding visual or auditory tasks also contribute to maintaining feature-bound representations in visual working memory—but not necessarily other aspects of working memory.

Prepared or not prepared: top-down modulation on memory of features and feature bindings

Orienting attention to the to-be-tested representations can enhance representations and protect them from interference. Previous studies have found that this effect on feature and bound representations was comparable despite their difference in stability. This may have occurred because participants were tested in a block design, which is susceptible to participants' effective top-down control on the cued representations based on the predictability of the design. In this study, we investigated how the foreknowledge of when and what to expect would affect visual representations in a change-detection task. Cue onset time was either early or late; changes included either features or feature bindings. When predictability was maximized via a block design (Experiments 1, 5, and 6), early cues equally facilitated both representations while late cues did not affect either representation. When either cue onset time (Experiment 2) or change type (Experiment 3) was unpredictable, early cues consistently facilitated feature representations, while bound representations were enhanced only when cue onset time was predictable. Additionally, late cuing only cost bound representations. Finally, when both factors were no longer predictable via an intermixed design (Experiment 4), early-cuing benefit was eliminated, with a late cuing cost for the bound representations. These results highlight the critical role of effective top-down control in memory maintenance for visual representations.

Feature binding and attention in working memory: a resolution of previous contradictory findings

We aimed to resolve an apparent contradiction between previous experiments from different laboratories, using dual-task methodology to compare effects of a concurrent executive load on immediate recognition memory for colours or shapes of items or their colour-shape combinations. Results of two experiments confirmed previous evidence that an irrelevant attentional load interferes equally with memory for features and memory for feature bindings. Detailed analyses suggested that previous contradictory evidence arose from limitations in the way recognition memory was measured. The present findings are inconsistent with an earlier suggestion that feature binding takes place within a multimodal episodic buffer Baddeley, ( 2000 ) and support a subsequent account in which binding takes place automatically prior to information entering the episodic buffer Baddeley, Allen, & Hitch, ( 2011 ). Methodologically, the results suggest that different measures of recognition memory performance (A', d', corrected recognition) give a converging picture of main effects, but are less consistent in detecting interactions. We suggest that this limitation on the reliability of measuring recognition should be taken into account in future research so as to avoid problems of replication that turn out to be more apparent than real.

Functional connectivity during top-down modulation of visual short-term memory representations

Recent evidence has revealed that short-lived internal representations held in visual short-term memory (VSTM) can be modulated by top-down control via retrospective attention which impacts subsequent behavioral performance. However, the functional inter-regional interactions underlying these top-down modulatory effects are not fully characterized. Here we used event-related functional magnetic imaging to investigate whether the strength of functional connectivity between the frontal cortex and posterior visual areas varies with the efficacy of top-down modulation of memory traces. Top-down modulation was manipulated by the timing of retro-cuing (early or late) in a VSTM task. Univariate analyses revealed that more effective top-down modulation (early cueing vs. late cueing) increased activity in early visual areas. Importantly, coherency analyses revealed that top-down modulation produced stronger functional connectivity between frontal and posterior occipital regions. Also, participants with stronger functional connectivity exhibit better memory performance. These results suggest that augmented functional connectivity between frontal and posterior visual areas strengthens the VSTM representations of importance to behavioral goals.

Attentive Tracking Disrupts Feature Binding in Visual Working Memory

One of the most influential theories in visual cognition proposes that attention is necessary to bind different visual features into coherent object percepts (Treisman & Gelade, 1980). While considerable evidence supports a role for attention in perceptual feature binding, whether attention plays a similar function in visual working memory (VWM) remains controversial. To test the attentional requirements of VWM feature binding, here we gave participants an attention-demanding multiple object tracking task during the retention interval of a VWM task. Results show that the tracking task disrupted memory for color-shape conjunctions above and beyond any impairment to working memory for object features, and that this impairment was larger when the VWM stimuli were presented at different spatial locations. These results demonstrate that the role of visuospatial attention in feature binding is not unique to perception, but extends to the working memory of these perceptual representations as well.

Neuropsychological evidence for a spatial bias in visual short-term memory after left posterior ventral damage

For the first time, we report a spatial bias in visual short-term memory (VSTM) after left medial and inferior occipito-temporal damage. Our patient D.M. showed a spatial bias in report from VSTM, being more accurate at reporting stimuli presented in her left than her right visual field (Experiment 1). This spatial bias could not be attributed to a visual field deficit (Experiment 2) and was based on the relative rather than the absolute locations of the stimuli (Experiment 3). It was reduced when the transfer of items to VSTM was facilitated-for example, by grouping stimuli (Experiment 4) or by reducing the number of items to be remembered (Experiment 5). The spatial bias was attenuated when items moved from right to centre or left to centre, and D.M. was cued to report the item that would have been on the right or left, had the movement continued (Experiment 6). We conclude that posterior ventral damage can impair both the consolidation of new information in VSTM and the explicit report of consolidated information from VSTM.

Object memory and change detection: dissociation as a function of visual and conceptual similarity

People often fail to detect a change between two visual scenes, a phenomenon referred to as change blindness. This study investigates how a post-change object's similarity to the pre-change object influences memory of the pre-change object and affects change detection. The results of Experiment 1 showed that similarity lowered detection sensitivity but did not affect the speed of identifying the pre-change object, suggesting that similarity between the pre- and post-change objects does not degrade the pre-change representation. Identification speed for the pre-change object was faster than naming the new object regardless of detection accuracy. Similarity also decreased detection sensitivity in Experiment 2 but improved the recognition of the pre-change object under both correct detection and detection failure. The similarity effect on recognition was greatly reduced when 20% of each pre-change stimulus was masked by random dots in Experiment 3. Together the results suggest that the level of pre-change representation under detection failure is equivalent to the level under correct detection and that the pre-change representation is almost complete. Similarity lowers detection sensitivity but improves explicit access in recognition. Dissociation arises between recognition and change detection as the two judgments rely on the match-to-mismatch signal and mismatch-to-match signal, respectively.

The neural correlates of attention orienting in visuospatial working memory for detecting feature and conjunction changes

The neural mechanisms of attentional orienting in visuospatial working memory for change detection were investigated. A spatial cue was provided with the onset time manipulated to allow more effective top-down control with an early cue than with a late cue. The change type was also manipulated so that accurate detection depended on color or the binding of color and location. The results showed that both the frontal and parietal regions subserved the change detection task without cueing. When data were collapsed over the two change types, early cueing increased activation in the right inferior frontal gyrus (IFG) and middle frontal gyrus (MFG) while late cueing increased activation in the right inferior parietal lobule (IPL) and temporoparietal junction (TPJ) as compared with the no-cue condition. The cue onset time led to different levels of enhancement in the frontal and posterior cortices related to top-down control and stimulus-driven orienting. For feature detection, early cueing increased activation in the right MFG and late cueing increased activation in the bilateral precuneus (PCu), right TPJ, and right cuneus. The neural correlates of conjunction detection involved the right PCu and cerebellum without cueing, were associated with the anterior MFG, left IFG, and the left STG with early cueing, and involved the right MFG, left IFG, and right IPL with late cueing. The left IFG was correlated with memory retrieval of the cued representation for conjunction detection, and the right posterior PCu was associated with maintenance and memory retrieval among competing stimuli.