Filtering performance in visual working memory is improved by reducing early spatial attention to the distractors

A negative emotional state impairs individuals' ability to filter distractors from working memory: an ERP study

Capacity-limited visual working memory (VWM) requires that individuals have sufficient memory space and the ability to filter distractors. Negative emotional states are known to impact VWM storage, yet their influence on distractor filtering within VWM remains underexplored. We conducted direct neural measurement of participants (n = 56) who conducted a lateralized change detection task with distractors, while manipulating the emotional state by presenting neutral or negative images before each trial. We found a detrimental effect of distractors on memory accuracy under both neutral and negative emotional states. Using the event-related potential (ERP) component, contralateral delay activity (CDA; sensitive to VWM load), to observe the VWM load in each condition, we found that in the neutral state, the participants showed significantly higher late CDA amplitudes when remembering 4 targets compared with 2 targets and 2 targets with 2 distractors but no significant difference when remembering 2 targets compared with 2 targets with 2 distractors. In the negative state, no significant CDA amplitude differences were evident when remembering 4 targets and 2 targets, but CDA was significantly higher when remembering 2 targets with 2 distractors compared with 2 targets. These results suggest that the maximum number of items participants could store in VWM was lower under negative emotional states than under neutral emotional states. Importantly, the participants could filter out distractors when in a neutral emotional state but not in a negative emotional state, indicating that negative emotional states impair their ability to filter out distractors in VWM.

Hearing fearful prosody impairs visual working memory maintenance

Interference by distractors has been associated multiple times with diminished visual and auditory working memory (WM) performance. Negative emotional distractors in particular lead to detrimental effects on WM. However, these associations have only been seen when distractors and items to maintain in WM are from the same sensory modality. In this study, we investigate cross-modal interference on WM. We invited 20 participants to complete a visual change-detection task, assessing visual WM (VWM), while hearing emotional (fearful) and neutral auditory distractors. Electrophysiological activity was recorded to measure contralateral delay activity (CDA) and auditory P2 event-related potentials (ERP), indexing WM maintenance and distractor salience respectively. At the behavioral level, fearful prosody didn't decrease significantly working memory accuracy, compared to neutral prosody. Regarding ERPs, fearful distractors evoked a greater P2 amplitude than neutral distractors. Correlations between the two ERP potentials indicated that P2 amplitude difference between the two types of prosody was associated with the difference in CDA amplitude for fearful and neutral trials. This association suggests that cognitive resources required to process fearful prosody detrimentally impact VWM maintenance. That result provides a piece of additional evidence that negative emotional stimuli produce greater interference than neutral stimuli and that the cognitive resources used to process stimuli from different modalities come from a common pool.

Stimulus specific cortical activity associated with ignoring distraction during working memory encoding and maintenance

Distraction disrupts Working Memory (WM) performance, but how the brain filters distraction is not known. One possibility is that neural activity associated with distractions is suppressed relative to a baseline/passive task (biased competition). Alternatively, distraction may be denied access to WM, with no suppression. Furthermore, behavioural work indicates separate mechanisms for ignoring distractions which occur (1) while we put information into WM (Encoding Distraction, ED) and (2) while we maintain already encoded information during the WM delay period (Delay Distraction, DD). Here we used fMRI in humans to measure category-sensitive cortical activity and probe the extent to which ED/DD mechanisms involve enhancement/suppression during a WM task. We observed significant enhancement of task-relevant activity, relative to a passive view task, which did not differ according to whether or when distractors appeared. For both ED and DD we found no evidence of suppression, but instead a robust increase in stimulus specific activity in response to additional stimuli presented during the passive view task, which was not seen for the WM task, when those additional stimuli were to be ignored. The results indicate that ED/DD resistance does not necessarily involve suppression of distractor-related activity. Rather, a rise in distractor-associated activity is prevented when distractors are presented, supporting models of input gating, and providing a potential mechanism by which input-gating might be achieved.

Visual-cortical enhancement by acoustic distractors: The effects of endogenous spatial attention and visual working memory load

Past work has shown that when a peripheral sound captures our attention, it activates the contralateral visual cortex as revealed by an event-related potential component labelled the auditory-evoked contralateral occipital positivity (ACOP). This cross-modal activation of the visual cortex has been observed even when the sounds were not relevant to the ongoing task (visual or auditory), suggesting that peripheral sounds automatically activate the visual cortex. However, it is unclear whether top-down factors such as visual working memory (VWM) load and endogenous attention, which modulate the impact of task-irrelevant information, may modulate this spatially-specific component. Here, we asked participants to perform a lateralized VWM task (change detection), whose performance is supported by both endogenous spatial attention and VWM storage. A peripheral sound that was unrelated to the ongoing task was delivered during the retention interval. The amplitude of sound-elicited ACOP was analyzed as a function of the spatial correspondence with the cued hemifield, and of the memory array set-size. The typical ACOP modulation was observed over parieto-occipital sites in the 280-500 ms time window after sound onset. Its amplitude was not affected by VWM load but was modulated when the location of the sound did not correspond to the hemifield (right or left) that was cued for the change detection task. Our results suggest that sound-elicited activation of visual cortices, as reflected in the ACOP modulation, is unaffected by visual working memory load. However, endogenous spatial attention affects the ACOP, challenging the hypothesis that it reflects an automatic process.

The effects of social anxiety on recognition memory for social threat words: An ERP study

In this study, the effect of social anxiety on item recognition memory was examined by adopting a study-test paradigm. Participants with high and low social anxiety (31 HSA vs. 30 LSA) memorized neutral target and threat target (NT vs. TT) words while threat distracters were simultaneously presented. The behavioral results did not exhibit group differences in recognition performance. The event-related potentials (ERP) results showed that the HSA and LSA participants all did not exhibit significant old/new effects for neutral targets, while only the LSA participants exhibited significant old/new effects for threat targets. For the distracters, the HSA participants did not exhibit evident old/new effects under the NT and TT conditions; while LSA participants showed a reversed LPC old/new effect for the threat distracters under the NT condition. The old/new effects for threat targets were impaired in HSA participants but presented in LSA participants. These findings suggest that social anxiety modulates the effect of recognition memory for social threat words.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

Effects of Attention Direction and Perceptual Distraction Within Visual Working Memory

Although substantial evidence demonstrates that directing attention to specific items is important for improving the performance of visual working memory (VWM), it is still not clear whether the attended items were better protected. The present study, thus, adopted a pre-cueing paradigm to examine the effect of attention direction and perceptual distractor on VWM. The results showed that a valid visual cue improved the individuals’ VWM performances and reduced their reaction time compared to the invalid and neutral cues. However, the VWM performances in the valid and neutral cue conditions were more disrupted by a post-stimuli distractor compared to the invalid cue condition. The findings suggest that although directing attention can improve the VWM performance, it is not efficient in protecting information from being distracted.

Attentional Templates Are Sharpened through Differential Signal Enhancement, Not Differential Allocation of Attention

In visual search, the internal representation of the target feature is referred to as the attentional template. The attentional template can be broad or precise depending on the task requirements. In singleton search, the attentional template is broad because the target is the only colored element in the display. In feature search, a precise attentional template is required because the target is in a specific color in an array of varied colors. To measure the precision of the attentional template, we used a cue-target paradigm where cueing benefits decrease when the cue color differs from the target color. Consistent with broad and precise attentional templates, the decrease of cueing effects was stronger in feature than in singleton search. Measurements of ERPs showed that the N2pc elicited by the cue decreased with increasing color difference, suggesting that attention was more strongly captured by cues that were similar to the target. However, the cue-elicited N2pc did not differ between feature and singleton search, making it unlikely to reflect the mechanism underlying attentional template precision. Furthermore, there was no evidence for attentional suppression as there was no cue-elicited P_D, even in conditions where the cueing benefit turned into a same-location cost. However, an index of signal enhancement, the contralateral positivity, reflected attention template precision. In general, there was sensory enhancement of the stimulus appearing at the cued location in the search display. With broad attentional templates, any stimulus at the cued location was enhanced, whereas enhancement was restricted to target-matching colors with precise attentional templates.

Directed avoidance and its effect on visual working memory

Attentional control processes help to prioritize the storage of information in visual working memory (VWM) by gating what enters the system and influencing how precisely this information is stored. However, the extent to which such prioritization occurs deliberately, opposed to incidentally, is poorly understood. In large part, this is because investigations of this matter have almost exclusively relied on comparisons of memory for exogenously cued items versus uncued items. To understand whether prioritization occurs independent of intention, though, it is essential to examine instances in which attended items are entirely task-irrelevant. Thus, in the current study we used a directed avoidance paradigm to examine VWM performance following the selection of an item known to be task-irrelevant. In Experiment 1, we confirmed that cueing the color of a non-target item paradoxically increases attention to the cued item when the target color is unknown, resulting in longer search times (in line with previous findings). In Experiments 2 and 3, we applied the same cueing procedure to a delayed-estimation task of VWM, but now found a non-target cueing benefit in which the recall of task-relevant items was improved by directed avoidance. We further found that this effect is not solely due to the reprioritization of cognitive resources during maintenance (Exp. 4), but involves additional control processes that 1) reallocate resources to relevant items at encoding, and 2) selectively stabilize such items during the transition from encoding to maintenance (Exp. 5). As such, we suggest that while attentionally selected items may initially be prioritized independent of importance, more controlled mechanisms reallocate resources on the basis of relevance when sufficient time is provided before the sensory information is removed or displaced.