Attention modulates maintenance of representations in visual short-term memory

Enhanced visual short-term memory in action video game players

Visual short-term memory (VSTM) is critical for acquiring visual knowledge and shows marked individual variability. Previous work has illustrated a VSTM advantage among action video game players (Boot et al. Acta Psychologica 129:387-398, 2008). A growing body of literature has suggested that action video game playing can bolster visual cognitive abilities in a domain-general manner, including abilities related to visual attention and the speed of processing, providing some potential bases for this VSTM advantage. In the present study, we investigated the VSTM advantage among video game players and assessed whether enhanced processing speed can account for this advantage. Experiment 1, using simple colored stimuli, revealed that action video game players demonstrate a similar VSTM advantage over nongamers, regardless of whether they are given limited or ample time to encode items into memory. Experiment 2, using complex shapes as the stimuli to increase the processing demands of the task, replicated this VSTM advantage, irrespective of encoding duration. These findings are inconsistent with a speed-of-processing account of this advantage. An alternative, attentional account, grounded in the existing literature on the visuo-cognitive consequences of video game play, is discussed.

Visual-spatial attention aids the maintenance of object representations in visual working memory

Theories have proposed that the maintenance of object representations in visual working memory is aided by a spatial rehearsal mechanism. In this study, we used two different approaches to test the hypothesis that overt and covert visual-spatial attention mechanisms contribute to the maintenance of object representations in visual working memory. First, we tracked observers' eye movements while they remembered a variable number of objects during change-detection tasks. We observed that during the blank retention interval, participants spontaneously shifted gaze to the locations that the objects had occupied in the memory array. Next, we hypothesized that if attention mechanisms contribute to the maintenance of object representations, then drawing attention away from the object locations during the retention interval should impair object memory during these change-detection tasks. Supporting this prediction, we found that attending to the fixation point in anticipation of a brief probe stimulus during the retention interval reduced change-detection accuracy, even on the trials in which no probe occurred. These findings support models of working memory in which visual-spatial selection mechanisms contribute to the maintenance of object representations.

Modulation of alpha and gamma oscillations related to retrospectively orienting attention within working memory

Selective attention mechanisms allow us to focus on information that is relevant to the current behavior and, equally important, ignore irrelevant information. An influential model proposes that oscillatory neural activity in the alpha band serves as an active functional inhibitory mechanism. Recent studies have shown that, in the same way that attention can be selectively oriented to bias sensory processing in favor of relevant stimuli in perceptual tasks, it is also possible to retrospectively orient attention to internal representations held in working memory. However, these studies have not explored the associated oscillatory phenomena. In the current study, we analysed the patterns of neural oscillatory activity recorded with magnetoencephalography while participants performed a change detection task, in which a spatial retro-cue was presented during the maintenance period, indicating which item or items were relevant for subsequent retrieval. Participants benefited from retro-cues in terms of accuracy and reaction time. Retro-cues also modulated oscillatory activity in the alpha and gamma frequency bands. We observed greater alpha activity in a ventral visual region ipsilateral to the attended hemifield, thus supporting its suppressive role, i.e. a functional disengagement of task-irrelevant regions. Accompanying this modulation, we found an increase in gamma activity contralateral to the attended hemifield, which could reflect attentional orienting and selective processing. These findings suggest that the oscillatory mechanisms underlying attentional orienting to representations held in working memory are similar to those engaged when attention is oriented in the perceptual space.

Age Group and Individual Differences in Attentional Orienting Dissociate Neural Mechanisms of Encoding and Maintenance in Visual STM

Selective attention biases the encoding and maintenance of representations in visual STM (VSTM). However, precise attentional mechanisms gating encoding and maintenance in VSTM and across development remain less well understood. We recorded EEG while adults and 10-year-olds used cues to guide attention before encoding or while maintaining items in VSTM. Known neural markers of spatial orienting to incoming percepts, that is, Early Directing Attention Negativity, Anterior Directing Attention Negativity, and Late Directing Attention Positivity, were examined in the context of orienting within VSTM. Adults elicited a set of neural markers that were broadly similar in preparation for encoding and during maintenance. In contrast, in children these processes dissociated. Furthermore, in children, individual differences in the amplitude of neural markers of prospective orienting related to individual differences in VSTM capacity, suggesting that children with high capacity are more efficient at selecting information for encoding into VSTM. Finally, retrospective, but not prospective, orienting in both age groups elicited the well-known marker of visual search (N2pc), indicating the recruitment of additional neural circuits when orienting during maintenance. Developmental and individual differences differentiate seemingly similar processes of orienting to perceptually available representations and to representations held in VSTM.

Causal evidence for a privileged working memory state in early visual cortex

Emerging evidence suggests that items held in working memory (WM) might not all be in the same representational state. One item might be privileged over others, making it more accessible and thereby recalled with greater precision. Here, using transcranial magnetic stimulation (TMS), we provide causal evidence in human participants that items in WM are differentially susceptible to disruptive TMS, depending on their state, determined either by task relevance or serial position. Across two experiments, we applied TMS to area MT+ during the WM retention of two motion directions. In Experiment 1, we used an "incidental cue" to bring one of the two targets into a privileged state. In Experiment 2, we presented the targets sequentially so that the last item was in a privileged state by virtue of recency. In both experiments, recall precision of motion direction was differentially affected by TMS, depending on the state of the memory target at the time of disruption. Privileged items were recalled with less precision, whereas nonprivileged items were recalled with higher precision. Thus, only the privileged item was susceptible to disruptive TMS over MT+. By contrast, precision of the nonprivileged item improved either directly because of facilitation by TMS or indirectly through reduced interference from the privileged item. Our results provide a unique line of evidence, as revealed by TMS over a posterior sensory brain region, for at least two different states of item representation in WM.

Neural mechanisms by which attention modulates the comparison of remembered and perceptual representations

Attention is important for effectively comparing incoming perceptual information with the contents of visual short-term memory (VSTM), such that any differences can be detected. However, how attentional mechanisms operate upon these comparison processes remains largely unknown. Here we investigate the underlying neural mechanisms by which attention modulates the comparisons between VSTM and perceptual representations using functional magnetic resonance imaging (fMRI). Participants performed a cued change detection task. Spatial cues were presented to orient their attention either to the location of an item in VSTM prior to its comparison (retro-cues), or simultaneously (simultaneous-cues) with the probe array. A no-cue condition was also included. When attention cannot be effectively deployed in advance (i.e. following the simultaneous-cues), we observed a distributed and extensive activation pattern in the prefrontal and parietal cortices in support of successful change detection. This was not the case when participants can deploy their attention in advance (i.e. following the retro-cues). The region-of-interest analyses confirmed that neural responses for successful change detection versus correct rejection in the visual and parietal regions were significantly different for simultaneous-cues compared to retro-cues. Importantly, we found enhanced functional connectivity between prefrontal and parietal cortices when detecting changes on the simultaneous-cue trials. Moreover, we demonstrated a close relationship between this functional connectivity and d′ scores. Together, our findings elucidate the attentional and neural mechanisms by which items held in VSTM are compared with incoming perceptual information.

Attention biases visual activity in visual short-term memory

In the current study, we tested whether representations in visual STM (VSTM) can be biased via top-down attentional modulation of visual activity in retinotopically specific locations. We manipulated attention using retrospective cues presented during the retention interval of a VSTM task. Retrospective cues triggered activity in a large-scale network implicated in attentional control and led to retinotopically specific modulation of activity in early visual areas V1-V4. Importantly, shifts of attention during VSTM maintenance were associated with changes in functional connectivity between pFC and retinotopic regions within V4. Our findings provide new insights into top-down control mechanisms that modulate VSTM representations for flexible and goal-directed maintenance of the most relevant memoranda.

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to 'sound objects' (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.

Performance in working memory and attentional control is associated with the rs2180619 SNP in the CNR1 gene

Individual differences in cognitive performance are partly dependent, on genetic polymporhisms. One of the single-nucleotide polymorphisms (SNP) of the CNR1 gene, which codes for cannabinoid receptor 1 (CB1R), is the rs2180619, located in a regulatory region of this gene (6q14-q15). The alleles of the rs2180619 are A > G; the G allele has been associated with addiction and high levels of anxiety (when the G allele interacts with the SS genotype of the 5-HTTLPR gene). However, GG genotype is observed also in healthy subjects. Considering G allele as risk for 'psychopathological conditions', it is possible that GG healthy subjects do not be addicted or anxious, but would have reduced performance, compared to AA subjects, in attentional control and working memory processing. One hundred and sixty-four healthy young Mexican-Mestizo subjects (100 women and 64, men; mean age: 22.86 years, SD=2.72) participated in this study, solving a task where attentional control and working memory were required. GG subjects, compared to AA subjects showed: (1) a general lower performance in the task (P = 0.02); (2) lower performance only when a high load of information was held in working memory (P = 0.02); and (3) a higher vulnerability to distractors (P = 0.03). Our results suggest that, although the performance of GG subjects was at normal levels, a lower efficiency of the endocannabinoid system, probably due to a lowered expression of CB1R, produced a reduction in the performance of these subjects when attentional control and working memory processing is challenged.

The effect of visual salience on memory-based choices

Deciding whether a stimulus is the "same" or "different" from a previous presented one involves integrating among the incoming sensory information, working memory, and perceptual decision making. Visual selective attention plays a crucial role in selecting the relevant information that informs a subsequent course of action. Previous studies have mainly investigated the role of visual attention during the encoding phase of working memory tasks. In this study, we investigate whether manipulation of bottom-up attention by changing stimulus visual salience impacts on later stages of memory-based decisions. In two experiments, we asked subjects to identify whether a stimulus had either the same or a different feature to that of a memorized sample. We manipulated visual salience of the test stimuli by varying a task-irrelevant feature contrast. Subjects chose a visually salient item more often when they looked for matching features and less often so when they looked for a nonmatch. This pattern of results indicates that salient items are more likely to be identified as a match. We interpret the findings in terms of capacity limitations at a comparison stage where a visually salient item is more likely to exhaust resources leading it to be prematurely parsed as a match.

Short-term memory across eye blinks

The effect of eye blinks on short-term memory was examined in two experiments. On each trial, participants viewed an initial display of coloured, oriented lines, then after a retention interval they viewed a test display that was either identical or different by one feature. Participants kept their eyes open throughout the retention interval on some blocks of trials, whereas on others they made a single eye blink. Accuracy was measured as a function of the number of items in the display to determine the capacity of short-term memory on blink and no-blink trials. In separate blocks of trials participants were instructed to remember colour only, orientation only, or both colour and orientation. Eye blinks reduced short-term memory capacity by approximately 0.6-0.8 items for both feature and conjunction stimuli. A third, control, experiment showed that a button press during the retention interval had no effect on short-term memory capacity, indicating that the effect of an eye blink was not due to general motoric dual-task interference. Eye blinks might instead reduce short-term memory capacity by interfering with attention-based rehearsal processes.

Orienting attention within visual short-term memory: development and mechanisms

How does developing attentional control operate within visual short-term memory (VSTM)? Seven-year-olds, 11-year-olds, and adults (total n = 205) were asked to report whether probe items were part of preceding visual arrays. In Experiment 1, central or peripheral cues oriented attention to the location of to-be-probed items either prior to encoding or during maintenance. Cues improved memory regardless of their position, but younger children benefited less from cues presented during maintenance, and these benefits related to VSTM span over and above basic memory in uncued trials. In Experiment 2, cues of low validity eliminated benefits, suggesting that even the youngest children use cues voluntarily, rather than automatically. These findings elucidate the close coupling between developing visuospatial attentional control and VSTM.

Distinct neural mechanisms of individual and developmental differences in VSTM capacity

Our ability to maintain visuo-spatial information increases gradually through childhood and is highly variable across individuals, although the cognitive and neural mechanisms underpinning these differences in capacity are unknown. We presented participants with arrays of to-be-remembered items containing two targets, four targets, or two targets and two distracters. The participants were divided into three groups: (i) high-capacity adults; (ii) low-capacity adults; and (iii) typically developing children. In addition to our behavioral methods we used electrophysiological scalp recordings to contrast the immature VSTM capacity of the children with the deficient VSTM capacity of the low-capacity adults. We also observed a relative negativity in the maintenance delay, over scalp contralateral to the original locations of the memoranda. For the low-capacity adults, this negativity was similarly modulated by target and distracter items, indicative of poor selectivity. This was not the case for the high-capacity adults; the response to memory arrays containing two target items and two distracters was equivalent to the response elicited by arrays containing only two target items. Importantly, the pattern of results in the children's ERP data was equivalent to that of the high-capacity adults, rather than to the performance-matched low-capacity adults. In short, despite their obvious differences in capacity, children are not specifically impaired at filtering out distractors, as characteristic of low-capacity adults.

No behavioral or ERP evidence for a developmental lag in visual working memory capacity or filtering in adolescents and adults with ADHD

Attention-deficit/hyperactivity disorder (ADHD) patients have both working memory (WM) and attention problems. Good attention skills are important for WM performance; individuals have higher WM capacity when being able to prevent storage of irrelevant information through efficient filtering. Since it is unknown how filtering ability is associated with WM performance in ADHD, this was investigated in the present study. A visuospatial working memory (VSWM) change detection task with distracting stimuli was administered to adolescents (12–16 years old) and adults (20–46 years old) with and without ADHD matched on education/IQ. Besides performance, contralateral delay activity (CDA) was measured; a neural correlate of the number of targets and distracters encoded and maintained in WM during the retention interval. Performance data showed similar WM-load, WM-distracter interference and developmental effects in ADHD and control groups. Adolescents’ performance on the WM task deteriorated more than that of adults in the presence of distracters and with higher WM-load, irrespective of Diagnosis. The CDA data suggested that initially all groups encoded/maintained distracting information, but only adults were able to bounce this information from memory later in the retention interval, leading to better WM performance. The only effect of Diagnosis was a smaller CDA in adolescents and adults with ADHD than in age/IQ-matched controls when maintaining a low 1-item load, which was possibly related to an inability to keep attention focused at cued stimuli with low task demands. Overall, the development of filtering efficiency and VSWM storage capacity in adolescents with ADHD was not different from that in typically developing peers.

Retrospective attention enhances visual working memory in the young but not the old: an ERP study

Behavioral evidence from the young suggests spatial cues that orient attention toward task-relevant items in visual working memory (VWM) enhance memory capacity. Whether older adults can also use retrospective cues ("retro-cues") to enhance VWM capacity is unknown. In the current event-related potential (ERP) study, young and old adults performed a VWM task in which spatially informative retro-cues were presented during maintenance. Young but not older adults' VWM capacity benefited from retro-cueing. The contralateral delay activity (CDA) ERP index of VWM maintenance was attenuated after the retro-cue, which effectively reduced the impact of memory load. CDA amplitudes were reduced prior to retro-cue onset in the old only. Despite a preserved ability to delete items from VWM, older adults may be less able to use retrospective attention to enhance memory capacity when expectancy of impending spatial cues disrupts effective VWM maintenance.

Attention restores discrete items to visual short-term memory

When a memory is forgotten, is it lost forever? Our study shows that selective attention can restore forgotten items to visual short-term memory (VSTM). In our two experiments, all stimuli presented in a memory array were designed to be equally task relevant during encoding. During the retention interval, however, participants were sometimes given a cue predicting which of the memory items would be probed at the end of the delay. This shift in task relevance improved recall for that item. We found that this type of cuing improved recall for items that otherwise would have been irretrievable, providing critical evidence that attention can restore forgotten information to VSTM. Psychophysical modeling of memory performance has confirmed that restoration of information in VSTM increases the probability that the cued item is available for recall but does not improve the representational quality of the memory. We further suggest that attention can restore discrete items to VSTM.

Obligatory encoding of task-irrelevant features depletes working memory resources

Selective attention is often considered the "gateway" to visual working memory (VWM). However, the extent to which we can voluntarily control which of an object's features enter memory remains subject to debate. Recent research has converged on the concept of VWM as a limited commodity distributed between elements of a visual scene. Consequently, as memory load increases, the fidelity with which each visual feature is stored decreases. Here we used changes in recall precision to probe whether task-irrelevant features were encoded into VWM when individuals were asked to store specific feature dimensions. Recall precision for both color and orientation was significantly enhanced when task-irrelevant features were removed, but knowledge of which features would be probed provided no advantage over having to memorize both features of all items. Next, we assessed the effect an interpolated orientation-or color-matching task had on the resolution with which orientations in a memory array were stored. We found that the presence of orientation information in the second array disrupted memory of the first array. The cost to recall precision was identical whether the interfering features had to be remembered, attended to, or could be ignored. Therefore, it appears that storing, or merely attending to, one feature of an object is sufficient to promote automatic encoding of all its features, depleting VWM resources. However, the precision cost was abolished when the match task preceded the memory array. So, while encoding is automatic, maintenance is voluntary, allowing resources to be reallocated to store new visual information.

Non-attended representations are perceptual rather than unconscious in nature

Introspectively we experience a phenomenally rich world. In stark contrast, many studies show that we can only report on the few items that we happen to attend to. So what happens to the unattended objects? Are these consciously processed as our first person perspective would have us believe, or are they - in fact - entirely unconscious? Here, we attempt to resolve this question by investigating the perceptual characteristics of visual sensory memory. Sensory memory is a fleeting, high-capacity form of memory that precedes attentional selection and working memory. We found that memory capacity benefits from figural information induced by the Kanizsa illusion. Importantly, this benefit was larger for sensory memory than for working memory and depended critically on the illusion, not on the stimulus configuration. This shows that pre-attentive sensory memory contains representations that have a genuinely perceptual nature, suggesting that non-attended representations are phenomenally experienced rather than unconscious.

Executive functions

Executive functions (EFs) make possible mentally playing with ideas; taking the time to think before acting; meeting novel, unanticipated challenges; resisting temptations; and staying focused. Core EFs are inhibition [response inhibition (self-control--resisting temptations and resisting acting impulsively) and interference control (selective attention and cognitive inhibition)], working memory, and cognitive flexibility (including creatively thinking "outside the box," seeing anything from different perspectives, and quickly and flexibly adapting to changed circumstances). The developmental progression and representative measures of each are discussed. Controversies are addressed (e.g., the relation between EFs and fluid intelligence, self-regulation, executive attention, and effortful control, and the relation between working memory and inhibition and attention). The importance of social, emotional, and physical health for cognitive health is discussed because stress, lack of sleep, loneliness, or lack of exercise each impair EFs. That EFs are trainable and can be improved with practice is addressed, including diverse methods tried thus far.

Nonspatial Cueing of Tactile STM Causes Shift of Spatial Attention

The focus of attention can be flexibly altered in mnemonic representations of past sensory events. We investigated the neural mechanisms of selection in tactile STM by applying vibrotactile sample stimuli of different intensities to both hands, followed by a symmetrically shaped visual retro-cue. The retro-cue indicated whether the weak or strong sample was relevant for subsequent comparison with a single tactile test stimulus. Locations of tactile stimuli were randomized, and the required response did not depend upon the spatial relation between cued sample and test stimulus. Selection between spatially segregated items in tactile STM was mirrored in lateralized activity following visual retro-cues (N2pc) and influenced encoding of task-irrelevant tactile probe stimuli (N140). Our findings support four major conclusions. First, retrospective selection results in transient shifts of spatial attention. Second, retrospective selection is functionally dissociable from attention-based rehearsal of locations. Third, selection mechanisms are linked across processing stages, as attention shifts in STM influence encoding of sensory signals. Fourth, selection in tactile STM recruits attentional control mechanisms that are, at least partially, supramodal.

Toward the neural mechanisms of reduced working memory capacity in schizophrenia

People with schizophrenia (PSZ) demonstrate reliable reductions in working memory (WM) capacity (i.e., the number of objects that can be held in memory). The present study asked whether WM impairments in PSZ can be explained by the same neural mechanisms that underlie individual differences in WM capacity among healthy individuals. Specifically, we examined event-related potentials in PSZ and healthy matched controls during a change detection task that required the storage of multiple objects in WM. The amplitude of contralateral delay activity (CDA), which correlates with WM capacity in healthy individuals, was larger in controls than in PSZ for memory loads of 3 and 5 objects, but larger in PSZ than in controls for a memory load of 1. This same pattern was found in the subgroups of PSZ and controls with an equivalent WM capacity. Moreover, the increase in CDA amplitude was correlated with individual differences in capacity in controls, but not in PSZ. These results demonstrate that WM impairment in PSZ is not associated with the same patterns of neural activity that characterize low WM capacity in healthy individuals. We propose that WM impairment in PSZ instead reflects a specific impairment in the ability to distribute attention broadly.

Top-down modulation: bridging selective attention and working memory

Selective attention, the ability to focus our cognitive resources on information relevant to our goals, influences working memory (WM) performance. Indeed, attention and working memory are increasingly viewed as overlapping constructs. Here, we review recent evidence from human neurophysiological studies demonstrating that top-down modulation serves as a common neural mechanism underlying these two cognitive operations. The core features include activity modulation in stimulus-selective sensory cortices with concurrent engagement of prefrontal and parietal control regions that function as sources of top-down signals. Notably, top-down modulation is engaged during both stimulus-present and stimulus-absent stages of WM tasks; that is, expectation of an ensuing stimulus to be remembered, selection and encoding of stimuli, maintenance of relevant information in mind and memory retrieval.