A Hierarchy of Functional States in Working Memory

Maintenance of color memoranda in activity-quiescent working memory states: Evidence from impulse perturbation

In the present study, we used an impulse perturbation method to probe working memory maintenance of colors in neurally active and activity-quiescent states, focusing on a set of pre-registered analyses. We analyzed the electroencephalograph (EEG) data of 30 participants who completed a delayed match-to-sample working memory task, in which one of the two items that were presented was retro-cued as task relevant. The analyses revealed that both cued and uncued colors were decodable from impulse-evoked activity, the latter in contrast to previous reports of working memory for orientation gratings. Decoding of colors from oscillations in the alpha band showed that cued items could be decoded therein whereas uncued items could not. Overall, the outcomes suggest that subtle differences exist between the representation of colors, and that of stimuli with spatial properties, but the present results also demonstrate that regardless of their specific neural state, both are accessible through visual impulse perturbation.

Internal attention modulates the functional state of novel stimulus-response associations in working memory

Information in working memory (WM) is crucial for guiding behavior. However, not all WM representations are equally relevant simultaneously. Current theoretical frameworks propose a functional dissociation between 'latent' and 'active' states, in which relevant representations are prioritized into an optimal (active) state to face current demands, while relevant information that is not immediately needed is maintained in a dormant (latent) state. In this context, task demands can induce rapid and flexible prioritization of information from latent to active state. Critically, these functional states have been primarily studied using simple visual memories, with attention selecting and prioritizing relevant representations to serve as templates to guide subsequent behavior. It remains unclear whether more complex WM representations, such as novel stimulus-response associations, can also be prioritized into different functional states depending on their task relevance, and if so how these different formats relate to each other. In the present study, we investigated whether novel WM-guided actions can be brought into different functional states depending on current task demands. Our results reveal that planned actions can be flexibly prioritized when needed and show how their functional state modulates their influence on ongoing behavior. Moreover, they suggest the representations of novel actions of different functional states are maintained in WM via a non-orthogonal coding scheme, thus are prone to interference.

Geometry of visuospatial working memory information in miniature gaze patterns

Stimulus-dependent eye movements have been recognized as a potential confound in decoding visual working memory information from neural signals. Here we combined eye-tracking with representational geometry analyses to uncover the information in miniature gaze patterns while participants (n = 41) were cued to maintain visual object orientations. Although participants were discouraged from breaking fixation by means of real-time feedback, small gaze shifts (<1°) robustly encoded the to-be-maintained stimulus orientation, with evidence for encoding two sequentially presented orientations at the same time. The orientation encoding on stimulus presentation was object-specific, but it changed to a more object-independent format during cued maintenance, particularly when attention had been temporarily withdrawn from the memorandum. Finally, categorical reporting biases increased after unattended storage, with indications of biased gaze geometries already emerging during the maintenance periods before behavioural reporting. These findings disclose a wealth of information in gaze patterns during visuospatial working memory and indicate systematic changes in representational format when memory contents have been unattended.

Selection within working memory impairs perceptual detection

There is broad consensus supporting the reciprocal influence of working memory (WM) and attention. Top-down mechanisms operate to cope with either environmental or internal demands. In that sense, it is possible to select an item within the contents of WM to endow it with prioritized access. Although evidence supports that maintaining an item in this privileged state does not rely on sustained visual attention, it is unknown whether selection within WM depends on perceptual attention. To answer this question, we recorded electrophysiological neural activity while participants performed a retro-cue task in which we inserted a detection task in the delay period after retro-cue presentation. Critically, the onset of to-be-detected near threshold stimuli was unpredictable, and thus, sustained perceptual spatial attention was needed to accomplish the detection task from the offset of the retro-cue. At a behavioral level, we found decreased visual detection when a WM representation was retro-cued. At a neural level, alpha oscillatory activity confirmed a spatial shift of attention to the retro-cued representation. We interpret the convergence of neural oscillations and behavioral data to point towards the theory that selection within WM could be accomplished through a perceptual attentional mechanism.

To be or not to be relevant: Comparing short- and long-term consequences across working memory prioritization procedures

Priority-based allocation of attentional resources has shown robust effects in working memory (WM) with both cue-based and reward-based prioritization. However, direct comparisons between these effects in WM are needed. Additionally, the consequences of WM prioritization for remembering in the long term remain unclear for both prioritization procedures. Here, we tested and compared the immediate and long-term memory (LTM) effects of cue-based versus reward-based retrospective prioritization of WM content. Participants encoded four memory items and were then indicated to prioritize one of the items through the presentation of either a retro-cue or a reward pattern. We then tested their immediate and delayed memory. The results of the first experiment showed better memory for prioritized than for unprioritized information in WM and LTM, but the WM effect was driven solely by the retro-cue, making it difficult to interpret any reward-based effects in LTM. In the second experiment, using a more explicit and meaningful reward-based manipulation, the results showed a prioritization benefit in WM for both prioritization procedures. In LTM, however, the prioritization effect was predominantly driven by the retro-cue manipulation. Taken together, we found that (1) the way in which attention is directed in WM impacts the size of the prioritization benefit in WM, (2) WM prioritization generally results in a prioritization effect in LTM, and (3) that the effect in LTM is more robust for cue-based prioritization. Exploratory analyses indicated that the LTM effect of cue-based prioritization reflected a cost in performance for noncued items rather than a benefit for cued items.

Prioritization sharpens working memories but does not protect them from distraction

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased toward visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. In five behavioral experiments, we used different forms of retrospective cues (indicating the likelihood of testing each item and/or the reward for responding correctly to each item) to manipulate the prioritization of items in working memory before visual distraction. We examined the effects of distraction with nonparametric analyses and a novel distractor intrusion model. We found that memory responses were more precise (lower absolute response errors and stronger memory signals) for items that were prioritized. However, these prioritized items were not immune to distraction, and their memory responses were biased toward the visual distractors to the same degree as were unprioritized items. Our findings demonstrate that the benefits associated with prioritization in working memory do not include protection from distraction biases. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Turning Attention Inside Out: How Working Memory Serves Behavior

Flexible behavior requires guidance not only by sensations that are available immediately but also by relevant mental contents carried forward through working memory. Therefore, selective-attention functions that modulate the contents of working memory to guide behavior (inside-out) are just as important as those operating on sensory signals to generate internal contents (outside-in). We review the burgeoning literature on selective attention in the inside-out direction and underscore its functional, flexible, and future-focused nature. We discuss in turn the purpose (why), targets (what), sources (when), and mechanisms (how) of selective attention inside working memory, using visual working memory as a model. We show how the study of internal selective attention brings new insights concerning the core cognitive processes of attention and working memory and how considering selective attention and working memory together paves the way for a rich and integrated understanding of how mind serves behavior.

Opening Questions in Visual Working Memory

In this reflective piece on visual working memory, I depart from the laboriously honed skills of writing a review. Instead of integrating approaches, synthesizing evidence, and building a cohesive perspective, I scratch my head and share niggles and puzzlements. I expose where my scholarship and understanding are stumped by findings and standard views in the literature.

Neural Reinstatement Tracks Spread of Attention between Object Features in Working Memory

Attention can be allocated in working memory (WM) to select and privilege relevant content. It is unclear whether attention selects individual features or whole objects in WM. Here, we used behavioral measures, eye-tracking, and EEG to test the hypothesis that attention spreads between an object's features in WM. Twenty-six participants completed a WM task that asked them to recall the angle of one of two oriented, colored bars after a delay while EEG and eye-tracking data were collected. During the delay, an orthogonal "incidental task" cued the color of one item for a match/mismatch judgment. On congruent trials (50%), the cued item was probed for subsequent orientation recall; on incongruent trials (50%), the other memory item was probed. As predicted, selecting the color of an object in WM brought other features of the cued object into an attended state as revealed by EEG decoding, oscillatory α-power, gaze bias, and improved orientation recall performance. Together, the results show that attentional selection spreads between an object's features in WM, consistent with object-based attentional selection. Analyses of neural processing at recall revealed that the selected object was automatically compared with the probe, whether it was the target for recall or not. This provides a potential mechanism for the observed benefits of nonpredictive cueing in WM, where a selected item is prioritized for subsequent decision-making.

The precedence effect in spatial hearing manifests in cortical neural population responses

Background

To localize sound sources accurately in a reverberant environment, human binaural hearing strongly favors analyzing the initial wave front of sounds. Behavioral studies of this “precedence effect” have so far largely been confined to human subjects, limiting the scope of complementary physiological approaches. Similarly, physiological studies have mostly looked at neural responses in the inferior colliculus, the main relay point between the inner ear and the auditory cortex, or used modeling of cochlear auditory transduction in an attempt to identify likely underlying mechanisms. Studies capable of providing a direct comparison of neural coding and behavioral measures of sound localization under the precedence effect are lacking.

Results

We adapted a “temporal weighting function” paradigm previously developed to quantify the precedence effect in human for use in laboratory rats. The animals learned to lateralize click trains in which each click in the train had a different interaural time difference. Computing the “perceptual weight” of each click in the train revealed a strong onset bias, very similar to that reported for humans. Follow-on electrocorticographic recording experiments revealed that onset weighting of interaural time differences is a robust feature of the cortical population response, but interestingly, it often fails to manifest at individual cortical recording sites.

Conclusion

While previous studies suggested that the precedence effect may be caused by early processing mechanisms in the cochlea or inhibitory circuitry in the brainstem and midbrain, our results indicate that the precedence effect is not fully developed at the level of individual recording sites in the auditory cortex, but robust and consistent precedence effects are observable only in the auditory cortex at the level of cortical population responses. This indicates that the precedence effect emerges at later cortical processing stages and is a significantly “higher order” feature than has hitherto been assumed.

The neural correlates of interference control dysfunction of working memory in major depressive disorder: An event-related potential study

Interference control function is a key function in a series of specific functions of working memory (WM), which is usually impaired in patients with major depressive disorder (MDD). Event-related potentials (ERPs) have advantages in exploring the neural processing of interference control and WM impairment, and therefore, it is helpful to further understand the neural mechanism of MDD. In the present study, 44 patients with MDD and 44 age- and sex-matched healthy controls (HCs) were recruited. All participants completed a 4-gradient difficulty Brown-Peterson task (BPT), whose difficulty was manipulated by changing the demand of interspersed distraction tasks. High-density EEG was simultaneously recorded. The hit rate and reaction time (RT) toward the target stimulus as well as the underlying ERP features were analyzed. The results showed that, when compared with HCs, MDD patients had significantly lower hit rates and longer RTs among all four difficulties of BPT. For ERP components, no significant between-group difference was found in either N100 or P200 average amplitudes; however, the centroparietal late positive potential (LPP) amplitude of both MDD group and HC group decreased with the increase of BPT difficulty, despite the pattern of the HC group was relative moderate. For both groups, the LPP amplitude was significantly smaller in high-order difficult BPT tasks than in low-order difficult tasks. Moreover, LPP amplitude in high-order difficult tasks was much smaller in MDD group than that of HC group. Our findings suggest that failure to control interference well may play a critical role in the impairment of WM in patients with MDD, and provided new evidence that the neural correlates of interference control dysfunction of WM in MDD.