Evidence for working memory storage operations in perceptual cortex

The influence of depth on object selection and manipulation in visual working memory within a 3D context

Recent studies have examined whether the internal selection mechanism functions similarly for perception and visual working memory (VWM). However, the process of how we access and manipulate object representations distributed in a 3D space remains unclear. In this study, we utilized a memory search task to investigate the effect of depth on object selection and manipulation within VWM. The memory display consisted of colored items half positioned at the near depth plane and the other half at the far plane. During memory maintenance, the participants were instructed to search for a target representation and update its color. The results showed that under object-based attention (Experiments 1, 3, and 5), the update time was faster for targets at the near plane than for those at the far plane. This effect was absent in VWM when deploying spatial attention (Experiment 2) and in visual search regardless of the type of attention deployed (Experiment 4). The differential effects of depth on spatial and object-based attention in VWM suggest that spatial attention primarily relied on 2D location information irrespective of depth, whereas object-based attention seemed to prioritize memory representations at the front plane before shifting to the back. Our findings shed light on the interaction between depth perception and the selection mechanisms within VWM in a 3D context, emphasizing the importance of ordinal, rather than metric, spatial information in guiding object-based attention in VWM.

Effective connectivity of working memory performance: a DCM study of MEG data

Visual working memory (WM) engages several nodes of a large-scale network that includes frontal, parietal, and visual regions; however, little is understood about how these regions interact to support WM behavior. In particular, it is unclear whether network dynamics during WM maintenance primarily represent feedforward or feedback connections. This question has important implications for current debates about the relative roles of frontoparietal and visual regions in WM maintenance. In the current study, we investigated the network activity supporting WM using MEG data acquired while healthy subjects performed a multi-item delayed estimation WM task. We used computational modeling of behavior to discriminate correct responses (high accuracy trials) from two different types of incorrect responses (low accuracy and swap trials), and dynamic causal modeling of MEG data to measure effective connectivity. We observed behaviorally dependent changes in effective connectivity in a brain network comprising frontoparietal and early visual areas. In comparison with high accuracy trials, frontoparietal and frontooccipital networks showed disrupted signals depending on type of behavioral error. Low accuracy trials showed disrupted feedback signals during early portions of WM maintenance and disrupted feedforward signals during later portions of maintenance delay, while swap errors showed disrupted feedback signals during the whole delay period. These results support a distributed model of WM that emphasizes the role of visual regions in WM storage and where changes in large scale network configurations can have important consequences for memory-guided behavior.

Accurate localization and coactivation profiles of the frontal eye field and inferior frontal junction: an ALE and MACM fMRI meta-analysis

The frontal eye field (FEF) and the inferior frontal junction (IFJ) are prefrontal structures involved in mediating multiple aspects of goal-driven behavior. Despite being recognized as prominent nodes of the networks underlying spatial attention and oculomotor control, and working memory and cognitive control, respectively, the limited quantitative evidence on their precise localization has considerably impeded the detailed understanding of their structure and connectivity. In this study, we performed an activation likelihood estimation (ALE) fMRI meta-analysis by selecting studies that employed standard paradigms to accurately infer the localization of these regions in stereotaxic space. For the FEF, we found the highest spatial convergence of activations for prosaccade and antisaccade paradigms at the junction of the precentral sulcus and superior frontal sulcus. For the IFJ, we found consistent activations across oddball/attention, working memory, task-switching and Stroop paradigms at the junction of the inferior precentral sulcus and inferior frontal sulcus. We related these clusters to previous meta-analyses, sulcal/gyral neuroanatomy, and a comprehensive brain parcellation, highlighting important differences compared to their results and taxonomy. Finally, we leveraged the ALE peak coordinates as seeds to perform a meta-analytic connectivity modeling (MACM) analysis, which revealed systematic coactivation patterns spanning the frontal, parietal, and temporal cortices. We decoded the behavioral domains associated with these coactivations, suggesting that these may allow FEF and IFJ to support their specialized roles in flexible behavior. Our study provides the meta-analytic groundwork for investigating the relationship between functional specialization and connectivity of two crucial control structures of the prefrontal cortex.

Distributed networks for auditory memory differentially contribute to recall precision

Re-directing attention to objects in working memory can enhance their representational fidelity. However, how this attentional enhancement of memory representations is implemented across distinct, sensory and cognitive-control brain network is unspecified. The present fMRI experiment leverages psychophysical modelling and multivariate auditory-pattern decoding as behavioral and neural proxies of mnemonic fidelity. Listeners performed an auditory syllable pitch-discrimination task and received retro-active cues to selectively attend to a to-be-probed syllable in memory. Accompanied by increased neural activation in fronto-parietal and cingulo-opercular networks, valid retro-cues yielded faster and more perceptually sensitive responses in recalling acoustic detail of memorized syllables. Information about the cued auditory object was decodable from hemodynamic response patterns in superior temporal sulcus (STS), fronto-parietal, and sensorimotor regions. However, among these regions retaining auditory memory objects, neural fidelity in the left STS and its enhancement through attention-to-memory best predicted individuals' gain in auditory memory recall precision. Our results demonstrate how functionally discrete brain regions differentially contribute to the attentional enhancement of memory representations.

Flexible Coding of Visual Working Memory Representations during Distraction

Visual working memory (VWM) recruits a broad network of brain regions, including prefrontal, parietal, and visual cortices. Recent evidence supports a "sensory recruitment" model of VWM, whereby precise visual details are maintained in the same stimulus-selective regions responsible for perception. A key question in evaluating the sensory recruitment model is how VWM representations persist through distracting visual input, given that the early visual areas that putatively represent VWM content are susceptible to interference from visual stimulation.To address this question, we used a functional magnetic resonance imaging inverted encoding model approach to quantitatively assess the effect of distractors on VWM representations in early visual cortex and the intraparietal sulcus (IPS), another region previously implicated in the storage of VWM information. This approach allowed us to reconstruct VWM representations for orientation, both before and after visual interference, and to examine whether oriented distractors systematically biased these representations. In our human participants (both male and female), we found that orientation information was maintained simultaneously in early visual areas and IPS in anticipation of possible distraction, and these representations persisted in the absence of distraction. Importantly, early visual representations were susceptible to interference; VWM orientations reconstructed from visual cortex were significantly biased toward distractors, corresponding to a small attractive bias in behavior. In contrast, IPS representations did not show such a bias. These results provide quantitative insight into the effect of interference on VWM representations, and they suggest a dynamic tradeoff between visual and parietal regions that allows flexible adaptation to task demands in service of VWM.SIGNIFICANCE STATEMENT Despite considerable evidence that stimulus-selective visual regions maintain precise visual information in working memory, it remains unclear how these representations persist through subsequent input. Here, we used quantitative model-based fMRI analyses to reconstruct the contents of working memory and examine the effects of distracting input. Although representations in the early visual areas were systematically biased by distractors, those in the intraparietal sulcus appeared distractor-resistant. In contrast, early visual representations were most reliable in the absence of distraction. These results demonstrate the dynamic, adaptive nature of visual working memory processes, and provide quantitative insight into the ways in which representations can be affected by interference. Further, they suggest that current models of working memory should be revised to incorporate this flexibility.

Protecting visual short-term memory during maintenance: Attentional modulation of target and distractor representations

In the presence of distraction, attentional filtering is a key predictor of efficient information storage in visual short-term memory (VSTM). Yet, the role of attention in distractor filtering, and the extent to which attentional filtering continues to protect information during post-perceptual stages of VSTM, remains largely unknown. In the current study, we investigated the role of spatial attention in distractor filtering during VSTM encoding and maintenance. Participants performed a change detection task with varying distractor load. Attentional deployment to target and distractor locations was tracked continuously by means of Steady-State Visual Evoked Potentials (SSVEPs). Analyses revealed that attention strongly modulated the amplitude of the second harmonic SSVEP response, with larger amplitudes at target compared to distractor locations. These attentional modulations commenced during encoding, and remained present during maintenance. Furthermore, the amount of attention paid to distractor locations was directly related to behavioral distractor costs: Individuals who paid more attention to target compared to distractor locations during VSTM maintenance generally suffered less from the presence of distractors. Together, these findings support an important role of spatial attention in distractor filtering at multiple stages of VSTM, and highlight the usefulness of SSVEPs in continuously tracking attention to multiple locations during VSTM.

Protracted development of executive and mnemonic brain systems underlying working memory in adolescence: A longitudinal fMRI study

Working memory (WM), the ability to hold information on-line to guide planned behavior, improves through adolescence in parallel with continued maturation of critical brain systems supporting cognitive control. Initial developmental neuroimaging studies with one or two timepoints have provided important though varied results limiting our understanding of which and how neural systems change during this transition into mature WM. In this study, we leverage functional magnetic resonance imaging (fMRI) longitudinal data spanning up to 9 years in 129 normally developing individuals to identify which systems demonstrate growth changes that accompany improvements in WM performance. We used a memory guided saccade task that allowed us to probe encoding, pure maintenance, and retrieval neural processes of WM. Consistent with prior research, we found that WM performance continued to improve into the early 20's. fMRI region of interest (ROI) analyses revealed developmental (1) increases in sensorimotor-related (encoding/retrieval) activity in visual cortex from childhood through early adulthood that were associated with WM accuracy and (2) decreases in sustained (maintenance) activity in executive regions from childhood through mid-adolescence that were associated with response latency in childhood and early adolescence. Together these results provide compelling evidence that underlying the maturation of WM is a transition from reliance on executive systems to specialized regions related to the domain of mnemonic requirements of the task leading to optimal performance.

The Role of Prefrontal Cortex in Working Memory: A Mini Review

A prominent account of prefrontal cortex (PFC) function is that single neurons within the PFC maintain representations of task-relevant stimuli in working memory. Evidence for this view comes from studies in which subjects hold a stimulus across a delay lasting up to several seconds. Persistent elevated activity in the PFC has been observed in animal models as well as in humans performing these tasks. This persistent activity has been interpreted as evidence for the encoding of the stimulus itself in working memory. However, recent findings have posed a challenge to this notion. A number of recent studies have examined neural data from the PFC and posterior sensory areas, both at the single neuron level in primates, and at a larger scale in humans, and have failed to find encoding of stimulus information in the PFC during tasks with a substantial working memory component. Strong stimulus related information, however, was seen in posterior sensory areas. These results suggest that delay period activity in the PFC might be better understood not as a signature of memory storage per se, but as a top down signal that influences posterior sensory areas where the actual working memory representations are maintained.

The Effect of Disruption of Prefrontal Cortical Function with Transcranial Magnetic Stimulation on Visual Working Memory

It is proposed that feedback signals from the prefrontal cortex (PFC) to extrastriate cortex are essential for goal-directed processing, maintenance, and selection of information in visual working memory (VWM). In a previous study, we found that disruption of PFC function with transcranial magnetic stimulation (TMS) in healthy individuals impaired behavioral performance on a face/scene matching task and decreased category-specific tuning in extrastriate cortex as measured with functional magnetic resonance imaging (fMRI). In this study, we investigated the effect of disruption of left inferior frontal gyrus (IFG) function on the fidelity of neural representations of two distinct information codes: (1) the stimulus category and (2) the goal-relevance of viewed stimuli. During fMRI scanning, subjects were presented face and scene images in pseudo-random order and instructed to remember either faces or scenes. Within both anatomical and functional regions of interest (ROIs), a multi-voxel pattern classifier was used to quantitatively assess the fidelity of activity patterns representing stimulus category: whether a face or a scene was presented on each trial, and goal relevance, whether the presented image was task relevant (i.e., a face is relevant in a “Remember Faces” block, but irrelevant in a “Remember Scenes” block). We found a reduction in the fidelity of the stimulus category code in visual cortex after left IFG disruption, providing causal evidence that lateral PFC modulates object category codes in visual cortex during VWM. In addition, we found that IFG disruption caused a reduction in the fidelity of the goal relevance code in a distributed set of brain regions. These results suggest that the IFG is involved in determining the task-relevance of visual input and communicating that information to a network of regions involved in further processing during VWM. Finally, we found that participants who exhibited greater fidelity of the goal relevance code in the non-disrupted right IFG after TMS performed the task with the highest accuracy.

Information maintenance in working memory: an integrated presentation of cognitive and neural concepts

Working memory (WM) maintains information in a state that it is available for processing. A host of various concepts exist which define this core function at different levels of abstraction. The present article intended to bring together existing cognitive and neural explanatory approaches about the architecture and neural mechanisms of information maintenance in WM. For this, we highlight how existing WM concepts define information retention and present different methodological approaches which led to the assumption that information can exist in various components and states. This view is broadened by neural concepts focussing on various forms of phase synchronization and molecular biological mechanisms relevant for retaining information in an active state. An integrated presentation of different concepts and methodological approaches can deepen our understanding of this central WM function.