Decoding the content of visual short-term memory under distraction in occipital and parietal areas

The role of variation in phonological and semantic working memory capacities in sentence comprehension: neural evidence from healthy and brain-damaged individuals

Research on the role of working memory (WM) in language processing has typically focused on WM for phonological information. However, considerable behavioral evidence supports the existence of a separate semantic WM system that plays a greater role in language processing. We review the neural evidence that supports the distinction between phonological and semantic WM capacities and discuss how individual differences in these capacities relate to sentence processing. In terms of neural substrates, findings from multivariate functional MRI for healthy participants and voxel-based lesion-symptom mapping for brain-damaged participants imply that the left supramarginal gyrus supports phonological WM, whereas the left inferior frontal gyrus (LIFG) and angular gyrus support semantic WM. In sentence comprehension, individual variation in semantic but not phonological WM related to performance in resolving semantic information and the LIFG region implicated in semantic WM showed fMRI activation during the resolution of semantic interference. Moreover, variation for brain-damaged participants in the integrity of a fiber tract supporting semantic WM had a greater relation to the processing of complex sentences than did the integrity of fiber tracts supporting phonological WM. Overall, the neural findings provide converging evidence regarding the distinction of these two capacities and the greater contribution of individual differences in semantic than phonological WM capacity to sentence processing.

Brain Neuroplasticity Leveraging Virtual Reality and Brain-Computer Interface Technologies

This study explores neuroplasticity through the use of virtual reality (VR) and brain-computer interfaces (BCIs). Neuroplasticity is the brain's ability to reorganize itself by forming new neural connections in response to learning, experience, and injury. VR offers a controlled environment to manipulate sensory inputs, while BCIs facilitate real-time monitoring and modulation of neural activity. By combining VR and BCI, researchers can stimulate specific brain regions, trigger neurochemical changes, and influence cognitive functions such as memory, perception, and motor skills. Key findings indicate that VR and BCI interventions are promising for rehabilitation therapies, treatment of phobias and anxiety disorders, and cognitive enhancement. Personalized VR experiences, adapted based on BCI feedback, enhance the efficacy of these interventions. This study underscores the potential for integrating VR and BCI technologies to understand and harness neuroplasticity for cognitive and therapeutic applications. The researchers utilized the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) method to conduct a comprehensive and systematic review of the existing literature on neuroplasticity, VR, and BCI. This involved identifying relevant studies through database searches, screening for eligibility, and assessing the quality of the included studies. Data extraction focused on the effects of VR and BCI on neuroplasticity and cognitive functions. The PRISMA method ensured a rigorous and transparent approach to synthesizing evidence, allowing the researchers to draw robust conclusions about the potential of VR and BCI technologies in promoting neuroplasticity and cognitive enhancement.

Comparing Neural Correlates of Memory Encoding and Maintenance for Foveal and Peripheral Stimuli

Visual working memory is believed to rely on top-down attentional mechanisms that sustain active sensory representations in early visual cortex, a mechanism referred to as sensory recruitment. However, both bottom-up sensory input and top-down attentional modulations thereof appear to prioritize the fovea over the periphery, such that initially peripheral percepts may even be assimilated by foveal processes. This raises the question whether and how visual working memory differs for central and peripheral input. To address this, we conducted a delayed orientation recall task in which an orientation was presented either at the center of the screen or at 15° eccentricity to the left or right. Response accuracy, EEG activity, and gaze position were recorded from 30 participants. Accuracy was slightly but significantly higher for foveal versus peripheral memories. Decoding of EEG recordings revealed a clear dissociation between early sensory and later maintenance signals. Although sensory signals were clearly decodable for foveal stimuli, they were not for peripheral input. In contrast, maintenance signals were equally decodable for both foveal and peripheral memories, suggesting comparable top-down components regardless of eccentricity. Moreover, although memory representations were initially spatially specific and reflected in voltage fluctuations, later during the maintenance period, they generalized across locations, as emerged in alpha oscillations, thus revealing a dynamic transformation within memory from separate sensory traces to what we propose are common output-related codes. Furthermore, the combined absence of reliable decoding of sensory signals and robust presence of maintenance decoding indicates that storage activity patterns as measured by EEG reflect signals beyond primary visual cortex. We discuss the implications for the sensory recruitment hypothesis.

EEG decoding reveals task-dependent recoding of sensory information in working memory

Working memory (WM) supports future behavior by retaining perceptual information obtained in the recent past. The present study tested the hypothesis that WM recodes sensory information in a format that better supports behavioral goals. We recorded EEG while participants performed color delayed-estimation tasks where the colorwheel for the response was either randomly rotated or held fixed across trials. Accordingly, observers had to remember the exact colors in the Rotation condition, whereas they could prepare for a response based on the fixed mapping between the colors and their corresponding locations on the colorwheel in the No-Rotation condition. Results showed that the color reports were faster and more precise in the No-Rotation condition even when exactly the same set of colors were tested in both conditions. To investigate how the color information was maintained in the brain, we decoded the color using a multivariate EEG classification method. The decoding was limited to the stimulus encoding period in the Rotation condition, whereas it continued to be significant during the maintenance period in the No-Rotation condition, indicating that the color information was actively maintained in the condition. Follow-up analyses suggested that the prolonged decoding was not merely driven by the covert shift of attention but rather by the recoding of sensory information into an action-oriented response format. Together, these results provide converging evidence that WM flexibly recodes sensory information depending on the specific task context to optimize subsequent behavioral performance.

Load effect of visual working memory on distractor interference: An investigation with two replication experiments

Konstantinou et al. (Experiment 1B; Attention, Perception, & Psychophysics, 76, 1985-1997, 2014) reported that an increase in visual short-term memory (VSTM) load reduced distractor interference in the flanker task. Yao et al. (Experiment 3; Attention, Perception, & Psychophysics, 82, 3291-3313, 2020) replicated the design of Konstantinou et al.'s experiment and showed that the VSTM load did not modulate the distractor interference effect, contradicting the original findings. However, it is unknown whether differences in task-design between the two experiments contributed to the inconsistent results. Therefore, we first replicated the original two studies with Experiment 1 (N = 54) and Experiment 2 (N = 54) and performed a statistical comparison between the data from these two experiments. In a third experiment (N = 28), we incorporated articulatory suppression into the design to exclude possible effects of verbalization. According to the ANOVA analyses, the VSTM load did not change the level of distractor interference in all three experiments, indicating that differences in task design alone do not explain the inconsistency.

Goal-directed attention transforms both working and long-term memory representations in the human parietal cortex

The abundance of distractors in the world poses a major challenge to our brain's limited processing capacity, but little is known about how selective attention modulates stimulus representations in the brain to reduce interference and support durable target memory. Here, we collected functional magnetic resonance imaging (fMRI) data in a selective attention task in which target and distractor pictures of different visual categories were simultaneously presented. Participants were asked to selectively process the target according to the effective cue, either before the encoding period (i.e., perceptual attention) or the maintenance period (i.e., reflective attention). On the next day, participants were asked to perform a memory recognition task in the scanner in which the targets, distractors, and novel items were presented in a pseudorandom order. Behavioral results showed that perceptual attention was better at enhancing target memory and reducing distractor memory than reflective attention, although the overall memory capacity (memory for both target and distractor) was comparable. Using multiple-voxel pattern analysis of the neural data, we found more robust target representation and weaker distractor representation in working memory for perceptual attention than for reflective attention. Interestingly, perceptual attention partially shifted the regions involved in maintaining the target representation from the visual cortex to the parietal cortex. Furthermore, the targets and distractors simultaneously presented in the perceptual attention condition showed reduced pattern similarity in the parietal cortex during retrieval compared to items not presented together. This neural pattern repulsion positively correlated with individuals' recognition of both targets and distractors. These results emphasize the critical role of selective attention in transforming memory representations to reduce interference and improve long-term memory performance.

Sensitivity to and Control of Distraction: Distractor-Entrained Oscillation and Frontoparietal EEG Gamma Synchronization

While recent advancements have been made towards a better understanding of the involvement of the prefrontal cortex (PFC) in the context of cognitive control, the exact mechanism is still not fully understood. Successful behavior requires the correct detection of goal-relevant cues and resisting irrelevant distractions. Frontal parietal networks have been implicated as important for maintaining cognitive control in the face of distraction. The present study investigated the role of gamma-band power in distraction resistance and frontoparietal networks, as its increase is linked to cholinergic activity. We examined changes in gamma activity and their relationship to frontoparietal top-down modulation for distractor challenges and to bottom-up distractor processing. Healthy young adults were tested using a modified version of the distractor condition sustained attention task (dSAT) while wearing an EEG. The modified distractor was designed so that oscillatory activities could be entrained to it, and the strength of entrainment was used to assess the degree of distraction. Increased top-down control during the distractor challenge increased gamma power in the left parietal regions rather than the right prefrontal regions predicted from rodent studies. Specifically, left parietal gamma power increased in response to distraction where the amount of this increase was negatively correlated with the neural activity reflecting bottom-up distractor processing in the visual area. Variability in gamma power in right prefrontal regions was associated with increased response time variability during distraction. This may suggest that the right prefrontal region may contribute to the signaling needed for top-down control rather than its implementation.

Neuronal representation of visual working memory content in the primate primary visual cortex

The human ability to perceive vivid memories as if they "float" before our eyes, even in the absence of actual visual stimuli, captivates the imagination. To determine the neural substrates underlying visual memories, we investigated the neuronal representation of working memory content in the primary visual cortex of monkeys. Our study revealed that neurons exhibit unique responses to different memory contents, using firing patterns distinct from those observed during the perception of external visual stimuli. Moreover, this neuronal representation evolves with alterations in the recalled content and extends beyond the retinotopic areas typically reserved for processing external visual input. These discoveries shed light on the visual encoding of memories and indicate avenues for understanding the remarkable power of the mind's eye.

Threat of shock increases distractor susceptibility during the short-term maintenance of visual information

Elevated arousal in anxiety is thought to affect attention control. To test this, we designed a visual short-term memory (VSTM) task to examine distractor suppression during periods of threat and no-threat. We hypothesized that threat would impair performance when subjects had to filter out large numbers of distractors. The VSTM task required subjects to attend to one array of squares while ignoring a separate array. The number of target and distractor squares varied systematically, with high (four squares) and low (two squares) target and distractor conditions. This study comprised two separate experiments. Experiment 1 used startle responses and white noise as to directly measure threat-induced anxiety. Experiment 2 used BOLD to measure brain responses. For Experiment 1, subjects showed significantly larger startle responses during threat compared to safe period, supporting the validity of the threat manipulation. For Experiment 2, we found that accuracy was affected by threat, such that the distractor load negatively impacted accuracy only in the threat condition. We also found threat-related differences in parietal cortex activity. Overall, these findings suggest that threat affects distractor susceptibility, impairing filtering of distracting information. This effect is possibly mediated by hyperarousal of parietal cortex during threat.

Nonfrontal Control of Working Memory

Items held in visual working memory can be quickly updated, replaced, removed, and even manipulated in accordance with current behavioral goals. Here, we use multivariate pattern analyses to identify the patterns of neuronal activity that realize the executive control processes supervising these flexible stores. We find that portions of the middle temporal gyrus and the intraparietal sulcus represent what item is cued for continued memorization independently of representations of the item itself. Importantly, this selection-specific activity could not be explained by sensory representations of the cue and is only present when control is exerted. Our results suggest that the selection of memorized items might be controlled in a distributed and decentralized fashion. This evidence provides an alternative perspective to the notion of "domain general" central executive control over memory function.

Multifaceted consequences of visual distraction during natural behaviour

Visual distraction is a ubiquitous aspect of everyday life. Studying the consequences of distraction during temporally extended tasks, however, is not tractable with traditional methods. Here we developed a virtual reality approach that segments complex behaviour into cognitive subcomponents, including encoding, visual search, working memory usage, and decision-making. Participants copied a model display by selecting objects from a resource pool and placing them into a workspace. By manipulating the distractibility of objects in the resource pool, we discovered interfering effects of distraction across the different cognitive subcomponents. We successfully traced the consequences of distraction all the way from overall task performance to the decision-making processes that gate memory usage. Distraction slowed down behaviour and increased costly body movements. Critically, distraction increased encoding demands, slowed visual search, and decreased reliance on working memory. Our findings illustrate that the effects of visual distraction during natural behaviour can be rather focal but nevertheless have cascading consequences.

Age-related enhancement of the association between episodic memory and gray matter volume in medial temporal and frontal lobes

BACKGROUND

Episodic memory (EM) deteriorates as a result of normal aging as well as Alzheimer's disease. The neural underpinnings of such age-related memory impairments in older individuals are not well-understood. Although previous research has unveiled the association between gray matter volume (GMV) and EM in the elderly population, such findings exhibit variances across distinct age cohorts. Consequently, an investigation into the dynamic evolution of this relationship with advancing age is imperative.

RESULT

The present study utilized a sliding window approach to examine how the correlation between EM and GMV varied with age in a cross-sectional sample of 926 Chinese older adults. We found that both verbal EM (VEM) and spatial EM (SEM) exhibited positive correlations with GMV in extensive areas primarily in the temporal and frontal lobes and that these correlations typically became stronger with older age. Moreover, there were variations in the strength of the correlation between EM and GMV with age, which differed based on sex and the specific type of EM. Specifically, the association between VEM and GMVs in the insula and parietal regions became stronger with age for females but not for males, whereas the association between SEM and GMVs in the parietal and occipital regions became stronger for males but not for females. At the brain system level, there is a significant age-related increase in the correlations between both types of EM and the GMV of both the anterior temporal (AT) system and the posterior medial (PM) system in male group. In females, both types of EM show stronger age-related correlations with the GMV of the AT system compared to males.

CONCLUSIONS

Our study revealed a significant positive correlation between GMV in most regions associated with EM and age, particularly in the frontal and temporal lobes. This discovery offers new insights into the connection between brain structure and the diminishing episodic memory function among older individuals.

A dynamic neural resource model bridges sensory and working memory

Probing memory of a complex visual image within a few hundred milliseconds after its disappearance reveals significantly greater fidelity of recall than if the probe is delayed by as little as a second. Classically interpreted, the former taps into a detailed but rapidly decaying visual sensory or 'iconic' memory (IM), while the latter relies on capacity-limited but comparatively stable visual working memory (VWM). While iconic decay and VWM capacity have been extensively studied independently, currently no single framework quantitatively accounts for the dynamics of memory fidelity over these time scales. Here, we extend a stationary neural population model of VWM with a temporal dimension, incorporating rapid sensory-driven accumulation of activity encoding each visual feature in memory, and a slower accumulation of internal error that causes memorized features to randomly drift over time. Instead of facilitating read-out from an independent sensory store, an early cue benefits recall by lifting the effective limit on VWM signal strength imposed when multiple items compete for representation, allowing memory for the cued item to be supplemented with information from the decaying sensory trace. Empirical measurements of human recall dynamics validate these predictions while excluding alternative model architectures. A key conclusion is that differences in capacity classically thought to distinguish IM and VWM are in fact contingent upon a single resource-limited WM store.

Divergent roles of early visual cortex and inferior frontal junction in visual working memory

BACKGROUND

Recent studies indicate that both prefrontal and visual regions play critical roles in visual working memory (VWM), with prefrontal regions mainly associated with executive functions, and visual cortices linked to representations of memory contents. VWM involves the selective filtering of irrelevant information, yet the specific contributions of the prefrontal regions and visual cortex in this process remain unclear.

OBJECTIVE

To understand the dynamic causal roles of prefrontal and visual regions in VWM.

METHODS

The differentiation of VWM components was achieved using a computational model that incorporated a swap rate for non-target stimuli. Single-pulse magnetic transcranial stimulation (spTMS) was delivered to the early visual cortex (EVC) and the inferior frontal junction (IFJ) across different phases of an orientation recall task that with or without distractors.

RESULTS

Our results indicate that spTMS over the EVC and IFJ influences VWM particularly when distractors are present. VWM precision can be impacted by spTMS applied to either region during the early retention, while spTMS effect is especially prominent when EVC is stimulated during the late retention phase and when directed at the ipsilateral EVC. Conversely, the probability of accurately recalling the target exhibited comparable patterns when spTMS was administered to either the EVC or IFJ.

CONCLUSIONS

We highlight the "sensory recruitment" of VWM characterized by critical involvement of EVC particularly in the information-filtering process within VWM. The maintenance of memory content representations necessitates ongoing communication between the EVC and IFJ throughout the entirety of the VWM process in a dynamic pattern.

Internal Representations Are Prioritized by Frontoparietal Theta Connectivity and Suppressed by alpha Oscillation Dynamics: Evidence from Concurrent Transcranial Magnetic Stimulation EEG and Invasive EEG

Control over internal representations requires the prioritization of relevant information and suppression of irrelevant information. The frontoparietal network exhibits prominent neural oscillations during these distinct cognitive processes. Yet, the causal role of this network-scale activity is unclear. Here, we targeted theta-frequency frontoparietal coherence and dynamic alpha oscillations in the posterior parietal cortex using online rhythmic transcranial magnetic stimulation (TMS) in women and men while they prioritized or suppressed internally maintained working memory (WM) representations. Using concurrent high-density EEG, we provided evidence that we acutely drove the targeted neural oscillation and TMS improved WM capacity only when the evoked activity corresponded with the desired cognitive process. To suppress an internal representation, we increased the amplitude of lateralized alpha oscillations in the posterior parietal cortex contralateral to the irrelevant visual field. For prioritization, we found that TMS to the prefrontal cortex increased theta-frequency connectivity in the prefrontoparietal network contralateral to the relevant visual field. To understand the spatial specificity of these effects, we administered the WM task to participants with implanted electrodes. We found that theta connectivity during prioritization was directed from the lateral prefrontal to the superior posterior parietal cortex. Together, these findings provide causal evidence in support of a model where a frontoparietal theta network prioritizes internally maintained representations and alpha oscillations in the posterior parietal cortex suppress irrelevant representations.

Contribution of the language network to the comprehension of Python programming code

Does the perisylvian language network contribute to comprehension of programming languages, like Python? Univariate neuroimaging studies find high responses to code in fronto-parietal executive areas but not in fronto-temporal language areas, suggesting the language network does little. We used multivariate-pattern-analysis to test whether the language network encodes Python functions. Python programmers read functions while undergoing fMRI. A linear SVM decoded for-loops from if-conditionals based on activity in lateral temporal (LT) language cortex. In searchlight analysis, decoding accuracy was higher in LT language cortex than anywhere else. Follow up analysis showed that decoding was not driven by presence of different words across functions, "for" vs "if," but by compositional program properties. Finally, univariate responses to code peaked earlier in LT language-cortex than in the fronto-parietal network. We propose that the language system forms initial "surface meaning" representations of programs, which input to the reasoning network for processing of algorithms.

The Reactivation of working memory representations affects attentional guidance

Recent studies have suggested that the neural activity that supported working memory (WM) storage is dynamic over time and this dynamic storage decides memory performance. Does the temporal dynamic of the WM representation also affect visual search, and how does it interact with distractor suppression over time? To address these issues, we tracked the time course of the reactivation of WM representations during visual search by analyzing the electroencephalogram (EEG) and event-related optical signals (EROS) in Experiments 1 and 2, respectively, and investigated the interaction between the representation reactivation and distractor suppression in Experiment 3. Participants had to maintain a color in WM under high- or low-precision requirement and perform a subsequent search task. The reactivation of WM representations was defined by the above-chance decoding accuracy. The EEG results showed that compared with the low-precision requirement, WM-matching distractors captured more attention and the WM representation were reactivated more frequently under high-precision requirement. The EROS results showed that compared with the low-precision requirement, the increased activity in occipital cortex in the WM-matching versus WM-mismatching conditions was observed at 224 ms during visual search under high-precision requirement. Regression analysis showed that the representation reactivation during visual search directly predicted the behavioral WM-based attentional capture effect, while the representation reactivation before visual search impacted the WM-based attentional capture effect through the mediation of distractor suppression during visual search. These results suggest that the reactivation of WM representations and distractor suppression collectively determine WM-based attentional capture.

Working memory signals in early visual cortex are present in weak and strong imagers

It has been suggested that visual images are memorized across brief periods of time by vividly imagining them as if they were still there. In line with this, the contents of both working memory and visual imagery are known to be encoded already in early visual cortex. If these signals in early visual areas were indeed to reflect a combined imagery and memory code, one would predict them to be weaker for individuals with reduced visual imagery vividness. Here, we systematically investigated this question in two groups of participants. Strong and weak imagers were asked to remember images across brief delay periods. We were able to reliably reconstruct the memorized stimuli from early visual cortex during the delay. Importantly, in contrast to the prediction, the quality of reconstruction was equally accurate for both strong and weak imagers. The decodable information also closely reflected behavioral precision in both groups, suggesting it could contribute to behavioral performance, even in the extreme case of completely aphantasic individuals. Our data thus suggest that working memory signals in early visual cortex can be present even in the (near) absence of phenomenal imagery.

Investigating the Roles of the Visual and Parietal Cortex in Representing Content versus Context in Visual Working Memory

Content-to-context binding is crucial for working memory performance. Using a dual-serial retrocueing (DSR) task on oriented gratings, Yu et al. (2020) found that content (orientation) of both prioritized and unprioritized memory items (PMI; UMI) was represented simultaneously in visual cortex, while their context (location) was represented in intraparietal sulcus (IPS), with a priority-based remapping of the representation of content and context of the UMI in each region, respectively. This registered report acquired fMRI of 24 healthy adults while they performed a DSR task with location as the to-be-reported content and orientation as the task-relevant context. We contrasted three accounts: domain-dependent, the engagement of visual and parietal regions depends on the feature domain (orientation vs location); functional, the engagement of these regions depends on their function (content vs context); and hybrid-a combination of the domain-dependent account and the additional stipulation that IPS encodes context regardless of domain. Delay-period activity in early visual cortex conformed most closely with functional predictions: robust priority-sensitive representation of stimulus location (content), but no evidence for the active representation of stimulus orientation (context). Delay-period activity in IPS, in contrast, conformed most closely to predictions of the hybrid account: active representation of content (location) and of prioritized context (orientation). Exploratory analyses further supported the hybrid account of IPS, revealing univariate sensitivity to variation in both content and context load, the latter in a manner that predicted individual differences in behavior. The representation of visual information in working memory is highly dependent on behavioral context.

Electrophysiological hallmarks for event relations and event roles in working memory

The ability to maintain events (i.e., interactions between/among objects) in working memory is crucial for our everyday cognition, yet the format of this representation is poorly understood. The current ERP study was designed to answer two questions: How is maintaining events (e.g., the tiger hit the lion) neurally different from maintaining item coordinations (e.g., the tiger and the lion)? That is, how is the event relation (present in events but not coordinations) represented? And how is the agent, or initiator of the event encoded differently from the patient, or receiver of the event during maintenance? We used a novel picture-sentence match-across-delay approach in which the working memory representation was "pinged" during the delay, replicated across two ERP experiments with Chinese and English materials. We found that maintenance of events elicited a long-lasting late sustained difference in posterior-occipital electrodes relative to non-events. This effect resembled the negative slow wave reported in previous studies of working memory, suggesting that the maintenance of events in working memory may impose a higher cost compared to coordinations. Although we did not observe significant ERP differences associated with pinging the agent vs. the patient during the delay, we did find that the ping appeared to dampen the ongoing sustained difference, suggesting a shift from sustained activity to activity silent mechanisms. These results suggest a new method by which ERPs can be used to elucidate the format of neural representation for events in working memory.

Where in the brain do internally generated and externally presented visual information interact?

Conscious experiences normally result from the flow of external input into our sensory systems. However, we can also create conscious percepts independently of sensory stimulation. These internally generated percepts are referred to as mental images, and they have many similarities with real visual percepts. Consequently, mental imagery is often referred to as "seeing in the mind's eye". While the neural basis of imagery has been widely studied, the interaction between internal and external sources of visual information has received little interest. Here we examined this question by using fMRI to record brain activity of healthy human volunteers while they were performing visual imagery that was distracted with a concurrent presentation of a visual stimulus. Multivariate pattern analysis (MVPA) was used to identify the brain basis of this interaction. Visual imagery was reflected in several brain areas in ventral temporal, lateral occipitotemporal, and posterior frontal cortices, with a left-hemisphere dominance. The key finding was that imagery content representations in the left lateral occipitotemporal cortex were disrupted when a visual distractor was presented during imagery. Our results thus demonstrate that the representations of internal and external visual information interact in brain areas associated with the encoding of visual objects and shapes.

Threat of shock increases distractor susceptibility during the short-term maintenance of visual information

BACKGROUND

Work on anxiety related attention control deficits suggests that elevated arousal impacts the ability to filter out distractors. To test this, we designed a task to look at distractor suppression during periods of threat. We administered trials of a visual short-term memory (VSTM) task, during periods of unpredictable threat, and hypothesized that threat would impair performance during trials where subjects were required to filter out large numbers of distractors.

METHOD

Experiment 1 involved fifteen healthy participants who completed one study visit. They performed four runs of a VSTM task comprising 32 trials each. Participants were presented with an arrow indicating left or right, followed by an array of squares. They were instructed to remember the target side and disregard the distractors on the off-target side. A subsequent target square was shown, and participants indicated whether it matched one of the previously presented target squares. The trial conditions included 50% matches and 50% mismatches, with an equal distribution of left and right targets. The number of target and distractor squares varied systematically, with high (4 squares) and low (2 squares) target and distractor conditions. Trials alternated between periods of safety and threat, with startle responses recorded using electromyography (EMG) following white noise presentations. Experiment 2 involved twenty-seven healthy participants who completed the same VSTM task inside an MRI scanner during a single study visit. The procedure mirrored that of Experiment 1, except for the absence of white noise presentations.

RESULTS

For Experiment 1, subjects showed significantly larger startle responses during threat compared to safe period, supporting the validity of the threat manipulation. However, results suggested that the white noise probes interfered with performance. For Experiment 2, we found that both accuracy was affected by threat, such that distractor load negatively impacted accuracy only in the threat condition.

CONCLUSION

Overall, these findings suggest that threat affects distractor susceptibility during the short-term maintenance of visual information. The presence of threat makes it more difficult to filter out distracting information. We believe that this is related to hyperarousal of parietal cortex, which has been observed during unpredictable threat.

The effects of object size on spatial orientation: an eye movement study

Introduction

The processing of visual information in the human brain is divided into two streams, namely, the dorsal and ventral streams, object identification is related to the ventral stream and motion processing is related to the dorsal stream. Object identification is interconnected with motion processing, object size was found to affect the information processing of motion characteristics in uniform linear motion. However, whether the object size affects the spatial orientation is still unknown.

Methods

Thirty-eight college students were recruited to participate in an experiment based on the spatial visualization dynamic test. Eyelink 1,000 Plus was used to collect eye movement data. The final direction difference (the difference between the final moving direction of the target and the final direction of the moving target pointing to the destination point), rotation angle (the rotation angle of the knob from the start of the target movement to the moment of key pressing) and eye movement indices under conditions of different object sizes and motion velocities were compared.

Results

The final direction difference and rotation angle under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point were significantly smaller than those under the other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). The average pupil size under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point was significantly larger than the average pupil size under other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point).

Discussion

A relatively large moving target can resist the landmark attraction effect in spatial orientation, and the influence of object size on spatial orientation may originate from differences in cognitive resource consumption. The present study enriches the interaction theory of the processing of object characteristics and motion characteristics and provides new ideas for the application of eye movement technology in the examination of spatial orientation ability.

Parietal-driven visual working memory representation in occipito-temporal cortex

Human fMRI studies have documented extensively that the content of visual working memory (VWM) can be reliably decoded from fMRI voxel response patterns during the delay period in both the occipito-temporal cortex (OTC), including early visual areas (EVC), and the posterior parietal cortex (PPC).1,2,3,4 Further work has revealed that VWM signal in OTC is largely sustained by feedback from associative areas such as prefrontal cortex (PFC) and PPC.4,5,6,7,8,9 It is unclear, however, if feedback during VWM simply restores sensory representations initially formed in OTC or if it can reshape the representational content of OTC during VWM delay. Taking advantage of a recent finding showing that object representational geometry differs between OTC and PPC in perception,10 here we find that, during VWM delay, the object representational geometry in OTC becomes more aligned with that of PPC during perception than with itself during perception. This finding supports the role of feedback in shaping the content of VWM in OTC, with the VWM content of OTC more determined by information retained in PPC than by the sensory information initially encoded in OTC.

Disturbance of information in superior parietal lobe during dual-task interference in a simulated driving task

Performing a secondary task while driving causes a decline in driving performance. This phenomenon, called dual-task interference, can have lethal consequences. Previous fMRI studies have looked at the changes in the average brain activity to uncover the neural correlates of dual-task interference. From these results, it is unclear whether the overall modulations in brain activity result from general effects such as task difficulty, attentional modulations, and mental effort or whether it is caused by a change in the responses specific to each condition due to dual-task interference. To overcome this limitation, here, we used multi-voxel pattern analysis (MVPA) to interrogate the change in the information content in multiple brain regions during dual-task interference in simulated driving. Participants performed a lane-change task in a simulated driving environment, along with a tone discrimination task with either short or long onset time difference (Stimulus Onset Asynchrony, SOA) between the two tasks. Behavioral results indicated a robust dual-task effect on lane-change reaction time (RT). MVPA revealed regions that carry information about the driving lane-change direction (shift right/shift left), including the superior parietal lobe (SPL), visual, and motor regions. Comparison of decoding accuracies across SOA conditions in the SPL region revealed lower accuracy in the short compared to the long SOA condition. This change in accuracy was not observed in the visual and motor regions. These findings suggest that the dual-task interference in driving may be related to the disturbance of information processing in the SPL region.

Bend but don't break: Prioritization protects working memory from displacement but leaves it vulnerable to distortion from distraction

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased towards passively viewed visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. We designed a study with five different types of visual distraction that varied in engagement and found evidence for both subtle distortions and catastrophic failures of memory. Importantly, prioritization protected working memories from catastrophic loss (fewer "swap errors") but rendered them more vulnerable to distortion (greater attractive "biases" towards the distractor). Our findings demonstrate that prioritization does not simply protect working memory from any and all interference, but rather it reduces the likelihood of catastrophic disruption from perceptual distraction at the cost of an increased likelihood of distortion.

Assessing the interaction between working memory and perception through time

Content maintained in visual working memory changes concurrent visual processing, suggesting that visual working memory may recruit an overlapping neural representation with visual perception. However, it remains unclear whether visual working memory representations persist as a sensory code through time, or are recoded later into an abstract code. Here, we directly contrasted a temporal decay + visual code account and a temporal decay + abstract code account within the temporal dynamics of the interaction between working memory and perception. By manipulating the ISI (inter-stimulus interval) between working memory encoding and a perceptual discrimination task, we found that task-relevant and therefore actively maintained perceptual information parametrically altered participants' ability to discriminate perceptual stimuli even 4 s after encoding, whereas task-irrelevant information caused only an acutely transient effect. While continuously present, the size of this shift in discrimination thresholds gradually decreased over time. Concomitantly, the size of the bias in working memory reports increased over time. The opposing directions of threshold and bias effects are consistent with the local maintenance of information in perceptual areas, explained by a temporal decay + visual code account. As the maintained representation decays over time, its ability to alter incoming perceptual signals decreases (reduced threshold effects) while its likelihood of being impacted by those same signals increases (increased bias effects). Altogether, these results suggest that the readout of working memory relies on a sensory representation at a cost of increased interference by ongoing perception.

Leveraging Motor Imagery Rehabilitation for Individuals with Disabilities: A Review

Motor imagery, an intricate cognitive procedure encompassing the mental simulation of motor actions, has surfaced as a potent strategy within the neuro-rehabilitation domain. It presents a non-invasive, economically viable method for facilitating individuals with disabilities in enhancing their motor functionality and regaining self-sufficiency. This manuscript delivers an exhaustive analysis of the significance of motor imagery in augmenting functional rehabilitation for individuals afflicted with physical impairments. It investigates the fundamental mechanisms governing motor imagery, its applications across diverse disability conditions, and the prospective advantages it renders. Moreover, this document addresses the prevailing obstacles and prospective trajectories in this sector, accentuating the necessity for continued investigation and the invention of cutting-edge technologies that optimize the potentiality of motor imagery in aiding disabled persons.

Ultra-High Field Imaging of Human Visual Cognition

Functional magnetic resonance imaging (fMRI), the key methodology for mapping the functions of the human brain in a noninvasive manner, is limited by low temporal and spatial resolution. Recent advances in ultra-high field (UHF) fMRI provide a mesoscopic (i.e., submillimeter resolution) tool that allows us to probe laminar and columnar circuits, distinguish bottom-up versus top-down pathways, and map small subcortical areas. We review recent work demonstrating that UHF fMRI provides a robust methodology for imaging the brain across cortical depths and columns that provides insights into the brain's organization and functions at unprecedented spatial resolution, advancing our understanding of the fine-scale computations and interareal communication that support visual cognition.

Neural population dynamics of human working memory

The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics.

Alpha oscillations protect working memory against distracters in a modality-specific way

Alpha oscillations are thought to be involved in suppressing distracting input in working-memory tasks. Yet, the spatial-temporal dynamics of such suppression remain unclear. Key questions are whether such suppression reflects a domain-general inattentiveness mechanism, or occurs in a stimulus- or modality-specific manner within cortical areas most responsive to the distracters; and whether the suppression is proactive (i.e., preparatory) or reactive. Here, we addressed these questions using a working-memory task where participants had to memorize an array of visually presented digits and reproduce one of them upon being probed. We manipulated the presence of distracters and the sensory modality in which distracters were presented during memory maintenance. Our results show that sensory areas most responsive to visual and auditory distracters exhibited stronger alpha power increase after visual and auditory distracter presentation respectively. These results suggest that alpha oscillations underlie distracter suppression in a reactive, modality-specific manner.

Neural evidence for advantaged representation of first items in memory

Visual areas activated during perception can retain specific information held in memory without the presence of physical stimuli via distributed activity patterns. Neuroimaging studies have shown that the delay-period representation of information in visual areas is modulated by factors such as memory load and task demands, raising the possibility of serial position as another potential modulator. Specifically, enhanced representation of first items during the post-encoding delay period may serve as a mechanism underlying the well-established but not well-understood primacy effect - the mnemonic advantage of first items. To test this hypothesis, 13 males and 16 females performed a human fMRI task, wherein each trial consisted of the sequential encoding of two stimuli (a famous face and landscape, order counterbalanced), followed by a distracting task, a delay period, and then a cued recall of one of the items. Participants exhibited the expected behavioral primacy effect, manifested as faster recall of the first items. In order to elucidate the still debated neural underpinnings of this effect, using multivariate decoding, a classifier was trained on data collected during encoding to differentiate stimulus categories (i.e., faces vs. landscapes) and tested on data collected during the post-encoding period. Greater reactivation of first versus second items was observed in the ventral occipito-temporal cortex during the entire post-encoding period but not during encoding. Moreover, trial-level analyses revealed that the degree of first-item neural advantage during the post-encoding delay predicted the behavioral primacy effect. These findings highlight the role of item reinstatement in ventral occipito-temporal cortex in the primacy effect and are discussed in the context of the uniqueness of the very first item and event boundaries, illuminating putative neural mechanisms underlying the effect.

Strategic control of location and ordinal context in visual working memory

Working memory (WM) requires encoding stimulus identity and context (e.g. where or when stimuli were encountered). To explore the neural bases of the strategic control of context binding in WM, we acquired fMRI while subjects performed delayed recognition of 3 orientation patches presented serially and at different locations. The recognition probe was an orientation patch with a superimposed digit, and pretrial instructions directed subjects to respond according to its location ("location-relevant"), to the ordinal position corresponding to its digit ("order-relevant"), or to just its orientation (relative to all three samples; "context-irrelevant"). Delay period signal in PPC was greater for context-relevant than for "context-irrelevant" trials, and multivariate decoding revealed strong sensitivity to context binding requirements (relevant vs. "irrelevant") and to context domain ("location-" vs. "order-relevant") in both occipital cortex and PPC. At recognition, multivariate inverted encoding modeling revealed markedly different patterns in these 2 regions, suggesting different context-processing functions. In occipital cortex, an active representation of the location of each of the 3 samples was reinstated regardless of the trial type. The pattern in PPC, by contrast, suggested a trial type-dependent filtering of sample information. These results indicate that PPC exerts strategic control over the representation of stimulus context in visual WM.

Neural correlates of visual and tactile path integration and their task related modulation

Self-motion induces sensory signals that allow to determine travel distance (path integration). For veridical path integration, one must distinguish self-generated from externally induced sensory signals. Predictive coding has been suggested to attenuate self-induced sensory responses, while task relevance can reverse the attenuating effect of prediction. But how is self-motion processing affected by prediction and task demands, and do effects generalize across senses? In this fMRI study, we investigated visual and tactile self-motion processing and its modulation by task demands. Visual stimuli simulated forward self-motion across a ground plane. Tactile self-motion stimuli were delivered by airflow across the subjects' forehead. In one task, subjects replicated a previously observed distance (Reproduction/Active; high behavioral demand) of passive self-displacement (Reproduction/Passive). In a second task, subjects travelled a self-chosen distance (Self/Active; low behavioral demand) which was recorded and played back to them (Self/Passive). For both tasks and sensory modalities, Active as compared to Passive trials showed enhancement in early visual areas and suppression in higher order areas of the inferior parietal lobule (IPL). Contrasting high and low demanding active trials yielded supramodal enhancement in the anterior insula. Suppression in the IPL suggests this area to be a comparator of sensory self-motion signals and predictions thereof.

A gradual transition from veridical to categorical representations along the visual hierarchy during working memory, but not perception

The ability to stably maintain visual information over brief delays is central to cognitive functioning. One possible way to achieve robust working memory maintenance is by having multiple concurrent mnemonic representations across multiple cortical loci. For example, early visual cortex might contribute to storage by representing information in a "sensory-like" format, while intraparietal sulcus uses a format transformed away from sensory driven responses. As an explicit test of mnemonic code transformations along the visual hierarchy, we quantitatively modeled the progression of veridical-to-categorical orientation representations in human participants. Participants directly viewed, or held in mind, an oriented grating pattern, and the similarity between fMRI activation patterns for different orientations was calculated throughout retinotopic cortex. During direct perception, similarity was clustered around cardinal orientations, while during working memory the obliques were represented more similarly. We modeled these similarity patterns based on the known distribution of orientation information in the natural world: The "veridical" model uses an efficient coding framework to capture hypothesized representations during visual perception. The "categorical" model assumes that different "psychological distances" between orientations result in orientation categorization relative to cardinal axes. During direct perception, the veridical model explained the data well in early visual areas, while the categorical model did worse. During working memory, the veridical model only explained some of the data, while the categorical model gradually gained explanatory power for increasingly anterior retinotopic regions. These findings suggest that directly viewed images are represented veridically, but once visual information is no longer tethered to the sensory world, there is a gradual progression to more categorical mnemonic formats along the visual hierarchy.

Mnemonic representations in human lateral geniculate nucleus

There is a growing appreciation for the role of the thalamus in high-level cognition. Motivated by findings that internal cognitive state drives activity in feedback layers of primary visual cortex (V1) that target the lateral geniculate nucleus (LGN), we investigated the role of LGN in working memory (WM). Specifically, we leveraged model-based neuroimaging approaches to test the hypothesis that human LGN encodes information about spatial locations temporarily encoded in WM. First, we localized and derived a detailed topographic organization in LGN that accords well with previous findings in humans and non-human primates. Next, we used models constructed on the spatial preferences of LGN populations in order to reconstruct spatial locations stored in WM as subjects performed modified memory-guided saccade tasks. We found that population LGN activity faithfully encoded the spatial locations held in memory in all subjects. Importantly, our tasks and models allowed us to dissociate the locations of retinal stimulation and the motor metrics of memory-guided saccades from the maintained spatial locations, thus confirming that human LGN represents true WM information. These findings add LGN to the growing list of subcortical regions involved in WM, and suggest a key pathway by which memories may influence incoming processing at the earliest levels of the visual hierarchy.

Impulse perturbation reveals cross-modal access to sensory working memory through learned associations

We investigated if learned associations between visual and auditory stimuli can afford full cross-modal access to working memory. Previous research using the impulse perturbation technique has shown that cross-modal access to working memory is one-sided; visual impulses reveal both auditory and visual memoranda, but auditory impulses do not seem to reveal visual memoranda (Wolff et al., 2020b). Our participants first learned to associate six auditory pure tones with six visual orientation gratings. Next, a delayed match-to-sample task for the orientations was completed, while EEG was recorded. Orientation memories were recalled either via their learned auditory counterpart, or were visually presented. We then decoded the orientation memories from the EEG responses to both auditory and visual impulses presented during the memory delay. Working memory content could always be decoded from visual impulses. Importantly, through recall of the learned associations, the auditory impulse also evoked a decodable response from the visual WM network, providing evidence for full cross-modal access. We also observed that after a brief initial dynamic period, the representational codes of the memory items generalized across time, as well as between perceptual maintenance and long-term recall conditions. Our results thus demonstrate that accessing learned associations in long-term memory provides a cross-modal pathway to working memory that seems to be based on a common coding scheme.

Decoding of Working Memory Contents in Auditory Cortex Is Not Distractor-Resistant

Working memory enables the temporary storage of relevant information in the service of behavior. Neuroimaging studies have suggested that sensory cortex is involved in maintaining contents in working memory. This raised the question of how sensory regions maintain memory representations during the exposure to distracting stimuli. Multivariate pattern analysis of fMRI signals in visual cortex has shown that the contents of visual working memory could be decoded concurrently with passively viewed distractors. The present fMRI study tested whether this finding extends to auditory working memory and to active distractor processing. We asked participants to memorize the pitch of a target sound and to compare it with a probe sound presented after a 13 s delay period. In separate conditions, we compared a blank delay phase (no distraction) with either passive listening to, or active processing of, an auditory distractor presented throughout the memory delay. Consistent with previous reports, pitch-specific memory information could be decoded in auditory cortex during the delay in trials without distraction. In contrast, decoding of target sounds in early auditory cortex dropped to chance level during both passive and active distraction. This was paralleled by memory performance decrements under distraction. Extending the analyses beyond sensory cortex yielded some evidence for memory content-specific activity in inferior frontal and superior parietal cortex during active distraction. In summary, while our findings question the involvement of early auditory cortex in the maintenance of distractor-resistant working memory contents, further research should elucidate the role of hierarchically higher regions.SIGNIFICANCE STATEMENT Information about sensory features held in working memory can be read out from hemodynamic activity recorded in human sensory cortices. Moreover, visual cortex can in parallel store visual content and process newly incoming, task-irrelevant visual input. The present study investigated the role of auditory cortex for working memory maintenance under distraction. While memorized sound frequencies could be decoded in auditory cortex in the absence of distraction, auditory distraction during the delay phase impaired memory performance and prevented decoding of information stored in working memory. Apparently, early auditory cortex is not sufficient to represent working memory contents under distraction that impairs performance. However, exploratory analyses indicated that, under distraction, higher-order frontal and parietal regions might contribute to content-specific working memory storage.

Prioritization sharpens working memories but does not protect them from distraction

Perceptual distraction distorts visual working memory representations. Previous research has shown that memory responses are systematically biased toward visual distractors that are similar to the memoranda. However, it remains unclear whether the prioritization of one working memory representation over another reduces the impact of perceptual distractors. In five behavioral experiments, we used different forms of retrospective cues (indicating the likelihood of testing each item and/or the reward for responding correctly to each item) to manipulate the prioritization of items in working memory before visual distraction. We examined the effects of distraction with nonparametric analyses and a novel distractor intrusion model. We found that memory responses were more precise (lower absolute response errors and stronger memory signals) for items that were prioritized. However, these prioritized items were not immune to distraction, and their memory responses were biased toward the visual distractors to the same degree as were unprioritized items. Our findings demonstrate that the benefits associated with prioritization in working memory do not include protection from distraction biases. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance

The role of the sensory visual cortex during visual short-term memory (VSTM) remains controversial. This controversy is possibly due to methodological issues in previous attempts to investigate the effects of transcranial magnetic stimulation (TMS) on VSTM. The aim of this study was to use TMS, while covering previous methodological deficits. Sixty-four young adults were recruited to participate in two experiments (Experiment 1: n = 36; Experiment 2: n = 28) using a VSTM orientation change-detection task under TMS. Monocular vision was ensured using red-blue goggles combined with red-blue stimuli. Double-pulse TMS was delivered at different times (Experiment 1: 0, 200 or 1000 ms; Experiment 2: 200, 1000 ms) during a 2 s maintenance phase, on one side of the occipital hemisphere. In Experiment 2, a sham TMS condition was introduced. Decreased detection sensitivity (d') in the ipsilateral occipital hemisphere to visual hemifield, and in the real TMS (compared with sham TMS) condition indicated inhibitory TMS effects, and thus, a causal involvement of the sensory visual cortex during early (200 ms) and late (1000 ms) maintenance in VSTM. These findings are aligned with sensory recruitment, which proposes that both perceptual and memory processes rely upon the same neural substrates in the sensory visual cortex. The methods used in this study were preregistered and had received in-principle acceptance on 6 June 2022 (Stage 1 protocol can be found in: https://doi.org/10.17605/OSF.IO/EMPDT).

Spectrotemporal content of human auditory working memory represented in functional connectivity patterns

Recent research suggests that working memory (WM), the mental sketchpad underlying thinking and communication, is maintained by multiple regions throughout the brain. Whether parts of a stable WM representation could be distributed across these brain regions is, however, an open question. We addressed this question by examining the content-specificity of connectivity-pattern matrices between subparts of cortical regions-of-interest (ROI). These connectivity patterns were calculated from functional MRI obtained during a ripple-sound auditory WM task. Statistical significance was assessed by comparing the decoding results to a null distribution derived from a permutation test considering all comparable two- to four-ROI connectivity patterns. Maintained WM items could be decoded from connectivity patterns across ROIs in frontal, parietal, and superior temporal cortices. All functional connectivity patterns that were specific to maintained sound content extended from early auditory to frontoparietal cortices. Our results demonstrate that WM maintenance is supported by content-specific patterns of functional connectivity across different levels of cortical hierarchy.

The entorhinal-DG/CA3 pathway in the medial temporal lobe retains visual working memory of a simple surface feature

Classic models consider working memory (WM) and long-term memory as distinct mental faculties that are supported by different neural mechanisms. Yet, there are significant parallels in the computation that both types of memory require. For instance, the representation of precise item-specific memory requires the separation of overlapping neural representations of similar information. This computation has been referred to as pattern separation, which can be mediated by the entorhinal-DG/CA3 pathway of the medial temporal lobe (MTL) in service of long-term episodic memory. However, although recent evidence has suggested that the MTL is involved in WM, the extent to which the entorhinal-DG/CA3 pathway supports precise item-specific WM has remained elusive. Here, we combine an established orientation WM task with high-resolution fMRI to test the hypothesis that the entorhinal-DG/CA3 pathway retains visual WM of a simple surface feature. Participants were retrospectively cued to retain one of the two studied orientation gratings during a brief delay period and then tried to reproduce the cued orientation as precisely as possible. By modeling the delay-period activity to reconstruct the retained WM content, we found that the anterior-lateral entorhinal cortex (aLEC) and the hippocampal DG/CA3 subfield both contain item-specific WM information that is associated with subsequent recall fidelity. Together, these results highlight the contribution of MTL circuitry to item-specific WM representation.

Brain Activation During Working Memory Task in Amnestic Mild Cognitive Impairment Patients and Its Association with Memory and Attention

BACKGROUND

Amnestic mild cognitive impairment (aMCI) is regarded as a transitional state of Alzheimer's disease, with working memory (WM) impairment.

OBJECTIVE

To investigate the brain activity in aMCI patients during WM tasks with the functional near-infrared spectroscopy (fNIRS) technique, as well as explore the association between brain activity and cognitive function in multiple domains.

METHODS

This study is a case-control study of 54 aMCI patients and 33 cognitively healthy elderly (NC). All participants underwent neuropsychological assessments. fNIRS was applied to examine the brain activation during the WM task. Multivariable linear regression analysis was applied to evaluate associations between brain activation and cognitive function in multiple domains.

RESULTS

Compared to NC subjects, aMCI patients had lower activation in the bilateral prefrontal, parietal, and occipital cortex during the WM task. Additionally, activation in the left prefrontal, bilateral parietal, and occipital cortex during the encoding and maintenance phase was positively associated with memory function. During memory retrieval, higher activity in the left prefrontal, parietal, and occipital cortex were correlated with higher memory scores. Besides, a positive association also formed between attention function and the activation in the left prefrontal, parietal, and occipital cortex during the WM task.

CONCLUSION

These findings demonstrated that reduced activation in the prefrontal, parietal and occipital cortex during WM might reflect the risk of cognitive impairment, especially memory and attention function in aMCI patients. Given the brain activation visualization, fNIRS may be a convenient and alternative tool for screening the risk of Alzheimer's disease.

Attentional distraction affects maintenance of information in visual sensory memory

Classical theoretical models suggest that visual short-term memory can be divided in two main memory systems: sensory memory, a short-lasting but high-capacity memory storage and working memory, a long-lasting but low-capacity memory store. Whilst, previous research has systematically shown a strong interplay between attentional mechanisms and working memory, less clear is the role of attention in sensory memory. In the present study we approach this issue by asking whether withdrawing attentional resources by a dual task (Experiment 1) or by presenting task irrelevant information during memory maintenance (Experiment 2 and 3) similarly or differently affect sensory and working memory. Overall, results showed that sensory memory content was undermined not only by a simultaneous high-demanding cognitive task but even when purely task-irrelevant and non-masking visual distractors were presented during maintenance. Our data provide support against theories that consider sensory memories as a case of visual awareness free of attention.

Cortical areas involved in grasping and reaching actions with and without visual information: An ALE meta-analysis of neuroimaging studies

The functional specialization of the ventral stream in Perception and the dorsal stream in Action is the cornerstone of the leading model proposed by Goodale and Milner in 1992. This model is based on neuropsychological evidence and has been a matter of debate for almost three decades, during which the dual-visual stream hypothesis has received much attention, including support and criticism. The advent of functional magnetic resonance imaging (fMRI) has allowed investigating the brain areas involved in Perception and Action, and provided useful data on the functional specialization of the two streams. Research on this topic has been quite prolific, yet no meta-analysis so far has explored the spatial convergence in the involvement of the two streams in Action. The present meta-analysis (N = 53 fMRI and PET studies) was designed to reveal the specific neural activations associated with Action (i.e., grasping and reaching movements), and the extent to which visual information affects the involvement of the two streams during motor control. Our results provide a comprehensive view of the consistent and spatially convergent neural correlates of Action based on neuroimaging studies conducted over the past two decades. In particular, occipital-temporal areas showed higher activation likelihood in the Vision compared to the No vision condition, but no difference between reach and grasp actions. Frontal-parietal areas were consistently involved in both reach and grasp actions regardless of visual availability. We discuss our results in light of the well-established dual-visual stream model and frame these findings in the context of recent discoveries obtained with advanced fMRI methods, such as multivoxel pattern analysis.

Predicting Identity-Preserving Object Transformations in Human Posterior Parietal Cortex and Convolutional Neural Networks

Previous research shows that, within human occipito-temporal cortex (OTC), we can use a general linear mapping function to link visual object responses across nonidentity feature changes, including Euclidean features (e.g., position and size) and non-Euclidean features (e.g., image statistics and spatial frequency). Although the learned mapping is capable of predicting responses of objects not included in training, these predictions are better for categories included than those not included in training. These findings demonstrate a near-orthogonal representation of object identity and nonidentity features throughout human OTC. Here, we extended these findings to examine the mapping across both Euclidean and non-Euclidean feature changes in human posterior parietal cortex (PPC), including functionally defined regions in inferior and superior intraparietal sulcus. We additionally examined responses in five convolutional neural networks (CNNs) pretrained with object classification, as CNNs are considered as the current best model of the primate ventral visual system. We separately compared results from PPC and CNNs with those of OTC. We found that a linear mapping function could successfully link object responses in different states of nonidentity transformations in human PPC and CNNs for both Euclidean and non-Euclidean features. Overall, we found that object identity and nonidentity features are represented in a near-orthogonal, rather than complete-orthogonal, manner in PPC and CNNs, just like they do in OTC. Meanwhile, some differences existed among OTC, PPC, and CNNs. These results demonstrate the similarities and differences in how visual object information across an identity-preserving image transformation may be represented in OTC, PPC, and CNNs.

Context Binding in Visual Working Memory Is Reflected in Bilateral Event-Related Potentials, But Not in Contralateral Delay Activity

Successful retrieval of a specific item from visual working memory (VWM) depends on the binding of that item to its unique context. Recent functional magnetic resonance imaging studies of VWM manipulating memory set homogeneity have identified an important role for the intraparietal sulcus in context binding, independent of any role in representing stimulus identity. The current study explored whether the contralateral delay activity (CDA), which is an event-related potential (ERP) component derived from posterior electrodes that tracks the amount of information held in VWM, might also be sensitive to context-binding demands. In experiment 1, human participants performed lateralized delayed recognition with memory sets containing one, three, or five items that were drawn from the same category (orientations: "homogeneous") or from different categories (orientation, color, and luminance: "heterogeneous"). Because the location and identity of the memory probe indicated the item to be retrieved, homogeneous trials placed higher context-binding demands. VWM capacity was higher in heterogeneous trials. ERPs contralateral (contra) and ipsilateral (ipsi) to the remembered stimuli were higher for homogeneous trials, but these differences were removed in the contra - ipsi subtraction that produced the CDA. In experiment 2, human participants performed lateralized delayed recall with memory sets of one or three items (homogeneous or heterogeneous). Behavior was superior for three-item heterogeneous trials than for homogeneous trials, with modeling revealing context-binding errors in the latter. Bilateral ERPs and CDA results replicated experiment 1. These results support that the CDA tracks the number of object files engaged by VWM and establish that it is not sensitive to context-binding demands.

Neurodynamic correlates for the cross-frequency coupled transcranial alternating current stimulation during working memory performance

Transcranial current stimulation is a neuromodulation technique used to modulate brain oscillations and, in turn, to enhance human cognitive function in a non-invasive manner. This study investigated whether cross-frequency coupled transcranial alternating current stimulation (CFC-tACS) improved working memory performance. Participants in both the tACS-treated and sham groups were instructed to perform a modified Sternberg task, where a combination of letters and digits was presented. Theta-phase/high-gamma-amplitude CFC-tACS was administered over electrode F3 and its four surrounding return electrodes (Fp1, Fz, F7, and C3) for 20 min. To identify neurophysiological correlates for the tACS-mediated enhancement of working memory performance, we analyzed EEG alpha and theta power, cross-frequency coupling, functional connectivity, and nodal efficiency during the retention period of the working memory task. We observed significantly reduced reaction times in the tACS-treated group, with suppressed treatment-mediated differences in frontal alpha power and unidirectional Fz-delta-phase to Oz-high-gamma-amplitude modulation during the second half of the retention period when network analyses revealed tACS-mediated fronto-occipital dissociative neurodynamics between alpha suppression and delta/theta enhancement. These findings indicate that tACS modulated top-down control and functional connectivity across the fronto-occipital regions, resulting in improved working memory performance. Our observations are indicative of the feasibility of enhancing cognitive performance by the CFC-formed tACS.