Spatial and non-spatial feature binding impairments in visual working memory in schizophrenia

Working memory (WM) impairments are well recognized in schizophrenia patients (PSZ) and contribute to poor psycho-social outcomes in this population. Distinct neural networks underlay the ability to encode and recall visual and spatial information raising the possibility that profile of visual working memory performance may help pinpoint dysfunctional neural correlates in schizophrenia. This study assessed the resolution and associative aspects of visual working memory deficits in schizophrenia and whether these deficits arise during encoding or maintenance processes. A total of 60 participants (30 PSZ and 30 healthy controls) matched in age, gender and education assessed on a modified object in place (OiPT), a delayed non-match-to-sample (DNMST) and a delayed spatial estimation (DSET) task. Patients demonstrated lower accuracy than controls in binding visual features of the same object and recognizing novel objects as well as lower precision recalling the location of a memorized target. Moreover, response choice set size affected recognition accuracy more in PSZ than controls. However, delay duration affected spatial recall precisions, binding, and recognition accuracy equally in the two groups. Our results suggest that visual working memory (vWM) impairments in schizophrenia predominantly reflect spatial and non-spatial binding deficits, with largely preserved discrete feature information. Moreover, these impairments likely arise more during encoding than during maintenance. These binding deficits may reflect impaired effective neural functional connectivity observed in schizophrenia.

Visual working memory phenomena based on categorical tasks replicate using a continuous measure: A simple interpretation and some methodological considerations

An increasingly popular method for investigating visuospatial working memory assumes stored features of objects such as color and orientation vary along continua subject to internal noise. It adapts the stimulus adjustment procedure from perceptual psychophysics to assess the precision with which stored features are represented in memory. This contrasts with methods using discrete, categorical measures of feature retention. The current study examined the replicability of some phenomena documented using conventional methodology when assessed using a continuous measure of feature recall. These concern memory for a short series of objects and include effects of recency, prioritizing an individual object, and presenting an irrelevant additional object after the last item (a poststimulus 'suffix'). In two experiments we find broadly similar results using a continuous measure of color-orientation binding to those obtained previously using categorical measures, with small differences we regard as minor. We interpret the convergence between methods in terms of a simple analogy between categorical memory and categorical perception whereby categorical retrieval involves the application of a discrete criterion to an underlying continuum of stored feature information. We conclude by discussing some of the advantages and limitations of continuous and categorical measures of retention.

Retrospective cue benefits in visual working memory are limited to a single location at a time

Working memory (WM) performance can be improved by an informative cue presented during storage. This effect, termed a retrocue benefit, can be used to study limits on how human observers prioritize information stored in WM for behavioral output. There is disagreement about whether retrocue benefits extend to multiple WM locations. Here, we hypothesized that multiple retrocues may improve some aspects of memory performance (e.g., a reduction in random guessing) while worsening others (e.g., an increase in the probability of reporting a feature presented at a non-probed location). We tested this possibility in three experiments. Participants remembered arrays of four orientations or colors over a brief delay, and spatial retrocues instructed participants to prioritize zero, one, two, or all four remembered orientations for possible report. At the end of the trial, participants recalled the orientation that appeared at one location. The results of this study revealed that participants' recall errors were lower during cue-one relative to cue-two and cue-four trials, and this benefit was driven primarily by a reduction in random guessing during cue-one trials. We found no evidence suggesting that multiple spatial cues (i.e., during cue-two trials) induced a trade-off between memory precision, random guessing, and non-target reports compared to neutral trials (i.e., cue-zero or cue-four). Thus, cuing participants to prioritize information appearing at multiple unique spatial positions led to no improvement in memory performance compared to neutral or no-cue trials, providing additional support for the view that retrocue benefits on WM performance are limited to a single spatial location at a time.

Where and when matter in visual recognition

Our perceptual system processes only a selected subset of an incoming stream of stimuli due to sensory biases and limitations in spatial and temporal attention and working memory capacity. In this study, we investigated perceptual access to sensory information that was temporally predictable or unpredictable and spread across the visual field. In a visual recognition task, participants were presented with an array of different number of alphabetical stimuli that were followed by a probe with a delay. They had to indicate whether the probe was included in the stimulus-set or not. To test the impact of temporal attention, coloured cues that were displayed before the visual stimuli indicated the presentation onset of the stimulus-set. We found that temporal predictability of stimulus onset yields higher performance. In addition, recognition performance was biased across the visual field with higher performance for stimuli that were presented on the upper and right visual quadrants. Our findings demonstrate that recognition accuracy is enhanced by temporal cues and has an inherently asymmetric shape across the visual field.

Sequential encoding paradigm reliably captures the individual differences from a simultaneous visual working memory task

Converging behavioral and neural evidence have suggested that visual stimuli could be attached to existing visual working memory sequentially in time. However, whether individual differences in sequential visual working memory paradigm are similar to those measured by the classical simultaneous change detection paradigm remain unknown. Here, we first show that sequentially presented visual stimuli exhibit similar working memory capacity bottlenecks as previous research using simultaneously presented items. We further reveal that within the same subject, the accuracy and capacity estimates using sequential and simultaneous paradigm were comparable across four different set sizes. Also, we discover that the individual differences measured by the sequential paradigm were highly correlated to those by the simultaneous paradigm within the same subject across all four set sizes of interest. Finally, we find that in a larger sample of subjects (n = 200), the variance and higher-order statistics were similar for sequential and simultaneous paradigms with set size of 6. Collectively, these findings indicate that individual differences measured by the sequential presentation of visual items rely on the similar working memory resources as those by the simultaneous form of presentation.

Visual-cortical enhancement by acoustic distractors: The effects of endogenous spatial attention and visual working memory load

Past work has shown that when a peripheral sound captures our attention, it activates the contralateral visual cortex as revealed by an event-related potential component labelled the auditory-evoked contralateral occipital positivity (ACOP). This cross-modal activation of the visual cortex has been observed even when the sounds were not relevant to the ongoing task (visual or auditory), suggesting that peripheral sounds automatically activate the visual cortex. However, it is unclear whether top-down factors such as visual working memory (VWM) load and endogenous attention, which modulate the impact of task-irrelevant information, may modulate this spatially-specific component. Here, we asked participants to perform a lateralized VWM task (change detection), whose performance is supported by both endogenous spatial attention and VWM storage. A peripheral sound that was unrelated to the ongoing task was delivered during the retention interval. The amplitude of sound-elicited ACOP was analyzed as a function of the spatial correspondence with the cued hemifield, and of the memory array set-size. The typical ACOP modulation was observed over parieto-occipital sites in the 280-500 ms time window after sound onset. Its amplitude was not affected by VWM load but was modulated when the location of the sound did not correspond to the hemifield (right or left) that was cued for the change detection task. Our results suggest that sound-elicited activation of visual cortices, as reflected in the ACOP modulation, is unaffected by visual working memory load. However, endogenous spatial attention affects the ACOP, challenging the hypothesis that it reflects an automatic process.

Perceptual comparisons modulate memory biases induced by new visual inputs

It is well-established that stimulus-specific information in visual working memory (VWM) can be systematically biased by new perceptual inputs. These memory biases are commonly attributed to interference that arises when perceptual inputs are physically similar to VWM contents. However, recent work has suggested that explicitly comparing the similarity between VWM contents and new perceptual inputs modulates the size of memory biases above and beyond stimulus-driven effects. Here, we sought to directly investigate this modulation hypothesis by comparing the size of memory biases following explicit comparisons to those induced when new perceptual inputs are ignored (Experiment 1) or maintained in VWM alongside target information (Experiment 2). We found that VWM reports showed larger attraction biases following explicit perceptual comparisons than when new perceptual inputs were ignored or maintained in VWM. An analysis of participants' perceptual comparisons revealed that memory biases were amplified after perceptual inputs were endorsed as similar-but not dissimilar-to one's VWM representation. These patterns were found to persist even after accounting for variability in the physical similarity between the target and perceptual stimuli across trials, as well as the baseline memory precision between the distinct task demands. Together, these findings illustrate a causal role of perceptual comparisons in modulating naturally-occurring memory biases.

Context consistency improves ensemble perception of facial expressions

Humans have developed the capacity to rapidly extract summary statistics from the facial expressions of a crowd, such as computing the average facial expression. Although dual-task paradigms involving memory and ensemble tasks have recently found that this ensemble coding ability is biased by visual working memory, few studies have examined whether the context-dependent nature of memory itself can influence the perceptual averaging process. In two experiments, participants made forced-choice judgments about mean facial expressions that were paired with task-irrelevant background images, and the background images either matched or mismatched across encoding and response phases. When the backgrounds matched, it was at either the perceptual level (uniformly oriented lines with the same orientation in encoding and response phases, in Experiment 1), or at the summary statistics level (uniformly oriented lines in the response phase that had the same orientation as the mean of randomly oriented lines that were seen in the encoding phase, in Experiment 2). Participants in Experiment 1 showed a higher ensemble precision and better discrimination sensitivity when the backgrounds matched than when they mismatched, which is consistent with the kind of robust contextual memory effect that has been seen in prior research. We further demonstrated that the context-matching facilitation effect occurred at both the perceptual level (Experiment 1) and at the summary statistics level (Experiment 2). These results demonstrate that the effects of visual working memory on perceptual averaging are obligatory, and they highlight the importance of memory-related context dependency in perceptual averaging.

Interference between items stored for distinct tasks in visual working memory

The action perspective on working memory suggests that memory representations are coded according to their specific temporal and behavioral task demands. This stands in contrast to theories that assume representations are stored in a task-agnostic format within a "common workspace". Here, we tested whether visual items that are memorized for different tasks are stored separately from one another or show evidence of inter-item interference during concurrent maintenance, indicating a common storage. In two experiments, we combined a framing memory task (memorize a motion direction for continuous direction report) with an embedded memory task (memorize a motion direction for a binary direction discrimination) that was placed within the retention period of the framing task. Even though the temporal and action demands were item specific, we observed two types of interference effects between the items: The embedded motion direction was (1) repulsed away and (2) degraded in precision by the motion direction of the item in the framing task. Repulsion and precision degradation increased with item similarity when both items were concurrently held in working memory. In contrast, perceptual and iconic memory control conditions revealed weaker repulsion overall and no interference effect on precision during the stimulus processing stages prior to working memory consolidation. Thus, additional inter-item interference arose uniquely within working memory. Together, our results present evidence that items that are stored for distinct tasks to be performed at distinct points in time, reside in a common workspace in working memory.

The role of motion in visual working memory for dynamic stimuli: More lagged but more precise representations of moving objects

While most visual working memory studies use static stimuli with unchanging features, objects in the real world are often dynamic, introducing significant differences in the surface feature information hitting the retina from the same object over time (e.g., changes in orientation, lighting, shadows). Previous research on dynamic stimuli has shown that change detection is improved if objects obey rules of physical motion, but it is unclear how memory for visual features interacts with object motion. In the current study, we investigated whether object motion facilitates greater temporal integration of continuously changing surface feature information. In a series of experiments, participants were asked to report the final color of continuously changing colored dots that were either moving or stationary on the screen. We found that the reported colors "lagged behind" the physical states of the dots when they were in motion. We also observed that the precision of memory responses was significantly higher for stimuli in the moving condition compared to the stationary condition. Together, these findings suggest that memory representation is improved - but lagged - for moving objects, consistent with the idea that object motion may facilitate integration of object information over longer intervals.

Perceptual bias contextualized in visually ambiguous stimuli

The visual appearance of an object is a function of stimulus properties as well as perceptual biases imposed by the observer. The context-specific trade-off between both can be measured accurately in a perceptual judgment task, involving grouping by proximity in ambiguous dot lattices. Such grouping depends lawfully on a stimulus parameter of the dot lattices known as their aspect ratio (AR), whose effect is modulated by a perceptual bias representing the preference for a cardinal orientation. In two experiments, we investigated how preceding context can lead to bias modulation, either in a top-down fashion via visual working memory (VWM) or bottom-up via sensory priming. In Experiment 1, we embedded the perceptual judgment task in a change detection paradigm and studied how the factors of VWM load (complexity of the memory array) and content (congruency in orientation to the ensuing dot lattice) affect the prominence of perceptual bias. A robust vertical orientation bias was observed, which was increased by VWM load and modulated by congruent VWM content. In Experiment 2, dot lattices were preceded by oriented primes. Here, primes regardless of orientation elicited a vertical orientation bias in dot lattices compared to a neutral baseline. Taken together, the two experiments demonstrate that top-down context (VWM load and content) effectively controls orientation bias modulation, while bottom-up context (i.e., priming) merely acts as an undifferentiated trigger to perceptual bias. These findings characterize the temporal context sensitivity of Gestalt perception, shed light on the processes responsible for different perceptual outcomes of ambiguous stimuli, and identify some of the mechanisms controlling perceptual bias.

Visual working memory representations bias attention more when they are the target of an action plan

Attention has frequently been regarded as an emergent property of linking sensory representations to action plans. It has recently been proposed that similar mechanisms may operate within visual working memory (VWM), such that linking an object in VWM to an action plan strengthens its sensory memory representation, which then expresses as an attentional bias. Here we directly tested this hypothesis by comparing attentional biases induced by VWM representations which were the target of a future action, to those induced by VWM representations that were equally task-relevant, but not the direct target of action. We predicted that the first condition would result in a more prioritized memory state and hence stronger attentional biases. Specifically, participants memorized a geometric shape for a subsequent memory test. At test, in case of a match, participants either had to perform a grip movement on the matching object (action condition), or perform the same movement, but on an unrelated object (control condition). To assess any attentional biases, during the delay period between memorandum and test, participants performed a visual selection task in which either the target was surrounded by the memorized shape (congruent trials) or a distractor (incongruent trials). Eye movements were measured as a proxy for attentional priority. We found a significant interaction for saccade latencies between action condition and shape congruency, reflecting more pronounced VWM-based attentional biases in the action condition. Our results are consistent with the idea that action plans prioritize sensory representations in VWM.

The interaction of internal and external attention

The internal/external framework of attention characterizes attention focused to perceptual stimuli and internal representations as highly similar processes. While much research on external attention examines how attention may be broadened or narrowed (attentional zoom lens), it is unclear if internal attention functions in a similar way. In the present study, we manipulate both internal and external attentions to be either broad or narrow. Participants first encoded either a broad or narrow working memory array containing three differently colored items. This array was maintained as they performed an Eriksen flanker task that was either distributed broadly or narrowly, followed by a memory test for a random memory item. We found that regardless of whether the flanker fell inside or outside of the internal breadth of attention, flanker congruency effects did not change. The exception to this was when internal breadth was manipulated with retrocuing, which resulted in greater congruency effects when flankers aligned with the span of internal breadth rather than falling outside of it. Overall, this study shows that internal breadth information is unlikely to alter processing of external distractors until some of the information is cued internally after encoding, suggesting limitations in the internal/external attention framework.

Eye movements dissociate between perceiving, sensing, and unconscious change detection in scenes

Detecting visual changes can be based on perceiving, whereby one can identify a specific detail that has changed, on sensing, whereby one knows that there is a change but is unable to identify what changed, or on unconscious change detection, whereby one is unaware of any change even though the change influences one's behavior. Prior work has indicated that the processes underlying these different types of change detection are functionally and neurally distinct, but the attentional mechanisms that are related to these different types of change detection remain largely unknown. In the current experiment, we examined eye movements during a change detection task in globally manipulated scenes, and participants indicated their change detection confidence on a scale that allowed us to isolate perceiving, sensing, and unconscious change detection. For perceiving-based change detection, but not sensing-based or unconscious change detection, participants were more likely to preferentially revisit highly changed scene regions across the first and second presentation of the scene (i.e., resampling). This increase in resampling started within 250 ms of the test scene onset, suggesting that the effect began within the first two fixations. In addition, changed scenes were related to more clustered (i.e., less dispersed) eye movements than unchanged scenes, particularly when the subjects were highly confident that no change had occurred - providing evidence for change detection outside of conscious awareness. The results indicate that perceiving, sensing, and unconscious change detection responses are related to partially distinct patterns of eye movements.

Working memory is updated by reallocation of resources from obsolete to new items

Visual working memory (VWM) resources are limited, placing constraints on how much visual information can be simultaneously retained. During visually guided activity, stored information can quickly become outdated, so updating mechanisms are needed to ensure the contents of memory remain relevant to current task goals. In particular, successful deallocation of resources from items that become obsolete is likely to be critical for maintaining the precision of those representations still in memory. The experiments in this study involved presenting two memory arrays of coloured disks in sequence. The appearance of the second array was a cue to replace, rehearse, or add a new colour to the colours in memory. We predicted that successful resource reallocation should result in comparable recall precision when an item was replaced or rehearsed, owing to the removal of pre-replacement features. In contrast, a failure to update WM should lead to comparable precision with a condition in which a new colour was added to memory. We identified a very small proportion (∼5%) of trials in which participants incorrectly reported a feature from the first array in place of its replacement in the second, which we interpreted as a failure to incorporate the information from the second display into memory. Once these trials were discounted, precision estimates were consistent with complete redistribution of resources in the case of updating a single item. We conclude that working memory can be efficiently updated when previous information becomes obsolete, but that this is a demanding active process that occasionally fails.

Is Categorization in Visual Working Memory a Way to Reduce Mental Effort? A Pupillometry Study

Recent studies on visual working memory (VWM) have shown that visual information can be stored in VWM as continuous (e.g., a specific shade of red) as well as categorical representations (e.g., the general category red). It has been widely assumed, yet never directly tested, that continuous representations require more VWM mental effort than categorical representations; given limited VWM capacity, this would mean that fewer continuous, as compared to categorical, representations can be maintained simultaneously. We tested this assumption by measuring pupil size, as a proxy for mental effort, in a delayed estimation task. Participants memorized one to four ambiguous (boundaries between adjacent color categories) or prototypical colors to encourage continuous or categorical representations, respectively; after a delay, a probe indicated the location of the to‐be‐reported color. We found that, for memory load 1, pupil size was larger while maintaining ambiguous as compared to prototypical colors, but without any difference in memory precision; this suggests that participants relied on an effortful continuous representation to maintain a single ambiguous color, thus resulting in pupil dilation while preserving precision. Strikingly, this effect gradually inverted, such that for memory load 4, pupil size was smaller while maintaining ambiguous and prototypical colors, but memory precision was now substantially reduced for ambiguous colors; this suggests that with increased memory load participants increasingly relied on categorical representations for ambiguous colors (which are by definition a poor fit to any category). Taken together, our results suggest that continuous representations are more effortful than categorical representations and that very few continuous representations (perhaps only one) can be maintained simultaneously.

Load-dependent functional connectivity deficits during visual working memory in first-episode psychosis

INTRODUCTION

Aberrant network connectivity is a core deficit in schizophrenia and may underlie many of its associated cognitive deficits. Previous work in first-episode schizophrenia spectrum illness (FESz) suggests preservation of working memory network function during low-load conditions with dysfunction emerging as task complexity increases. This study assessed visual network connectivity and its contribution to load-dependent working memory impairments.

METHODS

Magnetoencephalography was recorded from 35 FESz and 28 matched controls (HC) during a lateralized change detection task. Impaired alpha desynchronization was previously identified within bilateral dorsal occipital (Occ) regions. Here, whole-brain alpha-band connectivity was examined using phase-locking (PLV) and bilateral Occ as connectivity seeds. Load effects on connectivity were assessed across participants, and PLV modulation within networks was compared between groups.

RESULTS

Occ exhibited significant load modulated connectivity with six regions (FDR-corrected). HC exhibited PLV enhancement with load in all connections. FESz failed to show PLV modulation between right Occ and left inferior frontal gyrus, lateral occipito-temporal sulcus, and anterior intermediate parietal sulcus. Smaller PLVs in all three network connections during both memory load conditions were associated with increased reality distortion in FESz (FDR-corrected.) CONCLUSION: Examination of functional connectivity across the visual working memory network in FESz revealed an inability to enhance communication between perceptual and executive networks in response to increasing cognitive demands. Furthermore, the degree of network communication impairment was associated with positive symptoms. These findings provide insights into the nature of brain dysconnectivity and its contribution to symptoms in early psychosis and identify potential targets for future interventions.

Swap errors in visual working memory are fully explained by cue-feature variability

In cue-based recall from working memory, incorrectly reporting features of an uncued item may be referred to as a "swap" error. One account of these errors ascribes them to variability in memory for the cue features leading to erroneous selection of a non-target item, especially if it is similar to the target in the cue-feature dimension. However, alternative accounts of swap errors include cue-independent misbinding, and strategic guessing when the cued item is not in memory. Here we investigated the cause of swap errors by manipulating the variability with which either cue or report features (orientations in Exp 1; motion directions in Exp 2) were encoded. We found that swap errors increased with increasing variability in memory for the cue features, and their changing frequency could be quantitatively predicted based on recall variability when the same feature was used for report. These results are inconsistent with the hypothesis that swaps are a strategic response to forgotten items, and suggest that swap errors could be wholly accounted for by confusions due to cue-dimension variability. In a third experiment we examined whether spatial configuration of memory arrays in tasks with spatial cueing has an influence on swap error frequency. We observed a specific tendency to make swap errors to non-targets located precisely opposite to the cued location, suggesting that stimulus positions are partially encoded in a non-metric format.

No evidence that the retro-cue benefit requires reallocation of memory resources

Selective mechanisms allow us to prioritize items held in working memory. Does this reflect reallocation of working memory resources? We examined a critical prediction of this account-that reallocating more resources from one item to another should provide a greater benefit. We used a reward manipulation to create variable allocation of resources. Subsequently, a retro-cue instructed participants to drop a memory item. This retro-cue improved performance for the prioritized items relative to a neutral baseline. However, in contrast to the prevailing reallocation account, we found no difference between dropping a higher versus lower reward item. Importantly, removal of high versus low reward items led to better encoding of subsequently presented items, demonstrating that our reward manipulation was successful. While allocation of resources can influence the encoding and storage of new information into working memory, reallocation does not appear to be essential for selection effects in working memory.

Why does the probe value effect emerge in working memory? Examining the biased attentional refreshing account

People are able to prioritize more valuable information in working memory. The current study examined whether this value effect is due to the items of greater value being refreshed more than lower-value items during maintenance. To assess this possibility, we combined a probe value manipulation with a guided-refreshing procedure. Arrays of colored shapes were presented, and after a brief delay, participants reported the color of one randomly probed shape on a continuous color wheel. To manipulate probe value, one item was indicated as more valuable than the rest prior to encoding (i.e., worth more notional points), or all items were indicated as equally valuable. To guide refreshing, in some trials, two arrows were presented during maintenance, each arrow cueing the spatial location of one item. Participants were told to "think of" (i.e., refresh) the cued item. If value boosts are driven by attentional refreshing, cueing an item to be refreshed should enhance performance for items that are of low or equal value, but not items of high value, as these items would be refreshed regardless of the cue. This pattern of outcomes was observed, providing support for the hypothesis that attentional refreshing at least partially accounts for probe value effects in working memory.

Delay activity during visual working memory: A meta-analysis of 30 fMRI experiments

Visual working memory refers to the temporary maintenance and manipulation of task-related visual information. Recent debate on the underlying neural substrates of visual working memory has focused on the delay period of relevant tasks. Persistent neural activity throughout the delay period has been recognized as a correlate of working memory, yet regions demonstrating sustained hemodynamic responses show inconsistency across individual studies. To develop a more precise understanding of delay-period activations during visual working memory, we conducted a coordinate-based meta-analysis on 30 fMRI experiments involving 515 healthy adults with a mean age of 25.65 years. The main analysis revealed a widespread frontoparietal network associated with delay-period activity, as well as activation in the right inferior temporal cortex. These findings were replicated using different meta-analytical algorithms and were shown to be robust against between-study heterogeneity and publication bias. Further meta-analyses on different subgroups of experiments with specific task demands and stimulus types revealed similar delay-period networks, with activations distributed across the frontal and parietal cortices. The roles of prefrontal regions, posterior parietal regions, and inferior temporal areas are reviewed and discussed in the context of content-specific storage. We conclude that cognitive operations that occur during the unfilled delay period in visual working memory tasks can be flexibly expressed across a frontoparietal-temporal network depending on experimental parameters.

Pupil size variations reveal covert shifts of attention induced by numbers

The pupil light response is more than a pure reflexive mechanism that reacts to the amount of light entering the eye. The pupil size may also react to the luminance of objects lying in the visual periphery, revealing the locus of covert attention. In the present study, we took advantage of this response to study the spatial coding of abstract concepts with no physical counterpart: numbers. The participants' gaze was maintained fixed in the middle of a screen whose left and right parts were dark or bright, and variations in pupil size were recorded during an auditory number comparison task. The results showed that small numbers accentuated pupil dilation when the darker part of the screen was on the left, while large numbers accentuated pupil dilation when the darker part of the screen was on the right. This finding provides direct evidence for covert attention shifts on a left-to-right oriented mental spatial representation of numbers. From a more general perspective, it shows that the pupillary response to light is subject to modulation from spatial attention mechanisms operating on mental contents.

Tracking attentional states: Assessing the relationship between sustained and selective focused attention in visual working memory

Attention has multiple influences on visual working memory (VWM). Fluctuations in sustained attention predict VWM performance. Furthermore, focusing selective attention in VWM by retro-cuing the to-be-tested item during maintenance boosts retrieval. So far, we lack knowledge how the ability to focus selective attention relates to the state of sustained attention during the VWM trial. Here, we combined a retro-cue task and a self-rated attention protocol to test whether focusing selective attention via retro-cues: (1) mitigates spontaneous attention fluctuations, in which case retro-cues should be more helpful under low levels of self-rated attention; (2) depends on an optimal state of sustained attention, in which case retro-cue benefits should be largest under high levels of self-rated attention; or (3) is independent of sustained attention, in which case retro-cue benefits and self-rated attention effects should be additive. Our data supported the additive hypothesis. Across four experiments, self-rated attention levels predicted continuous reproduction of colors. Retro-cue trials produced better recall and higher rated attention. Critically, retro-cues improved recall to a similar extent across all levels of self-rated attention. This indicates that attention has multi-faceted and independent contributions to VWM.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

Dissociable causal roles of the frontal and parietal cortices in the effect of object location on object identity detection: a TMS study

According to the spatial congruency advantage, individuals exhibit higher accuracy and shorter reaction times during the visual working memory (VWM) task when VWM test stimuli appear in spatially congruent locations, relative to spatially incongruent locations, during the encoding phase. Functional magnetic resonance imaging studies have revealed changes in right inferior frontal gyrus (rIFG) and right supra-marginal gyrus (rSMG) activity as a function of object location stability. Nevertheless, it remains unclear whether these regions play a role in active object location repositioning or passive early perception of object location stability, and demonstrations of causality are lacking. In this study, we adopted an object identity change-detection task, involving a short train of 10-Hz online repetitive transcranial magnetic stimulations (rTMS) applied at the rIFG or rSMG concurrently with the onset of VWM test stimuli. In two experimental cohorts, we observed an improved accuracy in spatially incongruent high VWM load conditions when the 10 Hz-rTMS was applied at the rIFG compared with that in TMS control conditions, whereas these modulatory effects were not observed for the rSMG. Our results suggest that the rIFG and rSMG play dissociable roles in the spatial congruency effect, whereby the rIFG is engaged in active object location repositioning, while the rSMG is engaged in passive early perception of object location stability.