The bandwidth of consolidation into visual short-term memory (VSTM) depends on the visual feature

Influence of presentation duration on filtering of irrelevant stimuli in visual working memory

In environments teeming with distractions, the ability to selectively focus on relevant information is crucial for advanced cognitive processing. Existing research using event-related potential (ERP) technology has shown active suppression of irrelevant stimuli during the consolidation phase of visual working memory (VWM). In previous studies, participants have always been given sufficient time to consolidate VWM, while suppressing distracting information. However, it remains unclear whether the suppression of irrelevant distractors requires continuous effort throughout their presence or whether this suppression is only necessary after the consolidation of task-relevant information. To address this question, our study examines whether distractor suppression is necessary in scenarios where consolidation time is limited. This research investigates the effect of varying presentation durations on the filtering of distractors in VWM. We tasked participants with memorizing two color stimuli and ignoring four distractors, presented for either 50 ms or 200 ms. Using ERP technology, we discovered that the distractor-induced distractor positivity (PD) amplitude is larger during longer presentation durations compared to shorter ones. These findings underscore the significant impact of presentation duration on the efficacy of distractor suppression in VWM, as prolonged exposure results in a stronger suppression effect on distractors. This study sheds light on the temporal dynamics of attention and memory, emphasizing the critical role of stimulus timing in cognitive tasks. These findings provide valuable insights into the mechanisms underlying VWM and have significant implications for models of attention and memory.

Selectively maintaining an object's feature in visual working memory: A comparison between highly discriminable and fine-grained features

Selectively maintaining information is an essential function of visual working memory (VWM). Recent VWM studies have mainly focused on selective maintenance of objects, leaving the mechanisms of selectively maintaining an object's feature in VWM unknown. Based on the interactive model of perception and VWM, we hypothesized that there are distinct selective maintenance mechanisms for objects containing fine-grained features versus objects containing highly discriminable features. To test this hypothesis, we first required participants to memorize a dual-feature object (colored simple shapes vs. colored polygons), and informed them about the target feature via a retro-cue. Then a visual search task was added to examine the fate of the irrelevant feature. The selective maintenance of an object's feature predicted that the irrelevant feature should be removed from the active state of VWM and should not capture attention when presented as a distractor in the visual search task. We found that irrelevant simple shapes impaired performance in the visual search task (Experiment 1). However, irrelevant polygons did not affect visual search performance (Experiment 2), and this could not be explained by decay of polygons (Experiment 3) or by polygons not capturing attention (Experiment 4). These findings suggest that VWM adopts dissociable mechanisms to selectively maintain an object's feature, depending on the feature's perceptual characteristics.

Sustained attention required for effective dimension-based retro-cue benefit in visual working memory

In visual working memory (VWM) tasks, participants' performances can be improved through the use of dimension-based retro-cues, which direct internal attention to prioritize a particular dimension (e.g., color or orientation) of VWM representations even after the stimuli disappear. This phenomenon is known as the dimension-based retro-cue benefit (RCB). The present study investigates whether sustained attention is required for the dimension-based RCB by inserting interference or interruption between the retro-cue and the test array to distract attention. We tested the effects of perceptual interference or cognitive interruption on dimension-based RCB when the interference (Experiments 1 and 2 with masks) or interruption (Experiments 3 and 4 with an odd-even task) occurred concurrently with the stages for the maintenance of prioritized information (long cue-and-interference/interruption interstimulus interval, e.g., Experiments 1 and 3) or the deployment of attention (short cue-and-interference/interruption interstimulus interval, e.g., Experiments 2 and 4). Our results demonstrate that perceptual interference or cognitive interruption attenuates the dimension-based RCB. These findings suggest that sustained attention is necessary for the effective prioritization of a specific dimension of VWM representations.

The role of processing efficiency and selection history in the limit of visual awareness in shape perception

A growing body of research indicates that the limit in instant conscious awareness, or the unit of access, for some object features such as color, orientation, and direction of motion is more than one. In four experiments we explored the roles of processing efficiency and selection history in shape perception. Two targets, which were geometric shapes (less efficient) or alphabet letters (more efficient), were shown simultaneously or sequentially. The task was to judge whether a test probe matched one of the targets. In different experiments, the two types of trials were presented in separate blocks, interleaved couplets, or randomly within the same block during testing but regrouped in data analyses such that the same type of trials was either repeated or not repeated. Accuracy was higher in the sequential than simultaneous trials for geometric shapes, but not for upright letters, when the same trial type was blocked or in the repeated condition. These results suggest that processing efficiency and selection history both play a role in the unit of access in shape perception. They also underscore the flexibility of the visual system, which uses different factors to maximize conscious visual perception at a given time.

Little Support for Discrete Item Limits in Visual Working Memory

Some theorists argue that working memory is limited to a discrete number of items and that additional items are not encoded at all. Adam et al. (2017) presented evidence supporting this hypothesis: Participants reproduced visual features of up to six items in a self-chosen order. After the third or fourth response, error distributions were indistinguishable from guessing. I present four experiments with young adults (each N = 24) reexamining this finding. Experiment 1 presented items slowly and sequentially. Experiment 2 presented them simultaneously but longer than in the experiments of Adam et al. Experiments 3 and 4 exactly replicated one original experiment of Adam et al. All four experiments failed to replicate the evidence for guessing-like error distributions. Modeling data from individuals revealed a mixture of some who do and others who do not produce guessing-like distributions. This heterogeneity increases the credibility of an alternative to the item-limit hypothesis: Some individuals decide to guess on hard trials even when they have weak information in memory.

A major role for retrieval and/or comparison in the set-size effects of change detection

Set-size effects in change detection have been attributed to capacity limits in a variety of processes, including perception, memory encoding, memory storage, memory retrieval, comparison, and decision. In this study, we investigated the locus of the effect of increasing set size from 1 to 2. The task was to detect a 90 degree change in the orientation of 1 or 2 briefly presented Gabor patterns in noise. To measure purely attentional effects and not another phenomena, such as crowding, a precue was used to manipulate relevant set size while keeping the display constant. The locus of the capacity limit was determined by varying when observers were cued to a single relevant stimulus. To begin, we measured the baseline set-size effect for change detection. Next, a dual-task procedure and a 100% valid postcue was added to test for an effect of decision: This modification did not reliably change the set-size effects. In the critical experiments, a 100% valid cue was provided during the retention interval between displays, or only one stimulus was presented in the second display (local recognition). For both of these conditions, there was only a relatively small set-size effect. These results are consistent with the bulk of capacity limits being in memory retrieval or comparison and not in perception, memory encoding, or memory storage.

Selection history modulates the limit of visual awareness in color perception

Among studies on the limit of conscious representation of color at a given instant, some have shown evidence of momentary awareness of only a single color, while others have not, leading to uncertainty about the factors that influence the limit. In two experiments, we explored the role of selection history, or recent experience with a trial, which is known to influence the representations of task stimuli and responses. Two color patches were briefly displayed either simultaneously or sequentially. In Experiment 1, we presented the two types of trials either in separate blocks or in interleaved couplets. In the former case, participants could deploy optimal attentional control setting in response to different types of trials with little cost by using recent experience with a preceding trial and prior knowledge. In the latter case, reconfiguring attentional control setting after each trial would be costly. In Experiment 2, we mixed the two types of trials randomly within a block during testing, but re-grouped them in data analyses such that the same type of trials was either repeated or not repeated. The results show that accuracy was comparable between the simultaneous and sequential trials in the block condition in Experiment 1 and in the repeat condition in Experiment 2, suggesting that two colors were perceived at a time. These results indicate that selection history plays an important role in the limit of visual awareness in color perception and that the finding of single-color perception reported in previous research might not be a general phenomenon.

Individual differences in working memory capacity are unrelated to the magnitudes of retrocue benefits

Previous studies have associated visual working memory (VWM) capacity with the use of internal attention. Retrocues, which direct internal attention to a particular object or feature dimension, can improve VWM performance (i.e., retrocue benefit, RCB). However, so far, no study has investigated the relationship between VWM capacity and the magnitudes of RCBs obtained from object-based and dimension-based retrocues. The present study explored individual differences in the magnitudes of object- and dimension-based RCBs and their relationships with VWM capacity. Participants completed a VWM capacity measurement, an object-based cue task, and a dimension-based cue task. We confirmed that both object- and dimension-based retrocues could improve VWM performance. We also found a significant positive correlation between the magnitudes of object- and dimension-based RCB indexes, suggesting a partly overlapping mechanism between the use of object- and dimension-based retrocues. However, our results provided no evidence for a correlation between VWM capacity and the magnitudes of the object- or dimension-based RCBs. Although inadequate attention control is usually assumed to be associated with VWM capacity, the results suggest that the internal attention mechanism for using retrocues in VWM retention is independent of VWM capacity.

The two-stage process in visual working memory consolidation

Two hypotheses have been proposed to explain the formation manner for visual working memory (VWM) representations during the consolidation process: an all-or-none process hypothesis and a coarse-to-fine process hypothesis. However, neither the all-or-none process hypothesis nor the coarse-to-fine process hypothesis can stipulate clearly how VWM representations are formed during the consolidation process. In the current study, we propose a two-stage process hypothesis to reconcile these hypotheses. The two-stage process hypothesis suggests that the consolidation of coarse information is an all-or-none process in the early consolidation stage, while the consolidation of detailed information is a coarse-to-fine process in the late consolidation stage. By systematically manipulating the encoding time of memory stimuli, we asked participants to memorize one (Experiment 1) or two (Experiment 2) orientations in different encoding time intervals. We found that the memory rate increased linearly as the encoding time increased. More importantly, VWM precision remained constant when the encoding time was short, while the precision increased linearly as the encoding time increased when the encoding time was sufficient. These results supported the two-stage process hypothesis, which reconciles previous conflicting findings in the literature.

Negative emotional state modulates visual working memory in the late consolidation phase

Although a considerable literature has grown up around the interactions between emotional state and visual working memory (VWM) performance, the mechanism underlying the impact of the negative emotional state on VWM remains unclear. The present study aimed to test whether the influence of emotional state is related to the early phase or late phase of VWM consolidation process. Across three experiments, we found that the negative emotional state did not affect VWM performance when the presentation time of stimuli was short. However, when the presentation time was long, the negative emotional state increased the VWM precision and reduced the VWM number. According to the two-phase model proposed by Ye et al. (2017. A two-phase model of resource allocation in visual working memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(10), 1557-1566. doi: 10.1037/xlm0000376), the results suggested that negative emotional state could affect the late phase of resource allocation in VWM consolidation process, but it has no impact on the early consolidation phase. The findings from this study make important contributions to the current literature regarding the emotional modulation of VWM.

Working memory capacity affects trade-off between quality and quantity only when stimulus exposure duration is sufficient: Evidence for the two-phase model

The relation between visual working memory (VWM) capacity and attention has attracted much interest. In this study, we investigated the correlation between the participants’ VWM capacity and their ability to voluntarily trade off the precision and number of items remembered. The two-phase resource allocation model proposed by Ye et al. (2017) suggests that for a given set size, it takes a certain amount of consolidation time for an individual to control attention to adjust the VWM resources to trade off the precision and number. To verify whether trade-off ability varies across VWM capacity, we measured each individual’s VWM capacity and then conducted a colour recall task to examine their trade-off ability. By manipulating the task requirement, participants were instructed to memorise either more colours in a low-precision way or fewer colours in a high-precision way. We conducted two experiments by adjusting stimulus duration to be longer than predicted critical value (Experiment 1) and duration shorter than predicted critical value (Experiment 2). While the results of Experiment 1 showed a positive correlation between the VWM capacity and trade-off ability, the results of Experiment 2 showed a lack of such correlation. These results are consistent with the prediction from the two-phase model.

Can we perceive two colors at the same time? A direct test of Huang and Pashler's (2007) Boolean map theory of visual attention

Can observers access two spatially separated color targets (e.g., red and green) at the same time (i.e., in parallel)? According to the Boolean map theory of visual attention (Huang & Pashler, Psychological Review, 114(3), 599-631, 2007), access to two different features that belong to the same dimension (e.g., red and green targets) is limited and therefore can be held only in a serial fashion. The current study proposes a strong test of the Boolean map theory of attention through the application of two of the most rigorous stochastic approaches to response times modeling-the system factorial technology (Townsend & Nozawa, 1995) and the logical rule models (Fifić, Little, & Nosofsky, Psychological Review, 117, 309-348, 2010). These approaches allowed identification of serial, parallel, and coactive architectures in the processing of multicolor targets. The results showed that multiple-color targets are processed serially when observers are required to process all the targets in the display (i.e., an exhaustive stopping rule), and in parallel or coactively when observers can terminate the search when one of the targets is found (i.e., self-terminating stopping rule). These results are generally inconsistent with predictions of the Boolean map theory. They highlight the role of stopping rules in multicolor visual search, as well as the flexibility of the attentional system in shifting between processing architectures.

Parallel consolidation into visual working memory results in reduced precision representations

Information can be consolidated into visual working memory in parallel, i.e. two items can be consolidated in the same time required to consolidate one. However, while motion direction items consolidated in parallel are encoded at a reduced precision, no such reduction has been reported for colour. Here we examine two possible explanations for the inconsistency between the phenomena associated with consolidating these features in parallel: i) that reduced precision can only be detected when more than two colour items are consolidated in parallel, or ii) that the exposure duration used in previous studies was too long, allowing observers serially consolidate items. Our results show that (like motion direction) colour items consolidated in parallel are encoded at a reduced precision and the critical feature for detecting this phenomenon is the exposure duration. Furthermore, we demonstrate that this process is limited to two items. These findings indicate a general principle of consolidation into visual working memory, that is, a trade-off between the number of items consolidated in parallel and the precision at which they are encoded.

The bandwidth of VWM consolidation varies with the stimulus feature: Evidence from event-related potentials

Our previous work suggests that 2 colors can be consolidated into visual short-term memory (VSTM) in parallel without a loss of memory precision, whereas consolidation of 2 orientations is performed in a strictly serial manner. Those experiments compared VSTM performance for simultaneously and sequentially presented stimuli. However, there is still controversy about whether the bandwidth for consolidation is determined by the type of information. To further investigate this issue, here we measured electroencephalography while participants attempted to consolidate 1, 2 or 4 simultaneously presented colors (Experiment 1) or orientations (Experiment 2) under limited presentation times. We used the contralateral delay activity (CDA) as an electrophysiological marker of the number of items that were consolidated. For colored stimuli, the CDA amplitude increased between set-size 1 and 2 but did not further increase for set size 4. By contrast, for orientation, the CDA amplitude remained at the set size 1 amplitude as set size increased to 2 or 4 items. Furthermore, in a long exposure duration (300 ms) condition that did not limit the consolidation process, the CDA amplitude pattern indicated that VSTM capacity is limited to about 3 colored items and about 2 orientation items in our paradigm. Thus, the CDA effects observed in the short presentation time was not limited by VSTM storage, but rather by consolidation. These results are consistent with our previous behavioral research and suggest that the bandwidth of VSTM consolidation is determined by the stimulus feature. (PsycINFO Database Record

A two-phase model of resource allocation in visual working memory

Two broad theories of visual working memory (VWM) storage have emerged from current research, a discrete slot-based theory and a continuous resource theory. However, neither the discrete slot-based theory or continuous resource theory clearly stipulates how the mental commodity for VWM (discrete slot or continuous resource) is allocated. Allocation may be based on the number of items via stimulus-driven factors, or it may be based on task demands via voluntary control. Previous studies have obtained conflicting results regarding the automaticity versus controllability of such allocation. In the current study, we propose a two-phase allocation model, in which the mental commodity could be allocated only by stimulus-driven factors in the early consolidation phase. However, when there is sufficient time to complete the early phase, allocation can enter the late consolidation phase, where it can be flexibly and voluntarily controlled according to task demands. In an orientation recall task, we instructed participants to store either fewer items at high-precision or more items at low-precision. In 3 experiments, we systematically manipulated memory set size and exposure duration. We did not find an effect of task demands when the set size was high and exposure duration was short. However, when we either decreased the set size or increased the exposure duration, we found a trade-off between the number and precision of VWM representations. These results can be explained by a two-phase model, which can also account for previous conflicting findings in the literature. (PsycINFO Database Record