Pupil size variations reveal covert shifts of attention induced by numbers

The pupil light response is more than a pure reflexive mechanism that reacts to the amount of light entering the eye. The pupil size may also react to the luminance of objects lying in the visual periphery, revealing the locus of covert attention. In the present study, we took advantage of this response to study the spatial coding of abstract concepts with no physical counterpart: numbers. The participants' gaze was maintained fixed in the middle of a screen whose left and right parts were dark or bright, and variations in pupil size were recorded during an auditory number comparison task. The results showed that small numbers accentuated pupil dilation when the darker part of the screen was on the left, while large numbers accentuated pupil dilation when the darker part of the screen was on the right. This finding provides direct evidence for covert attention shifts on a left-to-right oriented mental spatial representation of numbers. From a more general perspective, it shows that the pupillary response to light is subject to modulation from spatial attention mechanisms operating on mental contents.

Tracking attentional states: Assessing the relationship between sustained and selective focused attention in visual working memory

Attention has multiple influences on visual working memory (VWM). Fluctuations in sustained attention predict VWM performance. Furthermore, focusing selective attention in VWM by retro-cuing the to-be-tested item during maintenance boosts retrieval. So far, we lack knowledge how the ability to focus selective attention relates to the state of sustained attention during the VWM trial. Here, we combined a retro-cue task and a self-rated attention protocol to test whether focusing selective attention via retro-cues: (1) mitigates spontaneous attention fluctuations, in which case retro-cues should be more helpful under low levels of self-rated attention; (2) depends on an optimal state of sustained attention, in which case retro-cue benefits should be largest under high levels of self-rated attention; or (3) is independent of sustained attention, in which case retro-cue benefits and self-rated attention effects should be additive. Our data supported the additive hypothesis. Across four experiments, self-rated attention levels predicted continuous reproduction of colors. Retro-cue trials produced better recall and higher rated attention. Critically, retro-cues improved recall to a similar extent across all levels of self-rated attention. This indicates that attention has multi-faceted and independent contributions to VWM.

The impact of retro-cue validity on working memory representation: Evidence from electroencephalograms

Visual working memory (VWM) performance can be improved by retrospectively cueing an item. The validity of retro-cues has an impact on the mechanisms underlying the retro-cue effect, but how non-cued representations are handled under different retro-cue validity conditions is not yet clear. Here, we used electroencephalograms to investigate whether retro-cue validity can affect the fate of non-cued representations in VWM. The participants were required to perform a change-detection task using a retro-cue with 80% or 20% validity. Contralateral delay activity and the lateralized alpha power were used to assess memory storage and selective attention, respectively. The retro-cue could redirect selective attention to the cued item under both validity conditions; however, the participants maintained the non-cued representations under the low-validity condition but dropped them from VWM under the high-validity condition. These results suggest that the maintenance of non-cued representations in VWM is affected by the expectation of cue validity and may be partially strategically driven. DATA AVAILABILITY: The datasets generated/analyzed during this study and experimental script have been added to https://osf.io/qtwc9/.

Dissociable causal roles of the frontal and parietal cortices in the effect of object location on object identity detection: a TMS study

According to the spatial congruency advantage, individuals exhibit higher accuracy and shorter reaction times during the visual working memory (VWM) task when VWM test stimuli appear in spatially congruent locations, relative to spatially incongruent locations, during the encoding phase. Functional magnetic resonance imaging studies have revealed changes in right inferior frontal gyrus (rIFG) and right supra-marginal gyrus (rSMG) activity as a function of object location stability. Nevertheless, it remains unclear whether these regions play a role in active object location repositioning or passive early perception of object location stability, and demonstrations of causality are lacking. In this study, we adopted an object identity change-detection task, involving a short train of 10-Hz online repetitive transcranial magnetic stimulations (rTMS) applied at the rIFG or rSMG concurrently with the onset of VWM test stimuli. In two experimental cohorts, we observed an improved accuracy in spatially incongruent high VWM load conditions when the 10 Hz-rTMS was applied at the rIFG compared with that in TMS control conditions, whereas these modulatory effects were not observed for the rSMG. Our results suggest that the rIFG and rSMG play dissociable roles in the spatial congruency effect, whereby the rIFG is engaged in active object location repositioning, while the rSMG is engaged in passive early perception of object location stability.

Scene wheels: Measuring perception and memory of real-world scenes with a continuous stimulus space

Precisely characterizing mental representations of visual experiences requires careful control of experimental stimuli. Recent work leveraging such stimulus control has led to important insights; however, these findings are constrained to simple visual properties like color and line orientation. There remains a critical methodological barrier to characterizing perceptual and mnemonic representations of realistic visual experiences. Here, we introduce a novel method to systematically control visual properties of natural scene stimuli. Using generative adversarial networks (GANs), a state-of-the-art deep learning technique for creating highly realistic synthetic images, we generated scene wheels in which continuously changing visual properties smoothly transition between meaningful realistic scenes. To validate the efficacy of scene wheels, we conducted two behavioral experiments that assess perceptual and mnemonic representations attained from the scene wheels. In the perceptual validation experiment, we tested whether the continuous transition of scene images along the wheel is reflected in human perceptual similarity judgment. The perceived similarity of the scene images correspondingly decreased as distances between the images increase on the wheel. In the memory experiment, participants reconstructed to-be-remembered scenes from the scene wheels. Reconstruction errors for these scenes resemble error distributions observed in prior studies using simple stimulus properties. Importantly, perceptual similarity judgment and memory precision varied systematically with scene wheel radius. These findings suggest our novel approach offers a window into the mental representations of naturalistic visual experiences.

Acute effects of cocoa flavanols on visual working memory: maintenance and updating

BACKGROUND

Consumption of cocoa flavanols may have acute physiological effects on the brain due to their ability to activate nitric oxide synthesis. Nitric oxide mediates vasodilation, which increases cerebral blood flow, and can also act as a neurotransmitter.

OBJECTIVES

This study aimed to examine whether cocoa flavanols have an acute influence on visual working memory (WM).

METHODS

Two separate randomised, double-blind, placebo-controlled, counterbalanced crossover experiments were conducted on normal healthy young adult volunteers (N_Exp1 = 48 and N_Exp2 = 32, gender-balanced). In these experiments, 415 mg of cocoa flavanols were administered to test their acute effects on visual working memory. In the first experiment, memory recall precision was measured in a task that required only passive maintenance of grating orientations in WM. In the second experiment, recall was measured after active updating (mental rotation) of WM contents. Habitual daily flavanols intake, body mass index, and gender were also considered in the analysis.

RESULTS

The results suggested that neither passive maintenance in visual WM nor active updating of WM were acutely enhanced by consumption of cocoa flavanols. Exploratory analyses with covariates (body mass index and daily flavanols intake), and the between-subjects factor of gender also showed no evidence for effects of cocoa flavanols, neither in terms of reaction time, nor accuracy.

CONCLUSIONS

Overall, cocoa flavanols did not improve visual working memory recall performance during maintenance, nor did it improve recall accuracy after memory updating.

Capacity limitations in template-guided multiple color search

Visual selection of target objects relies on representations of their known features in visual working memory. These representations are referred to as attentional templates. We asked how the capacity of visual working memory relates to the maximal number of attentional templates that can simultaneously guide visual selection. To measure the number of active attentional templates, we used the contingent capture paradigm where cues matching the attentional template have larger effects than cues in a non-matching color. We found larger cueing effects for matching than non-matching cues in one-, two-, and also three-color searches, suggesting that participants can establish up to three attentional templates. However, scrutiny of matching cue trials showed that with three attentional templates, larger cueing effects only occurred when the matching cue had the same color as the actual target. When the matching cue had a possible target color that was different from the actual target color, cueing effects were similar to non-matching cue colors. We assume that processing of a matching cue activates one of the three templates, which inhibits the remaining templates to the level of non-matching colors. With two colors, the inhibition from the activated template is less complete because the initial template activation is higher. Overall, only a maximum of two attentional templates can operate successfully in the contingent capture paradigm. The capacity of template-guided search is therefore far below the capacity of visual working memory.

Decoding Color Visual Working Memory from EEG Signals Using Graph Convolutional Neural Networks

Color has an important role in object recognition and visual working memory (VWM). Decoding color VWM in the human brain is helpful to understand the mechanism of visual cognitive process and evaluate memory ability. Recently, several studies showed that color could be decoded from scalp electroencephalogram (EEG) signals during the encoding stage of VWM, which process visible information with strong neural coding. Whether color could be decoded from other VWM processing stages, especially the maintaining stage which processes invisible information, is still unknown. Here, we constructed an EEG color graph convolutional network model (ECo-GCN) to decode colors during different VWM stages. Based on graph convolutional networks, ECo-GCN considers the graph structure of EEG signals and may be more efficient in color decoding. We found that (1) decoding accuracies for colors during the encoding, early, and late maintaining stages were 81.58%, 79.36%, and 77.06%, respectively, exceeding those during the pre-stimuli stage (67.34%), and (2) the decoding accuracy during maintaining stage could predict participants' memory performance. The results suggest that EEG signals during the maintaining stage may be more sensitive than behavioral measurement to predict the VWM performance of human, and ECo-GCN provides an effective approach to explore human cognitive function.

The nationality benefit: Long-term memory associations enhance visual working memory for color-shape conjunctions

Visual working memory (VWM) is typically found to be severely limited in capacity, but this limitation may be ameliorated by providing familiar objects that are associated with knowledge stored in long-term memory. However, comparing meaningful and meaningless stimuli usually entails a confound, because different types of objects also tend to vary in terms of their inherent perceptual complexity. The current study therefore aimed to dissociate stimulus complexity from object meaning in VWM. To this end, identical stimuli - namely, simple color-shape conjunctions - were presented, which either resembled meaningful configurations ("real" European flags), or which were rearranged to form perceptually identical but meaningless ("fake") flags. The results revealed complexity estimates for "real" and "fake" flags to be higher than for unicolor baseline stimuli. However, VWM capacity for real flags was comparable to the unicolor baseline stimuli (and substantially higher than for fake flags). This shows that relatively complex, yet meaningful "real" flags reveal a VWM capacity that is comparable to rather simple, unicolored memory items. Moreover, this "nationality" benefit was related to individual flag recognition performance, thus showing that VWM depends on object knowledge.

Is long-term memory used in a visuo-spatial change-detection paradigm?

In tests of working memory with verbal or spatial materials, repeating the same memory sets across trials leads to improved memory performance. This well-established "Hebb repetition effect" could not be shown for visual materials in previous research. The absence of the Hebb effect can be explained in two ways: Either persons fail to acquire a long-term memory representation of the repeated memory sets, or they acquire such long-term memory representations, but fail to use them during the working memory task. In two experiments (N1 = 18 and N2 = 30), we aimed to decide between these two possibilities by manipulating the long-term memory knowledge of some of the memory sets used in a change-detection task. Before the change-detection test, participants learned three arrays of colors to criterion. The subsequent change-detection test contained both previously learned and new color arrays. Change detection performance was better on previously learned compared with new arrays, showing that long-term memory is used in change detection.

Perceptual stimuli with novel bindings interfere with visual working memory

What influences the extent to which perceptual information interferes with the contents of visual working memory? In two experiments using a combination of change detection and continuous reproduction tasks, I show that binding novelty is a key factor in producing interference. In Experiment 2, participants viewed arrays of colored circles, then completed consecutive change detection and recall tests of their memory for stochastically independent items from the same array. When the probe used in the change detection test was novel (i.e., required a "change" response), subsequent recall performance was worse than in trials with matching (i.e., "no change") probes, irrespective of whether or not the same item was tested in both phases. In Experiment 2, participants viewed arrays of oriented arrows, then completed a change detection (requiring memory) or direction judgement (not requiring memory) test, followed by recalling a stochastically independent item. Again, novel probes in the first phase led to worse recall, irrespective of whether the initial task required memory. This effect held whether the probe was wholly novel (i.e., a new feature presented at any location) or simply involved a novel binding (i.e., an old feature presented at a new location). These findings highlight the role of novelty in visual interference, consistent with the assumptions of computational models of WM, and suggest that new bindings of old information are sufficient to produce such interference.

Breaking the cardinal rule: The impact of interitem interaction and attentional priority on the cardinal biases in orientation working memory

Although it is not typically assumed in influential models of visual working memory (WM), representations in WM are systematically biased by multiple factors. Orientation representations are biased away from the cardinal axis (i.e., cardinal bias) and they are biased away from or toward the other orientation simultaneously held in WM (i.e., interitem interaction). The present study investigated the extent to which these two bias mechanisms interact in WM. In Experiment 1, participants remembered two sequentially presented orientations and reproduced both orientations after a short delay. Cardinal biases were assessed separately for the trials where the two mechanisms produce biases in the same direction (i.e., congruent trials) and the trials where they produce biases in the opposite direction (i.e., incongruent trials). Whereas congruent trials exhibited a typical cardinal bias, incongruent trials exhibited no cardinal bias, demonstrating that the cardinal bias was canceled out by the interitem interaction. Follow-up experiments extended these results by manipulating attentional priority for the two orientations by means of precue (Experiment 2) and postcue (Experiment 3). In both experiments, attentionally prioritized items exhibited a typical cardinal bias irrespective of the congruency whereas attentionally unprioritized items exhibited a reversal of the cardinal bias in the incongruent trials, demonstrating that selective attention modulates the influence of the interitem interaction. Together, these results suggest that WM leverages information about specific stimuli and their relationship to support a given behavioral goal.

Neural basis of the visual working memory deficit in schizophrenia: Merging evidence from fMRI and EEG

Although people with schizophrenia (PSZ) exhibit robust and reliable deficits in working memory (WM) capacity, the neural processes that give rise to this impairment remain poorly understood. One reason for this lack of clarity is that most studies employ a single neural recording modality-each with strengths and weaknesses-with few examples of integrating results across modalities. To address this gap, we conducted a secondary analysis that combined data from an overlapping set of subjects in previously published electroencephalographic and functional magnetic resonance imaging studies that used nearly identical working memory tasks (visual change detection). The prior studies found similar patterns of results for both posterior parietal BOLD activation and suppression of the alpha frequency band within the EEG. Specifically, both signals exhibited abnormally shallow modulation as a function of the amount of information being stored in WM in PSZ. In the present study, both alpha suppression and posterior parietal BOLD activity increased as the number of items stored in WM increased. The magnitude of alpha suppression modulation was correlated with the magnitude of BOLD signal modulation in PSZ, but not in HCS. This finding suggests that the same illness-related biological processes constrain both alpha suppression and BOLD signal modulation as a function of WM storage in PSZ. The complementary strengths of these two techniques may thus combine to advance the identification of the processes underlying WM deficits in PSZ.

The storage resources of the active and passive states are independent in visual working memory

Recently, multiple studies have proposed that mnemonic representations can be maintained in qualitatively different neural states in visual working memory (VWM): the active state and the passive state. However, it remains unclear whether the storage resources in the two distinct states are independent of each other. To address this issue, we adopted retro-cue paradigms in Experiments 1 and 2 and a sequential change detection paradigm in Experiment 3 to examine whether memory performance in one storage state was independent of the influence of load variation in the other. The results from these three behavioral experiments showed that load variation in the active state does not affect memory performance in the passive state, and vice versa. The current study provides evidence that active and passive states do not compete for resources to maintain working memory (WM) representations, thus supporting resource dissociation between the two distinct states in VWM.

Visual working memory in aphantasia: Retained accuracy and capacity with a different strategy

Visual working memory paradigms involve retaining and manipulating visual information in mind over a period of seconds. Evidence suggests that visual imagery (sensory recruitment) is a strategy used by many to retain visual information during such tasks, leading some researchers to propose that visual imagery and visual working memory may be one and the same. If visual imagery is essential to visual working memory task performance there should be large ramifications for a special population of individuals who do not experience visual imagery, aphantasia. Here we assessed visual working memory task performance in this population using a number of different lab and clinical working memory tasks. We found no differences in capacity limits for visual, general number or spatial working memory for aphantasic individuals compared to controls. Further, aphantasic individuals showed no significant differences in performance on visual components of clinical working memory tests as compared to verbal components. However, there were significant differences in the reported strategies used by aphantasic individuals across all memory tasks. Additionally, aphantasic individual's visual memory accuracy did not demonstrate a significant oblique orientation effect, which is proposed to occur due to sensory recruitment, further supporting their non-visual imagery strategy reports. Taken together these data demonstrate that aphantasic individuals are not impaired on visual working memory tasks, suggesting visual imagery and working memory are not one and the same, with imagery (and sensory recruitment) being just one of the tools that can be used to solve visual working memory tasks.

Semantic influence on visual working memory of object identity and location

Does semantic information-in particular, regularities in category membership across objects-influence visual working memory (VWM) processing? We predict that the answer is "yes". Four experiments evaluating this prediction are reported. Experimental stimuli were images of real-world objects arranged in either one or two spatial clusters. On coherent trials, all objects belonging to a cluster also belonged to the same category. On incoherent trials, at least one cluster contained objects from different categories. Experiments using a change-detection paradigm (Experiments 1-3) and an experiment in which participants recalled the locations of objects in a scene (Experiment 4) yielded the same result: participants showed better memory performance on coherent trials than on incoherent trials. Taken as a whole, these experiments provide the best (perhaps only) data to date demonstrating that statistical regularities in semantic category membership improve VWM performance. Because a conventional perspective in cognitive science regards VWM as being sensitive solely to bottom-up visual properties of objects (e.g., shape, color, orientation), our results indicate that cognitive science may need to modify its conceptualization of VWM so that it is closer to "conceptual short-term memory", a short-term memory store representing current stimuli and their associated concepts (Potter, 1993, 2012).

Is the n-back task a measure of unstructured working memory capacity? Towards understanding its connection to other working memory tasks

Working memory is fundamental to human cognitive functioning, and it is often measured with the n-back task. However, it is not clear whether the n-back task is a valid measure of working memory. Importantly, previous studies have found poor correlations with measures of complex span, whereas a recent study (Frost et al., 2019) showed that n-back performance was correlated with a transsaccadic memory task but dissociated from performance on the change detection task, a well-accepted measure of working memory capacity. To test whether capacity is involved in the n-back task we correlated a spatial version of the test with different versions of the change detection task. Experiment 1 introduced perceptual and cognitive disruptions to the change detection task. This impacted task performance, however, all versions of the change detection task remained highly correlated with one another whereas there was no significant correlation with the n-back task. Experiment 2 removed spatial and non-spatial context from the change detection task. This produced a correlation with n-back. Our results indicate that the n-back task is supported by faculties similar to those that support change detection, but that this commonality is hidden when contextual information is available to be exploited in a change detection task such that structured representations can form. We suggest that n-back might be a valid measure of working memory, and that the ability to exploit contextual information is an important faculty captured by some versions of the change detection task.

The role of working memory and visual processing in prototype category learning

To investigate whetherworking memory and visual processing havethe same role or differentrolesin A/B and A/not A prototype category learning,the present study adoptedan A/Bor A/not A category learningtask in control and dual conditions. The results of Experiment 1 showed that an additional dual visual working memory taskrather thanadualverbal working memory task reduced accuracy of the A/B task, whereasnodual tasksinfluencedaccuracy of the A/not A task. The results of Experiment 2 revealed that an additionaldual visual processing task impairedaccuracy of the A/B task, whereas the dual visual processing task did not influence accuracy of the A/not Atask. These results indicate that visual working memory and visual processing play different roles in A/B and A/not A prototype category learning, andsupport that thesetwo types of prototype category learning are mediated by differentmemory systems.

Understanding occipital and parietal contributions to visual working memory: Commentary on Xu (2020)

In her commentary, Xu (2020) admonishes the reader that "To have a full understanding of the cognitive mechanisms underlying VWM [visual working memory], both behavioral and neural evidence needs to be taken into account. This is a must, and not a choice, for any study that attempts to capture the nature of VWM" (p. 11). Although we don't disagree with this statement, our overall assessment of this commentary is that it, itself, fails to satisfy several "musts" and, consequently, does not pose a serious challenge for the sensory recruitment framework for understanding visual working memory. These "musts" include accurately characterizing the framework being critiqued, not favoring verbal models and intuition at the expense of formal quantitative models, and providing even-handed interpretation of the work of others. We'll conclude with a summary of how the sensory recruitment framework can be incorporated into a broader working model of visual working memory.

Guided Search 6.0: An updated model of visual search

This paper describes Guided Search 6.0 (GS6), a revised model of visual search. When we encounter a scene, we can see something everywhere. However, we cannot recognize more than a few items at a time. Attention is used to select items so that their features can be "bound" into recognizable objects. Attention is "guided" so that items can be processed in an intelligent order. In GS6, this guidance comes from five sources of preattentive information: (1) top-down and (2) bottom-up feature guidance, (3) prior history (e.g., priming), (4) reward, and (5) scene syntax and semantics. These sources are combined into a spatial "priority map," a dynamic attentional landscape that evolves over the course of search. Selective attention is guided to the most active location in the priority map approximately 20 times per second. Guidance will not be uniform across the visual field. It will favor items near the point of fixation. Three types of functional visual field (FVFs) describe the nature of these foveal biases. There is a resolution FVF, an FVF governing exploratory eye movements, and an FVF governing covert deployments of attention. To be identified as targets or rejected as distractors, items must be compared to target templates held in memory. The binding and recognition of an attended object is modeled as a diffusion process taking > 150 ms/item. Since selection occurs more frequently than that, it follows that multiple items are undergoing recognition at the same time, though asynchronously, making GS6 a hybrid of serial and parallel processes. In GS6, if a target is not found, search terminates when an accumulating quitting signal reaches a threshold. Setting of that threshold is adaptive, allowing feedback about performance to shape subsequent searches. Simulation shows that the combination of asynchronous diffusion and a quitting signal can produce the basic patterns of response time and error data from a range of search experiments.

Object-based selection in visual working memory

Attentional mechanisms in perception can operate over locations, features, or objects. However, people direct attention not only towards information in the external world, but also to information maintained in working memory. To what extent do perception and memory draw on similar selection properties? Here we examined whether principles of object-based attention can also hold true in visual working memory. Experiment 1 examined whether object structure guides selection independently of spatial distance. In a memory updating task, participants encoded two rectangular bars with colored ends before updating two colors during maintenance. Memory updates were faster for two equidistant colors on the same object than on different objects. Experiment 2 examined whether selection of a single object feature spreads to other features within the same object. Participants memorized two sequentially presented Gabors, and a retro-cue indicated which object and feature dimension (color or orientation) would be most relevant to the memory test. We found stronger effects of object selection than feature selection: accuracy was higher for the uncued feature in the same object than the cued feature in the other object. Together these findings demonstrate effects of object-based attention on visual working memory, at least when object-based representations are encouraged, and suggest shared attentional mechanisms across perception and memory.

Neural evidence for categorical biases in location and orientation representations in a working memory task

Previous research demonstrated that visual representations in working memory exhibit biases with respect to the categorical structure of the stimulus space. However, a majority of those studies used behavioral measures of working memory, and it is not clear whether the working memory representations per se are influenced by the categorical structure or whether the biases arise in decision or response processes during the report. Here, I applied a multivariate decoding technique to EEG data collected during working memory tasks to determine whether neural activity associated with the representations in working memory is categorically biased prior to the report. I found that the decoding of spatial working memory was biased away from the nearest cardinal location, consistent with the biases observed in the behavioral responses. In a follow-up experiment which was designed to prevent the use of a response preparation strategy, I found that the decoding still exhibited categorical biases. Together, these results provide neural evidence that working memory representations themselves are categorically biased, imposing important constraints on the models of working memory representations.

Diverse patterns of vulnerability to visual illusions in children with neurodevelopmental disorders

Research on how children with neurodevelopmental disorders perceive, process, and interpret visual illusions (VIs) has been extensively focused on children with autism spectrum disorder providing controversial findings. In this study, we investigated the patterns of vulnerability to a wide set of VIs comprising 23 standard text book VIs and their variations in a clinical sample of children with neurodevelopmental disorders compared to typically developing children (TD). A total of 176 children, aged between 4.6 and 13.8 years old, were distributed into four groups: high-functioning autism (HFA; N = 23), attention-deficit/hyperactivity disorder (ADHD; N = 42), specific learning disorder (SLD; N = 70), and TD (N = 41). Regression models, adjusted for sex, age, and non-verbal IQ, showed that HFA was associated with greater responses accuracy than TD children to the full battery of VIs, to the cognitive illusions, to the distortions, and to both geometrical illusions of size/shape (cognitive distortions) and lightness contrast effects (physical distortions). The susceptibility of ADHD children was found attenuated for illusory contours and greater for paradoxical illusions in comparison with TD children. No significant differences were shown between the SLD group and the TD children. Our findings, which were adjusted for the same duration of visual working memory across groups, showed that there is a potential specific tendency of HFA children to failure of processing visual information in context. Contrarily, children with ADHD showed in general normal global processing such as children diagnosed with SLD.

Are the advantages of chess expertise on visuo-spatial working-memory capacity domain specific or domain general?

Chess experts have repeatedly demonstrated exceptional recall of chessboards, which is weakened by disruption of the chessboard. However, chess experts still perform better than novices when recalling such disrupted chessboards, suggesting a somewhat generalized expertise effect. In the current study, we examined the extent of this generalized expertise effect on early processing of visuo-spatial working memory (VSWM), by comparing 14 chess experts (Elo rating > 2000) and 15 novices on a change-detection paradigm using disrupted chessboards, where attention had to be selectively deployed to either visual or spatial features, or divided across both features. The paradigm differed in the stimuli used (domain-specific chess pieces vs. novel visual shapes) to evaluate domain-general effects of chess expertise. Both experts and novices had greater memory discriminability for chess stimuli than for the unfamiliar stimuli, suggesting a salience advantage for familiar stimuli. Experts, however, demonstrated better memory discriminability than novices not only for chess stimuli presented on these disrupted chessboards, but also for novel, domain-general stimuli, particularly when detecting spatial changes. This expertise advantage was greater for chessboards with supra-capacity set sizes. For set sizes within the working-memory capacity, the expertise advantage was driven by enhanced selective attention to spatial features by chess experts when compared to visual features. However, any expertise-related VSWM advantage disappeared in the absence of the 8 × 8 chessboard display, which implicates the chessboard display as an essential perceptual aspect facilitating the "expert memory effect" in chess, albeit one that might generalize beyond strictly domain-relevant stimuli.

Limited memory for ensemble statistics in visual change detection

Accounts of working memory based on independent item representations may overlook a possible contribution of ensemble statistics, higher-order regularities of a scene such as the mean or variance of a visual attribute. Here we used change detection tasks to investigate the hypothesis that observers store ensemble statistics in working memory and use them to detect changes in the visual environment. We controlled changes to the ensemble mean or variance between memory and test displays across six experiments. We made specific predictions of observers' sensitivity using an optimal summation model that integrates evidence across separate items but does not detect changes in ensemble statistics. We found strong evidence that observers outperformed this model, but only when task difficulty was high, and only for changes in stimulus variance. Under these conditions, we estimated that the variance of items contributed to change detection sensitivity more strongly than any individual item in this case. In contrast, however, we found strong evidence against the hypothesis that the average feature value is stored in working memory: when the mean of memoranda changed, sensitivity did not differ from the optimal summation model, which was blind to the ensemble mean, in five out of six experiments. Our results reveal that change detection is primarily limited by uncertainty in the memory of individual features, but that memory for the variance of items can facilitate detection under a limited set of conditions that involve relatively high working memory demands.