Fine-grained, local maps and coarse, global representations support human spatial working memory

Spatial and non-spatial feature binding impairments in visual working memory in schizophrenia

Working memory (WM) impairments are well recognized in schizophrenia patients (PSZ) and contribute to poor psycho-social outcomes in this population. Distinct neural networks underlay the ability to encode and recall visual and spatial information raising the possibility that profile of visual working memory performance may help pinpoint dysfunctional neural correlates in schizophrenia. This study assessed the resolution and associative aspects of visual working memory deficits in schizophrenia and whether these deficits arise during encoding or maintenance processes. A total of 60 participants (30 PSZ and 30 healthy controls) matched in age, gender and education assessed on a modified object in place (OiPT), a delayed non-match-to-sample (DNMST) and a delayed spatial estimation (DSET) task. Patients demonstrated lower accuracy than controls in binding visual features of the same object and recognizing novel objects as well as lower precision recalling the location of a memorized target. Moreover, response choice set size affected recognition accuracy more in PSZ than controls. However, delay duration affected spatial recall precisions, binding, and recognition accuracy equally in the two groups. Our results suggest that visual working memory (vWM) impairments in schizophrenia predominantly reflect spatial and non-spatial binding deficits, with largely preserved discrete feature information. Moreover, these impairments likely arise more during encoding than during maintenance. These binding deficits may reflect impaired effective neural functional connectivity observed in schizophrenia.

Working memory in action: Transsaccadic working memory deficits in the left visual field and after transcallosal remapping

Every waking second, we make three saccadic eye movements that move our retinal images. Thus, to attain a coherent image of the world we need to remember visuo-spatial information across saccades. But transsaccadic working memory (tWM) remains poorly understood. Crucially, there has been a debate whether there are any differences in tWM for the left vs. right visual field and depending on saccade direction. However, previous studies have probed tWM with minimal loads whereas spatial differences might arise with higher loads. Here we employed a task that probed higher memory load for spatial information in the left and right visual field and with horizontal as well as vertical saccades. We captured several measures of precision and accuracy of performance that, when submitted to principal component analysis, produced two components. Component 1, mainly associated with precision, yielded greater error for the left than the right visual field. Component 2 was associated with performance accuracy and unexpectedly produced a disadvantage after rightward saccades. Both components showed that performance was worse when rightward or leftward saccades afforded a shift of memory representations between visual fields compared to remapping within the same field. Our study offers several novel findings. It is the first to show that tWM involves at least two components likely reflecting working memory capacity and strategic aspects of working memory, respectively. Reduced capacity for the left, rather than the right visual field is consistent with how the left and right visual fields are known to be represented in the two hemispheres. Remapping difficulties between visual fields is consistent with the limited information transfer across the corpus callosum. Finally, the impact of rightward saccades on working memory might be due to greater interference of the accompanying shifts of attention. Our results highlight the dynamic nature of transsaccadic working memory.

Working Memory in Unilateral Spatial Neglect: Evidence for Impaired Binding of Object Identity and Object Location

Working memory (WM) is known to be impaired in patients with stroke experiencing unilateral spatial neglect (USN). Here, we examined in a systematic manner three WM components: memory of object identity, memory of object location, and binding between object identity and location. Moreover, we used two different retention intervals to isolate maintenance from other mnemonic and perceptual processes. Fourteen USN first-event stroke patients with right-hemisphere damage were tested in two different WM experiments using long and short retention intervals and an analog response scale. Patients exhibited more identification errors for items displayed on the contralesional side. Localization errors were also more prominent in the contralesional side, especially after a long retention interval. These localization errors were often a result of swap errors, that is, erroneous localizations of correctly identified contralesional objects in correctly memorized locations of ipsilesional objects. We conclude that a key WM deficit in USN is a lateralized impairment in binding between the identity of an object and its spatial tag.

View-Independent Working Memory Representations of Artificial Shapes in Prefrontal and Posterior Regions of the Human Brain

Traditional views of visual working memory postulate that memorized contents are stored in dorsolateral prefrontal cortex using an adaptive and flexible code. In contrast, recent studies proposed that contents are maintained by posterior brain areas using codes akin to perceptual representations. An important question is whether this reflects a difference in the level of abstraction between posterior and prefrontal representations. Here, we investigated whether neural representations of visual working memory contents are view-independent, as indicated by rotation-invariance. Using functional magnetic resonance imaging and multivariate pattern analyses, we show that when subjects memorize complex shapes, both posterior and frontal brain regions maintain the memorized contents using a rotation-invariant code. Importantly, we found the representations in frontal cortex to be localized to the frontal eye fields rather than dorsolateral prefrontal cortices. Thus, our results give evidence for the view-independent storage of complex shapes in distributed representations across posterior and frontal brain regions.

In the Beginning Was the Deed: Verbal Short-Term Memory as Object-Oriented Action

Our goal is not to present a new theory of verbal short-term memory (vSTM), but to supplant the concepts used to explain performance on vSTM tasks for some 60 years. We view the concepts of vSTM and its concomitant processes as reifications from observations of performance on these tasks. Millennia of refining, elaborating, and utilizing symbolic systems for representing the putative sounds of speech has seduced researchers into viewing verbal behavior as embodying the hallmarks of these systems, setting verbal material apart from other types of physical material with which people interact. Contrarily, we maintain that verbal material should be seen in the same light as other material. The way in which people encounter and manipulate it (e.g., in the microcosm of the vSTM setting) is to be understood with respect to processes that organize material into perceptual objects that may then be apprehended and manipulated by bodily effector systems. We outline how key empirical hallmarks of vSTM yield to this approach.

Memory as embodiment: The case of modality and serial short-term memory

Classical explanations for the modality effect-superior short-term serial recall of auditory compared to visual sequences-typically recur to privileged processing of information derived from auditory sources. Here we critically appraise such accounts, and re-evaluate the nature of the canonical empirical phenomena that have motivated them. Three experiments show that the standard account of modality in memory is untenable, since auditory superiority in recency is often accompanied by visual superiority in mid-list serial positions. We explain this simultaneous auditory and visual superiority by reference to the way in which perceptual objects are formed in the two modalities and how those objects are mapped to speech motor forms to support sequence maintenance and reproduction. Specifically, stronger obligatory object formation operating in the standard auditory form of sequence presentation compared to that for visual sequences leads both to enhanced addressability of information at the object boundaries and reduced addressability for that in the interior. Because standard visual presentation does not lead to such object formation, such sequences do not show the boundary advantage observed for auditory presentation, but neither do they suffer loss of addressability associated with object information, thereby affording more ready mapping of that information into a rehearsal cohort to support recall. We show that a range of factors that impede this perceptual-motor mapping eliminate visual superiority while leaving auditory superiority unaffected. We make a general case for viewing short-term memory as an embodied, perceptual-motor process.

The objects of visuospatial short-term memory: Perceptual organization and change detection

We used a colour change-detection paradigm where participants were required to remember colours of six equally spaced circles. Items were superimposed on a background so as to perceptually group them within (a) an intact ring-shaped object, (b) a physically segmented but perceptually completed ring-shaped object, or (c) a corresponding background segmented into three arc-shaped objects. A nonpredictive cue at the location of one of the circles was followed by the memory items, which in turn were followed by a test display containing a probe indicating the circle to be judged same/different. Reaction times for correct responses revealed a same-object advantage; correct responses were faster to probes on the same object as the cue than to equidistant probes on a segmented object. This same-object advantage was identical for physically and perceptually completed objects, but was only evident in reaction times, and not in accuracy measures. Not only, therefore, is it important to consider object-level perceptual organization of stimulus elements when assessing the influence of a range of factors (e.g., number and complexity of elements) in visuospatial short-term memory, but a more detailed picture of the structure of information in memory may be revealed by measuring speed as well as accuracy.