The impact of stimulus configuration on visual short-term memory decline in normal aging and mild cognitive impairment

INTRODUCTION

When we memorize simultaneous items, we not only store information about specific items and/or their locations but also how items are related to each other. Such relational information can be parsed into spatial (spatial configuration) and identity (object configuration) components. Both these configurations are found to support performance during a visual short-term memory (VSTM) task in young adults. How the VSTM performance of older adults is influenced by object/spatial configuration is less understood, which this study investigated.

METHODS

Twenty-nine young adults, 29 normally aging older adults, and 20 older adults with mild cognitive impairment (MCI) completed two yes-no memory-recognition experiments for four simultaneously presented items (2.5 s). Test display items were presented either at the same locations as the memory items (Experiment 1) or were globally shifted (Experiment 2). One of the test display items (target) was highlighted with a square box; participants indicated whether this item was shown in the preceding memory display. Both experiments comprised four conditions where nontarget items changed as follows: (i) nontarget items remained the same; (ii) nontarget items were replaced by new items; (iii) nontarget items switched locations; (iv) nontarget items were replaced by square boxes.

RESULTS

Performance (% correct) in both older groups was significantly reduced than young adults in both experiments and each condition. For the MCI adults, significantly reduced performance (vs. normal older adults) was found only for Experiment 1.

CONCLUSION

VSTM for simultaneous items declines significantly in normal aging; the decline is not influenced differently by spatial/object configuration change. The ability of VSTM to differentiate MCI from normal cognitive aging is apparent only where the spatial configuration of stimuli is retained at original locations. Findings are discussed in terms of the reduced ability to inhibit irrelevant items and location priming (by repetition) deficits.

Causal evidence for the role of the sensory visual cortex in visual short-term memory maintenance

The role of the sensory visual cortex during visual short-term memory (VSTM) remains controversial. This controversy is possibly due to methodological issues in previous attempts to investigate the effects of transcranial magnetic stimulation (TMS) on VSTM. The aim of this study was to use TMS, while covering previous methodological deficits. Sixty-four young adults were recruited to participate in two experiments (Experiment 1: n = 36; Experiment 2: n = 28) using a VSTM orientation change-detection task under TMS. Monocular vision was ensured using red-blue goggles combined with red-blue stimuli. Double-pulse TMS was delivered at different times (Experiment 1: 0, 200 or 1000 ms; Experiment 2: 200, 1000 ms) during a 2 s maintenance phase, on one side of the occipital hemisphere. In Experiment 2, a sham TMS condition was introduced. Decreased detection sensitivity (d') in the ipsilateral occipital hemisphere to visual hemifield, and in the real TMS (compared with sham TMS) condition indicated inhibitory TMS effects, and thus, a causal involvement of the sensory visual cortex during early (200 ms) and late (1000 ms) maintenance in VSTM. These findings are aligned with sensory recruitment, which proposes that both perceptual and memory processes rely upon the same neural substrates in the sensory visual cortex. The methods used in this study were preregistered and had received in-principle acceptance on 6 June 2022 (Stage 1 protocol can be found in: https://doi.org/10.17605/OSF.IO/EMPDT).

Visual Short-Term Memory Persists Across Multiple Fixations: An n-Back Approach to Quantifying Capacity in Infants and Adults

Visual short-term memory (STM) is a foundational component of general cognition that develops rapidly during the first year of life. Although previous research has revealed important relations between overt visual fixation and memory formation, it is unknown whether infants can maintain distinct memories for sequentially fixated items or remember nonfixated array items. Participants (5-month-olds, 11-month-olds, and adults; n = 24 at each age) from the United States were tested in a passive change-detection paradigm with an n-back manipulation to examine memory for the last fixated item (one-back), second-to-last fixated item (two-back), or nonfixated item (change-other). Eye tracking was used to measure overt fixation while participants passively viewed arrays of colored circles. Results for all ages revealed convergent evidence of memory for up to two sequentially fixated objects (i.e., one-back, two-back), with moderate evidence for nonfixated array items (change-other). A permutation analysis examining change preference over time suggested that differences could not be explained by perseverative looking or location biases.

EXPRESS: Long-term learning and forgetting of feature binding in verbal free recall

Temporary feature bindings can be learned under specific experimental conditions. However, how this learning occurs and how it is forgotten over long intervals is unclear. We addressed this question with repeated presentation of an array of coloured shapes followed by verbal free recall after delays of one day, one week, and one month. A total of 120 participants viewed 24 repetitions of the same study array of six objects each with two features (shape and colour). After 24 trials, 61 participants reported becoming aware of the repetition while 59 reported being unaware. Memory performance improved across trials, with aware participants showing faster learning than unaware participants whose performance appeared to reflect the capacity of short-term visual memory across all repetitions.Both aware and unaware participants recalled some of the array after their allocated delay, showing that learning had occurred during repetition trials, even for unaware participants who showed little or no improvement across 24 repetition trials. Memory for binding showed no change after one day compared to performance on the 24th repetition trial, was significantly lower for participants tested after one-week, and was lower still for those tested after one-month. Findings are interpreted as consistent with both a short-term, limited capacity visual cache that supports performance during early repetition trials, before learning can have occurred, and gradual strengthening across trials of an episodic long-term memory trace that supports learning. If the episodic trace exceeds the threshold of awareness, this accelerates learning.

Visual Short-Term Memory for Coherent and Sequential Motion: A rTMS Investigation

We investigated the role of the human medio-temporal complex (hMT+) in the memory encoding and storage of a sequence of four coherently moving random dot kinematograms (RDKs), by applying repetitive transcranial magnetic stimulation (rTMS) during an early or late phase of the retention interval. Moreover, in a second experiment, we also tested whether disrupting the functional integrity of hMT+ during the early phase impaired the precision of the encoded motion directions. Overall, results showed that both recognition accuracy and precision were worse in middle serial positions, suggesting the occurrence of primacy and recency effects. We found that rTMS delivered during the early (but not the late) phase of the retention interval was able to impair not only recognition of RDKs, but also the precision of the retained motion direction. However, such impairment occurred only for RDKs presented in middle positions along the presented sequence, where performance was already closer to chance level. Altogether these findings suggest an involvement of hMT+ in the memory encoding of visual motion direction. Given that both position sequence and rTMS modulated not only recognition but also the precision of the stored information, these findings are in support of a model of visual short-term memory with a variable resolution of each stored item, consistent with the assigned amount of memory resources, and that such item-specific memory resolution is supported by the functional integrity of area hMT+.

Aperiodic and Periodic Components of Ongoing Oscillatory Brain Dynamics Link Distinct Functional Aspects of Cognition across Adult Lifespan

Signal transmission in the brain propagates via distinct oscillatory frequency bands but the aperiodic component, 1/f activity, almost always co-exists which most of the previous studies have not sufficiently taken into consideration. We used a recently proposed parameterization model that delimits the oscillatory and aperiodic components of neural dynamics on lifespan aging data collected from human participants using magnetoencephalography (MEG). Since healthy aging underlines an enormous change in local tissue properties, any systematic relationship of 1/f activity would highlight their impact on the self-organized critical functional states. Furthermore, we have used patterns of correlation between aperiodic background and metrics of behavior to understand the domain general effects of 1/f activity. We suggest that age-associated global change in 1/f baseline alters the functional critical states of the brain affecting the global information processing impacting critically all aspects of cognition, e.g., metacognitive awareness, speed of retrieval of memory, cognitive load, and accuracy of recall through adult lifespan. This alteration in 1/f crucially impacts the oscillatory features peak frequency (PF) and band power ratio, which relates to more local processing and selective functional aspects of cognitive processing during the visual short-term memory (VSTM) task. In summary, this study leveraging on big lifespan data for the first time tracks the cross-sectional lifespan-associated periodic and aperiodic dynamical changes in the resting state to demonstrate how normative patterns of 1/f activity, PF, and band ratio (BR) measures provide distinct functional insights about the cognitive decline through adult lifespan.

Transcranial Magnetic Stimulation of the Right Superior Parietal Lobule Modulates the Retro-Cue Benefit in Visual Short-Term Memory

Several studies have shown enhanced performance in change detection tasks when spatial cues indicating the probe's location are presented after the memory array has disappeared (i.e., retro-cues) compared with spatial cues that are presented simultaneously with the test array (i.e., post-cues). This retro-cue benefit led some authors to propose the existence of two different stores of visual short-term memory: a weak but high-capacity store (fragile memory (FM)) linked to the effect of retro-cues and a robust but low-capacity store (working memory (WM)) linked to the effect of post-cues. The former is thought to be an attention-free system, whereas the latter would strictly depend on selective attention. Nonetheless, this dissociation is under debate, and several authors do not consider retro-cues as a proxy to measure the existence of an independent memory system (e.g., FM). We approached this controversial issue by altering the attention-related functions in the right superior parietal lobule (SPL) by transcranial magnetic stimulation (TMS), whose effects were mediated by the integrity of the right superior longitudinal fasciculus (SLF). Specifically, we asked whether TMS on the SPL affected the performance of retro cues vs. post-cues to a similar extent. The results showed that TMS on the SPL, mediated by right SLF-III integrity, produced a modulation of the retro-cue benefit, namely a memory capacity decrease in the post-cues but not in the retro-cues. These findings have strong implications for the debate on the existence of independent stages of visual short-term memory and for the growing literature showing a key role of the SLF for explaining the variability of TMS effects across participants.

Visual and Semantic Contributions to Visual Short-Term Memory

Liu et al. recently demonstrated novel neural evidence for visual and semantic contributions to the encoding and maintenance of object information in a delayed match-to-sample task. Their data highlight the close interaction between sensory experience and prior semantic knowledge in human visual short-term memory for naturalistic stimuli.

Stable maintenance of multiple representational formats in human visual short-term memory

Visual short-term memory (VSTM) enables humans to form a stable and coherent representation of the external world. However, the nature and temporal dynamics of the neural representations in VSTM that support this stability are barely understood. Here we combined human intracranial electroencephalography (iEEG) recordings with analyses using deep neural networks and semantic models to probe the representational format and temporal dynamics of information in VSTM. We found clear evidence that VSTM maintenance occurred in two distinct representational formats which originated from different encoding periods. The first format derived from an early encoding period (250 to 770 ms) corresponded to higher-order visual representations. The second format originated from a late encoding period (1,000 to 1,980 ms) and contained abstract semantic representations. These representational formats were overall stable during maintenance, with no consistent transformation across time. Nevertheless, maintenance of both representational formats showed substantial arrhythmic fluctuations, i.e., waxing and waning in irregular intervals. The increases of the maintained representational formats were specific to the phases of hippocampal low-frequency activity. Our results demonstrate that human VSTM simultaneously maintains representations at different levels of processing, from higher-order visual information to abstract semantic representations, which are stably maintained via coupling to hippocampal low-frequency activity.

Effects of visual short-term memory load and attentional demand on the contrast response function

Visual short-term memory (VSTM) load leads to impaired perception during maintenance. Here, we fitted the contrast response function to psychometric orientation discrimination data while also varying attention demand during maintenance to investigate: (1) whether VSTM load effects on perception are mediated by a modulation of the contrast threshold, consistent with contrast gain accounts, or by the function asymptote (1 lapse rate), consistent with response gain accounts; and (2) whether the VSTM load effects on the contrast response function depend on the availability of attentional resources. We manipulated VSTM load via the number of items in the memory set in a color and location VSTM task and assessed the contrast response function for an orientation discrimination task during maintenance. Attention demand was varied through spatial cuing of the orientation stimulus. Higher VSTM load increased the estimated contrast threshold of the contrast response function without affecting the estimated asymptote, but only when the discrimination task demanded attention. When attentional demand was reduced (in the cued conditions), the VSTM load effects on the contrast threshold were eliminated. The results suggest that VSTM load reduces perceptual sensitivity by increasing contrast thresholds, suggestive of a contrast gain modulation mechanism, as long as the perceptual discrimination task demands attention. These findings support recent claims that attentional resources are shared between perception and VSTM maintenance processes.

Reduced Dorsal Visual Oscillatory Activity During Working Memory Maintenance in the First-Episode Schizophrenia Spectrum

Cognitive deficits in people with schizophrenia are among the hardest to treat and strongly predict functional outcome. The ability to maintain sensory precepts in memory over a short delay is impacted early in the progression of schizophrenia and has been linked to reliable neurophysiological markers. Yet, little is known about the mechanisms of these deficits. Here, we investigated possible neurophysiological mechanisms of impaired visual short-term memory (vSTM, aka working memory maintenance) in the first-episode schizophrenia spectrum (FESz) using magnetoencephalography (MEG). Twenty-eight FESz and 25 matched controls performed a lateralized change detection task where they were cued to selectively attend and remember colors of circles presented in either the left or right peripheral visual field over a 1 s delay. Contralateral alpha suppression (CAS) during the delay period was used to assess selective attention to cued visual hemifields held in vSTM. Delay-period CAS was compared between FESz and controls and between trials presenting one vs three items per visual hemifield. CAS in dorsal visual cortex was reduced in FESz compared to controls in high-load trials, but not low-load trials. Group differences in CAS were found beginning 100 ms after the disappearance of the memory set, suggesting deficits were not due to the initial deployment of attention to the cued visual hemifield prior to stimulus presentation. CAS was not greater for high-load vs low-load trials in FESz subjects, although this effect was prominent in controls. Further, lateralized gamma (34-40 Hz) power emerged in dorsal visual cortex prior to the onset of CAS in controls but not FESz. Gamma power in this cluster differed between groups at both high and low load. CAS deficits observed in FESz were correlated with change detection accuracy, working memory function, estimated IQ, and negative symptoms. Our results implicate deficits in CAS in trials requiring broad, but not narrow, focus of attention to spatially distributed objects maintained in vSTM in FESz, possibly due to reduced ability to broadly distribute visuospatial attention (alpha) or disruption of object-location binding (gamma) during encoding/consolidation. This early pathophysiology may shed light upon mechanisms of emerging working memory deficits that are intrinsic to schizophrenia.

Tracking stimulus representation across a 2-back visual working memory task

How does the neural representation of visual working memory content vary with behavioural priority? To address this, we recorded electroencephalography (EEG) while subjects performed a continuous-performance 2-back working memory task with oriented-grating stimuli. We tracked the transition of the neural representation of an item (n) from its initial encoding, to the status of 'unprioritized memory item' (UMI), and back to 'prioritized memory item', with multivariate inverted encoding modelling. Results showed that the representational format was remapped from its initially encoded format into a distinctive 'opposite' representational format when it became a UMI and then mapped back into its initial format when subsequently prioritized in anticipation of its comparison with item n + 2. Thus, contrary to the default assumption that the activity representing an item in working memory might simply get weaker when it is deprioritized, it may be that a process of priority-based remapping helps to protect remembered information when it is not in the focus of attention.

Expansion and Contraction Modulate Visual Short-Term Memory

We examined the influence of expansion and contraction on visual short-term memory (VSTM) using a change-detection task. In each trial, several expanding/contracting line segments with various orientations were presented in two successive displays. The orientation of objects in the second display was either identical to, or different from, that of the first display. Observers were asked to judge the presence or absence of an orientation change in successive displays. Results showed that memory performance for expanding objects was higher than for contracting objects (expansion benefit: Experiments 1A and 1B). Further experiments focused on VSTM processing (encoding, storage, and retrieval). Regarding the retrieval stage, an expansion benefit was replicated only when the direction of motion was consistent between two successive displays (Experiment 2A). A cueing stimulus enhanced the memory performance for both expanding and contracting motions and eliminated the expansion benefit (Experiment 2B). Regarding the storage stage, we found the expansion benefit occurred only for shorter blank intervals between the two displays (Experiment 3). Regarding the encoding stage, the expansion benefit was observed regardless of presentation times (Experiment 4). These results indicate the possibility that expanding and contracting motions modulate VSTM.

Mindfulness Meditation Improves Visual Short-Term Memory

Research into the effects of mindfulness meditation on behavioral outcomes has received much interest in recent years, with benefits for both short-term memory and working memory identified. However, little research has considered the potential effects of brief mindfulness meditation interventions or the nature of any benefits for visual short-term memory. Here, we investigate the effect of a single, 8-minute mindfulness meditation intervention, presented via audio recording, on a short-term memory task for faces. In comparison with two control groups (listening to an audiobook or simply passing the time however they wished), our mindfulness meditation participants showed greater increases in visual short-term memory capacity from pre- to post-intervention. In addition, only mindfulness meditation resulted in significant increases in performance. In conclusion, a single, brief mindfulness meditation intervention led to improvements in visual short-term memory capacity for faces, with important implications regarding the minimum intervention necessary to produce measurable changes in short-term memory tasks.

Gray Matter Volume in Different Cortical Structures Dissociably Relates to Individual Differences in Capacity and Precision of Visual Working Memory

Visual working memory (VWM) refers to our ability to selectively maintain visual information in a mental representation. While cognitive limits of VWM greatly influence a variety of mental operations, it remains controversial whether the quantity or quality of representations in mind constrains VWM. Here, we examined behavior-to-brain anatomical relations as well as brain activity to brain anatomy associations with a "neural" marker specific to the retention interval of VWM. Our results consistently indicated that individuals who maintained a larger number of items in VWM tended to have a larger gray matter (GM) volume in their left lateral occipital region. In contrast, individuals with a superior ability to retain with high precision tended to have a larger GM volume in their right parietal lobe. These results indicate that individual differences in quantity and quality of VWM may be associated with regional GM volumes in a dissociable manner, indicating willful integration of information in VWM may recruit separable cortical subsystems.

Composite Face Effect Predicts Configural Encoding in Visual Short-Term Memory

In natural vision, visual scenes consist of individual items (e.g., trees) and global properties of items as a whole (e.g., forest). These different levels of representations can all contribute to perception, natural scene understanding, sensory memory, working memory, and long-term memory. Despite these various hierarchical representations across perception and cognition, the nature of the global representations has received considerably less attention in empirical research on working memory than item representations. The present study aimed to understand the perceptual root of the configural information retained in Visual Short-term Memory (VSTM). Specifically, we assessed whether configural VSTM was related to holistic face processing across participants using an individual differences approach. Configural versus item encoding in VSTM was assessed using Xie and Zhang’s (2017) dual-trace Signal Detection Theory model in a change detection task for orientation. Configural face processing was assessed using Le Grand composite face effect (CFE). In addition, overall face recognition was assessed using Glasgow Face Matching Test (GFMT). Across participants, holistic face encoding, but not face recognition accuracy, predicted configural information, but not item information, retained in VSTM. Together, these findings suggest that configural encoding in VSTM may have a perceptual root.

False Recognition in Short-Term Memory - Age-Differences in Confidence

Compared to young adults, older adults are more susceptible to endorse false memories as genuine and exhibit higher confidence in their decisions to do so. While most studies to date have addressed this phenomenon in the context of episodic memory, the literature on age-differences in false recognition during short-term memory (STM) is scarce. Hence, the present study investigated age-related differences in the rate of false alarms (FA) and subsequent confidence judgments in STM. Thirty-three young and thirty-three older adults performed a visual short-term recognition memory task. In each trial, participants encoded a single abstract object, then made a "same" or "different" decision on a subsequent test, followed by a confidence judgment. We found significant age-related differences in performance as measured by the sensitivity index (d'), but not in the rate of FAs. Older adults were more confident in their erroneous recognition decisions than younger adults. The results are discussed in the context of age-differences in monitoring and associative processes.

Cues to individuation facilitate 6-month-old infants' visual short-term memory

Infants' ability to perform visual short-term memory (VSTM) tasks develops rapidly between 6 and 8 months. Here we tested the hypothesis that infants' VSTM performance is influenced by their ability to individuate simultaneously presented objects. We used a one-shot change detection task to ask whether 6-month-old infants (N = 47) would detect a change in the color of 1 item in a 2-item array when the stimulus context facilitated individuation of the items. In Experiment 1 the 2 items in the display differed in shape and color and in Experiment 2 the onset and offset times of the 2 items differed. In both experiments, 6-month-old infants detected a change, contrasting with previous results. Thus, young infants' encoding of information about individual items in multiple-item arrays is related to their ability to individuate those items. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Overlapping and distinct contributions of stimulus location and of spatial context to nonspatial visual short-term memory

Stimulus location is not always informative during visual short-term memory (VSTM) for nonspatial features. Nevertheless, there is considerable evidence for the automatic encoding and retention of location information, regardless of its task relevance. To explore the functional and neural bases of the representation of spatial context in VSTM for nonspatial information, functional magnetic resonance imaging was performed while subjects performed delayed recall for the orientation of individual stimuli. Stimulus location varied across trials, and although this information was irrelevant for task performance, multivariate pattern analysis decoding of stimulus location sustained across trials, and also the decoding strength, predicted the precision of the recall of orientation. The influence of spatial context on the representation of orientation was operationalized by comparing the orientation reconstructions with multivariate inverted encoding models (IEM) trained in location context-dependent vs. -independent data. Although orientation reconstructions were robust for both location-dependent and location-independent IEMs, they were markedly stronger for the former. Furthermore, the functional relevance of location context was demonstrated by the fact that only the location-dependent neural representations of stimulus orientation predicted recall precision. NEW & NOTEWORTHY Neural representation strength of stimulus location predicts the precision of visual short-term memory (VSTM) recall of nonspatial stimulus, even when this information is task irrelevant. Neural representations of nonspatial stimuli that incorporate location context are stronger than those that do not, and only the former representations are strongly linked to behavior. The contributions to nonspatial VSTM performance of the representation of location context are at least partly distinct from those of the representation of stimulus content.

Electrical Stimulation Over Human Posterior Parietal Cortex Selectively Enhances the Capacity of Visual Short-Term Memory

Visual short-term memory (VSTM) provides an on-line mental space for incoming sensory information to be temporally maintained to carry out complex behavioral tasks. Despite its essential functions, the capacity at which VSTM could maintain sensory information is limited (i.e., VSTM can hold only about three to four visual items at once). Moreover, the quality of sensory representation (i.e., precision) degrades as more information has to be maintained in VSTM. Correlational evidence suggests that the level and the pattern of neural activity measured in the posterior parietal cortex (PPC) track both VSTM capacity and precision. However, the causal contributions of the PPC to these different VSTM operations are unclear. Here, we tested whether stimulating the PPC with transcranial direct current stimulation (tDCS) could increase VSTM capacity or precision. We found that stimulating the PPC in male and female human participants selectively enhanced VSTM capacity when the number of memory items exceeded capacity limit, without significant effects on VSTM precision. Moreover, this enhancement of VSTM capacity is region specific as stimulating the prefrontal cortex did not change VSTM capacity or precision. Null stimulation effects in the sensory memory condition confirmed that the tDCS-induced enhancement of VSTM capacity was not simply due to changes in sensory or attentional processes. Altogether, these results provide causal evidence suggesting that the PPC has a more dominant role in supporting the storage capacity of VSTM compared with maintaining the quality of sensory representations. Furthermore, tDCS could be used as a promising noninvasive method to enhance this PPC VSTM-related function.SIGNIFICANCE STATEMENT Correlational evidence from neuroimaging and electrophysiology suggests that the posterior parietal cortex (PPC) supports the storage capacity of visual short-term memory (VSTM) and the precision of sensory representations maintained in VSTM. However, the causal contributions of the PPC to these different VSTM functions were unclear. Here, we found that electrical stimulation over the PPC selectively enhanced VSTM capacity without changing VSTM precision. Overall, our findings suggest that the PPC has a dominant and causal role in supporting the storage capacity of VSTM.

Two good reasons to say 'change!' - ensemble representations as well as item representations impact standard measures of VWM capacity

Visual working memory (VWM) is a central bottleneck in human information processing. Its capacity is most often measured in terms of how many individual-item representations VWM can hold (k). In the standard task employed to estimate k, an array of highly discriminable colour patches is maintained and, after a short retention interval, compared to a test display (change detection). Recent research has shown that with more complex, structured displays, change-detection performance is, in addition to individual-item representations, supported by ensemble representations formed as a result of spatial subgroupings. Here, by asking participants to additionally localize the change, we reveal indication for an influence of ensemble representations even in the very simple, unstructured displays of the colour-patch change-detection task. Critically, pure-item models from which standard formulae of k are derived do not consider ensemble representations and, therefore, potentially overestimate k. To gauge this overestimation, we develop an item-plus-ensemble model of change detection and change localization. Estimates of k from this new model are about 1 item (~30%) lower than the estimates from traditional pure-item models, even if derived from the same data sets.

Quantifying Differences Between Passive and Task-Evoked Intrinsic Functional Connectivity in a Large-Scale Brain Simulation

Establishing a connection between intrinsic and task-evoked brain activities is critical because it would provide a way to map task-related brain regions in patients unable to comply with such tasks. A crucial question within this realm is to what extent the execution of a cognitive task affects the intrinsic activity of brain regions not involved in the task. Computational models can be useful to answer this question because they allow us to distinguish task from nontask neural elements while giving us the effects of task execution on nontask regions of interest at the neuroimaging level. The quantification of those effects in a computational model would represent a step toward elucidating the intrinsic versus task-evoked connection. In this study we used computational modeling and graph theoretical metrics to quantify changes in intrinsic functional brain connectivity due to task execution. We used our large-scale neural modeling framework to embed a computational model of visual short-term memory into an empirically derived connectome. We simulated a neuroimaging study consisting of 10 subjects performing passive fixation (PF), passive viewing (PV), and delayed match-to-sample (DMS) tasks. We used the simulated blood oxygen level-dependent functional magnetic resonance imaging time series to calculate functional connectivity (FC) matrices and used those matrices to compute several graph theoretical measures. After determining that the simulated graph theoretical measures were largely consistent with experiments, we were able to quantify the differences between the graph metrics of the PF condition and those of the PV and DMS conditions. Thus, we show that we can use graph theoretical methods applied to simulated brain networks to aid in the quantification of changes in intrinsic brain FC during task execution. Our results represent a step toward establishing a connection between intrinsic and task-related brain activities.

The Rapid Forgetting of Faces

How are faces forgotten? Studies examining forgetting in visual working memory (VWM) typically use simple visual features; however, in ecological scenarios, VWM typically contains complex objects. Given their significance in everyday functioning and their visual complexity, here we investigated how upright and inverted faces are forgotten within a few seconds, focusing on the raw errors that accompany such forgetting and examining their characteristics. In three experiments we found that longer retention intervals increased the size of errors. This effect was mainly accounted for by a larger proportion of random errors - suggesting that forgetting of faces reflects decreased accessibility of the memory representations over time. On the other hand, longer retention intervals did not modulate the precision of recall – suggesting that forgetting does not affect the precision of accessible memory representation. Thus, when upright and inverted faces are forgotten there is a complete failure to access them or a complete collapse of their memory representation. In contrast to the effect of retention interval (i.e., forgetting), face inversion led to larger errors that were mainly associated with decreased precision of recall. This effect was not modulated by the duration of the retention interval, and was observed even when memory was not required in the task. Therefore, upright faces are remembered more precisely compared to inverted ones due to perceptual, rather than mnemonic processes.

Distinct neural substrates for visual short-term memory of actions

Fundamental theories of human cognition have long posited that the short-term maintenance of actions is supported by one of the "core knowledge" systems of human visual cognition, yet its neural substrates are still not well understood. In particular, it is unclear whether the visual short-term memory (VSTM) of actions has distinct neural substrates or, as proposed by the spatio-object architecture of VSTM, shares them with VSTM of objects and spatial locations. In two experiments, we tested these two competing hypotheses by directly contrasting the neural substrates for VSTM of actions with those for objects and locations. Our results showed that the bilateral middle temporal cortex (MT) was specifically involved in VSTM of actions because its activation and its functional connectivity with the frontal-parietal network (FPN) were only modulated by the memory load of actions, but not by that of objects/agents or locations. Moreover, the brain regions involved in the maintenance of spatial location information (i.e., superior parietal lobule, SPL) was also recruited during the maintenance of actions, consistent with the temporal-spatial nature of actions. Meanwhile, the frontoparietal network (FPN) was commonly involved in all types of VSTM and showed flexible functional connectivity with the domain-specific regions, depending on the current working memory tasks. Together, our results provide clear evidence for a distinct neural system for maintaining actions in VSTM, which supports the core knowledge system theory and the domain-specific and domain-general architectures of VSTM.

The processing of images of biological threats in visual short-term memory

The idea that there is enhanced memory for negatively, emotionally charged pictures was examined. Performance was measured under rapid, serial visual presentation (RSVP) conditions in which, on every trial, a sequence of six photo-images was presented. Briefly after the offset of the sequence, two alternative images (a target and a foil) were presented and participants attempted to choose which image had occurred in the sequence. Images were of threatening and non-threatening cats and dogs. The target depicted either an animal expressing an emotion distinct from the other images, or the sequences contained only images depicting the same emotional valence. Enhanced memory was found for targets that differed in emotional valence from the other sequence images, compared to targets that expressed the same emotional valence. Further controls in stimulus selection were then introduced and the same emotional distinctiveness effect obtained. In ruling out possible visual and attentional accounts of the data, an informal dual route topic model is discussed. This places emphasis on how visual short-term memory reveals a sensitivity to the emotional content of the input as it unfolds over time. Items that present with a distinctive emotional content stand out in memory.

Visual Short-Term Memory Activity in Parietal Lobe Reflects Cognitive Processes beyond Attentional Selection

Visual short-term memory (VSTM) and attention are distinct yet interrelated processes. While both require selection of information across the visual field, memory additionally requires the maintenance of information across time and distraction. VSTM recruits areas within human (male and female) dorsal and ventral parietal cortex that are also implicated in spatial selection; therefore, it is important to determine whether overlapping activation might reflect shared attentional demands. Here, identical stimuli and controlled sustained attention across both tasks were used to ask whether fMRI signal amplitude, functional connectivity, and contralateral visual field bias reflect memory-specific task demands. While attention and VSTM activated similar cortical areas, BOLD amplitude and functional connectivity in parietal cortex differentiated the two tasks. Relative to attention, VSTM increased BOLD amplitude in dorsal parietal cortex and decreased BOLD amplitude in the angular gyrus. Additionally, the tasks differentially modulated parietal functional connectivity. Contrasting VSTM and attention, intraparietal sulcus (IPS) 1-2 were more strongly connected with anterior frontoparietal areas and more weakly connected with posterior regions. This divergence between tasks demonstrates that parietal activation reflects memory-specific functions and consequently modulates functional connectivity across the cortex. In contrast, both tasks demonstrated hemispheric asymmetries for spatial processing, exhibiting a stronger contralateral visual field bias in the left versus the right hemisphere across tasks, suggesting that asymmetries are characteristic of a shared selection process in IPS. These results demonstrate that parietal activity and patterns of functional connectivity distinguish VSTM from more general attention processes, establishing a central role of the parietal cortex in maintaining visual information.SIGNIFICANCE STATEMENT Visual short-term memory (VSTM) and attention are distinct yet interrelated processes. Cognitive mechanisms and neural activity underlying these tasks show a large degree of overlap. To examine whether activity within the posterior parietal cortex (PPC) reflects object maintenance across distraction or sustained attention per se, it is necessary to control for attentional demands inherent in VSTM tasks. We demonstrate that activity in PPC reflects VSTM demands even after controlling for attention; remembering items across distraction modulates relationships between parietal and other areas differently than during periods of sustained attention. Our study fills a gap in the literature by directly comparing and controlling for overlap between visual attention and VSTM tasks.

On the Right Track? Investigating the Effect of Path Characteristics on Visuospatial Bootstrapping in Verbal Serial Recall

Visuospatial bootstrapping (VSB) occurs when memory for verbal material is enhanced via association with meaningful visuospatial information. Sequences of digits are visually presented either in the center of the screen or within a keypad layout in which the digits may be arranged identically to familiar pin pad and mobile phone layouts, or randomly. Recall is consistently higher when digits are presented in the familiar layout. This “bootstrapping” could involve primarily long-term knowledge of the layout, primarily short-term memory of the unique spatial path, or may depend on both. We manipulated the path complexity of sequences to test whether the VSB effect depends on the quality of spatial representations in conjunction with the familiarity of the spatial layout in two experiments. We consistently observed both VSB effects and path complexity effects on verbal serial recall, but never observed any interaction between these factors, even when articulatory suppression was imposed. Analysis of recall by serial position revealed that the VSB effect was focused on the end-of-list items. Our finding of pervasive path complexity effects on verbal serial recall suggests incidental encoding of spatial path occurs during visually-presented verbal tasks regardless of layout familiarity, confirming that spatial factors can affect verbal recall, but ruling out the notion that incidental spatial paths are uniquely and voluntarily encoded with familiar layouts.

Does differential visual exploration contribute to visual memory impairments in 22q11.2 microdeletion syndrome?

BACKGROUND

Chromosome 22q11.2 microdeletion syndrome (22q11.2DS) is a genetic syndrome characterised by a unique cognitive profile. Individuals with the syndrome present several non-verbal deficits, including visual memory impairments and atypical exploration of visual information. In this study, we seek to understand how visual attention may contribute to memory difficulties in 22q11.2DS by tracking eye movements during the encoding phase of a visual short-term memory task.

METHOD

Eye movements were recorded during a computerised version of the multiple-choice Benton Visual Retention Test, which consisted of exploring and then recognising complex visual stimuli. Seventy-four participants affected by 22q11.2DS were compared with 70 typically developing participants.

RESULTS

Participants with 22q11.2DS performed less well than healthy controls on the task and spent more time and fixations on the principal (larger central) figures and less time and fixations on the smaller peripheral figures within the stimuli.

CONCLUSIONS

This study is the first to investigate visual attention in 22q11.2DS during a memory task. The results delineate impaired processes during encoding that affect visual memory performance. The findings may be especially useful for informing interventions intended to boost visual learning in patients with 22q11.2DS.

Retrieval and Monitoring Processes during Visual Working Memory: An ERP Study of the Benefit of Visual Semantics

In this study, we examined electrophysiological indices of episodic remembering whilst participants recalled novel shapes, with and without semantic content, within a visual working memory paradigm. The components of interest were the parietal episodic (PE; 400-800 ms) and late posterior negativity (LPN; 500-900 ms), as these have previously been identified as reliable markers of recollection and post-retrieval monitoring, respectively. Fifteen young adults completed a visual matrix patterns task, assessing memory for low and high semantic visual representations. Matrices with either low semantic or high semantic content (containing familiar visual forms) were briefly presented to participants for study (1500 ms), followed by a retention interval (6000 ms) and finally a same/different recognition phase. The event-related potentials of interest were tracked from the onset of the recognition test stimuli. Analyses revealed equivalent amplitude for the earlier PE effect for the processing of both low and high semantic stimulus types. However, the LPN was more negative-going for the processing of the low semantic stimuli. These data are discussed in terms of relatively 'pure' and complete retrieval of high semantic items, where support can readily be recruited from semantic memory. However, for the low semantic items additional executive resources, as indexed by the LPN, are recruited when memory monitoring and uncertainty exist in order to recall previously studied items more effectively.

Visual Working Memory Enhances the Neural Response to Matching Visual Input

Visual working memory (VWM) is used to maintain visual information available for subsequent goal-directed behavior. The content of VWM has been shown to affect the behavioral response to concurrent visual input, suggesting that visual representations originating from VWM and from sensory input draw upon a shared neural substrate (i.e., a sensory recruitment stance on VWM storage). Here, we hypothesized that visual information maintained in VWM would enhance the neural response to concurrent visual input that matches the content of VWM. To test this hypothesis, we measured fMRI BOLD responses to task-irrelevant stimuli acquired from 15 human participants (three males) performing a concurrent delayed match-to-sample task. In this task, observers were sequentially presented with two shape stimuli and a retro-cue indicating which of the two shapes should be memorized for subsequent recognition. During the retention interval, a task-irrelevant shape (the probe) was briefly presented in the peripheral visual field, which could either match or mismatch the shape category of the memorized stimulus. We show that this probe stimulus elicited a stronger BOLD response, and allowed for increased shape-classification performance, when it matched rather than mismatched the concurrently memorized content, despite identical visual stimulation. Our results demonstrate that VWM enhances the neural response to concurrent visual input in a content-specific way. This finding is consistent with the view that neural populations involved in sensory processing are recruited for VWM storage, and it provides a common explanation for a plethora of behavioral studies in which VWM-matching visual input elicits a stronger behavioral and perceptual response.SIGNIFICANCE STATEMENT Humans heavily rely on visual information to interact with their environment and frequently must memorize such information for later use. Visual working memory allows for maintaining such visual information in the mind's eye after termination of its retinal input. It is hypothesized that information maintained in visual working memory relies on the same neural populations that process visual input. Accordingly, the content of visual working memory is known to affect our conscious perception of concurrent visual input. Here, we demonstrate for the first time that visual input elicits an enhanced neural response when it matches the content of visual working memory, both in terms of signal strength and information content.

Parameter-Based Evaluation of Attentional Impairments in Schizophrenia and Their Modulation by Prefrontal Transcranial Direct Current Stimulation

BACKGROUND

Attentional dysfunctions constitute core cognitive symptoms in schizophrenia, but the precise underlying neurocognitive mechanisms remain to be elucidated.

METHODS

In this randomized, double-blind, sham-controlled study, we applied, for the first time, a theoretically grounded modeling approach based on Bundesen's Theory of Visual Attention (TVA) to (i) identify specific visual attentional parameters affected in schizophrenia and (ii) assess, as a proof of concept, the potential of single-dose anodal transcranial direct current stimulation (tDCS; 20 min, 2 mA) to the left dorsolateral prefrontal cortex to modulate these attentional parameters. To that end, attentional parameters were measured before (baseline), immediately after, and 24 h after the tDCS intervention in 20 schizophrenia patients and 20 healthy controls.

RESULTS

At baseline, analyses revealed significantly reduced visual processing speed and visual short-term memory storage capacity in schizophrenia. A significant stimulation condition × time point interaction in the schizophrenia patient group indicated improved processing speed at the follow-up session only in the sham condition (a practice effect), whereas performance remained stable across the three time points in patients receiving verum stimulation. In healthy controls, anodal tDCS did not result in a significant change in attentional performance.

CONCLUSION

With regard to question (i) above, these findings are indicative of a processing speed and short-term memory deficit as primary sources of attentional deficits in schizophrenia. With regard to question (ii), the efficacy of single-dose anodal tDCS for improving (speed aspects of visual) cognition, it appears that prefrontal tDCS (at the settings used in the present study), rather than ameliorating the processing speed deficit in schizophrenia, actually may interfere with practice-dependent improvements in the rate of visual information uptake. Such potentially unexpected effects of tDCS ought to be taken into consideration when discussing its applicability in psychiatric populations. The study was registered at http://apps.who.int/trialsearch/Trial2.aspx?TrialID=DRKS00011665.

The Whole Warps the Sum of Its Parts

The efficiency of averaging properties of sets without encoding redundant details is analogous to gestalt proposals that perception is parsimoniously organized as a function of recurrent order in the world. This similarity suggests that grouping and averaging are part of a broader set of strategies allowing the visual system to circumvent capacity limitations. To examine how gestalt grouping affects the manner in which information is averaged and remembered, I compared the error in observers' adjustments of remembered sizes of individual circles in two different mean-size sets defined by similarity, proximity, connectedness, or a common region. Overall, errors were more similar within the same gestalt-defined groups than between different gestalt-defined groups, such that the remembered sizes of individual circles were biased toward the mean size of their respective gestalt-defined groups. These results imply that gestalt grouping facilitates perceptual averaging to minimize the error with which individual items are encoded, thereby optimizing the efficiency of visual short-term memory.

Discrete capacity limits and neuroanatomical correlates of visual short-term memory for objects and spatial locations

Working memory is responsible for keeping information in mind when it is no longer in view, linking perception with higher cognitive functions. Despite such crucial role, short-term maintenance of visual information is severely limited. Research suggests that capacity limits in visual short-term memory (VSTM) are correlated with sustained activity in distinct brain areas. Here, we investigated whether variability in the structure of the brain is reflected in individual differences of behavioral capacity estimates for spatial and object VSTM. Behavioral capacity estimates were calculated separately for spatial and object information using a novel adaptive staircase procedure and were found to be unrelated, supporting domain-specific VSTM capacity limits. Voxel-based morphometry (VBM) analyses revealed dissociable neuroanatomical correlates of spatial versus object VSTM. Interindividual variability in spatial VSTM was reflected in the gray matter density of the inferior parietal lobule. In contrast, object VSTM was reflected in the gray matter density of the left insula. These dissociable findings highlight the importance of considering domain-specific estimates of VSTM capacity and point to the crucial brain regions that limit VSTM capacity for different types of visual information. Hum Brain Mapp 38:767-778, 2017. © 2016 Wiley Periodicals, Inc.

Working memory is not fixed-capacity: More active storage capacity for real-world objects than for simple stimuli

Visual working memory is the cognitive system that holds visual information active to make it resistant to interference from new perceptual input. Information about simple stimuli-colors and orientations-is encoded into working memory rapidly: In under 100 ms, working memory ‟fills up," revealing a stark capacity limit. However, for real-world objects, the same behavioral limits do not hold: With increasing encoding time, people store more real-world objects and do so with more detail. This boost in performance for real-world objects is generally assumed to reflect the use of a separate episodic long-term memory system, rather than working memory. Here we show that this behavioral increase in capacity with real-world objects is not solely due to the use of separate episodic long-term memory systems. In particular, we show that this increase is a result of active storage in working memory, as shown by directly measuring neural activity during the delay period of a working memory task using EEG. These data challenge fixed-capacity working memory models and demonstrate that working memory and its capacity limitations are dependent upon our existing knowledge.

Temporal and Spatial Predictability of an Irrelevant Event Differently Affect Detection and Memory of Items in a Visual Sequence

We examined how the temporal and spatial predictability of a task-irrelevant visual event affects the detection and memory of a visual item embedded in a continuously changing sequence. Participants observed 11 sequentially presented letters, during which a task-irrelevant visual event was either present or absent. Predictabilities of spatial location and temporal position of the event were controlled in 2 × 2 conditions. In the spatially predictable conditions, the event occurred at the same location within the stimulus sequence or at another location, while, in the spatially unpredictable conditions, it occurred at random locations. In the temporally predictable conditions, the event timing was fixed relative to the order of the letters, while in the temporally unpredictable condition; it could not be predicted from the letter order. Participants performed a working memory task and a target detection reaction time (RT) task. Memory accuracy was higher for a letter simultaneously presented at the same location as the event in the temporally unpredictable conditions, irrespective of the spatial predictability of the event. On the other hand, the detection RTs were only faster for a letter simultaneously presented at the same location as the event when the event was both temporally and spatially predictable. Thus, to facilitate ongoing detection processes, an event must be predictable both in space and time, while memory processes are enhanced by temporally unpredictable (i.e., surprising) events. Evidently, temporal predictability has differential effects on detection and memory of a visual item embedded in a sequence of images.

Dissociable loss of the representations in visual short-term memory

The present study investigated in what manner the information in visual short-term memory (VSTM) is lost. Participants memorized four items, one of which was given higher priority later by a retro-cue. Then participants were required to detect a possible change, which could be either a large or small change, occurred to one of the items. The results showed that the detection performance for the small change of the uncued items was poorer than the cued item, yet large change that occurred to all four memory items could be detected perfectly, indicating that the uncued representations lost some detailed information yet still had some basic features retained in VSTM. The present study suggests that after being encoded into VSTM, the information is not lost in an object-based manner; rather, features of an item are still dissociable, so that they can be lost separately.

Effects of age, gender, and stimulus presentation period on visual short-term memory

This study focused on age-related changes in visual short-term memory using visual stimuli that did not allow verbal encoding. Experiment 1 examined the effects of age and the length of the stimulus presentation period on visual short-term memory function. Experiment 2 examined the effects of age, gender, and the length of the stimulus presentation period on visual short-term memory function. The worst memory performance and the largest performance difference between the age groups were observed in the shortest stimulus presentation period conditions. The performance difference between the age groups became smaller as the stimulus presentation period became longer; however, it did not completely disappear. Although gender did not have a significant effect on d' regardless of the presentation period in the young group, a significant gender-based difference was observed for stimulus presentation periods of 500 ms and 1,000 ms in the older group. This study indicates that the decline in visual short-term memory observed in the older group is due to the interaction of several factors.

EEG can Track the Time Course of Successful Reference Resolution in Small Visual Worlds

Previous research has shown that language comprehenders resolve reference quickly and incrementally, but not much is known about the neural processes and representations that are involved. Studies of visual short-term memory suggest that access to the representation of an item from a previously seen display is associated with a negative evoked potential at posterior electrodes contralateral to the spatial location of that item in the display. In this paper we demonstrate that resolving the reference of a noun phrase in a recently seen visual display is associated with an event-related potential that is analogous to this effect. Our design was adapted from the visual world paradigm: in each trial, participants saw a display containing three simple objects, followed by a question about the objects, such as Was the pink fish next to a boat?, presented word by word. Questions differed in whether the color adjective allowed the reader to identify the referent of the noun phrase or not (i.e., whether one or more objects of the named color were present). Consistent with our hypothesis, we observed that reference resolution by the adjective was associated with a negative evoked potential at posterior electrodes contralateral to spatial location of the referent, starting approximately 333 ms after the onset of the adjective. The fact that the laterality of the effect depended upon the location of the referent within the display suggests that reference resolution in visual domains involves, at some level, a modality-specific representation. In addition, the effect gives us an estimate of the time course of processing from perception of the written word to the point at which its meaning is brought into correspondence with the referential domain.

Electrophysiological Evidence of a Delay in the Visual Recognition Process in Young Children

The present study analyzes the development of the visual recognition processing of the relevant stimulus in a Delayed Match-To-Sample (DMS) task during the matching phase. To do so, Electroencephalograms of 170 subjects between 6 and 26 years old were recorded. Behavioral responses and Event Related Potentials (ERPs) induced by the stimuli were obtained. Reaction times and errors, mainly omissions, were inversely related to age. The ERPs analysis showed a parietal negativity in the P7 and P8 electrodes when the relevant stimulus was presented in the contralateral site. This negativity resulting from the recognition and selection of the relevant stimulus was present in all age groups. However, the youngest children showed an extended latency in the recognition process. The results suggest that children and adults use similar processes to recognize the item maintained in visual short-term memory (VSTM), but children need more time to successfully recognize the memorized item.

Visual processing in reading disorders and attention-deficit/hyperactivity disorder and its contribution to basic reading ability

Whether visual processing deficits are common in reading disorders (RD), and related to reading ability in general, has been debated for decades. The type of visual processing affected also is debated, although visual discrimination and short-term memory (STM) may be more commonly related to reading ability. Reading disorders are frequently comorbid with ADHD, and children with ADHD often have subclinical reading problems. Hence, children with ADHD were used as a comparison group in this study. ADHD and RD may be dissociated in terms of visual processing. Whereas RD may be associated with deficits in visual discrimination and STM for order, ADHD is associated with deficits in visual-spatial processing. Thus, we hypothesized that children with RD would perform worse than controls and children with ADHD only on a measure of visual discrimination and a measure of visual STM that requires memory for order. We expected all groups would perform comparably on the measure of visual STM that does not require sequential processing. We found children with RD or ADHD were commensurate to controls on measures of visual discrimination and visual STM that do not require sequential processing. In contrast, both RD groups (RD, RD/ADHD) performed worse than controls on the measure of visual STM that requires memory for order, and children with comorbid RD/ADHD performed worse than those with ADHD. In addition, of the three visual measures, only sequential visual STM predicted reading ability. Hence, our findings suggest there is a deficit in visual sequential STM that is specific to RD and is related to basic reading ability. The source of this deficit is worthy of further research, but it may include both reduced memory for order and poorer verbal mediation.

Change Detection in Visual Short-Term Memory: The Relative Impact of Pairwise Switches and Identity Substitutions

Numerous kinds of visual event challenge our ability to keep track of the objects that populate our visual environment from moment to moment. These include blinks, occlusion, shifting visual attention, and changes to object's visual and spatial properties over time. These visual events may lead to objects falling out of our visual awareness, but can also lead to unnoticed changes, such as undetected object replacements and positional exchanges. Current visual memory models do not predict which visual changes are likely to be the most difficult to detect. We examine the accuracy with which switches (where two objects exchange locations) and substitutions (where one or two objects are replaced) are detected. Inferior performance for one-object substitutions versus two-objects switches, along with superior performance for two-object substitutions versus two-object switches was found. Our results are interpreted in terms of object file theory, trade-offs between diffused and localized attention, and net visual change.

Visual working memory modulates within-object metrics of saccade landing position

In two experiments, we examined the influence of visual working memory (VWM) on oculomotor selection, testing whether the landing positions of rapidly generated saccades are biased toward the region of an object that matches a feature held in VWM. Participants executed a saccade to the center of a single saccade target, divided into two colored regions and presented on the horizontal midline. Concurrently, participants maintained a color in VWM for an unrelated memory task. This color either matched one of the two regions or neither of the regions. Relative to the no-match baseline, the landing positions of rapidly generated saccades (mean latency < 150 ms) were biased toward the region that matched the remembered color. The results support the hypothesis that VWM modulates early, spatially organized sensory representations to bias selection toward locations with features that match VWM content. In addition, the results demonstrate that saccades to spatially extended objects are sensitive to within-object differences in salience.

Cognitive aging on latent constructs for visual processing capacity: a novel structural equation modeling framework with causal assumptions based on a theory of visual attention

We examined the effects of normal aging on visual cognition in a sample of 112 healthy adults aged 60–75. A testbattery was designed to capture high-level measures of visual working memory and low-level measures of visuospatial attention and memory. To answer questions of how cognitive aging affects specific aspects of visual processing capacity, we used confirmatory factor analyses in Structural Equation Modeling (SEM; Model 2), informed by functional structures that were modeled with path analyses in SEM (Model 1). The results show that aging effects were selective to measures of visual processing speed compared to visual short-term memory (VSTM) capacity (Model 2). These results are consistent with some studies reporting selective aging effects on processing speed, and inconsistent with other studies reporting aging effects on both processing speed and VSTM capacity. In the discussion we argue that this discrepancy may be mediated by differences in age ranges, and variables of demography. The study demonstrates that SEM is a sensitive method to detect cognitive aging effects even within a narrow age-range, and a useful approach to structure the relationships between measured variables, and the cognitive functional foundation they supposedly represent.

The effect of spatial organization of targets and distractors on the capacity to selectively memorize objects in visual short-term memory

We conducted a series of experiments to explore how the spatial configuration of objects influences the selection and the processing of these objects in a visual short-term memory task. We designed a new experiment in which participants had to memorize 4 targets presented among 4 distractors. Targets were cued during the presentation of distractor objects. Their locations varied according to 4 spatial configurations. From the first to the last configuration, the distance between targets’ locations was progressively increased. The results revealed a high capacity to select and memorize targets embedded among distractors even when targets were extremely distant from each other. This capacity is discussed in relation to the unitary conception of attention, models of split attention, and the competitive interaction model. Finally, we propose that the spatial dispersion of objects has different effects on attentional allocation and processing stages. Thus, when targets are extremely distant from each other, attentional allocation becomes more difficult while processing becomes easier. This finding implicates that these 2 aspects of attention need to be more clearly distinguished in future research.

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.

Distributed and Overlapping Neural Substrates for Object Individuation and Identification in Visual Short-Term Memory

Object individuation and identification are 2 key processes involved in representing visual information in short-term memory (VSTM). Individuation involves the use of spatial and temporal cues to register an object as a distinct perceptual event relative to other stimuli, whereas object identification involves extraction of featural and related conceptual properties of a stimulus. Together, individuation and identification provide the "what," "where," and "when" of visual perception. In the current study, we asked whether individuation and identification processes are underpinned by distinct neural substrates, and to what extent brain regions that reflect these 2 operations are consistent across encoding, maintenance, and retrieval stages of VSTM. We used functional magnetic resonance imaging to identify brain regions that represent the number of objects (individuation) and/or object features (identification) in an array. Using univariate and multivariate analyses, we found substantial overlap between these 2 operations in the brain. Moreover, we show that regions supporting individuation and identification vary across distinct stages of information processing. Our findings challenge influential models of multiple-object encoding in VSTM, which argue that individuation and identification are underpinned by a limited set of nonoverlapping brain regions.

Visual short-term memory deficits associated with GBA mutation and Parkinson's disease

Individuals with mutation in the lysosomal enzyme glucocerebrosidase (GBA) gene are at significantly high risk of developing Parkinson’s disease with cognitive deficit. We examined whether visual short-term memory impairments, long associated with patients with Parkinson’s disease, are also present in GBA-positive individuals—both with and without Parkinson’s disease. Precision of visual working memory was measured using a serial order task in which participants observed four bars, each of a different colour and orientation, presented sequentially at screen centre. Afterwards, they were asked to adjust a coloured probe bar’s orientation to match the orientation of the bar of the same colour in the sequence. An additional attentional ‘filtering’ condition tested patients’ ability to selectively encode one of the four bars while ignoring the others. A sensorimotor task using the same stimuli controlled for perceptual and motor factors. There was a significant deficit in memory precision in GBA-positive individuals—with or without Parkinson’s disease—as well as GBA-negative patients with Parkinson’s disease, compared to healthy controls. Worst recall was observed in GBA-positive cases with Parkinson’s disease. Although all groups were impaired in visual short-term memory, there was a double dissociation between sources of error associated with GBA mutation and Parkinson’s disease. The deficit observed in GBA-positive individuals, regardless of whether they had Parkinson’s disease, was explained by a systematic increase in interference from features of other items in memory: misbinding errors. In contrast, impairments in patients with Parkinson’s disease, regardless of GBA status, was explained by increased random responses. Individuals who were GBA-positive and also had Parkinson’s disease suffered from both types of error, demonstrating the worst performance. These findings provide evidence for dissociable signature deficits within the domain of visual short-term memory associated with GBA mutation and with Parkinson’s disease. Identification of the specific pattern of cognitive impairment in GBA mutation versus Parkinson’s disease is potentially important as it might help to identify individuals at risk of developing Parkinson’s disease.

Spatial specificity of working memory representations in the early visual cortex

Recent fMRI decoding studies have demonstrated that early retinotopic visual areas exhibit similar patterns of activity during the perception of a stimulus and during the maintenance of that stimulus in working memory. These findings provide support for the sensory recruitment hypothesis that the mechanisms underlying perception serve as a foundation for visual working memory. However, a recent study by Ester, Serences, and Awh (2009) found that the orientation of a peripheral grating maintained in working memory could be classified from both the contralateral and ipsilateral regions of the primary visual cortex (V1), implying that, unlike perception, feature-specific information was maintained in a nonretinotopic manner. Here, we evaluated the hypothesis that early visual areas can maintain information in a spatially specific manner and will do so if the task encourages the binding of feature information to a specific location. To encourage reliance on spatially specific memory, our experiment required observers to retain the orientations of two laterally presented gratings. Multivariate pattern analysis revealed that the orientation of each remembered grating was classified more accurately based on activity patterns in the contralateral than in the ipsilateral regions of V1 and V2. In contrast, higher extrastriate areas exhibited similar levels of performance across the two hemispheres. A time-resolved analysis further indicated that the retinotopic specificity of the working memory representation in V1 and V2 was maintained throughout the retention interval. Our results suggest that early visual areas provide a cortical basis for actively maintaining information about the features and locations of stimuli in visual working memory.

Accurate metacognition for visual sensory memory representations

The capacity to attend to multiple objects in the visual field is limited. However, introspectively, people feel that they see the whole visual world at once. Some scholars suggest that this introspective feeling is based on short-lived sensory memory representations, whereas others argue that the feeling of seeing more than can be attended to is illusory. Here, we investigated this phenomenon by combining objective memory performance with subjective confidence ratings during a change-detection task. This allowed us to compute a measure of metacognition--the degree of knowledge that subjects have about the correctness of their decisions--for different stages of memory. We show that subjects store more objects in sensory memory than they can attend to but, at the same time, have similar metacognition for sensory memory and working memory representations. This suggests that these subjective impressions are not an illusion but accurate reflections of the richness of visual perception.